2026-02-13T17:59:25.265 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T17:59:25.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T17:59:25.359 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{low} onode-segment$/{none} write$/{v1/{compr$/{yes$/{zstd}} v1}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '49683' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 30 debug ms: 20 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: avl bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd memory target: 1610612736 osd objectstore: bluestore osd op num shards: 1 osd op num threads per shard: 2 osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - \(MON_NETSPLIT) - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) mon_bind_msgr2: false sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 5319 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJuB4twVUAIp9Qt0aLdyZ32ph4OUtYSLelMCOnnAO5TSQ2n0qsr8TsaxzETwpWyoEyeE8LPWjfI86uzJ5QyIA6I= trial187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEofDSp228KXwZnriFHeOFaTAjv0QDAQfQMSWPMAdMCkburHy1nxhMed9lpWQfOzJ0DqU7dzAGUameI/97N40jE= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_16:37:03 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T17:59:25.359 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-13T17:59:25.360 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-13T17:59:25.360 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T17:59:25.361 INFO:teuthology.task.internal:Checking packages... 2026-02-13T17:59:25.361 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-13T17:59:25.362 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T17:59:25.362 INFO:teuthology.packaging:ref: None 2026-02-13T17:59:25.362 INFO:teuthology.packaging:tag: None 2026-02-13T17:59:25.362 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-13T17:59:25.362 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T17:59:25.362 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-13T17:59:25.481 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230-gafefaa40-1jammy 2026-02-13T17:59:25.481 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T17:59:25.494 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T17:59:25.494 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T17:59:25.508 INFO:teuthology.task.internal:Saving configuration 2026-02-13T17:59:25.520 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T17:59:25.533 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T17:59:25.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial078.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 17:55:54.032812', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPfl7zx8VpVMSiqw628kPYBYsCZwVQmdrEIvx9nwUCFY'} 2026-02-13T17:59:25.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial187.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 17:55:54.032217', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMtrLk6l6q46tBzPvfAoT15Qz3AjmPtG+jHFGVyh4wPG'} 2026-02-13T17:59:25.666 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T17:59:25.678 INFO:teuthology.task.internal:roles: ubuntu@trial078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-13T17:59:25.678 INFO:teuthology.task.internal:roles: ubuntu@trial187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-13T17:59:25.678 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T17:59:25.809 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7db5eb990040>, signals=[15]) 2026-02-13T17:59:25.809 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T17:59:25.821 INFO:teuthology.task.internal:Opening connections... 2026-02-13T17:59:25.821 DEBUG:teuthology.task.internal:connecting to ubuntu@trial078.front.sepia.ceph.com 2026-02-13T17:59:25.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T17:59:25.885 DEBUG:teuthology.task.internal:connecting to ubuntu@trial187.front.sepia.ceph.com 2026-02-13T17:59:25.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T17:59:25.946 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T17:59:25.958 DEBUG:teuthology.orchestra.run.trial078:> uname -m 2026-02-13T17:59:25.961 INFO:teuthology.orchestra.run.trial078.stdout:x86_64 2026-02-13T17:59:25.961 DEBUG:teuthology.orchestra.run.trial078:> cat /etc/os-release 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:NAME="Ubuntu" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_ID="22.04" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_CODENAME=jammy 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:ID=ubuntu 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:ID_LIKE=debian 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T17:59:26.006 INFO:teuthology.orchestra.run.trial078.stdout:UBUNTU_CODENAME=jammy 2026-02-13T17:59:26.007 INFO:teuthology.lock.ops:Updating trial078.front.sepia.ceph.com on lock server 2026-02-13T17:59:26.072 DEBUG:teuthology.orchestra.run.trial187:> uname -m 2026-02-13T17:59:26.075 INFO:teuthology.orchestra.run.trial187.stdout:x86_64 2026-02-13T17:59:26.075 DEBUG:teuthology.orchestra.run.trial187:> cat /etc/os-release 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:NAME="Ubuntu" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:VERSION_ID="22.04" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:VERSION_CODENAME=jammy 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:ID=ubuntu 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:ID_LIKE=debian 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T17:59:26.120 INFO:teuthology.orchestra.run.trial187.stdout:UBUNTU_CODENAME=jammy 2026-02-13T17:59:26.120 INFO:teuthology.lock.ops:Updating trial187.front.sepia.ceph.com on lock server 2026-02-13T17:59:26.189 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T17:59:26.202 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T17:59:26.216 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T17:59:26.216 DEBUG:teuthology.orchestra.run.trial078:> test '!' -e /home/ubuntu/cephtest 2026-02-13T17:59:26.217 DEBUG:teuthology.orchestra.run.trial187:> test '!' -e /home/ubuntu/cephtest 2026-02-13T17:59:26.221 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T17:59:26.233 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T17:59:26.233 DEBUG:teuthology.orchestra.run.trial078:> test -z $(ls -A /var/lib/ceph) 2026-02-13T17:59:26.267 DEBUG:teuthology.orchestra.run.trial187:> test -z $(ls -A /var/lib/ceph) 2026-02-13T17:59:26.271 INFO:teuthology.orchestra.run.trial078.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T17:59:26.273 INFO:teuthology.orchestra.run.trial187.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T17:59:26.274 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T17:59:26.420 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T17:59:26.442 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-13T17:59:26.443 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-13T17:59:26.443 DEBUG:teuthology.orchestra.run.trial078:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T17:59:26.443 DEBUG:teuthology.orchestra.run.trial187:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T17:59:26.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T17:59:26.446 DEBUG:teuthology.orchestra.run.trial187:> uname -r 2026-02-13T17:59:26.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T17:59:26.446 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-13T17:59:26.494 INFO:teuthology.orchestra.run.trial078.stdout:5.15.0-164-generic 2026-02-13T17:59:26.494 INFO:teuthology.task.kernel:Running kernel on trial078: 5.15.0-164-generic 2026-02-13T17:59:26.494 DEBUG:teuthology.orchestra.run.trial078:> sudo apt-get clean 2026-02-13T17:59:26.496 INFO:teuthology.orchestra.run.trial187.stdout:5.15.0-164-generic 2026-02-13T17:59:26.496 INFO:teuthology.task.kernel:Running kernel on trial187: 5.15.0-164-generic 2026-02-13T17:59:26.496 DEBUG:teuthology.orchestra.run.trial187:> sudo apt-get clean 2026-02-13T17:59:26.552 DEBUG:teuthology.orchestra.run.trial078:> sudo apt-get update 2026-02-13T17:59:26.553 DEBUG:teuthology.orchestra.run.trial187:> sudo apt-get update 2026-02-13T17:59:27.063 INFO:teuthology.orchestra.run.trial187.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T17:59:27.064 INFO:teuthology.orchestra.run.trial078.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T17:59:27.135 INFO:teuthology.orchestra.run.trial187.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T17:59:27.136 INFO:teuthology.orchestra.run.trial078.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T17:59:27.411 INFO:teuthology.orchestra.run.trial187.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T17:59:27.413 INFO:teuthology.orchestra.run.trial078.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T17:59:27.532 INFO:teuthology.orchestra.run.trial187.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T17:59:27.535 INFO:teuthology.orchestra.run.trial078.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T17:59:27.646 INFO:teuthology.orchestra.run.trial187.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T17:59:27.650 INFO:teuthology.orchestra.run.trial078.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T17:59:27.973 INFO:teuthology.orchestra.run.trial187.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T17:59:27.980 INFO:teuthology.orchestra.run.trial078.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T17:59:27.983 INFO:teuthology.orchestra.run.trial187.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T17:59:27.983 INFO:teuthology.orchestra.run.trial187.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T17:59:27.989 INFO:teuthology.orchestra.run.trial078.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T17:59:27.990 INFO:teuthology.orchestra.run.trial078.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T17:59:28.012 INFO:teuthology.orchestra.run.trial187.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T17:59:28.018 INFO:teuthology.orchestra.run.trial187.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-13T17:59:28.018 INFO:teuthology.orchestra.run.trial187.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T17:59:28.019 INFO:teuthology.orchestra.run.trial078.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T17:59:28.025 INFO:teuthology.orchestra.run.trial078.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-13T17:59:28.025 INFO:teuthology.orchestra.run.trial078.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T17:59:28.146 INFO:teuthology.orchestra.run.trial187.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T17:59:28.152 INFO:teuthology.orchestra.run.trial078.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T17:59:28.164 INFO:teuthology.orchestra.run.trial187.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T17:59:28.171 INFO:teuthology.orchestra.run.trial078.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T17:59:28.235 INFO:teuthology.orchestra.run.trial187.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T17:59:28.242 INFO:teuthology.orchestra.run.trial078.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T17:59:28.243 INFO:teuthology.orchestra.run.trial187.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T17:59:28.243 INFO:teuthology.orchestra.run.trial187.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T17:59:28.250 INFO:teuthology.orchestra.run.trial078.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T17:59:28.250 INFO:teuthology.orchestra.run.trial078.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T17:59:28.269 INFO:teuthology.orchestra.run.trial187.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T17:59:28.275 INFO:teuthology.orchestra.run.trial187.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T17:59:28.275 INFO:teuthology.orchestra.run.trial187.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T17:59:28.277 INFO:teuthology.orchestra.run.trial078.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T17:59:28.282 INFO:teuthology.orchestra.run.trial078.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T17:59:28.283 INFO:teuthology.orchestra.run.trial078.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T17:59:28.401 INFO:teuthology.orchestra.run.trial187.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T17:59:28.404 INFO:teuthology.orchestra.run.trial078.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T17:59:31.728 INFO:teuthology.orchestra.run.trial187.stdout:Fetched 22.7 MB in 3s (8371 kB/s) 2026-02-13T17:59:31.797 INFO:teuthology.orchestra.run.trial078.stdout:Fetched 22.7 MB in 3s (8219 kB/s) 2026-02-13T17:59:32.249 INFO:teuthology.orchestra.run.trial187.stdout:Reading package lists... 2026-02-13T17:59:32.263 DEBUG:teuthology.orchestra.run.trial187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T17:59:32.326 INFO:teuthology.orchestra.run.trial078.stdout:Reading package lists... 2026-02-13T17:59:32.337 INFO:teuthology.orchestra.run.trial187.stdout:Reading package lists... 2026-02-13T17:59:32.339 DEBUG:teuthology.orchestra.run.trial078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T17:59:32.372 INFO:teuthology.orchestra.run.trial078.stdout:Reading package lists... 2026-02-13T17:59:32.443 INFO:teuthology.orchestra.run.trial187.stdout:Building dependency tree... 2026-02-13T17:59:32.443 INFO:teuthology.orchestra.run.trial187.stdout:Reading state information... 2026-02-13T17:59:32.477 INFO:teuthology.orchestra.run.trial078.stdout:Building dependency tree... 2026-02-13T17:59:32.478 INFO:teuthology.orchestra.run.trial078.stdout:Reading state information... 2026-02-13T17:59:32.526 INFO:teuthology.orchestra.run.trial187.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: sg3-utils-udev 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout:The following additional packages will be installed: 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout:Suggested packages: 2026-02-13T17:59:32.527 INFO:teuthology.orchestra.run.trial187.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T17:59:32.540 INFO:teuthology.orchestra.run.trial187.stdout:The following NEW packages will be installed: 2026-02-13T17:59:32.540 INFO:teuthology.orchestra.run.trial187.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T17:59:32.541 INFO:teuthology.orchestra.run.trial187.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T17:59:32.541 INFO:teuthology.orchestra.run.trial187.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T17:59:32.541 INFO:teuthology.orchestra.run.trial187.stdout:The following packages will be upgraded: 2026-02-13T17:59:32.541 INFO:teuthology.orchestra.run.trial187.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T17:59:32.566 INFO:teuthology.orchestra.run.trial078.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T17:59:32.566 INFO:teuthology.orchestra.run.trial078.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T17:59:32.566 INFO:teuthology.orchestra.run.trial078.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T17:59:32.566 INFO:teuthology.orchestra.run.trial078.stdout: sg3-utils-udev 2026-02-13T17:59:32.566 INFO:teuthology.orchestra.run.trial078.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T17:59:32.567 INFO:teuthology.orchestra.run.trial078.stdout:The following additional packages will be installed: 2026-02-13T17:59:32.567 INFO:teuthology.orchestra.run.trial078.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T17:59:32.567 INFO:teuthology.orchestra.run.trial078.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T17:59:32.567 INFO:teuthology.orchestra.run.trial078.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T17:59:32.567 INFO:teuthology.orchestra.run.trial078.stdout:Suggested packages: 2026-02-13T17:59:32.567 INFO:teuthology.orchestra.run.trial078.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T17:59:32.580 INFO:teuthology.orchestra.run.trial078.stdout:The following NEW packages will be installed: 2026-02-13T17:59:32.580 INFO:teuthology.orchestra.run.trial078.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T17:59:32.580 INFO:teuthology.orchestra.run.trial078.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T17:59:32.580 INFO:teuthology.orchestra.run.trial078.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T17:59:32.580 INFO:teuthology.orchestra.run.trial078.stdout:The following packages will be upgraded: 2026-02-13T17:59:32.581 INFO:teuthology.orchestra.run.trial078.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T17:59:32.641 INFO:teuthology.orchestra.run.trial187.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T17:59:32.641 INFO:teuthology.orchestra.run.trial187.stdout:Need to get 113 MB of archives. 2026-02-13T17:59:32.641 INFO:teuthology.orchestra.run.trial187.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T17:59:32.641 INFO:teuthology.orchestra.run.trial187.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T17:59:32.813 INFO:teuthology.orchestra.run.trial187.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T17:59:32.857 INFO:teuthology.orchestra.run.trial187.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T17:59:32.989 INFO:teuthology.orchestra.run.trial078.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T17:59:32.989 INFO:teuthology.orchestra.run.trial078.stdout:Need to get 113 MB of archives. 2026-02-13T17:59:32.989 INFO:teuthology.orchestra.run.trial078.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T17:59:32.989 INFO:teuthology.orchestra.run.trial078.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T17:59:33.100 INFO:teuthology.orchestra.run.trial187.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T17:59:33.101 INFO:teuthology.orchestra.run.trial187.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T17:59:33.101 INFO:teuthology.orchestra.run.trial187.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T17:59:33.153 INFO:teuthology.orchestra.run.trial187.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T17:59:33.164 INFO:teuthology.orchestra.run.trial187.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T17:59:33.361 INFO:teuthology.orchestra.run.trial187.stdout:Fetched 113 MB in 1s (183 MB/s) 2026-02-13T17:59:33.378 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T17:59:33.546 INFO:teuthology.orchestra.run.trial187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T17:59:33.547 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:33.549 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:33.905 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T17:59:33.912 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:33.930 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:33.972 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T17:59:33.978 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:33.978 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:34.321 INFO:teuthology.orchestra.run.trial078.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T17:59:34.650 INFO:teuthology.orchestra.run.trial078.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T17:59:35.070 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T17:59:35.071 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T17:59:35.094 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T17:59:35.095 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T17:59:35.111 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T17:59:35.118 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T17:59:35.118 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T17:59:36.465 INFO:teuthology.orchestra.run.trial078.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T17:59:36.465 INFO:teuthology.orchestra.run.trial078.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T17:59:36.465 INFO:teuthology.orchestra.run.trial078.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T17:59:36.482 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T17:59:36.494 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:36.494 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:36.805 INFO:teuthology.orchestra.run.trial078.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T17:59:36.884 INFO:teuthology.orchestra.run.trial078.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T17:59:37.082 INFO:teuthology.orchestra.run.trial078.stdout:Fetched 113 MB in 4s (26.4 MB/s) 2026-02-13T17:59:37.091 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T17:59:37.092 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T17:59:37.101 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T17:59:37.117 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T17:59:37.118 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:37.120 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T17:59:37.121 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:37.263 INFO:teuthology.orchestra.run.trial078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T17:59:37.265 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:37.266 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:37.587 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T17:59:37.593 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:37.612 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:37.652 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T17:59:37.658 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:37.658 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:37.889 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:38.708 INFO:teuthology.orchestra.run.trial187.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T17:59:38.708 INFO:teuthology.orchestra.run.trial187.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T17:59:38.714 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:38.752 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T17:59:38.753 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T17:59:38.775 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T17:59:38.776 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T17:59:38.793 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T17:59:38.800 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T17:59:38.800 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T17:59:39.502 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T17:59:39.503 INFO:teuthology.orchestra.run.trial187.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T17:59:39.504 INFO:teuthology.orchestra.run.trial187.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:39.509 INFO:teuthology.orchestra.run.trial187.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T17:59:39.509 INFO:teuthology.orchestra.run.trial187.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T17:59:40.192 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T17:59:40.204 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T17:59:40.204 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:40.784 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T17:59:40.785 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T17:59:40.810 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T17:59:40.811 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:40.813 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T17:59:40.814 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:41.580 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:42.398 INFO:teuthology.orchestra.run.trial078.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T17:59:42.398 INFO:teuthology.orchestra.run.trial078.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T17:59:42.404 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:43.190 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T17:59:43.192 INFO:teuthology.orchestra.run.trial078.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T17:59:43.193 INFO:teuthology.orchestra.run.trial078.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T17:59:43.198 INFO:teuthology.orchestra.run.trial078.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T17:59:43.198 INFO:teuthology.orchestra.run.trial078.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T17:59:46.581 INFO:teuthology.orchestra.run.trial187.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T17:59:50.273 INFO:teuthology.orchestra.run.trial078.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T17:59:53.238 INFO:teuthology.orchestra.run.trial187.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T17:59:53.238 INFO:teuthology.orchestra.run.trial187.stdout:Sourcing file `/etc/default/grub' 2026-02-13T17:59:53.256 INFO:teuthology.orchestra.run.trial187.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T17:59:53.257 INFO:teuthology.orchestra.run.trial187.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T17:59:53.260 INFO:teuthology.orchestra.run.trial187.stdout:Generating grub configuration file ... 2026-02-13T17:59:53.341 INFO:teuthology.orchestra.run.trial187.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T17:59:53.348 INFO:teuthology.orchestra.run.trial187.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T17:59:53.524 INFO:teuthology.orchestra.run.trial187.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T17:59:53.530 INFO:teuthology.orchestra.run.trial187.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T17:59:53.603 INFO:teuthology.orchestra.run.trial187.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T17:59:53.603 INFO:teuthology.orchestra.run.trial187.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T17:59:53.603 INFO:teuthology.orchestra.run.trial187.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T17:59:53.606 INFO:teuthology.orchestra.run.trial187.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T17:59:53.615 INFO:teuthology.orchestra.run.trial187.stdout:done 2026-02-13T17:59:54.023 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.023 INFO:teuthology.orchestra.run.trial187.stdout:Pending kernel upgrade! 2026-02-13T17:59:54.023 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.023 INFO:teuthology.orchestra.run.trial187.stdout:Running kernel version: 2026-02-13T17:59:54.023 INFO:teuthology.orchestra.run.trial187.stdout: 5.15.0-164-generic 2026-02-13T17:59:54.023 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout:Diagnostics: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout:The processor microcode seems to be up-to-date. 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout:No services need to be restarted. 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout:No containers need to be restarted. 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.024 INFO:teuthology.orchestra.run.trial187.stdout:No user sessions are running outdated binaries. 2026-02-13T17:59:54.025 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T17:59:54.025 INFO:teuthology.orchestra.run.trial187.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T17:59:54.686 DEBUG:teuthology.orchestra.run.trial187:> dpkg -s linux-image-generic 2026-02-13T17:59:54.696 INFO:teuthology.orchestra.run.trial187.stdout:Package: linux-image-generic 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Status: install ok installed 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Priority: optional 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Section: kernel 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Installed-Size: 21 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Architecture: amd64 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Source: linux-meta 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Version: 5.15.0.170.159 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T17:59:54.697 INFO:teuthology.orchestra.run.trial187.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T17:59:54.698 INFO:teuthology.orchestra.run.trial187.stdout:Recommends: thermald 2026-02-13T17:59:54.698 INFO:teuthology.orchestra.run.trial187.stdout:Description: Generic Linux kernel image 2026-02-13T17:59:54.698 INFO:teuthology.orchestra.run.trial187.stdout: This package will always depend on the latest generic kernel image 2026-02-13T17:59:54.698 INFO:teuthology.orchestra.run.trial187.stdout: available. 2026-02-13T17:59:54.698 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T17:59:54.698 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T17:59:54.698 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T17:59:54.699 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T17:59:54.699 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial187.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T17:59:54.699 DEBUG:teuthology.orchestra.run.trial187:> sudo apt-get clean 2026-02-13T17:59:54.778 DEBUG:teuthology.orchestra.run.trial187:> sudo apt-get update 2026-02-13T17:59:55.274 INFO:teuthology.orchestra.run.trial187.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T17:59:55.357 INFO:teuthology.orchestra.run.trial187.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T17:59:55.445 INFO:teuthology.orchestra.run.trial187.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T17:59:55.533 INFO:teuthology.orchestra.run.trial187.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T17:59:56.177 INFO:teuthology.orchestra.run.trial187.stdout:Reading package lists... 2026-02-13T17:59:56.191 DEBUG:teuthology.orchestra.run.trial187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T17:59:56.225 INFO:teuthology.orchestra.run.trial187.stdout:Reading package lists... 2026-02-13T17:59:56.331 INFO:teuthology.orchestra.run.trial187.stdout:Building dependency tree... 2026-02-13T17:59:56.331 INFO:teuthology.orchestra.run.trial187.stdout:Reading state information... 2026-02-13T17:59:56.415 INFO:teuthology.orchestra.run.trial187.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T17:59:56.416 INFO:teuthology.orchestra.run.trial187.stdout:linux-image-generic set to manually installed. 2026-02-13T17:59:56.416 INFO:teuthology.orchestra.run.trial187.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T17:59:56.416 INFO:teuthology.orchestra.run.trial187.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T17:59:56.416 INFO:teuthology.orchestra.run.trial187.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T17:59:56.416 INFO:teuthology.orchestra.run.trial187.stdout: sg3-utils-udev 2026-02-13T17:59:56.416 INFO:teuthology.orchestra.run.trial187.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T17:59:56.435 INFO:teuthology.orchestra.run.trial187.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T17:59:56.437 DEBUG:teuthology.orchestra.run.trial187:> dpkg -s linux-image-generic 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Package: linux-image-generic 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Status: install ok installed 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Priority: optional 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Section: kernel 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Installed-Size: 21 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Architecture: amd64 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Source: linux-meta 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Version: 5.15.0.170.159 2026-02-13T17:59:56.487 INFO:teuthology.orchestra.run.trial187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T17:59:56.488 INFO:teuthology.orchestra.run.trial187.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T17:59:56.488 INFO:teuthology.orchestra.run.trial187.stdout:Recommends: thermald 2026-02-13T17:59:56.488 INFO:teuthology.orchestra.run.trial187.stdout:Description: Generic Linux kernel image 2026-02-13T17:59:56.488 INFO:teuthology.orchestra.run.trial187.stdout: This package will always depend on the latest generic kernel image 2026-02-13T17:59:56.488 INFO:teuthology.orchestra.run.trial187.stdout: available. 2026-02-13T17:59:56.489 DEBUG:teuthology.orchestra.run.trial187:> mktemp 2026-02-13T17:59:56.533 INFO:teuthology.orchestra.run.trial187.stdout:/tmp/tmp.AkMOdbkUAJ 2026-02-13T17:59:56.534 DEBUG:teuthology.orchestra.run.trial187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.AkMOdbkUAJ 2026-02-13T17:59:56.582 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod 0666 /tmp/tmp.AkMOdbkUAJ 2026-02-13T17:59:56.680 DEBUG:teuthology.orchestra.remote:trial187:/tmp/tmp.AkMOdbkUAJ is 7KB 2026-02-13T17:59:56.688 DEBUG:teuthology.orchestra.run.trial187:> rm -fr /tmp/tmp.AkMOdbkUAJ 2026-02-13T17:59:56.692 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T17:59:56.745 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T17:59:56.745 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T17:59:56.746 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T17:59:56.799 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T17:59:56.800 DEBUG:teuthology.orchestra.run.trial187:> sudo update-grub 2026-02-13T17:59:56.909 INFO:teuthology.orchestra.run.trial078.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T17:59:56.909 INFO:teuthology.orchestra.run.trial078.stdout:Sourcing file `/etc/default/grub' 2026-02-13T17:59:56.929 INFO:teuthology.orchestra.run.trial078.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T17:59:56.930 INFO:teuthology.orchestra.run.trial078.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T17:59:56.932 INFO:teuthology.orchestra.run.trial078.stdout:Generating grub configuration file ... 2026-02-13T17:59:57.014 INFO:teuthology.orchestra.run.trial078.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T17:59:57.020 INFO:teuthology.orchestra.run.trial078.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T17:59:57.024 INFO:teuthology.orchestra.run.trial187.stderr:Sourcing file `/etc/default/grub' 2026-02-13T17:59:57.043 INFO:teuthology.orchestra.run.trial187.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T17:59:57.043 INFO:teuthology.orchestra.run.trial187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T17:59:57.046 INFO:teuthology.orchestra.run.trial187.stderr:Generating grub configuration file ... 2026-02-13T17:59:57.126 INFO:teuthology.orchestra.run.trial187.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T17:59:57.132 INFO:teuthology.orchestra.run.trial187.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T17:59:57.192 INFO:teuthology.orchestra.run.trial078.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T17:59:57.197 INFO:teuthology.orchestra.run.trial078.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T17:59:57.270 INFO:teuthology.orchestra.run.trial078.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T17:59:57.270 INFO:teuthology.orchestra.run.trial078.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T17:59:57.270 INFO:teuthology.orchestra.run.trial078.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T17:59:57.273 INFO:teuthology.orchestra.run.trial078.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T17:59:57.282 INFO:teuthology.orchestra.run.trial078.stdout:done 2026-02-13T17:59:57.308 INFO:teuthology.orchestra.run.trial187.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T17:59:57.313 INFO:teuthology.orchestra.run.trial187.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T17:59:57.381 INFO:teuthology.orchestra.run.trial187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T17:59:57.381 INFO:teuthology.orchestra.run.trial187.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T17:59:57.381 INFO:teuthology.orchestra.run.trial187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T17:59:57.383 INFO:teuthology.orchestra.run.trial187.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T17:59:57.390 INFO:teuthology.orchestra.run.trial187.stderr:done 2026-02-13T17:59:57.392 DEBUG:teuthology.orchestra.run.trial187:> sudo shutdown -r now 2026-02-13T17:59:57.671 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout:Pending kernel upgrade! 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout:Running kernel version: 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout: 5.15.0-164-generic 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout:Diagnostics: 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.672 INFO:teuthology.orchestra.run.trial078.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout:The processor microcode seems to be up-to-date. 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout:No services need to be restarted. 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout:No containers need to be restarted. 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout:No user sessions are running outdated binaries. 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T17:59:57.673 INFO:teuthology.orchestra.run.trial078.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T17:59:58.314 DEBUG:teuthology.orchestra.run.trial078:> dpkg -s linux-image-generic 2026-02-13T17:59:58.324 INFO:teuthology.orchestra.run.trial078.stdout:Package: linux-image-generic 2026-02-13T17:59:58.324 INFO:teuthology.orchestra.run.trial078.stdout:Status: install ok installed 2026-02-13T17:59:58.324 INFO:teuthology.orchestra.run.trial078.stdout:Priority: optional 2026-02-13T17:59:58.324 INFO:teuthology.orchestra.run.trial078.stdout:Section: kernel 2026-02-13T17:59:58.324 INFO:teuthology.orchestra.run.trial078.stdout:Installed-Size: 21 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Architecture: amd64 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Source: linux-meta 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Version: 5.15.0.170.159 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Recommends: thermald 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout:Description: Generic Linux kernel image 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout: This package will always depend on the latest generic kernel image 2026-02-13T17:59:58.325 INFO:teuthology.orchestra.run.trial078.stdout: available. 2026-02-13T17:59:58.326 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T17:59:58.326 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T17:59:58.326 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T17:59:58.326 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T17:59:58.326 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial078.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T17:59:58.326 DEBUG:teuthology.orchestra.run.trial078:> sudo apt-get clean 2026-02-13T17:59:58.406 DEBUG:teuthology.orchestra.run.trial078:> sudo apt-get update 2026-02-13T17:59:58.901 INFO:teuthology.orchestra.run.trial078.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T17:59:58.983 INFO:teuthology.orchestra.run.trial078.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T17:59:59.072 INFO:teuthology.orchestra.run.trial078.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T17:59:59.160 INFO:teuthology.orchestra.run.trial078.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T17:59:59.807 INFO:teuthology.orchestra.run.trial078.stdout:Reading package lists... 2026-02-13T17:59:59.821 DEBUG:teuthology.orchestra.run.trial078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T17:59:59.855 INFO:teuthology.orchestra.run.trial078.stdout:Reading package lists... 2026-02-13T17:59:59.962 INFO:teuthology.orchestra.run.trial078.stdout:Building dependency tree... 2026-02-13T17:59:59.962 INFO:teuthology.orchestra.run.trial078.stdout:Reading state information... 2026-02-13T18:00:00.046 INFO:teuthology.orchestra.run.trial078.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T18:00:00.047 INFO:teuthology.orchestra.run.trial078.stdout:linux-image-generic set to manually installed. 2026-02-13T18:00:00.047 INFO:teuthology.orchestra.run.trial078.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T18:00:00.047 INFO:teuthology.orchestra.run.trial078.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T18:00:00.047 INFO:teuthology.orchestra.run.trial078.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T18:00:00.047 INFO:teuthology.orchestra.run.trial078.stdout: sg3-utils-udev 2026-02-13T18:00:00.047 INFO:teuthology.orchestra.run.trial078.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T18:00:00.067 INFO:teuthology.orchestra.run.trial078.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T18:00:00.069 DEBUG:teuthology.orchestra.run.trial078:> dpkg -s linux-image-generic 2026-02-13T18:00:00.120 INFO:teuthology.orchestra.run.trial078.stdout:Package: linux-image-generic 2026-02-13T18:00:00.120 INFO:teuthology.orchestra.run.trial078.stdout:Status: install ok installed 2026-02-13T18:00:00.120 INFO:teuthology.orchestra.run.trial078.stdout:Priority: optional 2026-02-13T18:00:00.120 INFO:teuthology.orchestra.run.trial078.stdout:Section: kernel 2026-02-13T18:00:00.120 INFO:teuthology.orchestra.run.trial078.stdout:Installed-Size: 21 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Architecture: amd64 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Source: linux-meta 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Version: 5.15.0.170.159 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Recommends: thermald 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout:Description: Generic Linux kernel image 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout: This package will always depend on the latest generic kernel image 2026-02-13T18:00:00.121 INFO:teuthology.orchestra.run.trial078.stdout: available. 2026-02-13T18:00:00.122 DEBUG:teuthology.orchestra.run.trial078:> mktemp 2026-02-13T18:00:00.167 INFO:teuthology.orchestra.run.trial078.stdout:/tmp/tmp.KhDASvNWT3 2026-02-13T18:00:00.167 DEBUG:teuthology.orchestra.run.trial078:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KhDASvNWT3 2026-02-13T18:00:00.219 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0666 /tmp/tmp.KhDASvNWT3 2026-02-13T18:00:00.313 DEBUG:teuthology.orchestra.remote:trial078:/tmp/tmp.KhDASvNWT3 is 7KB 2026-02-13T18:00:00.321 DEBUG:teuthology.orchestra.run.trial078:> rm -fr /tmp/tmp.KhDASvNWT3 2026-02-13T18:00:00.325 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T18:00:00.375 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:00:00.375 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T18:00:00.375 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T18:00:00.429 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T18:00:00.429 DEBUG:teuthology.orchestra.run.trial078:> sudo update-grub 2026-02-13T18:00:00.660 INFO:teuthology.orchestra.run.trial078.stderr:Sourcing file `/etc/default/grub' 2026-02-13T18:00:00.679 INFO:teuthology.orchestra.run.trial078.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T18:00:00.680 INFO:teuthology.orchestra.run.trial078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T18:00:00.682 INFO:teuthology.orchestra.run.trial078.stderr:Generating grub configuration file ... 2026-02-13T18:00:00.763 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T18:00:00.769 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T18:00:00.937 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T18:00:00.943 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T18:00:01.011 INFO:teuthology.orchestra.run.trial078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T18:00:01.011 INFO:teuthology.orchestra.run.trial078.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T18:00:01.012 INFO:teuthology.orchestra.run.trial078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T18:00:01.014 INFO:teuthology.orchestra.run.trial078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T18:00:01.021 INFO:teuthology.orchestra.run.trial078.stderr:done 2026-02-13T18:00:01.023 DEBUG:teuthology.orchestra.run.trial078:> sudo shutdown -r now 2026-02-13T18:00:27.420 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T18:00:27.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T18:00:27.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:00:31.029 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T18:00:31.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T18:00:31.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:01:27.480 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T18:01:31.035 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T18:01:36.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T18:01:36.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:01:36.614 DEBUG:teuthology.orchestra.run.trial187:> true 2026-02-13T18:01:37.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T18:01:37.005 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-170-generic"... 2026-02-13T18:01:37.005 DEBUG:teuthology.orchestra.run.trial187:> uname -r 2026-02-13T18:01:37.051 INFO:teuthology.orchestra.run.trial187.stdout:5.15.0-170-generic 2026-02-13T18:01:37.051 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T18:01:37.051 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T18:01:37.052 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T18:01:38.053 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-13T18:01:38.053 DEBUG:teuthology.orchestra.run.trial187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T18:01:38.066 INFO:teuthology.orchestra.run.trial187.stdout:ttyS1 2026-02-13T18:01:38.089 DEBUG:teuthology.parallel:result is None 2026-02-13T18:01:40.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T18:01:40.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:01:40.168 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-13T18:01:40.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T18:01:40.576 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-13T18:01:40.576 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-13T18:01:40.620 INFO:teuthology.orchestra.run.trial078.stdout:5.15.0-170-generic 2026-02-13T18:01:40.620 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T18:01:40.620 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T18:01:40.620 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T18:01:41.621 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-13T18:01:41.621 DEBUG:teuthology.orchestra.run.trial078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T18:01:41.634 INFO:teuthology.orchestra.run.trial078.stdout:ttyS1 2026-02-13T18:01:41.666 DEBUG:teuthology.parallel:result is None 2026-02-13T18:01:41.670 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T18:01:41.688 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T18:01:41.690 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T18:01:41.711 DEBUG:teuthology.orchestra.run.trial187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T18:01:41.718 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T18:01:41.730 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T18:01:41.744 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T18:01:41.745 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T18:01:41.758 DEBUG:teuthology.orchestra.run.trial187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T18:01:41.773 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T18:01:41.785 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T18:01:41.785 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T18:01:41.806 DEBUG:teuthology.orchestra.run.trial187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T18:01:41.814 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T18:01:41.816 INFO:teuthology.orchestra.run.trial187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T18:01:41.820 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T18:01:41.822 INFO:teuthology.orchestra.run.trial187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T18:01:41.824 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T18:01:41.836 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T18:01:41.836 DEBUG:teuthology.orchestra.run.trial078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T18:01:41.866 DEBUG:teuthology.orchestra.run.trial187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T18:01:41.875 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T18:01:41.896 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T18:01:41.896 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T18:01:41.918 DEBUG:teuthology.orchestra.run.trial187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T18:01:41.923 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T18:01:41.964 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T18:01:42.008 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:01:42.008 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T18:01:42.058 DEBUG:teuthology.orchestra.run.trial187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T18:01:42.062 DEBUG:teuthology.orchestra.run.trial187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T18:01:42.107 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:01:42.107 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T18:01:42.157 DEBUG:teuthology.orchestra.run.trial078:> sudo service rsyslog restart 2026-02-13T18:01:42.159 DEBUG:teuthology.orchestra.run.trial187:> sudo service rsyslog restart 2026-02-13T18:01:42.217 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T18:01:42.229 INFO:teuthology.task.internal:Starting timer... 2026-02-13T18:01:42.229 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T18:01:42.254 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T18:01:42.273 DEBUG:teuthology.task.selinux:Excluding trial078: OS 'ubuntu' does not support SELinux 2026-02-13T18:01:42.273 DEBUG:teuthology.task.selinux:Excluding trial187: OS 'ubuntu' does not support SELinux 2026-02-13T18:01:42.273 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T18:01:42.273 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-13T18:01:42.274 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T18:01:42.274 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T18:01:42.291 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-13T18:01:42.296 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-13T18:01:42.425 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T18:01:42.436 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T18:01:42.439 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial078.front.sepia.ceph.com,trial187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T18:04:11.599 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial078.front.sepia.ceph.com'), Remote(name='ubuntu@trial187.front.sepia.ceph.com')] 2026-02-13T18:04:11.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T18:04:11.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:04:11.714 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-13T18:04:11.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T18:04:11.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T18:04:11.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:04:12.077 DEBUG:teuthology.orchestra.run.trial187:> true 2026-02-13T18:04:12.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T18:04:12.323 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T18:04:12.336 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T18:04:12.336 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T18:04:12.336 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T18:04:12.338 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T18:04:12.338 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T18:04:12.355 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Command line: ntpd -gq 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: ---------------------------------------------------- 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: corporation. Support and training for ntp-4 are 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: available at https://www.nwtime.org/support 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: ---------------------------------------------------- 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: proto: precision = 0.020 usec (-25) 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: basedate set to 2022-02-04 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: gps base set to 2022-02-06 (week 2196) 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T18:04:12.356 INFO:teuthology.orchestra.run.trial078.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listen normally on 3 enp1s0f0 10.20.193.78:123 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listen normally on 4 lo [::1]:123 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:64ae%2]:123 2026-02-13T18:04:12.357 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:12 ntpd[8806]: Listening on routing socket on fd #22 for interface updates 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Command line: ntpd -gq 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: ---------------------------------------------------- 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: corporation. Support and training for ntp-4 are 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: available at https://www.nwtime.org/support 2026-02-13T18:04:12.381 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: ---------------------------------------------------- 2026-02-13T18:04:12.382 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: proto: precision = 0.020 usec (-25) 2026-02-13T18:04:12.382 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: basedate set to 2022-02-04 2026-02-13T18:04:12.382 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: gps base set to 2022-02-06 (week 2196) 2026-02-13T18:04:12.382 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T18:04:12.382 INFO:teuthology.orchestra.run.trial187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T18:04:12.382 INFO:teuthology.orchestra.run.trial187.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listen normally on 3 enp1s0f0 10.20.193.187:123 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listen normally on 4 lo [::1]:123 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6216%2]:123 2026-02-13T18:04:12.383 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:12 ntpd[8790]: Listening on routing socket on fd #22 for interface updates 2026-02-13T18:04:13.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:13.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:13.401 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.401 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.401 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:13.401 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:13.424 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.424 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.424 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:13.424 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:13 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:13.470 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:13.471 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:13.471 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:13.471 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:13 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:14.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:14 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:14.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:14 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:14.389 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:14 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:14.389 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:14 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:14.390 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:14 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:14.390 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:14 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:15.356 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.356 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.356 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:15.386 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:15.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:15.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:15.423 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.423 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.424 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:15.424 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:15.428 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.428 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.428 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:15.428 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:15 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:15.470 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:15.470 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:15.470 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:15.470 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:15 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:16.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:16.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:16.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:16.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:16.389 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:16.389 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:16.389 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:16.390 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:16.408 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:16.408 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:16.408 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:16.408 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:16 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:17.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:17.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:17.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:17.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:17.401 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.401 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.401 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:17.402 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:17.423 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.423 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.423 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:17.423 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:17.427 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.427 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.427 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:17.427 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:17 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:17.474 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:17.475 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:17.475 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:17.475 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:17 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:18.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:18.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:18.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:18.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:18.390 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:18.390 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:18.390 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:18.391 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:18.408 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:18.409 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:18.409 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:18.409 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:18 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:19.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.357 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.358 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.381 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.382 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:19.387 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:19.388 INFO:teuthology.orchestra.run.trial078.stdout:13 Feb 18:04:19 ntpd[8806]: ntpd: time set +0.325606 s 2026-02-13T18:04:19.388 INFO:teuthology.orchestra.run.trial078.stdout:ntpd: time set +0.325606s 2026-02-13T18:04:19.388 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T18:04:19.389 INFO:teuthology.orchestra.run.trial078.stderr:13 Feb 18:04:19 ntpd[8806]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T18:04:19.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T18:04:19.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T18:04:19.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T18:04:19.400 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T18:04:19.401 INFO:teuthology.orchestra.run.trial187.stdout:13 Feb 18:04:19 ntpd[8790]: ntpd: time set -0.355595 s 2026-02-13T18:04:19.401 INFO:teuthology.orchestra.run.trial187.stdout:ntpd: time set -0.355595s 2026-02-13T18:04:19.401 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T18:04:19.401 INFO:teuthology.orchestra.run.trial187.stderr:13 Feb 18:04:19 ntpd[8790]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T18:04:19.461 INFO:teuthology.orchestra.run.trial187.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T18:04:19.462 INFO:teuthology.orchestra.run.trial187.stdout:============================================================================== 2026-02-13T18:04:19.462 INFO:teuthology.orchestra.run.trial187.stdout: 38.45.64.130 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.462 INFO:teuthology.orchestra.run.trial187.stdout: 172-235-154-118 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.462 INFO:teuthology.orchestra.run.trial187.stdout: s2-a.time.mci1. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.462 INFO:teuthology.orchestra.run.trial187.stdout: 172-232-15-202. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.465 INFO:teuthology.orchestra.run.trial078.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T18:04:19.465 INFO:teuthology.orchestra.run.trial078.stdout:============================================================================== 2026-02-13T18:04:19.465 INFO:teuthology.orchestra.run.trial078.stdout: ip216-250-115-1 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.465 INFO:teuthology.orchestra.run.trial078.stdout: sushi.ruselabs. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.465 INFO:teuthology.orchestra.run.trial078.stdout: 108.61.215.221 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.465 INFO:teuthology.orchestra.run.trial078.stdout: clock01.cymru.c .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T18:04:19.467 INFO:teuthology.run_tasks:Running task install... 2026-02-13T18:04:19.481 DEBUG:teuthology.task.install:project ceph 2026-02-13T18:04:19.482 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-13T18:04:19.482 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-13T18:04:19.482 INFO:teuthology.task.install:Using flavor: default 2026-02-13T18:04:19.491 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T18:04:19.491 INFO:teuthology.task.install:extra packages: [] 2026-02-13T18:04:19.492 DEBUG:teuthology.orchestra.run.trial078:> sudo apt-key list | grep Ceph 2026-02-13T18:04:19.492 DEBUG:teuthology.orchestra.run.trial187:> sudo apt-key list | grep Ceph 2026-02-13T18:04:19.551 INFO:teuthology.orchestra.run.trial187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T18:04:19.557 INFO:teuthology.orchestra.run.trial078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T18:04:19.580 INFO:teuthology.orchestra.run.trial187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T18:04:19.580 INFO:teuthology.orchestra.run.trial187.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T18:04:19.581 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-13T18:04:19.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T18:04:19.585 INFO:teuthology.orchestra.run.trial078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T18:04:19.585 INFO:teuthology.orchestra.run.trial078.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T18:04:19.586 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-13T18:04:19.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T18:04:19.738 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default/ 2026-02-13T18:04:19.738 INFO:teuthology.task.install.deb:Package version is 20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:04:19.750 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default/ 2026-02-13T18:04:19.750 INFO:teuthology.task.install.deb:Package version is 20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:04:19.895 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:04:19.895 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T18:04:19.905 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:04:19.905 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T18:04:19.905 DEBUG:teuthology.orchestra.run.trial187:> sudo apt-get update 2026-02-13T18:04:19.914 DEBUG:teuthology.orchestra.run.trial078:> sudo apt-get update 2026-02-13T18:04:20.101 INFO:teuthology.orchestra.run.trial078.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T18:04:20.102 INFO:teuthology.orchestra.run.trial187.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T18:04:20.112 INFO:teuthology.orchestra.run.trial078.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-13T18:04:20.113 INFO:teuthology.orchestra.run.trial187.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-13T18:04:20.124 INFO:teuthology.orchestra.run.trial078.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T18:04:20.125 INFO:teuthology.orchestra.run.trial187.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T18:04:20.136 INFO:teuthology.orchestra.run.trial078.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-13T18:04:20.137 INFO:teuthology.orchestra.run.trial187.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-13T18:04:20.419 INFO:teuthology.orchestra.run.trial187.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T18:04:20.429 INFO:teuthology.orchestra.run.trial078.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T18:04:20.501 INFO:teuthology.orchestra.run.trial187.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T18:04:20.516 INFO:teuthology.orchestra.run.trial078.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T18:04:20.589 INFO:teuthology.orchestra.run.trial187.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T18:04:20.607 INFO:teuthology.orchestra.run.trial078.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T18:04:20.678 INFO:teuthology.orchestra.run.trial187.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T18:04:20.699 INFO:teuthology.orchestra.run.trial078.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T18:04:20.825 INFO:teuthology.orchestra.run.trial187.stdout:Fetched 26.9 kB in 1s (35.4 kB/s) 2026-02-13T18:04:20.844 INFO:teuthology.orchestra.run.trial078.stdout:Fetched 26.9 kB in 1s (35.0 kB/s) 2026-02-13T18:04:21.347 INFO:teuthology.orchestra.run.trial187.stdout:Reading package lists... 2026-02-13T18:04:21.361 DEBUG:teuthology.orchestra.run.trial187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5230-gafefaa40-1jammy cephadm=20.3.0-5230-gafefaa40-1jammy ceph-mds=20.3.0-5230-gafefaa40-1jammy ceph-mgr=20.3.0-5230-gafefaa40-1jammy ceph-osd=20.3.0-5230-gafefaa40-1jammy ceph-osd-classic=20.3.0-5230-gafefaa40-1jammy ceph-common=20.3.0-5230-gafefaa40-1jammy ceph-fuse=20.3.0-5230-gafefaa40-1jammy ceph-test=20.3.0-5230-gafefaa40-1jammy ceph-volume=20.3.0-5230-gafefaa40-1jammy radosgw=20.3.0-5230-gafefaa40-1jammy python3-rados=20.3.0-5230-gafefaa40-1jammy python3-rgw=20.3.0-5230-gafefaa40-1jammy python3-cephfs=20.3.0-5230-gafefaa40-1jammy python3-rbd=20.3.0-5230-gafefaa40-1jammy libcephfs2=20.3.0-5230-gafefaa40-1jammy libcephfs-dev=20.3.0-5230-gafefaa40-1jammy librados2=20.3.0-5230-gafefaa40-1jammy librbd1=20.3.0-5230-gafefaa40-1jammy rbd-fuse=20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:04:21.374 INFO:teuthology.orchestra.run.trial078.stdout:Reading package lists... 2026-02-13T18:04:21.389 DEBUG:teuthology.orchestra.run.trial078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5230-gafefaa40-1jammy cephadm=20.3.0-5230-gafefaa40-1jammy ceph-mds=20.3.0-5230-gafefaa40-1jammy ceph-mgr=20.3.0-5230-gafefaa40-1jammy ceph-osd=20.3.0-5230-gafefaa40-1jammy ceph-osd-classic=20.3.0-5230-gafefaa40-1jammy ceph-common=20.3.0-5230-gafefaa40-1jammy ceph-fuse=20.3.0-5230-gafefaa40-1jammy ceph-test=20.3.0-5230-gafefaa40-1jammy ceph-volume=20.3.0-5230-gafefaa40-1jammy radosgw=20.3.0-5230-gafefaa40-1jammy python3-rados=20.3.0-5230-gafefaa40-1jammy python3-rgw=20.3.0-5230-gafefaa40-1jammy python3-cephfs=20.3.0-5230-gafefaa40-1jammy python3-rbd=20.3.0-5230-gafefaa40-1jammy libcephfs2=20.3.0-5230-gafefaa40-1jammy libcephfs-dev=20.3.0-5230-gafefaa40-1jammy librados2=20.3.0-5230-gafefaa40-1jammy librbd1=20.3.0-5230-gafefaa40-1jammy rbd-fuse=20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:04:21.394 INFO:teuthology.orchestra.run.trial187.stdout:Reading package lists... 2026-02-13T18:04:21.423 INFO:teuthology.orchestra.run.trial078.stdout:Reading package lists... 2026-02-13T18:04:21.505 INFO:teuthology.orchestra.run.trial187.stdout:Building dependency tree... 2026-02-13T18:04:21.506 INFO:teuthology.orchestra.run.trial187.stdout:Reading state information... 2026-02-13T18:04:21.533 INFO:teuthology.orchestra.run.trial078.stdout:Building dependency tree... 2026-02-13T18:04:21.533 INFO:teuthology.orchestra.run.trial078.stdout:Reading state information... 2026-02-13T18:04:21.595 INFO:teuthology.orchestra.run.trial187.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T18:04:21.595 INFO:teuthology.orchestra.run.trial187.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T18:04:21.595 INFO:teuthology.orchestra.run.trial187.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T18:04:21.595 INFO:teuthology.orchestra.run.trial187.stdout: sg3-utils-udev 2026-02-13T18:04:21.595 INFO:teuthology.orchestra.run.trial187.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout:The following additional packages will be installed: 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-13T18:04:21.596 INFO:teuthology.orchestra.run.trial187.stdout:Suggested packages: 2026-02-13T18:04:21.597 INFO:teuthology.orchestra.run.trial187.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T18:04:21.597 INFO:teuthology.orchestra.run.trial187.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T18:04:21.597 INFO:teuthology.orchestra.run.trial187.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T18:04:21.597 INFO:teuthology.orchestra.run.trial187.stdout:Recommended packages: 2026-02-13T18:04:21.597 INFO:teuthology.orchestra.run.trial187.stdout: btrfs-tools 2026-02-13T18:04:21.624 INFO:teuthology.orchestra.run.trial078.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T18:04:21.624 INFO:teuthology.orchestra.run.trial078.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T18:04:21.624 INFO:teuthology.orchestra.run.trial078.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T18:04:21.624 INFO:teuthology.orchestra.run.trial078.stdout: sg3-utils-udev 2026-02-13T18:04:21.624 INFO:teuthology.orchestra.run.trial078.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout:The following additional packages will be installed: 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T18:04:21.625 INFO:teuthology.orchestra.run.trial078.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout:Suggested packages: 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout:Recommended packages: 2026-02-13T18:04:21.626 INFO:teuthology.orchestra.run.trial078.stdout: btrfs-tools 2026-02-13T18:04:21.628 INFO:teuthology.orchestra.run.trial187.stdout:The following NEW packages will be installed: 2026-02-13T18:04:21.628 INFO:teuthology.orchestra.run.trial187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T18:04:21.628 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T18:04:21.628 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-13T18:04:21.629 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-13T18:04:21.630 INFO:teuthology.orchestra.run.trial187.stdout: socat xmlstarlet 2026-02-13T18:04:21.660 INFO:teuthology.orchestra.run.trial078.stdout:The following NEW packages will be installed: 2026-02-13T18:04:21.660 INFO:teuthology.orchestra.run.trial078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T18:04:21.660 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T18:04:21.660 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-13T18:04:21.661 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-13T18:04:21.661 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-13T18:04:21.661 INFO:teuthology.orchestra.run.trial078.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-13T18:04:21.661 INFO:teuthology.orchestra.run.trial078.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-13T18:04:21.662 INFO:teuthology.orchestra.run.trial078.stdout: socat xmlstarlet 2026-02-13T18:04:21.709 INFO:teuthology.orchestra.run.trial187.stdout:0 upgraded, 87 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T18:04:21.709 INFO:teuthology.orchestra.run.trial187.stdout:Need to get 701 MB of archives. 2026-02-13T18:04:21.709 INFO:teuthology.orchestra.run.trial187.stdout:After this operation, 2670 MB of additional disk space will be used. 2026-02-13T18:04:21.709 INFO:teuthology.orchestra.run.trial187.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5230-gafefaa40-1jammy [3798 kB] 2026-02-13T18:04:21.740 INFO:teuthology.orchestra.run.trial078.stdout:0 upgraded, 87 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T18:04:21.740 INFO:teuthology.orchestra.run.trial078.stdout:Need to get 701 MB of archives. 2026-02-13T18:04:21.740 INFO:teuthology.orchestra.run.trial078.stdout:After this operation, 2670 MB of additional disk space will be used. 2026-02-13T18:04:21.740 INFO:teuthology.orchestra.run.trial078.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5230-gafefaa40-1jammy [3798 kB] 2026-02-13T18:04:21.825 INFO:teuthology.orchestra.run.trial187.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5230-gafefaa40-1jammy [2910 kB] 2026-02-13T18:04:21.882 INFO:teuthology.orchestra.run.trial187.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5230-gafefaa40-1jammy [882 kB] 2026-02-13T18:04:21.896 INFO:teuthology.orchestra.run.trial187.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5230-gafefaa40-1jammy [359 kB] 2026-02-13T18:04:21.903 INFO:teuthology.orchestra.run.trial187.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5230-gafefaa40-1jammy [32.8 kB] 2026-02-13T18:04:21.903 INFO:teuthology.orchestra.run.trial187.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5230-gafefaa40-1jammy [225 kB] 2026-02-13T18:04:21.908 INFO:teuthology.orchestra.run.trial187.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5230-gafefaa40-1jammy [88.4 kB] 2026-02-13T18:04:21.909 INFO:teuthology.orchestra.run.trial187.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5230-gafefaa40-1jammy [339 kB] 2026-02-13T18:04:21.920 INFO:teuthology.orchestra.run.trial187.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5230-gafefaa40-1jammy [9083 kB] 2026-02-13T18:04:22.061 INFO:teuthology.orchestra.run.trial187.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T18:04:22.076 INFO:teuthology.orchestra.run.trial078.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5230-gafefaa40-1jammy [2910 kB] 2026-02-13T18:04:22.093 INFO:teuthology.orchestra.run.trial078.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T18:04:22.101 INFO:teuthology.orchestra.run.trial187.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5230-gafefaa40-1jammy [112 kB] 2026-02-13T18:04:22.102 INFO:teuthology.orchestra.run.trial187.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5230-gafefaa40-1jammy [261 kB] 2026-02-13T18:04:22.106 INFO:teuthology.orchestra.run.trial187.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5230-gafefaa40-1jammy [31.5 MB] 2026-02-13T18:04:22.323 INFO:teuthology.orchestra.run.trial078.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5230-gafefaa40-1jammy [882 kB] 2026-02-13T18:04:22.387 INFO:teuthology.orchestra.run.trial078.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5230-gafefaa40-1jammy [359 kB] 2026-02-13T18:04:22.393 INFO:teuthology.orchestra.run.trial078.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5230-gafefaa40-1jammy [32.8 kB] 2026-02-13T18:04:22.393 INFO:teuthology.orchestra.run.trial078.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5230-gafefaa40-1jammy [225 kB] 2026-02-13T18:04:22.397 INFO:teuthology.orchestra.run.trial078.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5230-gafefaa40-1jammy [88.4 kB] 2026-02-13T18:04:22.449 INFO:teuthology.orchestra.run.trial078.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5230-gafefaa40-1jammy [339 kB] 2026-02-13T18:04:22.454 INFO:teuthology.orchestra.run.trial078.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5230-gafefaa40-1jammy [9083 kB] 2026-02-13T18:04:22.489 INFO:teuthology.orchestra.run.trial187.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T18:04:22.502 INFO:teuthology.orchestra.run.trial187.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T18:04:22.521 INFO:teuthology.orchestra.run.trial078.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T18:04:22.534 INFO:teuthology.orchestra.run.trial078.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T18:04:22.591 INFO:teuthology.orchestra.run.trial187.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T18:04:22.622 INFO:teuthology.orchestra.run.trial078.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T18:04:22.770 INFO:teuthology.orchestra.run.trial187.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5230-gafefaa40-1jammy [4982 kB] 2026-02-13T18:04:22.845 INFO:teuthology.orchestra.run.trial187.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T18:04:22.858 INFO:teuthology.orchestra.run.trial187.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T18:04:22.875 INFO:teuthology.orchestra.run.trial078.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T18:04:22.889 INFO:teuthology.orchestra.run.trial078.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T18:04:22.892 INFO:teuthology.orchestra.run.trial187.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T18:04:22.902 INFO:teuthology.orchestra.run.trial187.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T18:04:22.904 INFO:teuthology.orchestra.run.trial187.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T18:04:22.906 INFO:teuthology.orchestra.run.trial187.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T18:04:22.907 INFO:teuthology.orchestra.run.trial187.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T18:04:22.922 INFO:teuthology.orchestra.run.trial078.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T18:04:22.927 INFO:teuthology.orchestra.run.trial187.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T18:04:22.929 INFO:teuthology.orchestra.run.trial187.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T18:04:22.933 INFO:teuthology.orchestra.run.trial078.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T18:04:22.935 INFO:teuthology.orchestra.run.trial078.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T18:04:22.936 INFO:teuthology.orchestra.run.trial187.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T18:04:22.936 INFO:teuthology.orchestra.run.trial078.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T18:04:22.937 INFO:teuthology.orchestra.run.trial078.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T18:04:22.948 INFO:teuthology.orchestra.run.trial187.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5230-gafefaa40-1jammy [293 kB] 2026-02-13T18:04:22.950 INFO:teuthology.orchestra.run.trial187.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5230-gafefaa40-1jammy [127 kB] 2026-02-13T18:04:22.950 INFO:teuthology.orchestra.run.trial187.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5230-gafefaa40-1jammy [922 kB] 2026-02-13T18:04:22.955 INFO:teuthology.orchestra.run.trial187.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5230-gafefaa40-1jammy [7542 kB] 2026-02-13T18:04:22.958 INFO:teuthology.orchestra.run.trial078.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T18:04:22.959 INFO:teuthology.orchestra.run.trial078.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T18:04:22.966 INFO:teuthology.orchestra.run.trial078.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5230-gafefaa40-1jammy [112 kB] 2026-02-13T18:04:22.966 INFO:teuthology.orchestra.run.trial078.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T18:04:22.966 INFO:teuthology.orchestra.run.trial078.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5230-gafefaa40-1jammy [261 kB] 2026-02-13T18:04:22.994 INFO:teuthology.orchestra.run.trial078.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5230-gafefaa40-1jammy [31.5 MB] 2026-02-13T18:04:23.020 INFO:teuthology.orchestra.run.trial187.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T18:04:23.020 INFO:teuthology.orchestra.run.trial187.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T18:04:23.020 INFO:teuthology.orchestra.run.trial187.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T18:04:23.021 INFO:teuthology.orchestra.run.trial187.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T18:04:23.021 INFO:teuthology.orchestra.run.trial187.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T18:04:23.021 INFO:teuthology.orchestra.run.trial187.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T18:04:23.021 INFO:teuthology.orchestra.run.trial187.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T18:04:23.027 INFO:teuthology.orchestra.run.trial187.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T18:04:23.027 INFO:teuthology.orchestra.run.trial187.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T18:04:23.050 INFO:teuthology.orchestra.run.trial078.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T18:04:23.051 INFO:teuthology.orchestra.run.trial078.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T18:04:23.051 INFO:teuthology.orchestra.run.trial078.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T18:04:23.051 INFO:teuthology.orchestra.run.trial078.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T18:04:23.051 INFO:teuthology.orchestra.run.trial078.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T18:04:23.052 INFO:teuthology.orchestra.run.trial078.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T18:04:23.052 INFO:teuthology.orchestra.run.trial078.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T18:04:23.057 INFO:teuthology.orchestra.run.trial078.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T18:04:23.058 INFO:teuthology.orchestra.run.trial078.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T18:04:23.115 INFO:teuthology.orchestra.run.trial187.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T18:04:23.117 INFO:teuthology.orchestra.run.trial187.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T18:04:23.118 INFO:teuthology.orchestra.run.trial187.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T18:04:23.119 INFO:teuthology.orchestra.run.trial187.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T18:04:23.132 INFO:teuthology.orchestra.run.trial187.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5230-gafefaa40-1jammy [468 MB] 2026-02-13T18:04:23.145 INFO:teuthology.orchestra.run.trial078.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T18:04:23.148 INFO:teuthology.orchestra.run.trial078.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T18:04:23.149 INFO:teuthology.orchestra.run.trial078.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T18:04:23.149 INFO:teuthology.orchestra.run.trial078.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T18:04:23.150 INFO:teuthology.orchestra.run.trial187.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T18:04:23.153 INFO:teuthology.orchestra.run.trial187.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T18:04:23.153 INFO:teuthology.orchestra.run.trial187.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T18:04:23.181 INFO:teuthology.orchestra.run.trial078.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T18:04:23.184 INFO:teuthology.orchestra.run.trial078.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T18:04:23.184 INFO:teuthology.orchestra.run.trial078.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T18:04:23.226 INFO:teuthology.orchestra.run.trial187.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T18:04:23.226 INFO:teuthology.orchestra.run.trial187.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T18:04:23.227 INFO:teuthology.orchestra.run.trial187.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T18:04:23.227 INFO:teuthology.orchestra.run.trial187.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T18:04:23.228 INFO:teuthology.orchestra.run.trial187.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T18:04:23.228 INFO:teuthology.orchestra.run.trial187.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T18:04:23.256 INFO:teuthology.orchestra.run.trial078.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T18:04:23.257 INFO:teuthology.orchestra.run.trial078.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T18:04:23.257 INFO:teuthology.orchestra.run.trial078.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T18:04:23.258 INFO:teuthology.orchestra.run.trial078.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T18:04:23.258 INFO:teuthology.orchestra.run.trial078.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T18:04:23.258 INFO:teuthology.orchestra.run.trial078.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T18:04:23.303 INFO:teuthology.orchestra.run.trial187.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T18:04:23.305 INFO:teuthology.orchestra.run.trial187.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T18:04:23.306 INFO:teuthology.orchestra.run.trial187.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T18:04:23.333 INFO:teuthology.orchestra.run.trial078.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T18:04:23.335 INFO:teuthology.orchestra.run.trial078.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T18:04:23.336 INFO:teuthology.orchestra.run.trial078.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T18:04:23.394 INFO:teuthology.orchestra.run.trial187.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T18:04:23.398 INFO:teuthology.orchestra.run.trial187.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T18:04:23.401 INFO:teuthology.orchestra.run.trial187.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T18:04:23.405 INFO:teuthology.orchestra.run.trial187.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T18:04:23.408 INFO:teuthology.orchestra.run.trial187.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T18:04:23.409 INFO:teuthology.orchestra.run.trial187.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T18:04:23.409 INFO:teuthology.orchestra.run.trial187.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T18:04:23.424 INFO:teuthology.orchestra.run.trial078.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T18:04:23.428 INFO:teuthology.orchestra.run.trial078.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T18:04:23.430 INFO:teuthology.orchestra.run.trial078.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T18:04:23.435 INFO:teuthology.orchestra.run.trial078.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T18:04:23.438 INFO:teuthology.orchestra.run.trial078.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T18:04:23.439 INFO:teuthology.orchestra.run.trial078.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T18:04:23.439 INFO:teuthology.orchestra.run.trial078.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T18:04:23.486 INFO:teuthology.orchestra.run.trial187.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T18:04:23.486 INFO:teuthology.orchestra.run.trial187.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T18:04:23.494 INFO:teuthology.orchestra.run.trial187.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T18:04:23.515 INFO:teuthology.orchestra.run.trial078.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T18:04:23.516 INFO:teuthology.orchestra.run.trial078.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T18:04:23.524 INFO:teuthology.orchestra.run.trial078.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T18:04:23.577 INFO:teuthology.orchestra.run.trial187.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T18:04:23.579 INFO:teuthology.orchestra.run.trial187.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T18:04:23.580 INFO:teuthology.orchestra.run.trial187.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T18:04:23.580 INFO:teuthology.orchestra.run.trial187.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T18:04:23.607 INFO:teuthology.orchestra.run.trial078.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T18:04:23.609 INFO:teuthology.orchestra.run.trial078.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T18:04:23.609 INFO:teuthology.orchestra.run.trial078.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T18:04:23.610 INFO:teuthology.orchestra.run.trial078.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T18:04:24.180 INFO:teuthology.orchestra.run.trial078.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5230-gafefaa40-1jammy [4982 kB] 2026-02-13T18:04:24.374 INFO:teuthology.orchestra.run.trial078.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5230-gafefaa40-1jammy [293 kB] 2026-02-13T18:04:24.378 INFO:teuthology.orchestra.run.trial078.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5230-gafefaa40-1jammy [127 kB] 2026-02-13T18:04:24.380 INFO:teuthology.orchestra.run.trial078.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5230-gafefaa40-1jammy [922 kB] 2026-02-13T18:04:24.417 INFO:teuthology.orchestra.run.trial078.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5230-gafefaa40-1jammy [7542 kB] 2026-02-13T18:04:24.689 INFO:teuthology.orchestra.run.trial078.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5230-gafefaa40-1jammy [468 MB] 2026-02-13T18:04:38.127 INFO:teuthology.orchestra.run.trial187.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5230-gafefaa40-1jammy [180 kB] 2026-02-13T18:04:38.128 INFO:teuthology.orchestra.run.trial187.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5230-gafefaa40-1jammy [14.0 kB] 2026-02-13T18:04:38.129 INFO:teuthology.orchestra.run.trial187.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5230-gafefaa40-1jammy [1030 kB] 2026-02-13T18:04:38.134 INFO:teuthology.orchestra.run.trial187.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5230-gafefaa40-1jammy [2438 kB] 2026-02-13T18:04:38.147 INFO:teuthology.orchestra.run.trial187.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5230-gafefaa40-1jammy [1068 kB] 2026-02-13T18:04:38.176 INFO:teuthology.orchestra.run.trial187.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5230-gafefaa40-1jammy [190 kB] 2026-02-13T18:04:38.179 INFO:teuthology.orchestra.run.trial187.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5230-gafefaa40-1jammy [54.5 MB] 2026-02-13T18:04:39.781 INFO:teuthology.orchestra.run.trial187.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5230-gafefaa40-1jammy [8626 kB] 2026-02-13T18:04:40.012 INFO:teuthology.orchestra.run.trial187.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5230-gafefaa40-1jammy [14.2 kB] 2026-02-13T18:04:40.012 INFO:teuthology.orchestra.run.trial187.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5230-gafefaa40-1jammy [68.6 MB] 2026-02-13T18:04:40.800 INFO:teuthology.orchestra.run.trial078.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5230-gafefaa40-1jammy [180 kB] 2026-02-13T18:04:40.800 INFO:teuthology.orchestra.run.trial078.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5230-gafefaa40-1jammy [14.0 kB] 2026-02-13T18:04:40.801 INFO:teuthology.orchestra.run.trial078.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5230-gafefaa40-1jammy [1030 kB] 2026-02-13T18:04:40.806 INFO:teuthology.orchestra.run.trial078.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5230-gafefaa40-1jammy [2438 kB] 2026-02-13T18:04:40.817 INFO:teuthology.orchestra.run.trial078.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5230-gafefaa40-1jammy [1068 kB] 2026-02-13T18:04:40.850 INFO:teuthology.orchestra.run.trial078.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5230-gafefaa40-1jammy [190 kB] 2026-02-13T18:04:40.857 INFO:teuthology.orchestra.run.trial078.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5230-gafefaa40-1jammy [54.5 MB] 2026-02-13T18:04:41.929 INFO:teuthology.orchestra.run.trial187.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5230-gafefaa40-1jammy [136 kB] 2026-02-13T18:04:41.934 INFO:teuthology.orchestra.run.trial187.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5230-gafefaa40-1jammy [45.1 kB] 2026-02-13T18:04:41.935 INFO:teuthology.orchestra.run.trial187.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5230-gafefaa40-1jammy [31.7 kB] 2026-02-13T18:04:41.935 INFO:teuthology.orchestra.run.trial187.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5230-gafefaa40-1jammy [44.2 kB] 2026-02-13T18:04:41.936 INFO:teuthology.orchestra.run.trial187.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5230-gafefaa40-1jammy [18.3 MB] 2026-02-13T18:04:42.526 INFO:teuthology.orchestra.run.trial187.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5230-gafefaa40-1jammy [93.5 kB] 2026-02-13T18:04:42.656 INFO:teuthology.orchestra.run.trial078.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5230-gafefaa40-1jammy [8626 kB] 2026-02-13T18:04:42.782 INFO:teuthology.orchestra.run.trial078.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5230-gafefaa40-1jammy [14.2 kB] 2026-02-13T18:04:42.782 INFO:teuthology.orchestra.run.trial078.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5230-gafefaa40-1jammy [68.6 MB] 2026-02-13T18:04:42.821 INFO:teuthology.orchestra.run.trial187.stdout:Fetched 701 MB in 21s (33.6 MB/s) 2026-02-13T18:04:42.839 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T18:04:42.999 INFO:teuthology.orchestra.run.trial187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T18:04:43.001 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T18:04:43.001 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T18:04:43.019 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T18:04:43.030 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T18:04:43.031 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T18:04:43.048 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T18:04:43.059 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T18:04:43.060 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T18:04:43.079 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T18:04:43.091 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T18:04:43.097 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:43.132 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T18:04:43.142 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T18:04:43.142 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:43.160 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T18:04:43.168 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T18:04:43.168 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:43.188 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T18:04:43.196 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T18:04:43.196 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T18:04:43.212 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package librados2. 2026-02-13T18:04:43.220 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../07-librados2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.220 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.263 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libnbd0. 2026-02-13T18:04:43.271 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T18:04:43.271 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T18:04:43.286 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package librbd1. 2026-02-13T18:04:43.294 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../09-librbd1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.294 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.332 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T18:04:43.340 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.340 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.360 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-rados. 2026-02-13T18:04:43.368 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.369 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.385 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T18:04:43.393 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:43.394 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.408 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T18:04:43.416 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.416 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.431 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T18:04:43.440 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:43.440 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.459 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T18:04:43.466 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T18:04:43.467 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T18:04:43.482 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T18:04:43.491 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T18:04:43.491 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T18:04:43.506 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T18:04:43.514 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.514 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.532 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T18:04:43.540 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T18:04:43.540 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T18:04:43.559 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package librgw2. 2026-02-13T18:04:43.567 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../19-librgw2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.567 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.664 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T18:04:43.673 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.673 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.688 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T18:04:43.696 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T18:04:43.696 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T18:04:43.711 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T18:04:43.719 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.719 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.736 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-common. 2026-02-13T18:04:43.744 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:43.744 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:43.915 INFO:teuthology.orchestra.run.trial078.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5230-gafefaa40-1jammy [136 kB] 2026-02-13T18:04:43.916 INFO:teuthology.orchestra.run.trial078.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5230-gafefaa40-1jammy [45.1 kB] 2026-02-13T18:04:43.917 INFO:teuthology.orchestra.run.trial078.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5230-gafefaa40-1jammy [31.7 kB] 2026-02-13T18:04:43.917 INFO:teuthology.orchestra.run.trial078.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5230-gafefaa40-1jammy [44.2 kB] 2026-02-13T18:04:43.917 INFO:teuthology.orchestra.run.trial078.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5230-gafefaa40-1jammy [18.3 MB] 2026-02-13T18:04:44.012 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-base. 2026-02-13T18:04:44.020 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.025 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.086 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T18:04:44.094 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T18:04:44.095 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T18:04:44.109 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T18:04:44.118 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T18:04:44.118 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T18:04:44.135 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T18:04:44.143 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T18:04:44.143 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T18:04:44.158 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T18:04:44.166 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T18:04:44.166 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T18:04:44.181 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T18:04:44.189 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T18:04:44.190 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T18:04:44.203 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T18:04:44.210 INFO:teuthology.orchestra.run.trial078.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5230-gafefaa40-1jammy [93.5 kB] 2026-02-13T18:04:44.211 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T18:04:44.212 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T18:04:44.226 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-portend. 2026-02-13T18:04:44.234 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-13T18:04:44.234 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T18:04:44.249 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T18:04:44.257 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T18:04:44.257 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T18:04:44.271 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T18:04:44.279 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T18:04:44.279 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T18:04:44.303 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T18:04:44.311 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T18:04:44.311 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T18:04:44.327 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T18:04:44.335 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:44.335 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.366 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T18:04:44.374 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.375 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.389 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T18:04:44.397 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.398 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.418 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T18:04:44.426 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.427 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.492 INFO:teuthology.orchestra.run.trial078.stdout:Fetched 701 MB in 23s (31.1 MB/s) 2026-02-13T18:04:44.492 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T18:04:44.501 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T18:04:44.501 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T18:04:44.508 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T18:04:44.516 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-13T18:04:44.524 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.524 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.663 INFO:teuthology.orchestra.run.trial078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T18:04:44.666 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T18:04:44.667 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T18:04:44.688 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T18:04:44.701 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T18:04:44.701 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T18:04:44.718 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T18:04:44.729 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T18:04:44.730 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T18:04:44.749 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T18:04:44.757 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T18:04:44.762 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:44.793 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T18:04:44.801 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T18:04:44.801 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:44.818 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T18:04:44.826 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T18:04:44.826 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:44.845 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T18:04:44.853 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T18:04:44.854 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T18:04:44.870 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package librados2. 2026-02-13T18:04:44.878 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../07-librados2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.878 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.919 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libnbd0. 2026-02-13T18:04:44.927 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T18:04:44.928 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T18:04:44.942 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package librbd1. 2026-02-13T18:04:44.950 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../09-librbd1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.950 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:44.987 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T18:04:44.996 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:44.996 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.016 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-rados. 2026-02-13T18:04:45.024 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.024 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.040 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T18:04:45.048 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:45.049 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.062 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T18:04:45.070 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.070 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.086 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T18:04:45.094 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:45.095 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.113 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T18:04:45.120 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T18:04:45.121 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T18:04:45.137 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T18:04:45.145 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T18:04:45.145 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T18:04:45.159 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T18:04:45.167 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.167 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.184 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T18:04:45.192 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T18:04:45.193 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T18:04:45.212 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package librgw2. 2026-02-13T18:04:45.219 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../19-librgw2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.220 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.316 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T18:04:45.324 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.324 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.340 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T18:04:45.348 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T18:04:45.348 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T18:04:45.363 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T18:04:45.371 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.371 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.388 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-common. 2026-02-13T18:04:45.396 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.396 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.657 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-base. 2026-02-13T18:04:45.665 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:45.669 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:45.727 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T18:04:45.735 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T18:04:45.735 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T18:04:45.750 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T18:04:45.758 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T18:04:45.758 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T18:04:45.776 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T18:04:45.784 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T18:04:45.784 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T18:04:45.799 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T18:04:45.807 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T18:04:45.807 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T18:04:45.822 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T18:04:45.830 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T18:04:45.830 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T18:04:45.844 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T18:04:45.852 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T18:04:45.852 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T18:04:45.867 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-portend. 2026-02-13T18:04:45.875 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-13T18:04:45.875 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T18:04:45.890 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T18:04:45.898 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T18:04:45.898 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T18:04:45.912 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T18:04:45.920 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T18:04:45.920 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T18:04:45.944 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T18:04:45.952 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T18:04:45.952 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T18:04:45.968 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T18:04:45.976 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:45.977 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:46.007 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T18:04:46.015 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:46.015 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:46.030 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T18:04:46.038 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:46.039 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:46.059 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T18:04:46.067 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:46.067 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:46.132 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T18:04:46.140 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T18:04:46.140 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T18:04:46.156 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-13T18:04:46.164 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:46.164 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.552 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T18:04:48.562 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:48.563 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.583 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph. 2026-02-13T18:04:48.595 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../42-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:48.595 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.611 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T18:04:48.624 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:48.624 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.648 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T18:04:48.659 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:48.659 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.689 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package cephadm. 2026-02-13T18:04:48.698 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../45-cephadm_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:48.698 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.714 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T18:04:48.722 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T18:04:48.723 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:48.744 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T18:04:48.752 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:48.752 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:48.773 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T18:04:48.781 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T18:04:48.782 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T18:04:48.797 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-routes. 2026-02-13T18:04:48.804 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T18:04:48.805 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T18:04:48.825 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T18:04:48.833 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:48.833 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:49.524 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T18:04:49.534 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T18:04:49.534 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T18:04:49.573 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T18:04:49.581 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T18:04:49.582 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T18:04:49.609 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T18:04:49.618 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T18:04:49.618 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T18:04:49.634 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T18:04:49.642 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T18:04:49.643 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T18:04:49.727 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T18:04:49.736 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:49.737 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:49.892 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T18:04:49.901 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T18:04:49.901 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T18:04:49.915 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T18:04:49.924 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-13T18:04:49.924 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T18:04:49.941 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T18:04:49.949 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T18:04:49.950 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T18:04:49.967 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T18:04:49.975 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T18:04:49.976 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T18:04:49.991 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T18:04:50.000 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T18:04:50.000 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T18:04:50.018 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T18:04:50.026 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T18:04:50.026 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T18:04:50.127 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T18:04:50.136 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:50.136 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.151 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T18:04:50.159 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T18:04:50.160 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T18:04:50.176 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T18:04:50.184 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T18:04:50.184 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:50.186 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T18:04:50.198 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:50.199 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.200 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package jq. 2026-02-13T18:04:50.208 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T18:04:50.208 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:50.219 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph. 2026-02-13T18:04:50.222 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package socat. 2026-02-13T18:04:50.230 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T18:04:50.231 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T18:04:50.231 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../42-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:50.232 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.247 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T18:04:50.250 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T18:04:50.259 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T18:04:50.260 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T18:04:50.260 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:50.260 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.286 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T18:04:50.296 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-test. 2026-02-13T18:04:50.297 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:50.298 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.305 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:50.305 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.330 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package cephadm. 2026-02-13T18:04:50.338 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../45-cephadm_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:50.339 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.355 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T18:04:50.363 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T18:04:50.364 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:50.385 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T18:04:50.393 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:50.394 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.414 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T18:04:50.422 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T18:04:50.423 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T18:04:50.438 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-routes. 2026-02-13T18:04:50.446 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T18:04:50.446 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T18:04:50.466 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T18:04:50.474 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:50.474 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.963 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T18:04:50.972 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:50.972 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:50.995 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T18:04:51.004 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:51.005 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.020 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T18:04:51.028 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:51.029 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.043 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T18:04:51.051 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:51.052 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.068 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T18:04:51.077 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T18:04:51.077 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T18:04:51.108 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T18:04:51.117 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T18:04:51.117 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:51.147 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T18:04:51.156 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T18:04:51.156 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T18:04:51.168 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T18:04:51.171 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T18:04:51.178 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T18:04:51.178 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T18:04:51.180 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T18:04:51.180 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T18:04:51.197 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T18:04:51.206 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T18:04:51.206 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T18:04:51.217 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T18:04:51.224 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-py. 2026-02-13T18:04:51.225 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T18:04:51.226 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T18:04:51.232 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-13T18:04:51.233 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T18:04:51.252 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T18:04:51.253 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T18:04:51.261 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T18:04:51.261 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T18:04:51.262 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T18:04:51.262 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T18:04:51.276 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T18:04:51.284 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T18:04:51.285 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T18:04:51.304 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-toml. 2026-02-13T18:04:51.313 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-13T18:04:51.313 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T18:04:51.328 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T18:04:51.336 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T18:04:51.337 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T18:04:51.359 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T18:04:51.367 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T18:04:51.367 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T18:04:51.368 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T18:04:51.377 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:51.377 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.392 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package python3-webob. 2026-02-13T18:04:51.400 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T18:04:51.400 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T18:04:51.417 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T18:04:51.425 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T18:04:51.426 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T18:04:51.492 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package radosgw. 2026-02-13T18:04:51.501 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../85-radosgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:51.501 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.530 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T18:04:51.539 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T18:04:51.539 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T18:04:51.554 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T18:04:51.562 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-13T18:04:51.563 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T18:04:51.581 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T18:04:51.589 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T18:04:51.590 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T18:04:51.606 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T18:04:51.615 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T18:04:51.615 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T18:04:51.631 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T18:04:51.639 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T18:04:51.640 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T18:04:51.657 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T18:04:51.662 INFO:teuthology.orchestra.run.trial187.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T18:04:51.665 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T18:04:51.665 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T18:04:51.671 INFO:teuthology.orchestra.run.trial187.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:51.671 INFO:teuthology.orchestra.run.trial187.stdout:Unpacking rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.700 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T18:04:51.758 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T18:04:51.767 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:51.767 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:51.767 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T18:04:51.768 INFO:teuthology.orchestra.run.trial187.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T18:04:51.781 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T18:04:51.789 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T18:04:51.789 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T18:04:51.805 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T18:04:51.813 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T18:04:51.814 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:51.828 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package jq. 2026-02-13T18:04:51.837 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T18:04:51.837 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:51.839 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T18:04:51.852 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package socat. 2026-02-13T18:04:51.860 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T18:04:51.860 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T18:04:51.879 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T18:04:51.887 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T18:04:51.888 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T18:04:51.922 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-test. 2026-02-13T18:04:51.931 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:51.931 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:52.123 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T18:04:52.532 INFO:teuthology.orchestra.run.trial187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T18:04:52.543 INFO:teuthology.orchestra.run.trial187.stdout:Setting up cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:52.589 INFO:teuthology.orchestra.run.trial187.stdout:Adding system user cephadm....done 2026-02-13T18:04:52.595 INFO:teuthology.orchestra.run.trial187.stdout:usermod: no changes 2026-02-13T18:04:52.596 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T18:04:52.601 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T18:04:52.605 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-13T18:04:52.606 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:52.628 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T18:04:52.637 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:52.637 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:52.652 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T18:04:52.660 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:52.661 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:52.674 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T18:04:52.675 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:52.676 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T18:04:52.683 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:52.683 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:52.699 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T18:04:52.708 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T18:04:52.708 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T18:04:52.741 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T18:04:52.748 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T18:04:52.749 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T18:04:52.749 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:52.779 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T18:04:52.788 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T18:04:52.788 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T18:04:52.802 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T18:04:52.810 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T18:04:52.811 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T18:04:52.822 INFO:teuthology.orchestra.run.trial187.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T18:04:52.823 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T18:04:52.826 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T18:04:52.835 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T18:04:52.835 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T18:04:52.853 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-py. 2026-02-13T18:04:52.861 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-13T18:04:52.862 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T18:04:52.882 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T18:04:52.891 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T18:04:52.891 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T18:04:52.919 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T18:04:52.932 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-toml. 2026-02-13T18:04:52.941 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-13T18:04:52.941 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T18:04:52.956 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T18:04:52.965 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T18:04:52.965 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T18:04:52.987 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T18:04:52.995 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T18:04:52.996 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T18:04:53.020 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package python3-webob. 2026-02-13T18:04:53.028 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T18:04:53.029 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T18:04:53.043 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T18:04:53.045 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T18:04:53.054 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T18:04:53.054 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T18:04:53.121 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T18:04:53.123 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package radosgw. 2026-02-13T18:04:53.132 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../85-radosgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:53.133 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:53.197 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:53.266 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T18:04:53.267 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T18:04:53.268 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T18:04:53.269 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T18:04:53.270 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T18:04:53.288 INFO:teuthology.orchestra.run.trial078.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T18:04:53.297 INFO:teuthology.orchestra.run.trial078.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-13T18:04:53.297 INFO:teuthology.orchestra.run.trial078.stdout:Unpacking rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:53.325 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T18:04:53.392 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T18:04:53.392 INFO:teuthology.orchestra.run.trial078.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T18:04:53.395 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T18:04:53.463 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T18:04:53.476 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:53.477 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T18:04:53.554 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T18:04:53.643 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T18:04:53.760 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T18:04:53.898 INFO:teuthology.orchestra.run.trial187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T18:04:53.899 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T18:04:53.994 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:54.122 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T18:04:54.146 INFO:teuthology.orchestra.run.trial078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T18:04:54.157 INFO:teuthology.orchestra.run.trial078.stdout:Setting up cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:54.202 INFO:teuthology.orchestra.run.trial078.stdout:Adding system user cephadm....done 2026-02-13T18:04:54.204 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T18:04:54.208 INFO:teuthology.orchestra.run.trial078.stdout:usermod: no changes 2026-02-13T18:04:54.214 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T18:04:54.276 INFO:teuthology.orchestra.run.trial187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T18:04:54.277 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:54.284 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:54.285 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T18:04:54.357 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T18:04:54.367 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T18:04:54.429 INFO:teuthology.orchestra.run.trial078.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T18:04:54.430 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T18:04:54.526 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T18:04:54.646 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T18:04:54.721 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T18:04:54.794 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:54.861 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T18:04:54.862 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T18:04:54.863 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T18:04:54.864 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T18:04:54.865 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T18:04:54.879 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:54.883 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T18:04:54.961 INFO:teuthology.orchestra.run.trial187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T18:04:54.962 INFO:teuthology.orchestra.run.trial187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T18:04:54.963 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T18:04:54.985 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T18:04:55.038 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T18:04:55.061 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:55.062 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T18:04:55.111 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:55.112 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T18:04:55.137 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T18:04:55.192 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T18:04:55.265 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T18:04:55.304 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T18:04:55.404 INFO:teuthology.orchestra.run.trial187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T18:04:55.405 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T18:04:55.488 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T18:04:55.489 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T18:04:55.549 INFO:teuthology.orchestra.run.trial078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T18:04:55.550 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T18:04:55.567 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T18:04:55.645 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T18:04:55.652 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T18:04:55.725 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:55.726 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T18:04:55.771 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T18:04:55.853 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T18:04:55.863 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T18:04:55.924 INFO:teuthology.orchestra.run.trial078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T18:04:55.925 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:55.939 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:55.940 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T18:04:56.014 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T18:04:56.027 INFO:teuthology.orchestra.run.trial187.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:56.028 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T18:04:56.163 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T18:04:56.164 INFO:teuthology.orchestra.run.trial187.stdout:Setting up librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.165 INFO:teuthology.orchestra.run.trial187.stdout:Setting up librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.166 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.167 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T18:04:56.507 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:56.512 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T18:04:56.589 INFO:teuthology.orchestra.run.trial078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T18:04:56.590 INFO:teuthology.orchestra.run.trial078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T18:04:56.591 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T18:04:56.666 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T18:04:56.702 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.703 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.704 INFO:teuthology.orchestra.run.trial187.stdout:Setting up librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.705 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.706 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:56.739 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:56.740 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T18:04:56.780 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T18:04:56.781 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T18:04:56.817 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T18:04:56.893 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T18:04:56.973 INFO:teuthology.orchestra.run.trial078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T18:04:56.974 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T18:04:57.055 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T18:04:57.056 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T18:04:57.131 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T18:04:57.200 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.201 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.202 INFO:teuthology.orchestra.run.trial187.stdout:Setting up libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.203 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.204 INFO:teuthology.orchestra.run.trial187.stdout:Setting up rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.205 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.206 INFO:teuthology.orchestra.run.trial187.stdout:Setting up python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.207 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.214 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T18:04:57.236 INFO:teuthology.orchestra.run.trial187.stdout:Adding group ceph....done 2026-02-13T18:04:57.270 INFO:teuthology.orchestra.run.trial187.stdout:Adding system user ceph....done 2026-02-13T18:04:57.280 INFO:teuthology.orchestra.run.trial187.stdout:Setting system user ceph properties....done 2026-02-13T18:04:57.287 INFO:teuthology.orchestra.run.trial187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T18:04:57.289 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:57.290 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T18:04:57.373 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T18:04:57.422 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T18:04:57.496 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T18:04:57.497 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T18:04:57.580 INFO:teuthology.orchestra.run.trial078.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T18:04:57.581 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T18:04:57.663 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T18:04:57.711 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T18:04:57.712 INFO:teuthology.orchestra.run.trial078.stdout:Setting up librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.713 INFO:teuthology.orchestra.run.trial078.stdout:Setting up librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.714 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:57.715 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T18:04:58.054 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.055 INFO:teuthology.orchestra.run.trial187.stdout:Setting up radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.224 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.225 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.226 INFO:teuthology.orchestra.run.trial078.stdout:Setting up librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.227 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.228 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.302 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T18:04:58.302 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T18:04:58.317 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T18:04:58.317 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T18:04:58.710 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.711 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.712 INFO:teuthology.orchestra.run.trial078.stdout:Setting up libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.713 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.714 INFO:teuthology.orchestra.run.trial078.stdout:Setting up rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.715 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.716 INFO:teuthology.orchestra.run.trial078.stdout:Setting up python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.716 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.733 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:58.744 INFO:teuthology.orchestra.run.trial078.stdout:Adding group ceph....done 2026-02-13T18:04:58.780 INFO:teuthology.orchestra.run.trial078.stdout:Adding system user ceph....done 2026-02-13T18:04:58.790 INFO:teuthology.orchestra.run.trial078.stdout:Setting system user ceph properties....done 2026-02-13T18:04:58.796 INFO:teuthology.orchestra.run.trial078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T18:04:58.854 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T18:04:58.887 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T18:04:59.144 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T18:04:59.239 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:59.302 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T18:04:59.302 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T18:04:59.547 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:59.548 INFO:teuthology.orchestra.run.trial078.stdout:Setting up radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:59.708 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:04:59.785 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T18:04:59.785 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T18:04:59.802 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T18:04:59.802 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T18:05:00.175 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.176 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.193 INFO:teuthology.orchestra.run.trial187.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-13T18:05:00.194 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.203 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.214 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.287 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T18:05:00.287 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T18:05:00.313 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T18:05:00.692 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.716 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.728 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.739 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:00.754 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T18:05:00.754 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T18:05:00.835 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T18:05:00.835 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T18:05:01.152 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.212 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T18:05:01.212 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T18:05:01.243 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.244 INFO:teuthology.orchestra.run.trial187.stdout:Setting up ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.353 INFO:teuthology.orchestra.run.trial187.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T18:05:01.436 INFO:teuthology.orchestra.run.trial187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T18:05:01.614 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.615 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.631 INFO:teuthology.orchestra.run.trial078.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-13T18:05:01.640 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.651 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:01.721 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T18:05:01.721 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T18:05:02.111 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout:Running kernel seems to be up-to-date. 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout:The processor microcode seems to be up-to-date. 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout:No services need to be restarted. 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout:No containers need to be restarted. 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout:No user sessions are running outdated binaries. 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:02.113 INFO:teuthology.orchestra.run.trial187.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T18:05:02.121 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:02.132 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:02.217 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T18:05:02.217 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T18:05:02.623 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:02.624 INFO:teuthology.orchestra.run.trial078.stdout:Setting up ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-13T18:05:02.732 INFO:teuthology.orchestra.run.trial078.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T18:05:02.753 INFO:teuthology.orchestra.run.trial078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T18:05:02.762 INFO:teuthology.orchestra.run.trial187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T18:05:02.768 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:03.167 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:03.167 INFO:teuthology.orchestra.run.trial078.stdout:Running kernel seems to be up-to-date. 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout:The processor microcode seems to be up-to-date. 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout:No services need to be restarted. 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout:No containers need to be restarted. 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout:No user sessions are running outdated binaries. 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:03.168 INFO:teuthology.orchestra.run.trial078.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T18:05:03.817 INFO:teuthology.orchestra.run.trial078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T18:05:03.824 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:03.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T18:05:03.990 DEBUG:teuthology.orchestra.run.trial078:> dpkg-query -W -f '${Version}' ceph 2026-02-13T18:05:04.001 INFO:teuthology.orchestra.run.trial078.stdout:20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:05:04.001 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:05:04.002 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230-gafefaa40-1jammy is installed. 2026-02-13T18:05:04.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T18:05:04.135 DEBUG:teuthology.orchestra.run.trial187:> dpkg-query -W -f '${Version}' ceph 2026-02-13T18:05:04.145 INFO:teuthology.orchestra.run.trial187.stdout:20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:05:04.145 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230-gafefaa40-1jammy 2026-02-13T18:05:04.145 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230-gafefaa40-1jammy is installed. 2026-02-13T18:05:04.147 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T18:05:04.148 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:04.148 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T18:05:04.158 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:04.158 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T18:05:04.194 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T18:05:04.194 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:04.194 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T18:05:04.207 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T18:05:04.255 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:04.255 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T18:05:04.263 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T18:05:04.313 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T18:05:04.314 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:04.314 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T18:05:04.323 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T18:05:04.370 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:04.370 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T18:05:04.379 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T18:05:04.429 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T18:05:04.429 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:04.429 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T18:05:04.439 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T18:05:04.486 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:04.486 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T18:05:04.496 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T18:05:04.546 INFO:teuthology.run_tasks:Running task ceph... 2026-02-13T18:05:04.663 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-13T18:05:04.664 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 777 /var/log/ceph 2026-02-13T18:05:04.665 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod 777 /var/log/ceph 2026-02-13T18:05:04.673 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-13T18:05:04.673 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T18:05:04.717 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T18:05:04.724 INFO:tasks.ceph:Creating extra log directories... 2026-02-13T18:05:04.724 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T18:05:04.765 DEBUG:teuthology.orchestra.run.trial187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T18:05:04.787 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-13T18:05:04.787 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-13T18:05:04.788 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683', 'branch': 'wip-yuri4-testing-2026-02-11-2126', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{low} onode-segment$/{none} write$/{v1/{compr$/{yes$/{zstd}} v1}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '49683', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 5319, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2026-02-11-2126', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'targets': {'trial078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJuB4twVUAIp9Qt0aLdyZ32ph4OUtYSLelMCOnnAO5TSQ2n0qsr8TsaxzETwpWyoEyeE8LPWjfI86uzJ5QyIA6I=', 'trial187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEofDSp228KXwZnriFHeOFaTAjv0QDAQfQMSWPMAdMCkburHy1nxhMed9lpWQfOzJ0DqU7dzAGUameI/97N40jE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1}}, {'rados': {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-13_16:37:03', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-13T18:05:04.788 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T18:05:04.813 DEBUG:teuthology.orchestra.run.trial187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T18:05:04.819 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T18:05:04.857 DEBUG:teuthology.orchestra.run.trial187:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T18:05:04.872 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:04.872 DEBUG:teuthology.orchestra.run.trial078:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T18:05:04.912 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T18:05:04.912 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_1 2026-02-13T18:05:04.959 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T18:05:04.959 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:04.960 INFO:teuthology.orchestra.run.trial078.stdout:Device: 5h/5d Inode: 895 Links: 1 2026-02-13T18:05:04.960 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:04.960 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 18:03:58.448969590 +0000 2026-02-13T18:05:04.960 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 18:03:58.308974049 +0000 2026-02-13T18:05:04.960 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 18:03:58.308974049 +0000 2026-02-13T18:05:04.960 INFO:teuthology.orchestra.run.trial078.stdout: Birth: - 2026-02-13T18:05:04.960 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T18:05:05.010 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T18:05:05.011 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T18:05:05.011 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000173298 s, 3.0 MB/s 2026-02-13T18:05:05.012 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T18:05:05.065 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_2 2026-02-13T18:05:05.111 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T18:05:05.111 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.111 INFO:teuthology.orchestra.run.trial078.stdout:Device: 5h/5d Inode: 920 Links: 1 2026-02-13T18:05:05.111 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.111 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 18:03:58.808958119 +0000 2026-02-13T18:05:05.112 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 18:03:58.620964107 +0000 2026-02-13T18:05:05.112 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 18:03:58.620964107 +0000 2026-02-13T18:05:05.112 INFO:teuthology.orchestra.run.trial078.stdout: Birth: - 2026-02-13T18:05:05.112 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T18:05:05.158 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T18:05:05.158 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T18:05:05.158 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000166436 s, 3.1 MB/s 2026-02-13T18:05:05.160 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T18:05:05.208 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_3 2026-02-13T18:05:05.255 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T18:05:05.255 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.255 INFO:teuthology.orchestra.run.trial078.stdout:Device: 5h/5d Inode: 944 Links: 1 2026-02-13T18:05:05.256 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.256 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 18:03:59.164946773 +0000 2026-02-13T18:05:05.256 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 18:03:58.980952636 +0000 2026-02-13T18:05:05.256 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 18:03:58.980952636 +0000 2026-02-13T18:05:05.256 INFO:teuthology.orchestra.run.trial078.stdout: Birth: - 2026-02-13T18:05:05.256 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T18:05:05.302 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T18:05:05.302 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T18:05:05.303 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000164963 s, 3.1 MB/s 2026-02-13T18:05:05.304 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T18:05:05.353 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_4 2026-02-13T18:05:05.399 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T18:05:05.399 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.400 INFO:teuthology.orchestra.run.trial078.stdout:Device: 5h/5d Inode: 969 Links: 1 2026-02-13T18:05:05.400 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.400 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 18:03:59.328941547 +0000 2026-02-13T18:05:05.400 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 18:03:59.324941677 +0000 2026-02-13T18:05:05.400 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 18:03:59.324941677 +0000 2026-02-13T18:05:05.400 INFO:teuthology.orchestra.run.trial078.stdout: Birth: - 2026-02-13T18:05:05.400 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T18:05:05.451 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T18:05:05.452 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T18:05:05.452 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000172898 s, 3.0 MB/s 2026-02-13T18:05:05.453 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T18:05:05.501 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:05.501 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:05.501 DEBUG:teuthology.orchestra.run.trial187:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T18:05:05.507 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T18:05:05.507 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_1 2026-02-13T18:05:05.554 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout:Device: 5h/5d Inode: 900 Links: 1 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 18:03:59.149273437 +0000 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 18:03:58.961279433 +0000 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 18:03:58.961279433 +0000 2026-02-13T18:05:05.555 INFO:teuthology.orchestra.run.trial187.stdout: Birth: - 2026-02-13T18:05:05.556 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T18:05:05.605 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T18:05:05.606 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T18:05:05.606 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000170113 s, 3.0 MB/s 2026-02-13T18:05:05.607 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T18:05:05.655 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_2 2026-02-13T18:05:05.701 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout:Device: 5h/5d Inode: 936 Links: 1 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 18:03:59.309268332 +0000 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 18:03:59.305268461 +0000 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 18:03:59.305268461 +0000 2026-02-13T18:05:05.702 INFO:teuthology.orchestra.run.trial187.stdout: Birth: - 2026-02-13T18:05:05.702 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T18:05:05.749 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T18:05:05.749 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T18:05:05.749 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000165914 s, 3.1 MB/s 2026-02-13T18:05:05.750 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T18:05:05.796 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_3 2026-02-13T18:05:05.842 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T18:05:05.842 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.842 INFO:teuthology.orchestra.run.trial187.stdout:Device: 5h/5d Inode: 947 Links: 1 2026-02-13T18:05:05.842 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.843 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 18:03:59.769253659 +0000 2026-02-13T18:05:05.843 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 18:03:59.609258764 +0000 2026-02-13T18:05:05.843 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 18:03:59.609258764 +0000 2026-02-13T18:05:05.843 INFO:teuthology.orchestra.run.trial187.stdout: Birth: - 2026-02-13T18:05:05.843 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T18:05:05.889 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T18:05:05.889 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T18:05:05.890 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000167348 s, 3.1 MB/s 2026-02-13T18:05:05.891 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T18:05:05.940 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_4 2026-02-13T18:05:05.986 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T18:05:05.986 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T18:05:05.987 INFO:teuthology.orchestra.run.trial187.stdout:Device: 5h/5d Inode: 972 Links: 1 2026-02-13T18:05:05.987 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T18:05:05.987 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 18:04:00.133242049 +0000 2026-02-13T18:05:05.987 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 18:03:59.925248682 +0000 2026-02-13T18:05:05.987 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 18:03:59.925248682 +0000 2026-02-13T18:05:05.987 INFO:teuthology.orchestra.run.trial187.stdout: Birth: - 2026-02-13T18:05:05.987 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T18:05:06.033 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T18:05:06.033 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T18:05:06.034 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000172607 s, 3.0 MB/s 2026-02-13T18:05:06.035 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T18:05:06.084 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:06.084 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial187.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-13T18:05:06.084 INFO:tasks.ceph:Generating config... 2026-02-13T18:05:06.086 INFO:tasks.ceph:[client] debug monc = 20 2026-02-13T18:05:06.086 INFO:tasks.ceph:[client] debug ms = 1 2026-02-13T18:05:06.086 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-13T18:05:06.086 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-13T18:05:06.086 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-13T18:05:06.086 INFO:tasks.ceph:[global] ms inject delay max = 1 2026-02-13T18:05:06.087 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2026-02-13T18:05:06.087 INFO:tasks.ceph:[global] ms inject delay type = mon 2026-02-13T18:05:06.087 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2026-02-13T18:05:06.087 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2026-02-13T18:05:06.087 INFO:tasks.ceph:[global] ms type = async 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] debug ms = 20 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-13T18:05:06.087 INFO:tasks.ceph:[mon] paxos min = 10 2026-02-13T18:05:06.088 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-13T18:05:06.088 INFO:tasks.ceph:[mon] paxos trim min = 10 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore allocator = avl 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore write v2 = False 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-13T18:05:06.088 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd op num shards = 1 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd op num threads per shard = 2 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-13T18:05:06.089 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-13T18:05:06.089 INFO:tasks.ceph:Setting up mon.a... 2026-02-13T18:05:06.090 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-13T18:05:06.107 INFO:teuthology.orchestra.run.trial078.stdout:creating /etc/ceph/ceph.keyring 2026-02-13T18:05:06.110 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-13T18:05:06.170 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T18:05:06.218 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.78:6789]'), ('mon.c', '[v1:10.20.193.78:6790]'), ('mon.b', '[v1:10.20.193.187:6789]')] 2026-02-13T18:05:06.219 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.78:6789],[v1:10.20.193.78:6790],[v1:10.20.193.187:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 20, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-13T18:05:06.221 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:06.221 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T18:05:06.263 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.78:6789]' --addv c '[v1:10.20.193.78:6790]' --addv b '[v1:10.20.193.187:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: generated fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:setting min_mon_release = tentacle 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:epoch 0 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:min_mon_release 20 (tentacle) 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:election_strategy: 3 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:06.322 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-13T18:05:06.323 DEBUG:teuthology.orchestra.run.trial078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T18:05:06.367 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 54a6df06-e4af-4200-a7a8-eae08bdbf188... 2026-02-13T18:05:06.368 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T18:05:06.409 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T18:05:06.426 INFO:teuthology.orchestra.run.trial078.stdout:[global] 2026-02-13T18:05:06.426 INFO:teuthology.orchestra.run.trial078.stdout: chdir = "" 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: auth supported = cephx 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: filestore xattr use omap = true 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon clock drift allowed = 1.000 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: osd crush chooseleaf type = 0 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: auth debug = true 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: ms die on old message = true 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: ms die on bug = true 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon pg warn max object skew = 0 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default size = 2 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon osd allow primary affinity = true 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon osd allow pg remap = true 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on legacy crush tunables = false 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on crush straw calc version zero = false 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on no sortbitwise = false 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on osd down out interval zero = false 2026-02-13T18:05:06.427 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on too few osds = false 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon_allow_pool_size_one = true 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: osd default data pool replay window = 5 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon allow pool delete = true 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon cluster log file level = debug 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: debug asserts on shutdown = true 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon health detail to clog = false 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon host = "[v1:10.20.193.78:6789],[v1:10.20.193.78:6790],[v1:10.20.193.187:6789]" 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon client directed command retry = 5 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: mon election default strategy = 3 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms bind msgr2 = False 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms inject delay max = 1 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms inject delay probability = 0.005 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms inject delay type = mon 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms inject internal delays = 0.002 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms inject socket failures = 2500 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: ms type = async 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: fsid = 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout:[osd] 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: osd journal size = 100 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: osd scrub load threshold = 5.0 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: osd scrub max interval = 600 2026-02-13T18:05:06.428 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock profile = high_recovery_ops 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock skip benchmark = True 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd recover clone overlap = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd recovery max chunk = 1048576 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd debug shutdown = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd debug op order = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify stray on activate = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd debug trim objects = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd open classes on start = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd debug pg log writeout = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd deep scrub update digest min age = 30 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd map max advance = 10 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: journal zero on create = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: filestore ondisk finisher threads = 3 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: filestore apply finisher threads = 3 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bdev debug aio = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: osd debug misdirected ops = true 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bdev async discard = True 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bdev enable discard = True 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bluestore allocator = avl 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bluestore block size = 96636764160 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bluestore compression algorithm = zstd 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bluestore compression mode = aggressive 2026-02-13T18:05:06.429 INFO:teuthology.orchestra.run.trial078.stdout: bluestore fsck on mount = True 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: bluestore onode segment size = 0 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: bluestore write v2 = False 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: bluestore zero block detection = True 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug bluefs = 20 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug bluestore = 20 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug osd = 20 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug rocksdb = 10 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: mon osd full ratio = 0.9 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: mon osd nearfull ratio = 0.8 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify cached snaps = True 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify missing on start = True 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd failsafe full ratio = 0.95 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock override recovery settings = True 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd memory target = 1610612736 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd objectstore = bluestore 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd op num shards = 1 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd op num threads per shard = 2 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd op queue = debug_random 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: osd op queue cut off = debug_random 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout:[mgr] 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug mgr = 20 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug mon = 20 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug auth = 20 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min pgs per osd = 4 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min bytes per osd = 10 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: mgr/telemetry/nag = false 2026-02-13T18:05:06.430 INFO:teuthology.orchestra.run.trial078.stdout: debug monc = 10 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout:[mon] 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 20 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: debug mon = 30 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: debug paxos = 20 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: debug auth = 20 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon data avail warn = 5 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon mgr mkfs grace = 240 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min pgs per osd = 4 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon osd reporter subtree level = osd 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon osd prime pg temp = true 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min bytes per osd = 10 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: # 1m isn't quite enough 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon_down_mkfs_grace = 2m 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_filestore_osds = false 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon min osdmap epochs = 25 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon osdmap full prune interval = 2 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon osdmap full prune min = 15 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon osdmap full prune txsize = 2 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon scrub inject crc mismatch = 0.01 2026-02-13T18:05:06.431 INFO:teuthology.orchestra.run.trial078.stdout: mon scrub inject missing keys = 0.05 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: mon scrub interval = 300 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: paxos min = 10 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: paxos service trim min = 5 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: paxos trim min = 10 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout:[client] 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: rgw cache enabled = true 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: rgw enable ops log = true 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: rgw enable usage log = true 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: debug monc = 20 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout:[mon.a] 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout:[mon.c] 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial078.stdout:[mon.b] 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout:[global] 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: chdir = "" 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: auth supported = cephx 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: filestore xattr use omap = true 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.432 INFO:teuthology.orchestra.run.trial187.stdout: mon clock drift allowed = 1.000 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: osd crush chooseleaf type = 0 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: auth debug = true 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: ms die on old message = true 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: ms die on bug = true 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon pg warn max object skew = 0 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: osd pool default size = 2 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon osd allow primary affinity = true 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon osd allow pg remap = true 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon warn on legacy crush tunables = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon warn on crush straw calc version zero = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon warn on no sortbitwise = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon warn on osd down out interval zero = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon warn on too few osds = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: mon_allow_pool_size_one = true 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: osd default data pool replay window = 5 2026-02-13T18:05:06.433 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: mon allow pool delete = true 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: mon cluster log file level = debug 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: debug asserts on shutdown = true 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: mon health detail to clog = false 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: mon host = "[v1:10.20.193.78:6789],[v1:10.20.193.78:6790],[v1:10.20.193.187:6789]" 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: mon client directed command retry = 5 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: mon election default strategy = 3 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms bind msgr2 = False 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms inject delay max = 1 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms inject delay probability = 0.005 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms inject delay type = mon 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms inject internal delays = 0.002 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms inject socket failures = 2500 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: ms type = async 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: fsid = 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout:[osd] 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd journal size = 100 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd scrub load threshold = 5.0 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd scrub max interval = 600 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd mclock profile = high_recovery_ops 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd mclock skip benchmark = True 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd recover clone overlap = true 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd recovery max chunk = 1048576 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd debug shutdown = true 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd debug op order = true 2026-02-13T18:05:06.434 INFO:teuthology.orchestra.run.trial187.stdout: osd debug verify stray on activate = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: osd debug trim objects = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: osd open classes on start = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: osd debug pg log writeout = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: osd deep scrub update digest min age = 30 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: osd map max advance = 10 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: journal zero on create = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: filestore ondisk finisher threads = 3 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: filestore apply finisher threads = 3 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bdev debug aio = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: osd debug misdirected ops = true 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bdev async discard = True 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bdev enable discard = True 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore allocator = avl 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore block size = 96636764160 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore compression algorithm = zstd 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore compression mode = aggressive 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore fsck on mount = True 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore onode segment size = 0 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore write v2 = False 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: bluestore zero block detection = True 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: debug bluefs = 20 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: debug bluestore = 20 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: debug ms = 1 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: debug osd = 20 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: debug rocksdb = 10 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T18:05:06.435 INFO:teuthology.orchestra.run.trial187.stdout: mon osd full ratio = 0.9 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon osd nearfull ratio = 0.8 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd debug verify cached snaps = True 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd debug verify missing on start = True 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd failsafe full ratio = 0.95 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd mclock override recovery settings = True 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd memory target = 1610612736 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd objectstore = bluestore 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd op num shards = 1 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd op num threads per shard = 2 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd op queue = debug_random 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: osd op queue cut off = debug_random 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout:[mgr] 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug ms = 1 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug mgr = 20 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug mon = 20 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug auth = 20 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon reweight min pgs per osd = 4 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon reweight min bytes per osd = 10 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mgr/telemetry/nag = false 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug monc = 10 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout:[mon] 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug ms = 20 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug mon = 30 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug paxos = 20 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: debug auth = 20 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon data avail warn = 5 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon mgr mkfs grace = 240 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon reweight min pgs per osd = 4 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon osd reporter subtree level = osd 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon osd prime pg temp = true 2026-02-13T18:05:06.436 INFO:teuthology.orchestra.run.trial187.stdout: mon reweight min bytes per osd = 10 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: # 1m isn't quite enough 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon_down_mkfs_grace = 2m 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon_warn_on_filestore_osds = false 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon min osdmap epochs = 25 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon osdmap full prune interval = 2 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon osdmap full prune min = 15 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon osdmap full prune txsize = 2 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon scrub inject crc mismatch = 0.01 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon scrub inject missing keys = 0.05 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: mon scrub interval = 300 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: paxos min = 10 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: paxos service trim min = 5 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: paxos trim min = 10 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout:[client] 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: rgw cache enabled = true 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: rgw enable ops log = true 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: rgw enable usage log = true 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: debug monc = 20 2026-02-13T18:05:06.437 INFO:teuthology.orchestra.run.trial187.stdout: debug ms = 1 2026-02-13T18:05:06.438 INFO:teuthology.orchestra.run.trial187.stdout:[mon.a] 2026-02-13T18:05:06.438 INFO:teuthology.orchestra.run.trial187.stdout:[mon.c] 2026-02-13T18:05:06.438 INFO:teuthology.orchestra.run.trial187.stdout:[mon.b] 2026-02-13T18:05:06.438 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-13T18:05:06.439 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-13T18:05:06.501 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-13T18:05:06.502 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:06.502 DEBUG:teuthology.orchestra.run.trial078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-13T18:05:06.547 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:06.547 DEBUG:teuthology.orchestra.run.trial078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-13T18:05:06.590 INFO:tasks.ceph:Sending monmap to node ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:05:06.591 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:06.591 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T18:05:06.591 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T18:05:06.645 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:06.645 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:06.691 INFO:tasks.ceph:Sending monmap to node ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:05:06.692 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:06.692 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T18:05:06.692 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T18:05:06.707 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:06.707 DEBUG:teuthology.orchestra.run.trial187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:06.754 INFO:tasks.ceph:Setting up mon nodes... 2026-02-13T18:05:06.754 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-13T18:05:06.754 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T18:05:06.823 INFO:teuthology.orchestra.run.trial187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T18:05:06.827 INFO:tasks.ceph:Setting up mds nodes... 2026-02-13T18:05:06.827 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-13T18:05:06.827 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T18:05:06.893 INFO:teuthology.orchestra.run.trial187.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-13T18:05:06.900 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-13T18:05:06.900 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial187.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-13T18:05:06.901 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-13T18:05:06.911 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:06.911 INFO:tasks.ceph:role: osd.0 2026-02-13T18:05:06.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:05:06.911 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T18:05:06.960 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T18:05:06.961 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T18:05:07.539 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-13T18:05:07.541 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-13T18:05:07.541 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-13T18:05:07.597 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-13T18:05:07.645 INFO:teuthology.orchestra.run.trial078.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T18:05:07.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:05:07.648 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-13T18:05:07.699 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:07.699 INFO:tasks.ceph:role: osd.1 2026-02-13T18:05:07.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:05:07.699 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T18:05:07.749 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T18:05:08.313 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-13T18:05:08.314 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-13T18:05:08.314 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-13T18:05:08.368 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-13T18:05:08.417 INFO:teuthology.orchestra.run.trial078.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T18:05:08.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:05:08.417 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-13T18:05:08.467 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:08.467 INFO:tasks.ceph:role: osd.2 2026-02-13T18:05:08.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:05:08.467 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T18:05:08.517 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T18:05:09.080 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-13T18:05:09.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-13T18:05:09.081 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-13T18:05:09.140 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-13T18:05:09.188 INFO:teuthology.orchestra.run.trial078.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T18:05:09.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:05:09.189 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:09.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:09.248+0000 7fd64991da40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-13T18:05:09.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:09.248+0000 7fd64991da40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-13T18:05:09.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:09.248+0000 7fd64991da40 -1 bdev(0x55f7ef11d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-13T18:05:09.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:09.248+0000 7fd64991da40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-13T18:05:10.141 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-13T18:05:10.192 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:10.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:10.252+0000 7fd11c4a7a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-13T18:05:10.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:10.252+0000 7fd11c4a7a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-13T18:05:10.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:10.252+0000 7fd11c4a7a40 -1 bdev(0x55b51c94d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-13T18:05:10.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:10.252+0000 7fd11c4a7a40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-13T18:05:11.033 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-13T18:05:11.084 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:11.144+0000 7f4d047b8a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-13T18:05:11.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:11.144+0000 7f4d047b8a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-13T18:05:11.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:11.144+0000 7f4d047b8a40 -1 bdev(0x55c84fd19800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-13T18:05:11.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:11.144+0000 7f4d047b8a40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-13T18:05:12.039 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-13T18:05:12.088 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-13T18:05:12.098 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:12.098 INFO:tasks.ceph:role: osd.3 2026-02-13T18:05:12.098 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:05:12.099 DEBUG:teuthology.orchestra.run.trial187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T18:05:12.148 INFO:teuthology.orchestra.run.trial187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T18:05:12.148 INFO:teuthology.orchestra.run.trial187.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T18:05:12.148 INFO:teuthology.orchestra.run.trial187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T18:05:12.148 INFO:teuthology.orchestra.run.trial187.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T18:05:12.148 INFO:teuthology.orchestra.run.trial187.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T18:05:12.149 INFO:teuthology.orchestra.run.trial187.stdout: = sunit=0 swidth=0 blks 2026-02-13T18:05:12.149 INFO:teuthology.orchestra.run.trial187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T18:05:12.149 INFO:teuthology.orchestra.run.trial187.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T18:05:12.149 INFO:teuthology.orchestra.run.trial187.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T18:05:12.149 INFO:teuthology.orchestra.run.trial187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T18:05:12.726 INFO:teuthology.orchestra.run.trial187.stdout:Discarding blocks...Done. 2026-02-13T18:05:12.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial187.front.sepia.ceph.com -o noatime 2026-02-13T18:05:12.728 DEBUG:teuthology.orchestra.run.trial187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-13T18:05:12.788 DEBUG:teuthology.orchestra.run.trial187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-13T18:05:12.836 INFO:teuthology.orchestra.run.trial187.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T18:05:12.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:05:12.837 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-13T18:05:12.887 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:12.887 INFO:tasks.ceph:role: osd.4 2026-02-13T18:05:12.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:05:12.887 DEBUG:teuthology.orchestra.run.trial187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T18:05:12.941 INFO:teuthology.orchestra.run.trial187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T18:05:12.941 INFO:teuthology.orchestra.run.trial187.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T18:05:12.941 INFO:teuthology.orchestra.run.trial187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T18:05:12.941 INFO:teuthology.orchestra.run.trial187.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T18:05:12.941 INFO:teuthology.orchestra.run.trial187.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T18:05:12.942 INFO:teuthology.orchestra.run.trial187.stdout: = sunit=0 swidth=0 blks 2026-02-13T18:05:12.942 INFO:teuthology.orchestra.run.trial187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T18:05:12.942 INFO:teuthology.orchestra.run.trial187.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T18:05:12.942 INFO:teuthology.orchestra.run.trial187.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T18:05:12.942 INFO:teuthology.orchestra.run.trial187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T18:05:13.505 INFO:teuthology.orchestra.run.trial187.stdout:Discarding blocks...Done. 2026-02-13T18:05:13.507 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial187.front.sepia.ceph.com -o noatime 2026-02-13T18:05:13.507 DEBUG:teuthology.orchestra.run.trial187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-13T18:05:13.560 DEBUG:teuthology.orchestra.run.trial187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-13T18:05:13.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:05:13.609 INFO:teuthology.orchestra.run.trial187.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T18:05:13.610 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-13T18:05:13.659 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T18:05:13.659 INFO:tasks.ceph:role: osd.5 2026-02-13T18:05:13.659 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:05:13.659 DEBUG:teuthology.orchestra.run.trial187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T18:05:13.712 INFO:teuthology.orchestra.run.trial187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T18:05:13.712 INFO:teuthology.orchestra.run.trial187.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T18:05:13.712 INFO:teuthology.orchestra.run.trial187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T18:05:13.712 INFO:teuthology.orchestra.run.trial187.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T18:05:13.713 INFO:teuthology.orchestra.run.trial187.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T18:05:13.713 INFO:teuthology.orchestra.run.trial187.stdout: = sunit=0 swidth=0 blks 2026-02-13T18:05:13.713 INFO:teuthology.orchestra.run.trial187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T18:05:13.713 INFO:teuthology.orchestra.run.trial187.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T18:05:13.713 INFO:teuthology.orchestra.run.trial187.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T18:05:13.713 INFO:teuthology.orchestra.run.trial187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T18:05:14.273 INFO:teuthology.orchestra.run.trial187.stdout:Discarding blocks...Done. 2026-02-13T18:05:14.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial187.front.sepia.ceph.com -o noatime 2026-02-13T18:05:14.275 DEBUG:teuthology.orchestra.run.trial187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-13T18:05:14.332 DEBUG:teuthology.orchestra.run.trial187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-13T18:05:14.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:05:14.381 INFO:teuthology.orchestra.run.trial187.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T18:05:14.381 DEBUG:teuthology.orchestra.run.trial187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:14.444 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:14.439+0000 7f5baef59a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-13T18:05:14.445 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:14.439+0000 7f5baef59a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-13T18:05:14.445 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:14.439+0000 7f5baef59a40 -1 bdev(0x55c4ef8f9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-13T18:05:14.445 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:14.439+0000 7f5baef59a40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-13T18:05:15.297 DEBUG:teuthology.orchestra.run.trial187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-13T18:05:15.348 DEBUG:teuthology.orchestra.run.trial187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:15.411 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:15.407+0000 7f79f2b16a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-13T18:05:15.412 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:15.407+0000 7f79f2b16a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-13T18:05:15.412 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:15.407+0000 7f79f2b16a40 -1 bdev(0x55d23bca5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-13T18:05:15.412 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:15.407+0000 7f79f2b16a40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-13T18:05:16.195 DEBUG:teuthology.orchestra.run.trial187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-13T18:05:16.247 DEBUG:teuthology.orchestra.run.trial187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:16.311 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:16.307+0000 7f1f018bba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-13T18:05:16.312 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:16.307+0000 7f1f018bba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-13T18:05:16.312 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:16.307+0000 7f1f018bba40 -1 bdev(0x55e7e0f6d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-13T18:05:16.312 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:16.307+0000 7f1f018bba40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-13T18:05:17.117 DEBUG:teuthology.orchestra.run.trial187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-13T18:05:17.168 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-13T18:05:17.168 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:17.168 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-13T18:05:17.180 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:17.180 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-13T18:05:17.233 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:17.233 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-13T18:05:17.289 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:17.289 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-13T18:05:17.299 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:17.300 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-13T18:05:17.352 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:17.352 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-13T18:05:17.404 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:17.404 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-13T18:05:17.456 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:17.456 DEBUG:teuthology.orchestra.run.trial187:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-13T18:05:17.503 INFO:tasks.ceph:Adding keys to all mons... 2026-02-13T18:05:17.503 DEBUG:teuthology.orchestra.run.trial078:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T18:05:17.505 DEBUG:teuthology.orchestra.run.trial187:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T18:05:17.549 INFO:teuthology.orchestra.run.trial078.stdout:[osd.0] 2026-02-13T18:05:17.549 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDVZ49px7n3DhAA5YpFRIhjHVsM0QV9+U61Xw== 2026-02-13T18:05:17.549 INFO:teuthology.orchestra.run.trial078.stdout:[osd.1] 2026-02-13T18:05:17.549 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDWZ49pWcYoDxAA1M7LuHam8/3prUHTjRQSJQ== 2026-02-13T18:05:17.549 INFO:teuthology.orchestra.run.trial078.stdout:[osd.2] 2026-02-13T18:05:17.549 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDXZ49pwoK/CBAA0H5bwHpz3mzPlVXcMHEnNg== 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout:[mgr.x] 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDSZ49pIKAPMRAAGMofVzO9M55KgCz4hbbaIA== 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout:[osd.3] 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDaZ49p+qlzGhAA8M2tsXvU5HZ+PTooXAng1A== 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout:[osd.4] 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDbZ49prVx9GBAAOBeTbDH5ameNw8pjVO1f/A== 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout:[osd.5] 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDcZ49psfaGEhAAFLEAqpzdd39IdmouBsq8Zw== 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout:[client.0] 2026-02-13T18:05:17.550 INFO:teuthology.orchestra.run.trial078.stdout: key = AQDSZ49pzj82NRAAiHQqdP7yNmQOB0AYxwaYRA== 2026-02-13T18:05:17.554 INFO:teuthology.orchestra.run.trial187.stdout:[osd.0] 2026-02-13T18:05:17.554 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDVZ49px7n3DhAA5YpFRIhjHVsM0QV9+U61Xw== 2026-02-13T18:05:17.554 INFO:teuthology.orchestra.run.trial187.stdout:[osd.1] 2026-02-13T18:05:17.554 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDWZ49pWcYoDxAA1M7LuHam8/3prUHTjRQSJQ== 2026-02-13T18:05:17.554 INFO:teuthology.orchestra.run.trial187.stdout:[osd.2] 2026-02-13T18:05:17.554 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDXZ49pwoK/CBAA0H5bwHpz3mzPlVXcMHEnNg== 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout:[mgr.x] 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDSZ49pIKAPMRAAGMofVzO9M55KgCz4hbbaIA== 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout:[osd.3] 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDaZ49p+qlzGhAA8M2tsXvU5HZ+PTooXAng1A== 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout:[osd.4] 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDbZ49prVx9GBAAOBeTbDH5ameNw8pjVO1f/A== 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout:[osd.5] 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDcZ49psfaGEhAAFLEAqpzdd39IdmouBsq8Zw== 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout:[client.0] 2026-02-13T18:05:17.555 INFO:teuthology.orchestra.run.trial187.stdout: key = AQDSZ49pzj82NRAAiHQqdP7yNmQOB0AYxwaYRA== 2026-02-13T18:05:17.557 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.593 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.621 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.657 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.683 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.721 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.747 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T18:05:17.785 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T18:05:17.812 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.848 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.874 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.908 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.938 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.968 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T18:05:17.998 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T18:05:18.036 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T18:05:18.059 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-13T18:05:18.059 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-13T18:05:18.107 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T18:05:18.174 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-13T18:05:18.223 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-13T18:05:18.271 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T18:05:18.343 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-13T18:05:18.391 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-13T18:05:18.400 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T18:05:18.469 DEBUG:teuthology.orchestra.run.trial187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-13T18:05:18.519 DEBUG:teuthology.orchestra.run.trial078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:18.521 DEBUG:teuthology.orchestra.run.trial187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T18:05:18.562 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-13T18:05:18.563 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T18:05:18.563 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T18:05:18.565 INFO:tasks.ceph.mon.a:Started 2026-02-13T18:05:18.565 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T18:05:18.566 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T18:05:18.568 INFO:tasks.ceph.mon.c:Started 2026-02-13T18:05:18.568 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T18:05:18.568 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T18:05:18.604 INFO:tasks.ceph.mon.b:Started 2026-02-13T18:05:18.605 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-13T18:05:18.605 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-13T18:05:18.605 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-13T18:05:18.607 INFO:tasks.ceph.mgr.x:Started 2026-02-13T18:05:18.607 DEBUG:tasks.ceph:set 0 configs 2026-02-13T18:05:18.607 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph config dump 2026-02-13T18:05:18.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient: get_monmap_and_config 2026-02-13T18:05:18.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient: build_initial_monmap 2026-02-13T18:05:18.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient: monmap: 2026-02-13T18:05:18.663 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:18.663 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:18.663 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:18.660351+0000 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:18.660351+0000 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:18.664 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:18.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 1 Processor -- start 2026-02-13T18:05:18.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 1 -- start start 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient: init 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient(hunting): picked mon.noname-a con 0x7f3e9408e920 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient(hunting): picked mon.noname-b con 0x7f3e9408d7b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient(hunting): picked mon.noname-c con 0x7f3e94184cb0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9405d030 con 0x7f3e9408e920 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9405d730 con 0x7f3e94184cb0 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9405e0d0 con 0x7f3e9408d7b0 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9be2a640 10 monclient(hunting): authenticate will time out at 549.715532s 2026-02-13T18:05:18.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e99b9f640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3e9408e920 0x7f3e9408ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53476/0 (socket says 10.20.193.78:53476) 2026-02-13T18:05:18.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e9939e640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f3e9408d7b0 0x7f3e9408f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:51372/0 (socket says 10.20.193.78:51372) 2026-02-13T18:05:18.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.656+0000 7f3e99b9f640 1 -- 10.20.193.78:0/2300224900 learned_addr learned my addr 10.20.193.78:0/2300224900 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:18.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.660+0000 7f3e9939e640 1 -- 10.20.193.78:0/2300224900 >> v1:10.20.193.78:6790/0 conn(0x7f3e9408d7b0 legacy=0x7f3e9408f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:18.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.660+0000 7f3e99b9f640 1 -- 10.20.193.78:0/2300224900 >> v1:10.20.193.78:6789/0 conn(0x7f3e9408e920 legacy=0x7f3e9408ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:18.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:18.660+0000 7f3e9a3a0640 1 -- 10.20.193.78:0/2300224900 >> v1:10.20.193.187:6789/0 conn(0x7f3e94184cb0 legacy=0x7f3e941a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965249462 0 0) 0x7f3e9405d030 con 0x7f3e9408e920 2026-02-13T18:05:19.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): my global_id is 4098 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e7c003620 con 0x7f3e9408e920 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962962091 0 0) 0x7f3e9405d730 con 0x7f3e94184cb0 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): my global_id is 4102 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e9405d030 con 0x7f3e94184cb0 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467469945 0 0) 0x7f3e9405e0d0 con 0x7f3e9408d7b0 2026-02-13T18:05:19.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient(hunting): my global_id is 4103 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e9405d730 con 0x7f3e9408d7b0 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2822558110 0 0) 0x7f3e7c003620 con 0x7f3e9408e920 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 >> v1:10.20.193.78:6790/0 conn(0x7f3e9408d7b0 legacy=0x7f3e9408f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 >> v1:10.20.193.187:6789/0 conn(0x7f3e94184cb0 legacy=0x7f3e941a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: _finish_hunting 0 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 monclient: found mon.noname-a 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9408cdd0 con 0x7f3e9408e920 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: _finish_auth 0 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: _check_auth_tickets 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e84003110 con 0x7f3e9408e920 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: dump: 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.603 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 5 monclient: authenticate success, global_id 4098 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e840033e0 con 0x7f3e9408e920 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 1 -- 10.20.193.78:0/2300224900 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e84004b50 con 0x7f3e9408e920 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:19.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e98b9d640 10 monclient: dump: 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 4 set_mon_vals no callback set 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 10 monclient: shutdown 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 1 -- 10.20.193.78:0/2300224900 >> v1:10.20.193.78:6789/0 conn(0x7f3e9408e920 legacy=0x7f3e9408ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 1 -- 10.20.193.78:0/2300224900 shutdown_connections 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 1 -- 10.20.193.78:0/2300224900 >> 10.20.193.78:0/2300224900 conn(0x7f3e9408ff50 msgr2=0x7f3e94090350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 1 -- 10.20.193.78:0/2300224900 shutdown_connections 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 1 -- 10.20.193.78:0/2300224900 wait complete. 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 10 monclient: build_initial_monmap 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.592+0000 7f3e9be2a640 10 monclient: monmap: 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:19.606 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 Processor -- start 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 -- start start 2026-02-13T18:05:19.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: init 2026-02-13T18:05:19.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient(hunting): picked mon.noname-b con 0x7f3e9408d7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient(hunting): picked mon.noname-a con 0x7f3e9408e920 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient(hunting): picked mon.noname-c con 0x7f3e94184cb0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e94185190 con 0x7f3e9408e920 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e94189a80 con 0x7f3e9408d7b0 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e94184ac0 con 0x7f3e94184cb0 2026-02-13T18:05:19.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient(hunting): authenticate will time out at 550.652638s 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9939e640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3e9408e920 0x7f3e94183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53482/0 (socket says 10.20.193.78:53482) 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9939e640 1 -- 10.20.193.78:0/278066632 learned_addr learned my addr 10.20.193.78:0/278066632 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9939e640 1 -- 10.20.193.78:0/278066632 >> v1:10.20.193.78:6789/0 conn(0x7f3e9408e920 legacy=0x7f3e94183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613412451 0 0) 0x7f3e94185190 con 0x7f3e9408e920 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): my global_id is 4107 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e99b9f640 1 -- 10.20.193.78:0/278066632 >> v1:10.20.193.187:6789/0 conn(0x7f3e9408d7b0 legacy=0x7f3e941432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e64003620 con 0x7f3e9408e920 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1177201012 0 0) 0x7f3e64003620 con 0x7f3e9408e920 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e94185190 con 0x7f3e9408e920 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e880048e0 con 0x7f3e9408e920 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:19.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): dump: 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.614 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1114687070 0 0) 0x7f3e94185190 con 0x7f3e9408e920 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 >> v1:10.20.193.78:6790/0 conn(0x7f3e94184cb0 legacy=0x7f3e941843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 >> v1:10.20.193.187:6789/0 conn(0x7f3e9408d7b0 legacy=0x7f3e941432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 monclient: found mon.a 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e94188590 con 0x7f3e9408e920 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 5 monclient: authenticate success, global_id 4107 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: _renew_subs 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9418a8f0 con 0x7f3e9408e920 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: _renew_subs 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e941890f0 con 0x7f3e9408e920 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e88004d30 con 0x7f3e9408e920 2026-02-13T18:05:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e88005090 con 0x7f3e9408e920 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 10 monclient: dump: 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.618 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e83fff640 4 set_mon_vals no callback set 2026-02-13T18:05:19.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f3e88005640 con 0x7f3e9408e920 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.596+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 2172560710 0 0) 0x7f3e88006e20 con 0x7f3e9408e920 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e9be2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e9be2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e9be2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e94189430 con 0x7f3e9408e920 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f3e88006370 con 0x7f3e9408e920 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:19.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.600+0000 7f3e827fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:19.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f3e94060260 con 0x7f3e9408e920 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e827fc640 1 -- 10.20.193.78:0/278066632 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f3e88005960 con 0x7f3e9408e920 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e827fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e827fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:19.635 INFO:teuthology.orchestra.run.trial078.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T18:05:19.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 10 monclient: shutdown 2026-02-13T18:05:19.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:19.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 >> v1:10.20.193.78:6789/0 conn(0x7f3e9408e920 legacy=0x7f3e94183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 shutdown_connections 2026-02-13T18:05:19.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 >> 10.20.193.78:0/278066632 conn(0x7f3e9408ff50 msgr2=0x7f3e94092840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:19.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 shutdown_connections 2026-02-13T18:05:19.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.628+0000 7f3e9be2a640 1 -- 10.20.193.78:0/278066632 wait complete. 2026-02-13T18:05:19.645 INFO:tasks.ceph:Setting crush tunables to default 2026-02-13T18:05:19.645 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd crush tunables default 2026-02-13T18:05:19.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.696+0000 7f8c4d31f640 10 monclient: get_monmap_and_config 2026-02-13T18:05:19.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.696+0000 7f8c4d31f640 10 monclient: build_initial_monmap 2026-02-13T18:05:19.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.696+0000 7f8c4d31f640 10 monclient: monmap: 2026-02-13T18:05:19.705 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:19.701259+0000 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:19.701259+0000 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 Processor -- start 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- start start 2026-02-13T18:05:19.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient: init 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient(hunting): picked mon.noname-a con 0x7f8c4808b1e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient(hunting): picked mon.noname-b con 0x7f8c4808d680 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient(hunting): picked mon.noname-c con 0x7f8c4808b5b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4808cb40 con 0x7f8c4808b1e0 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4808ba30 con 0x7f8c4808b5b0 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4808a420 con 0x7f8c4808d680 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient(hunting): authenticate will time out at 550.756418s 2026-02-13T18:05:19.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c46ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f8c4808b1e0 0x7f8c4808cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:53488/0 (socket says 10.20.193.78:53488) 2026-02-13T18:05:19.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c46ffd640 1 -- 10.20.193.78:0/1043757324 learned_addr learned my addr 10.20.193.78:0/1043757324 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c467fc640 1 -- 10.20.193.78:0/1043757324 >> v1:10.20.193.78:6790/0 conn(0x7f8c4808d680 legacy=0x7f8c48183e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c46ffd640 1 -- 10.20.193.78:0/1043757324 >> v1:10.20.193.78:6789/0 conn(0x7f8c4808b1e0 legacy=0x7f8c4808cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c477fe640 1 -- 10.20.193.78:0/1043757324 >> v1:10.20.193.187:6789/0 conn(0x7f8c4808b5b0 legacy=0x7f8c481a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337016068 0 0) 0x7f8c4808cb40 con 0x7f8c4808b1e0 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): my global_id is 4110 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c34003620 con 0x7f8c4808b1e0 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759219246 0 0) 0x7f8c4808a420 con 0x7f8c4808d680 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient(hunting): my global_id is 4106 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c4808cb40 con 0x7f8c4808d680 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2202314383 0 0) 0x7f8c34003620 con 0x7f8c4808b1e0 2026-02-13T18:05:19.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 >> v1:10.20.193.78:6790/0 conn(0x7f8c4808d680 legacy=0x7f8c48183e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 >> v1:10.20.193.187:6789/0 conn(0x7f8c4808b5b0 legacy=0x7f8c481a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 monclient: found mon.noname-a 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4808a700 con 0x7f8c4808b1e0 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8c3c003110 con 0x7f8c4808b1e0 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:19.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: dump: 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 5 monclient: authenticate success, global_id 4110 2026-02-13T18:05:19.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c3c0033e0 con 0x7f8c4808b1e0 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 1 -- 10.20.193.78:0/1043757324 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8c3c004b50 con 0x7f8c4808b1e0 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c45ffb640 10 monclient: dump: 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.719 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 4 set_mon_vals no callback set 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 10 monclient: shutdown 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- 10.20.193.78:0/1043757324 >> v1:10.20.193.78:6789/0 conn(0x7f8c4808b1e0 legacy=0x7f8c4808cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- 10.20.193.78:0/1043757324 shutdown_connections 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- 10.20.193.78:0/1043757324 >> 10.20.193.78:0/1043757324 conn(0x7f8c480918e0 msgr2=0x7f8c48091ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:19.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- 10.20.193.78:0/1043757324 shutdown_connections 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.700+0000 7f8c4d31f640 1 -- 10.20.193.78:0/1043757324 wait complete. 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: build_initial_monmap 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: monmap: 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:19.721 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 Processor -- start 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 -- start start 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: init 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient(hunting): picked mon.noname-c con 0x7f8c4808b1e0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient(hunting): picked mon.noname-a con 0x7f8c4808b5b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient(hunting): picked mon.noname-b con 0x7f8c480818f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c480830f0 con 0x7f8c4808b5b0 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c48080d90 con 0x7f8c480818f0 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c48082850 con 0x7f8c4808b1e0 2026-02-13T18:05:19.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient(hunting): authenticate will time out at 550.761067s 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c46ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f8c4808b1e0 0x7f8c48084620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:51402/0 (socket says 10.20.193.78:51402) 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c46ffd640 1 -- 10.20.193.78:0/3303672669 learned_addr learned my addr 10.20.193.78:0/3303672669 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c46ffd640 1 -- 10.20.193.78:0/3303672669 >> v1:10.20.193.78:6790/0 conn(0x7f8c4808b1e0 legacy=0x7f8c48084620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c467fc640 1 -- 10.20.193.78:0/3303672669 >> v1:10.20.193.78:6789/0 conn(0x7f8c4808b5b0 legacy=0x7f8c48194090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738007882 0 0) 0x7f8c480830f0 con 0x7f8c4808b5b0 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): my global_id is 4113 2026-02-13T18:05:19.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c14003620 con 0x7f8c4808b5b0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865538872 0 0) 0x7f8c48082850 con 0x7f8c4808b1e0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): my global_id is 4109 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c480830f0 con 0x7f8c4808b1e0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c477fe640 1 -- 10.20.193.78:0/3303672669 >> v1:10.20.193.187:6789/0 conn(0x7f8c480818f0 legacy=0x7f8c481957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 350807454 0 0) 0x7f8c14003620 con 0x7f8c4808b5b0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c48082850 con 0x7f8c4808b5b0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8c300033d0 con 0x7f8c4808b5b0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:19.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): dump: 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:19.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1016561312 0 0) 0x7f8c480830f0 con 0x7f8c4808b1e0 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c14003620 con 0x7f8c4808b1e0 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8c3c0048e0 con 0x7f8c4808b1e0 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient(hunting): dump: 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.726 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1340141897 0 0) 0x7f8c48082850 con 0x7f8c4808b5b0 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 >> v1:10.20.193.78:6790/0 conn(0x7f8c4808b1e0 legacy=0x7f8c48084620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 >> v1:10.20.193.187:6789/0 conn(0x7f8c480818f0 legacy=0x7f8c481957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 monclient: found mon.a 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48082b30 con 0x7f8c4808b5b0 2026-02-13T18:05:19.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 5 monclient: authenticate success, global_id 4113 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: _renew_subs 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c48084d30 con 0x7f8c4808b5b0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: _renew_subs 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c48153160 con 0x7f8c4808b5b0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c300039c0 con 0x7f8c4808b5b0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8c30003d50 con 0x7f8c4808b5b0 2026-02-13T18:05:19.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c457fa640 4 set_mon_vals no callback set 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 10 monclient: dump: 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:19.729 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.704+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f8c300043b0 con 0x7f8c4808b5b0 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 2172560710 0 0) 0x7f8c30006d40 con 0x7f8c4808b5b0 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c4d31f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c4d31f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c4d31f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c480008e0 con 0x7f8c4808b5b0 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f8c30006280 con 0x7f8c4808b5b0 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:19.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.708+0000 7f8c277fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:19.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.736+0000 7f8c4d31f640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T18:05:19.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.736+0000 7f8c4d31f640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T18:05:19.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.736+0000 7f8c4d31f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:19.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.736+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8c4808d680 con 0x7f8c4808b5b0 2026-02-13T18:05:19.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c277fe640 1 -- 10.20.193.78:0/3303672669 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f8c30005a40 con 0x7f8c4808b5b0 2026-02-13T18:05:19.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T18:05:19.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c277fe640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-13T18:05:19.745 INFO:teuthology.orchestra.run.trial078.stderr:adjusted tunables profile to default 2026-02-13T18:05:19.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 10 monclient: shutdown 2026-02-13T18:05:19.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:19.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 >> v1:10.20.193.78:6789/0 conn(0x7f8c4808b5b0 legacy=0x7f8c48194090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:19.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 shutdown_connections 2026-02-13T18:05:19.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 >> 10.20.193.78:0/3303672669 conn(0x7f8c480918e0 msgr2=0x7f8c480862f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:19.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 shutdown_connections 2026-02-13T18:05:19.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:19.740+0000 7f8c4d31f640 1 -- 10.20.193.78:0/3303672669 wait complete. 2026-02-13T18:05:19.754 INFO:tasks.ceph:check_enable_crimson: False 2026-02-13T18:05:19.754 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-13T18:05:19.754 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:19.754 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-13T18:05:19.765 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:19.765 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-13T18:05:19.821 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T18:05:19.821 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-13T18:05:19.873 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:19.873 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-13T18:05:19.882 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:19.882 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-13T18:05:19.930 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T18:05:19.931 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-13T18:05:19.978 DEBUG:teuthology.orchestra.run.trial187:> sudo ceph --cluster ceph osd new 0458b6dd-2248-4622-ad34-c5b862d03fbf 0 2026-02-13T18:05:20.080 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.080 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.080 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient: monmap: 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:20.079026+0000 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:20.079026+0000 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.081 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 1 Processor -- start 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 1 -- start start 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient: init 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient(hunting): picked mon.noname-b con 0x7f117813f7b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.083 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient(hunting): picked mon.noname-c con 0x7f1178095410 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient(hunting): picked mon.noname-a con 0x7f11781851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1178140290 con 0x7f11781851c0 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1178094750 con 0x7f1178095410 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1178093c80 con 0x7f117813f7b0 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f117daa6640 10 monclient(hunting): authenticate will time out at 542.825817s 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f116ffff640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 0x7f1178183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44446/0 (socket says 10.20.193.187:44446) 2026-02-13T18:05:20.084 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.075+0000 7f116ffff640 1 -- 10.20.193.187:0/3241710821 learned_addr learned my addr 10.20.193.187:0/3241710821 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.092 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116ffff640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 legacy=0x7f1178183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.092 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202227162 0 0) 0x7f1178094750 con 0x7f1178095410 2026-02-13T18:05:20.092 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.092 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): my global_id is 4111 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1164003620 con 0x7f1178095410 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117d2a5640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.78:6789/0 conn(0x7f11781851c0 legacy=0x7f11781a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117caa4640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.78:6790/0 conn(0x7f117813f7b0 legacy=0x7f117813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116ffff640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 legacy=0x7f1178183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116ffff640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 legacy=0x7f1178183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116ffff640 1 --1- 10.20.193.187:0/3241710821 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 0x7f1178183aa0 :-1 s=OPENED pgs=15 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116ffff640 1 --1- 10.20.193.187:0/3241710821 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 0x7f1178183aa0 :-1 s=OPENED pgs=15 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.187:6789/0 2026-02-13T18:05:20.093 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851542979 0 0) 0x7f11740041c0 con 0x7f11781851c0 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): my global_id is 4116 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1178094750 con 0x7f11781851c0 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283578729 0 0) 0x7f1178093c80 con 0x7f117813f7b0 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient(hunting): my global_id is 4112 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11740041c0 con 0x7f117813f7b0 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3900336473 0 0) 0x7f1178094750 con 0x7f11781851c0 2026-02-13T18:05:20.094 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.78:6790/0 conn(0x7f117813f7b0 legacy=0x7f117813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 legacy=0x7f1178183aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 monclient: found mon.noname-a 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1178094190 con 0x7f11781851c0 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1174004840 con 0x7f11781851c0 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:20.095 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: dump: 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 5 monclient: authenticate success, global_id 4116 2026-02-13T18:05:20.096 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1174004c20 con 0x7f11781851c0 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 1 -- 10.20.193.187:0/3241710821 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1174004fb0 con 0x7f11781851c0 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f116f7fe640 10 monclient: dump: 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.097 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 4 set_mon_vals no callback set 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: shutdown 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- 10.20.193.187:0/3241710821 >> v1:10.20.193.78:6789/0 conn(0x7f11781851c0 legacy=0x7f11781a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- 10.20.193.187:0/3241710821 shutdown_connections 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- 10.20.193.187:0/3241710821 >> 10.20.193.187:0/3241710821 conn(0x7f1178054400 msgr2=0x7f1178054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.098 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- 10.20.193.187:0/3241710821 shutdown_connections 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- 10.20.193.187:0/3241710821 wait complete. 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: monmap: 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 0.000000 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:created 0.000000 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 1 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.099 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 Processor -- start 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- start start 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: init 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient(hunting): picked mon.noname-b con 0x7f1178095410 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient(hunting): picked mon.noname-c con 0x7f117813f7b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient(hunting): picked mon.noname-a con 0x7f11781851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1178111a90 con 0x7f11781851c0 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1178110c20 con 0x7f1178095410 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117810f730 con 0x7f117813f7b0 2026-02-13T18:05:20.100 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117daa6640 10 monclient(hunting): authenticate will time out at 542.830047s 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117caa4640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 0x7f117813e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44448/0 (socket says 10.20.193.187:44448) 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.079+0000 7f117caa4640 1 -- 10.20.193.187:0/3280862225 learned_addr learned my addr 10.20.193.187:0/3280862225 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117caa4640 1 -- 10.20.193.187:0/3280862225 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 legacy=0x7f117813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116ffff640 1 -- 10.20.193.187:0/3280862225 >> v1:10.20.193.78:6790/0 conn(0x7f117813f7b0 legacy=0x7f117813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117d2a5640 1 -- 10.20.193.187:0/3280862225 >> v1:10.20.193.78:6789/0 conn(0x7f11781851c0 legacy=0x7f11781814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687669646 0 0) 0x7f1178110c20 con 0x7f1178095410 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): my global_id is 4114 2026-02-13T18:05:20.101 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1148003620 con 0x7f1178095410 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522427099 0 0) 0x7f1178111a90 con 0x7f11781851c0 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): my global_id is 4119 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1178110c20 con 0x7f11781851c0 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690443252 0 0) 0x7f117810f730 con 0x7f117813f7b0 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): my global_id is 4115 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1178111a90 con 0x7f117813f7b0 2026-02-13T18:05:20.102 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2902666885 0 0) 0x7f1148003620 con 0x7f1178095410 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f117810f730 con 0x7f1178095410 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f11680033c0 con 0x7f1178095410 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.103 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3119168410 0 0) 0x7f117810f730 con 0x7f1178095410 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 >> v1:10.20.193.78:6790/0 conn(0x7f117813f7b0 legacy=0x7f117813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 >> v1:10.20.193.78:6789/0 conn(0x7f11781851c0 legacy=0x7f11781814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 monclient: found mon.b 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11781111f0 con 0x7f1178095410 2026-02-13T18:05:20.104 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 5 monclient: authenticate success, global_id 4114 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 monclient: _renew_subs 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f117810f0e0 con 0x7f1178095410 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 monclient: _renew_subs 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1178110460 con 0x7f1178095410 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11680039c0 con 0x7f1178095410 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.105 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1168003d50 con 0x7f1178095410 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: dump: 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.106 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116effd640 4 set_mon_vals no callback set 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f11680043b0 con 0x7f1178095410 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 1959954016 0 0) 0x7f1168006d20 con 0x7f1178095410 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1178050ff0 con 0x7f1178095410 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f1168005b00 con 0x7f1178095410 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.107 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.083+0000 7f116d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.124 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0458b6dd-2248-4622-ad34-c5b862d03fbf", "id": 0}] 2026-02-13T18:05:20.124 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0458b6dd-2248-4622-ad34-c5b862d03fbf", "id": 0}] 2026-02-13T18:05:20.124 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.124 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd new", "uuid": "0458b6dd-2248-4622-ad34-c5b862d03fbf", "id": 0} v 0) -- 0x7f11781a6bb0 con 0x7f1178095410 2026-02-13T18:05:20.126 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f116d7fa640 1 -- 10.20.193.187:0/3280862225 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0458b6dd-2248-4622-ad34-c5b862d03fbf", "id": 0}]=0 v3) ==== 112+0+2 (unknown 122627882 0 732707515) 0x7f1168005e50 con 0x7f1178095410 2026-02-13T18:05:20.126 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f116d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0458b6dd-2248-4622-ad34-c5b862d03fbf", "id": 0}] 2026-02-13T18:05:20.126 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f116d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.127 INFO:teuthology.orchestra.run.trial187.stdout:0 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 10 monclient: shutdown 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 >> v1:10.20.193.187:6789/0 conn(0x7f1178095410 legacy=0x7f117813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 shutdown_connections 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 >> 10.20.193.187:0/3280862225 conn(0x7f1178054400 msgr2=0x7f11781a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 shutdown_connections 2026-02-13T18:05:20.128 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.119+0000 7f117daa6640 1 -- 10.20.193.187:0/3280862225 wait complete. 2026-02-13T18:05:20.136 DEBUG:teuthology.orchestra.run.trial187:> sudo ceph --cluster ceph osd new bb192088-5eba-48c0-82aa-550bd21e170d 1 2026-02-13T18:05:20.196 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient: monmap: 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:20.195567+0000 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:20.195567+0000 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.197 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.198 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.198 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.198 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.199 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 1 Processor -- start 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 1 -- start start 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient: init 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient(hunting): picked mon.noname-b con 0x7fd49013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient(hunting): picked mon.noname-a con 0x7fd49005e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient(hunting): picked mon.noname-c con 0x7fd4901853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd490095530 con 0x7fd49005e4b0 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd490140390 con 0x7fd4901853c0 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49005d230 con 0x7fd49013f8b0 2026-02-13T18:05:20.200 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.201 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd496d6e640 10 monclient(hunting): authenticate will time out at 542.942456s 2026-02-13T18:05:20.201 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd4952e4640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fd4901853c0 0x7fd4901a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44462/0 (socket says 10.20.193.187:44462) 2026-02-13T18:05:20.201 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd4952e4640 1 -- 10.20.193.187:0/1253381175 learned_addr learned my addr 10.20.193.187:0/1253381175 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.201 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd494ae3640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.78:6790/0 conn(0x7fd49013f8b0 legacy=0x7fd49013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-13T18:05:20.201 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd494ae3640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.78:6790/0 conn(0x7fd49013f8b0 legacy=0x7fd49013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-13T18:05:20.201 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.191+0000 7fd494ae3640 1 --1- 10.20.193.187:0/1253381175 >> v1:10.20.193.78:6790/0 conn(0x7fd49013f8b0 0x7fd49013fc80 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=1 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-13T18:05:20.208 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4952e4640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.187:6789/0 conn(0x7fd4901853c0 legacy=0x7fd4901a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.208 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd487fff640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.78:6789/0 conn(0x7fd49005e4b0 legacy=0x7fd490183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.208 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600743795 0 0) 0x7fd48c004170 con 0x7fd4901853c0 2026-02-13T18:05:20.208 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.209 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.209 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.209 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): my global_id is 4117 2026-02-13T18:05:20.209 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c003620 con 0x7fd4901853c0 2026-02-13T18:05:20.209 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320978033 0 0) 0x7fd478002cb0 con 0x7fd49005e4b0 2026-02-13T18:05:20.209 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.210 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.210 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.210 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient(hunting): my global_id is 4122 2026-02-13T18:05:20.210 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd48c004170 con 0x7fd49005e4b0 2026-02-13T18:05:20.210 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1711086137 0 0) 0x7fd47c003620 con 0x7fd4901853c0 2026-02-13T18:05:20.210 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.78:6790/0 conn(0x7fd49013f8b0 legacy=0x7fd49013fc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.78:6789/0 conn(0x7fd49005e4b0 legacy=0x7fd490183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 monclient: found mon.noname-c 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49005d510 con 0x7fd4901853c0 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.211 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd48c0047f0 con 0x7fd4901853c0 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 5 monclient: authenticate success, global_id 4117 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:20.212 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: dump: 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.213 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd48c004a40 con 0x7fd4901853c0 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 1 -- 10.20.193.187:0/1253381175 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd48c006090 con 0x7fd4901853c0 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 4 set_mon_vals no callback set 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd4877fe640 10 monclient: dump: 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.214 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: shutdown 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.215 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- 10.20.193.187:0/1253381175 >> v1:10.20.193.187:6789/0 conn(0x7fd4901853c0 legacy=0x7fd4901a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- 10.20.193.187:0/1253381175 shutdown_connections 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- 10.20.193.187:0/1253381175 >> 10.20.193.187:0/1253381175 conn(0x7fd4900545d0 msgr2=0x7fd4900549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- 10.20.193.187:0/1253381175 shutdown_connections 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- 10.20.193.187:0/1253381175 wait complete. 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: monmap: 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 0.000000 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:created 0.000000 2026-02-13T18:05:20.216 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 1 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 Processor -- start 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- start start 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: init 2026-02-13T18:05:20.217 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient(hunting): picked mon.noname-c con 0x7fd49005e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient(hunting): picked mon.noname-b con 0x7fd49013f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient(hunting): picked mon.noname-a con 0x7fd4901853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd490112120 con 0x7fd4901853c0 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4901112b0 con 0x7fd49013f8b0 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49010fdc0 con 0x7fd49005e4b0 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd496d6e640 10 monclient(hunting): authenticate will time out at 542.946420s 2026-02-13T18:05:20.218 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd487fff640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 0x7fd490180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44478/0 (socket says 10.20.193.187:44478) 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.195+0000 7fd487fff640 1 -- 10.20.193.187:0/2700258368 learned_addr learned my addr 10.20.193.187:0/2700258368 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd487fff640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 legacy=0x7fd490180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd487fff640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 legacy=0x7fd490180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd487fff640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 legacy=0x7fd490180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd487fff640 1 --1- 10.20.193.187:0/2700258368 >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 0x7fd490180590 :-1 s=OPENED pgs=18 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd487fff640 1 --1- 10.20.193.187:0/2700258368 >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 0x7fd490180590 :-1 s=OPENED pgs=18 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:20.219 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.187:6789/0 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4952e4640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.78:6789/0 conn(0x7fd4901853c0 legacy=0x7fd490181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd494ae3640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.78:6790/0 conn(0x7fd49005e4b0 legacy=0x7fd49013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056907993 0 0) 0x7fd490112120 con 0x7fd4901853c0 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): my global_id is 4125 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd460003620 con 0x7fd4901853c0 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822721064 0 0) 0x7fd49010fdc0 con 0x7fd49005e4b0 2026-02-13T18:05:20.220 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.221 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.221 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.221 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): my global_id is 4118 2026-02-13T18:05:20.221 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd490112120 con 0x7fd49005e4b0 2026-02-13T18:05:20.221 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 196610977 0 0) 0x7fd460003620 con 0x7fd4901853c0 2026-02-13T18:05:20.221 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49010fdc0 con 0x7fd4901853c0 2026-02-13T18:05:20.222 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd48c005fa0 con 0x7fd4901853c0 2026-02-13T18:05:20.222 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.222 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:20.222 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): dump: 2026-02-13T18:05:20.222 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.222 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.223 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.223 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.223 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.223 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.223 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.223 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.224 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.224 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.224 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.224 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1418360018 0 0) 0x7fd49010fdc0 con 0x7fd4901853c0 2026-02-13T18:05:20.224 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.78:6790/0 conn(0x7fd49005e4b0 legacy=0x7fd49013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.224 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.187:6789/0 conn(0x7fd49013f8b0 legacy=0x7fd490180590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:20.225 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.225 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 monclient: found mon.a 2026-02-13T18:05:20.225 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.225 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.225 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd490111880 con 0x7fd4901853c0 2026-02-13T18:05:20.225 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.226 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.226 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.226 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 5 monclient: authenticate success, global_id 4125 2026-02-13T18:05:20.226 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 monclient: _renew_subs 2026-02-13T18:05:20.226 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.227 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd49010f770 con 0x7fd4901853c0 2026-02-13T18:05:20.227 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 monclient: _renew_subs 2026-02-13T18:05:20.227 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.227 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd490110920 con 0x7fd4901853c0 2026-02-13T18:05:20.227 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd48c004a40 con 0x7fd4901853c0 2026-02-13T18:05:20.227 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.228 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd48c006860 con 0x7fd4901853c0 2026-02-13T18:05:20.228 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.228 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:20.228 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: dump: 2026-02-13T18:05:20.228 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.228 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.229 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.229 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.229 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.229 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.229 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.229 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd486ffd640 4 set_mon_vals no callback set 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fd48c006e10 con 0x7fd4901853c0 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 2235425830 0 0) 0x7fd48c0085c0 con 0x7fd4901853c0 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.230 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.231 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.231 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4900008e0 con 0x7fd4901853c0 2026-02-13T18:05:20.231 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fd490140390 con 0x7fd4901853c0 2026-02-13T18:05:20.231 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.231 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.199+0000 7fd4857fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.241 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "bb192088-5eba-48c0-82aa-550bd21e170d", "id": 1}] 2026-02-13T18:05:20.241 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "bb192088-5eba-48c0-82aa-550bd21e170d", "id": 1}] 2026-02-13T18:05:20.241 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.241 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd new", "uuid": "bb192088-5eba-48c0-82aa-550bd21e170d", "id": 1} v 0) -- 0x7fd490093020 con 0x7fd4901853c0 2026-02-13T18:05:20.241 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd4857fa640 1 -- 10.20.193.187:0/2700258368 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb192088-5eba-48c0-82aa-550bd21e170d", "id": 1}]=0 v4) ==== 112+0+2 (unknown 3793100517 0 940483276) 0x7fd48c008840 con 0x7fd4901853c0 2026-02-13T18:05:20.242 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd4857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "bb192088-5eba-48c0-82aa-550bd21e170d", "id": 1}] 2026-02-13T18:05:20.242 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd4857fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.242 INFO:teuthology.orchestra.run.trial187.stdout:1 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 10 monclient: shutdown 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 >> v1:10.20.193.78:6789/0 conn(0x7fd4901853c0 legacy=0x7fd490181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 shutdown_connections 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 >> 10.20.193.187:0/2700258368 conn(0x7fd4900545d0 msgr2=0x7fd490095d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 shutdown_connections 2026-02-13T18:05:20.243 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.235+0000 7fd496d6e640 1 -- 10.20.193.187:0/2700258368 wait complete. 2026-02-13T18:05:20.251 DEBUG:teuthology.orchestra.run.trial187:> sudo ceph --cluster ceph osd new b90c999b-baf5-460a-acff-1e45f3214fc1 2 2026-02-13T18:05:20.311 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient: monmap: 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:20.310337+0000 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:20.310337+0000 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.312 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.313 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.313 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.313 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.314 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 1 Processor -- start 2026-02-13T18:05:20.314 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 1 -- start start 2026-02-13T18:05:20.314 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient: init 2026-02-13T18:05:20.314 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.314 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient(hunting): picked mon.noname-b con 0x7fab0008c8e0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient(hunting): picked mon.noname-c con 0x7fab0005d070 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient(hunting): picked mon.noname-a con 0x7fab0008dfb0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0005c3b0 con 0x7fab0008dfb0 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0005c690 con 0x7fab0005d070 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab00054660 con 0x7fab0008c8e0 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 10 monclient(hunting): authenticate will time out at 543.057102s 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab04a94640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fab0005d070 0x7fab00183920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44482/0 (socket says 10.20.193.187:44482) 2026-02-13T18:05:20.315 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab04a94640 1 -- 10.20.193.187:0/1227405650 learned_addr learned my addr 10.20.193.187:0/1227405650 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab04a94640 1 -- 10.20.193.187:0/1227405650 >> v1:10.20.193.187:6789/0 conn(0x7fab0005d070 legacy=0x7fab00183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545986244 0 0) 0x7fab0005c690 con 0x7fab0005d070 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): my global_id is 4120 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab05295640 1 -- 10.20.193.187:0/1227405650 >> v1:10.20.193.78:6790/0 conn(0x7fab0008c8e0 legacy=0x7fab0008ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae8003620 con 0x7fab0005d070 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab05a96640 1 -- 10.20.193.187:0/1227405650 >> v1:10.20.193.78:6789/0 conn(0x7fab0008dfb0 legacy=0x7fab001a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.319 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 140884480 0 0) 0x7fab0005c3b0 con 0x7fab0008dfb0 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient(hunting): my global_id is 4128 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab0005c690 con 0x7fab0008dfb0 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4730170 0 0) 0x7faae8003620 con 0x7fab0005d070 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 >> v1:10.20.193.78:6790/0 conn(0x7fab0008c8e0 legacy=0x7fab0008ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 >> v1:10.20.193.78:6789/0 conn(0x7fab0008dfb0 legacy=0x7fab001a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 monclient: found mon.noname-c 2026-02-13T18:05:20.320 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0008d3c0 con 0x7fab0005d070 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 5 monclient: authenticate success, global_id 4120 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faaf4003110 con 0x7fab0005d070 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: dump: 2026-02-13T18:05:20.321 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7fab06297640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faaf4003450 con 0x7fab0005d070 2026-02-13T18:05:20.322 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.307+0000 7faaeffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 4 set_mon_vals no callback set 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaeffff640 1 -- 10.20.193.187:0/1227405650 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faaf4004b50 con 0x7fab0005d070 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaeffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaeffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaeffff640 10 monclient: dump: 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.323 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: shutdown 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- 10.20.193.187:0/1227405650 >> v1:10.20.193.187:6789/0 conn(0x7fab0005d070 legacy=0x7fab00183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- 10.20.193.187:0/1227405650 shutdown_connections 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- 10.20.193.187:0/1227405650 >> 10.20.193.187:0/1227405650 conn(0x7fab00056ae0 msgr2=0x7fab00091ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- 10.20.193.187:0/1227405650 shutdown_connections 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- 10.20.193.187:0/1227405650 wait complete. 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: monmap: 2026-02-13T18:05:20.324 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 0.000000 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:created 0.000000 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 1 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 Processor -- start 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- start start 2026-02-13T18:05:20.325 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: init 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient(hunting): picked mon.noname-c con 0x7fab0005d070 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient(hunting): picked mon.noname-b con 0x7fab0008c8e0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient(hunting): picked mon.noname-a con 0x7fab0008dfb0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0012b830 con 0x7fab0008dfb0 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0005e800 con 0x7fab0008c8e0 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab00129790 con 0x7fab0005d070 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab06297640 10 monclient(hunting): authenticate will time out at 543.061561s 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab04a94640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fab0008c8e0 0x7fab00129080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44488/0 (socket says 10.20.193.187:44488) 2026-02-13T18:05:20.326 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab04a94640 1 -- 10.20.193.187:0/1882589104 learned_addr learned my addr 10.20.193.187:0/1882589104 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.329 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab04a94640 1 -- 10.20.193.187:0/1882589104 >> v1:10.20.193.187:6789/0 conn(0x7fab0008c8e0 legacy=0x7fab00129080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.329 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289856659 0 0) 0x7fab0005e800 con 0x7fab0008c8e0 2026-02-13T18:05:20.329 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaedffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaedffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaedffb640 10 monclient(hunting): my global_id is 4123 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad0003620 con 0x7fab0008c8e0 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.311+0000 7fab05295640 1 -- 10.20.193.187:0/1882589104 >> v1:10.20.193.78:6790/0 conn(0x7fab0005d070 legacy=0x7fab00128970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab05a96640 1 -- 10.20.193.187:0/1882589104 >> v1:10.20.193.78:6789/0 conn(0x7fab0008dfb0 legacy=0x7fab001a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2425898641 0 0) 0x7faad0003620 con 0x7fab0008c8e0 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab0005e800 con 0x7fab0008c8e0 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faaf4002b70 con 0x7fab0008c8e0 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:20.330 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): dump: 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.331 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108043411 0 0) 0x7fab0012b830 con 0x7fab0008dfb0 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): my global_id is 4131 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad0003620 con 0x7fab0008dfb0 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364038416 0 0) 0x7fab00129790 con 0x7fab0005d070 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient(hunting): my global_id is 4124 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab0012b830 con 0x7fab0005d070 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3136345162 0 0) 0x7fab0005e800 con 0x7fab0008c8e0 2026-02-13T18:05:20.332 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 >> v1:10.20.193.78:6790/0 conn(0x7fab0005d070 legacy=0x7fab00128970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 >> v1:10.20.193.78:6789/0 conn(0x7fab0008dfb0 legacy=0x7fab001a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 monclient: found mon.b 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0012a340 con 0x7fab0008c8e0 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 5 monclient: authenticate success, global_id 4123 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 monclient: _renew_subs 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab0012c6a0 con 0x7fab0008c8e0 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 monclient: _renew_subs 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fab0012cac0 con 0x7fab0008c8e0 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faaf40033f0 con 0x7fab0008c8e0 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faaf40052a0 con 0x7fab0008c8e0 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaef7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: dump: 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.334 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7faaf4005850 con 0x7fab0008c8e0 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 2510074982 0 0) 0x7faaf4006ed0 con 0x7fab0008c8e0 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.335 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab000008e0 con 0x7fab0008c8e0 2026-02-13T18:05:20.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7faaf4006110 con 0x7fab0008c8e0 2026-02-13T18:05:20.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.315+0000 7faaedffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.355 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.347+0000 7fab06297640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b90c999b-baf5-460a-acff-1e45f3214fc1", "id": 2}] 2026-02-13T18:05:20.355 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.347+0000 7fab06297640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b90c999b-baf5-460a-acff-1e45f3214fc1", "id": 2}] 2026-02-13T18:05:20.355 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.347+0000 7fab06297640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.355 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.347+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b90c999b-baf5-460a-acff-1e45f3214fc1", "id": 2} v 0) -- 0x7fab001a6980 con 0x7fab0008c8e0 2026-02-13T18:05:20.358 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7faaedffb640 1 -- 10.20.193.187:0/1882589104 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b90c999b-baf5-460a-acff-1e45f3214fc1", "id": 2}]=0 v5) ==== 112+0+2 (unknown 298976037 0 216599125) 0x7faaf4005c40 con 0x7fab0008c8e0 2026-02-13T18:05:20.358 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7faaedffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b90c999b-baf5-460a-acff-1e45f3214fc1", "id": 2}] 2026-02-13T18:05:20.358 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7faaedffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.358 INFO:teuthology.orchestra.run.trial187.stdout:2 2026-02-13T18:05:20.359 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 10 monclient: shutdown 2026-02-13T18:05:20.359 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.360 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 >> v1:10.20.193.187:6789/0 conn(0x7fab0008c8e0 legacy=0x7fab00129080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.360 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 shutdown_connections 2026-02-13T18:05:20.360 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 >> 10.20.193.187:0/1882589104 conn(0x7fab00056ae0 msgr2=0x7fab00142b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.360 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 shutdown_connections 2026-02-13T18:05:20.360 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.351+0000 7fab06297640 1 -- 10.20.193.187:0/1882589104 wait complete. 2026-02-13T18:05:20.370 DEBUG:teuthology.orchestra.run.trial187:> sudo ceph --cluster ceph osd new 2fea0170-ac6c-43b4-ba22-661f1f1723b4 3 2026-02-13T18:05:20.431 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.423+0000 7f33c92a1640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.431 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.423+0000 7f33c92a1640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.431 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.423+0000 7f33c92a1640 10 monclient: monmap: 2026-02-13T18:05:20.431 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.431 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:20.430275+0000 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:20.430275+0000 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.432 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.433 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 1 Processor -- start 2026-02-13T18:05:20.433 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 1 -- start start 2026-02-13T18:05:20.433 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient: init 2026-02-13T18:05:20.433 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient(hunting): picked mon.noname-a con 0x7f33c413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient(hunting): picked mon.noname-c con 0x7f33c405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient(hunting): picked mon.noname-b con 0x7f33c41853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c4095530 con 0x7f33c413f8b0 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c4140390 con 0x7f33c405e4b0 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c405d230 con 0x7f33c41853c0 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c92a1640 10 monclient(hunting): authenticate will time out at 543.177287s 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c27fc640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f33c405e4b0 0x7f33c4183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44492/0 (socket says 10.20.193.187:44492) 2026-02-13T18:05:20.434 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c27fc640 1 -- 10.20.193.187:0/2354688711 learned_addr learned my addr 10.20.193.187:0/2354688711 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c27fc640 1 -- 10.20.193.187:0/2354688711 >> v1:10.20.193.187:6789/0 conn(0x7f33c405e4b0 legacy=0x7f33c4183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c37fe640 1 -- 10.20.193.187:0/2354688711 >> v1:10.20.193.78:6790/0 conn(0x7f33c41853c0 legacy=0x7f33c41a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868351614 0 0) 0x7f33ac002c60 con 0x7f33c405e4b0 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.437 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): my global_id is 4126 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b0003620 con 0x7f33c405e4b0 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017378212 0 0) 0x7f33c405d230 con 0x7f33c41853c0 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 10 monclient(hunting): my global_id is 4127 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33ac002c60 con 0x7f33c41853c0 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2210712246 0 0) 0x7f33b0003620 con 0x7f33c405e4b0 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 >> v1:10.20.193.78:6790/0 conn(0x7f33c41853c0 legacy=0x7f33c41a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 >> v1:10.20.193.78:6789/0 conn(0x7f33c413f8b0 legacy=0x7f33c413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.427+0000 7f33c2ffd640 1 -- 10.20.193.187:0/2354688711 >> v1:10.20.193.78:6789/0 conn(0x7f33c413f8b0 legacy=0x7f33c413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 1 monclient: found mon.noname-c 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.438 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c405d510 con 0x7f33c405e4b0 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 5 monclient: authenticate success, global_id 4126 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f33ac0032e0 con 0x7f33c405e4b0 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: dump: 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.439 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33ac0049a0 con 0x7f33c405e4b0 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 1 -- 10.20.193.187:0/2354688711 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f33ac004d30 con 0x7f33c405e4b0 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 4 set_mon_vals no callback set 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c1ffb640 10 monclient: dump: 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.440 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: shutdown 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- 10.20.193.187:0/2354688711 >> v1:10.20.193.187:6789/0 conn(0x7f33c405e4b0 legacy=0x7f33c4183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- 10.20.193.187:0/2354688711 shutdown_connections 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- 10.20.193.187:0/2354688711 >> 10.20.193.187:0/2354688711 conn(0x7f33c40545d0 msgr2=0x7f33c40549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- 10.20.193.187:0/2354688711 shutdown_connections 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- 10.20.193.187:0/2354688711 wait complete. 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: monmap: 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 0.000000 2026-02-13T18:05:20.441 INFO:teuthology.orchestra.run.trial187.stderr:created 0.000000 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 1 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 Processor -- start 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- start start 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: init 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient(hunting): picked mon.noname-b con 0x7f33c405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient(hunting): picked mon.noname-c con 0x7f33c413f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient(hunting): picked mon.noname-a con 0x7f33c41853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c4111fb0 con 0x7f33c41853c0 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c4111140 con 0x7f33c405e4b0 2026-02-13T18:05:20.442 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c410fc50 con 0x7f33c413f8b0 2026-02-13T18:05:20.443 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.443 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c92a1640 10 monclient(hunting): authenticate will time out at 543.181645s 2026-02-13T18:05:20.443 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c2ffd640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f33c405e4b0 0x7f33c413eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44496/0 (socket says 10.20.193.187:44496) 2026-02-13T18:05:20.443 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c2ffd640 1 -- 10.20.193.187:0/4031570946 learned_addr learned my addr 10.20.193.187:0/4031570946 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33c2ffd640 1 -- 10.20.193.187:0/4031570946 >> v1:10.20.193.187:6789/0 conn(0x7f33c405e4b0 legacy=0x7f33c413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187893684 0 0) 0x7f33c4111140 con 0x7f33c405e4b0 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33a37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.431+0000 7f33a37fe640 10 monclient(hunting): my global_id is 4129 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3390003620 con 0x7f33c405e4b0 2026-02-13T18:05:20.446 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c37fe640 1 -- 10.20.193.187:0/4031570946 >> v1:10.20.193.78:6789/0 conn(0x7f33c41853c0 legacy=0x7f33c4181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c27fc640 1 -- 10.20.193.187:0/4031570946 >> v1:10.20.193.78:6790/0 conn(0x7f33c413f8b0 legacy=0x7f33c4180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3998189988 0 0) 0x7f3390003620 con 0x7f33c405e4b0 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33c4111140 con 0x7f33c405e4b0 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979475078 0 0) 0x7f33c4111fb0 con 0x7f33c41853c0 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): my global_id is 4137 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3390003620 con 0x7f33c41853c0 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f33b8003380 con 0x7f33c405e4b0 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): dump: 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.447 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95121678 0 0) 0x7f33c410fc50 con 0x7f33c413f8b0 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient(hunting): my global_id is 4130 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33c4111fb0 con 0x7f33c413f8b0 2026-02-13T18:05:20.448 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1418180445 0 0) 0x7f33c4111140 con 0x7f33c405e4b0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 >> v1:10.20.193.78:6790/0 conn(0x7f33c413f8b0 legacy=0x7f33c4180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 >> v1:10.20.193.78:6789/0 conn(0x7f33c41853c0 legacy=0x7f33c4181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 monclient: found mon.b 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c4111710 con 0x7f33c405e4b0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 5 monclient: authenticate success, global_id 4129 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 monclient: _renew_subs 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f33c410f650 con 0x7f33c405e4b0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 monclient: _renew_subs 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f33c413f400 con 0x7f33c405e4b0 2026-02-13T18:05:20.449 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33b80039c0 con 0x7f33c405e4b0 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f33b8003d20 con 0x7f33c405e4b0 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: dump: 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f33b8004350 con 0x7f33c405e4b0 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c17fa640 4 set_mon_vals no callback set 2026-02-13T18:05:20.450 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 1974639092 0 0) 0x7f33b8006f30 con 0x7f33c405e4b0 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c40008e0 con 0x7f33c405e4b0 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f33c4095530 con 0x7f33c405e4b0 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.451 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.435+0000 7f33a37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.475 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.467+0000 7f33c92a1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2fea0170-ac6c-43b4-ba22-661f1f1723b4", "id": 3}] 2026-02-13T18:05:20.475 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.467+0000 7f33c92a1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2fea0170-ac6c-43b4-ba22-661f1f1723b4", "id": 3}] 2026-02-13T18:05:20.476 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.467+0000 7f33c92a1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.476 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.467+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2fea0170-ac6c-43b4-ba22-661f1f1723b4", "id": 3} v 0) -- 0x7f33c4093020 con 0x7f33c405e4b0 2026-02-13T18:05:20.478 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33a37fe640 1 -- 10.20.193.187:0/4031570946 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fea0170-ac6c-43b4-ba22-661f1f1723b4", "id": 3}]=0 v6) ==== 112+0+2 (unknown 981300662 0 525046306) 0x7f33b8006b80 con 0x7f33c405e4b0 2026-02-13T18:05:20.478 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33a37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2fea0170-ac6c-43b4-ba22-661f1f1723b4", "id": 3}] 2026-02-13T18:05:20.478 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33a37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.478 INFO:teuthology.orchestra.run.trial187.stdout:3 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 10 monclient: shutdown 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 >> v1:10.20.193.187:6789/0 conn(0x7f33c405e4b0 legacy=0x7f33c413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 shutdown_connections 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 >> 10.20.193.187:0/4031570946 conn(0x7f33c40545d0 msgr2=0x7f33c4096580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 shutdown_connections 2026-02-13T18:05:20.479 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.471+0000 7f33c92a1640 1 -- 10.20.193.187:0/4031570946 wait complete. 2026-02-13T18:05:20.490 DEBUG:teuthology.orchestra.run.trial187:> sudo ceph --cluster ceph osd new b22c98c9-3704-459a-8d11-f1090966127b 4 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.543+0000 7f374ec06640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.543+0000 7f374ec06640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.543+0000 7f374ec06640 10 monclient: monmap: 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:20.549465+0000 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:20.549465+0000 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.551 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.552 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.552 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.552 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.552 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.543+0000 7f374ec06640 1 Processor -- start 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.543+0000 7f374ec06640 1 -- start start 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.543+0000 7f374ec06640 10 monclient: init 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient(hunting): picked mon.noname-c con 0x7f37480561f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient(hunting): picked mon.noname-a con 0x7f3748059d10 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient(hunting): picked mon.noname-b con 0x7f3748056cd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.558 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3748059340 con 0x7f3748059d10 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37480957e0 con 0x7f37480561f0 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3748058430 con 0x7f3748056cd0 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient(hunting): authenticate will time out at 543.296235s 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374dc04640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f37480561f0 0x7f37480565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44506/0 (socket says 10.20.193.187:44506) 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374dc04640 1 -- 10.20.193.187:0/3411281268 learned_addr learned my addr 10.20.193.187:0/3411281268 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374dc04640 1 -- 10.20.193.187:0/3411281268 >> v1:10.20.193.187:6789/0 conn(0x7f37480561f0 legacy=0x7f37480565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374e405640 1 -- 10.20.193.187:0/3411281268 >> v1:10.20.193.78:6790/0 conn(0x7f3748056cd0 legacy=0x7f37481a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374d403640 1 -- 10.20.193.187:0/3411281268 >> v1:10.20.193.78:6789/0 conn(0x7f3748059d10 legacy=0x7f3748188460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275830414 0 0) 0x7f37480957e0 con 0x7f37480561f0 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.559 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): my global_id is 4132 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3730003620 con 0x7f37480561f0 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344270914 0 0) 0x7f3748059340 con 0x7f3748059d10 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): my global_id is 4140 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37480957e0 con 0x7f3748059d10 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257220079 0 0) 0x7f3748058430 con 0x7f3748056cd0 2026-02-13T18:05:20.560 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient(hunting): my global_id is 4133 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3748059340 con 0x7f3748056cd0 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731414623 0 0) 0x7f3730003620 con 0x7f37480561f0 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 >> v1:10.20.193.78:6790/0 conn(0x7f3748056cd0 legacy=0x7f37481a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 >> v1:10.20.193.78:6789/0 conn(0x7f3748059d10 legacy=0x7f3748188460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 monclient: found mon.noname-c 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.561 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3748057390 con 0x7f37480561f0 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 5 monclient: authenticate success, global_id 4132 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3738003110 con 0x7f37480561f0 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: dump: 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.562 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37380033e0 con 0x7f37480561f0 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 1 -- 10.20.193.187:0/3411281268 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3738004b50 con 0x7f37480561f0 2026-02-13T18:05:20.563 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374cc02640 10 monclient: dump: 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.564 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 4 set_mon_vals no callback set 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 10 monclient: shutdown 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- 10.20.193.187:0/3411281268 >> v1:10.20.193.187:6789/0 conn(0x7f37480561f0 legacy=0x7f37480565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- 10.20.193.187:0/3411281268 shutdown_connections 2026-02-13T18:05:20.565 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- 10.20.193.187:0/3411281268 >> 10.20.193.187:0/3411281268 conn(0x7f3748096880 msgr2=0x7f37480928d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- 10.20.193.187:0/3411281268 shutdown_connections 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.547+0000 7f374ec06640 1 -- 10.20.193.187:0/3411281268 wait complete. 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: monmap: 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.566 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 0.000000 2026-02-13T18:05:20.567 INFO:teuthology.orchestra.run.trial187.stderr:created 0.000000 2026-02-13T18:05:20.567 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.567 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 1 2026-02-13T18:05:20.567 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.567 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.567 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 Processor -- start 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 -- start start 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: init 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient(hunting): picked mon.noname-b con 0x7f37480561f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient(hunting): picked mon.noname-c con 0x7f3748056cd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.568 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient(hunting): picked mon.noname-a con 0x7f3748059d10 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374808d2d0 con 0x7f3748059d10 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374808a320 con 0x7f37480561f0 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3748059010 con 0x7f3748056cd0 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient(hunting): authenticate will time out at 543.300600s 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374dc04640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f37480561f0 0x7f3748089500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44518/0 (socket says 10.20.193.187:44518) 2026-02-13T18:05:20.569 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374dc04640 1 -- 10.20.193.187:0/1251124421 learned_addr learned my addr 10.20.193.187:0/1251124421 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.572 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374dc04640 1 -- 10.20.193.187:0/1251124421 >> v1:10.20.193.187:6789/0 conn(0x7f37480561f0 legacy=0x7f3748089500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.572 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004721139 0 0) 0x7f374808a320 con 0x7f37480561f0 2026-02-13T18:05:20.572 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): my global_id is 4135 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374e405640 1 -- 10.20.193.187:0/1251124421 >> v1:10.20.193.78:6789/0 conn(0x7f3748059d10 legacy=0x7f37481a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3718003620 con 0x7f37480561f0 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374d403640 1 -- 10.20.193.187:0/1251124421 >> v1:10.20.193.78:6790/0 conn(0x7f3748056cd0 legacy=0x7f3748089c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293801858 0 0) 0x7f374808d2d0 con 0x7f3748059d10 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.573 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): my global_id is 4143 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f374808a320 con 0x7f3748059d10 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 329251063 0 0) 0x7f3718003620 con 0x7f37480561f0 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f374808d2d0 con 0x7f37480561f0 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3738002b70 con 0x7f37480561f0 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): dump: 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.574 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259749544 0 0) 0x7f3748059010 con 0x7f3748056cd0 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.575 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): my global_id is 4136 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3718003620 con 0x7f3748056cd0 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 805267872 0 0) 0x7f374808a320 con 0x7f3748059d10 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3748059010 con 0x7f3748059d10 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3744004900 con 0x7f3748059d10 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient(hunting): dump: 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.576 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 848667251 0 0) 0x7f374808d2d0 con 0x7f37480561f0 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 >> v1:10.20.193.78:6790/0 conn(0x7f3748056cd0 legacy=0x7f3748089c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.577 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 >> v1:10.20.193.78:6789/0 conn(0x7f3748059d10 legacy=0x7f37481a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.578 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.578 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 monclient: found mon.b 2026-02-13T18:05:20.578 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.578 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.578 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374808c460 con 0x7f37480561f0 2026-02-13T18:05:20.578 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 5 monclient: authenticate success, global_id 4135 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: _renew_subs 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f374808af70 con 0x7f37480561f0 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: _renew_subs 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f374808fb40 con 0x7f37480561f0 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37380033e0 con 0x7f37480561f0 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.579 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f37380052e0 con 0x7f37480561f0 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 10 monclient: dump: 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.580 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f3738005890 con 0x7f37480561f0 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f3737fff640 4 set_mon_vals no callback set 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 2113412115 0 0) 0x7f3738006fe0 con 0x7f37480561f0 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.551+0000 7f374ec06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.555+0000 7f374ec06640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.555+0000 7f374ec06640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.555+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37480008e0 con 0x7f37480561f0 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.555+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f3738006b80 con 0x7f37480561f0 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.555+0000 7f37367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.581 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.555+0000 7f37367fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.593 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f374ec06640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b22c98c9-3704-459a-8d11-f1090966127b", "id": 4}] 2026-02-13T18:05:20.593 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f374ec06640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b22c98c9-3704-459a-8d11-f1090966127b", "id": 4}] 2026-02-13T18:05:20.593 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f374ec06640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.593 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b22c98c9-3704-459a-8d11-f1090966127b", "id": 4} v 0) -- 0x7f3748090840 con 0x7f37480561f0 2026-02-13T18:05:20.595 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f37367fc640 1 -- 10.20.193.187:0/1251124421 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b22c98c9-3704-459a-8d11-f1090966127b", "id": 4}]=0 v7) ==== 112+0+2 (unknown 1675212378 0 1697012583) 0x7f3738005bb0 con 0x7f37480561f0 2026-02-13T18:05:20.595 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f37367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b22c98c9-3704-459a-8d11-f1090966127b", "id": 4}] 2026-02-13T18:05:20.596 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.587+0000 7f37367fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.596 INFO:teuthology.orchestra.run.trial187.stdout:4 2026-02-13T18:05:20.597 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 10 monclient: shutdown 2026-02-13T18:05:20.598 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.598 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 >> v1:10.20.193.187:6789/0 conn(0x7f37480561f0 legacy=0x7f3748089500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.598 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 shutdown_connections 2026-02-13T18:05:20.598 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 >> 10.20.193.187:0/1251124421 conn(0x7f3748096880 msgr2=0x7f374812a540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.598 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 shutdown_connections 2026-02-13T18:05:20.599 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.591+0000 7f374ec06640 1 -- 10.20.193.187:0/1251124421 wait complete. 2026-02-13T18:05:20.605 DEBUG:teuthology.orchestra.run.trial187:> sudo ceph --cluster ceph osd new f6df89ae-d7d7-4616-9af9-d386764d842f 5 2026-02-13T18:05:20.663 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient: monmap: 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:20.662688+0000 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:20.662688+0000 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 1 Processor -- start 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 1 -- start start 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient: init 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:20.664 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient(hunting): picked mon.noname-c con 0x7fb30813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient(hunting): picked mon.noname-b con 0x7fb30805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient(hunting): picked mon.noname-a con 0x7fb3081853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308095530 con 0x7fb3081853c0 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308140390 con 0x7fb30813f8b0 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30805d230 con 0x7fb30805e4b0 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb30db20640 10 monclient(hunting): authenticate will time out at 543.409621s 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb3077fe640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fb30813f8b0 0x7fb30813fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44532/0 (socket says 10.20.193.187:44532) 2026-02-13T18:05:20.665 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb3077fe640 1 -- 10.20.193.187:0/4173699768 learned_addr learned my addr 10.20.193.187:0/4173699768 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.659+0000 7fb3077fe640 1 -- 10.20.193.187:0/4173699768 >> v1:10.20.193.187:6789/0 conn(0x7fb30813f8b0 legacy=0x7fb30813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb307fff640 1 -- 10.20.193.187:0/4173699768 >> v1:10.20.193.78:6789/0 conn(0x7fb3081853c0 legacy=0x7fb3081a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb306ffd640 1 -- 10.20.193.187:0/4173699768 >> v1:10.20.193.78:6790/0 conn(0x7fb30805e4b0 legacy=0x7fb308183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241603275 0 0) 0x7fb2f4002c60 con 0x7fb30813f8b0 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): my global_id is 4138 2026-02-13T18:05:20.667 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2ec003620 con 0x7fb30813f8b0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758103274 0 0) 0x7fb2fc0041c0 con 0x7fb3081853c0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient(hunting): my global_id is 4146 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f4002c60 con 0x7fb3081853c0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1217514620 0 0) 0x7fb2ec003620 con 0x7fb30813f8b0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 >> v1:10.20.193.78:6790/0 conn(0x7fb30805e4b0 legacy=0x7fb308183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 >> v1:10.20.193.78:6789/0 conn(0x7fb3081853c0 legacy=0x7fb3081a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 monclient: found mon.noname-c 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30805d510 con 0x7fb30813f8b0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.668 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 5 monclient: authenticate success, global_id 4138 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2f40032e0 con 0x7fb30813f8b0 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: dump: 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2f40049a0 con 0x7fb30813f8b0 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 1 -- 10.20.193.187:0/4173699768 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2f4004d30 con 0x7fb30813f8b0 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb3067fc640 10 monclient: dump: 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.669 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 4 set_mon_vals no callback set 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: shutdown 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- 10.20.193.187:0/4173699768 >> v1:10.20.193.187:6789/0 conn(0x7fb30813f8b0 legacy=0x7fb30813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- 10.20.193.187:0/4173699768 shutdown_connections 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- 10.20.193.187:0/4173699768 >> 10.20.193.187:0/4173699768 conn(0x7fb3080545d0 msgr2=0x7fb3080549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- 10.20.193.187:0/4173699768 shutdown_connections 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- 10.20.193.187:0/4173699768 wait complete. 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: monmap: 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:epoch 0 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 0.000000 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:created 0.000000 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 1 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.670 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 Processor -- start 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- start start 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: init 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient(hunting): picked mon.noname-c con 0x7fb30805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient(hunting): picked mon.noname-a con 0x7fb30813f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient(hunting): picked mon.noname-b con 0x7fb3081853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308112130 con 0x7fb30813f8b0 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3081112c0 con 0x7fb3081853c0 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30810fdd0 con 0x7fb30805e4b0 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb30db20640 10 monclient(hunting): authenticate will time out at 543.413807s 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb307fff640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fb3081853c0 0x7fb308181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.187:44542/0 (socket says 10.20.193.187:44542) 2026-02-13T18:05:20.671 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.663+0000 7fb307fff640 1 -- 10.20.193.187:0/2711324825 learned_addr learned my addr 10.20.193.187:0/2711324825 (peer_addr_for_me v1:10.20.193.187:0/0) 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb307fff640 1 -- 10.20.193.187:0/2711324825 >> v1:10.20.193.187:6789/0 conn(0x7fb3081853c0 legacy=0x7fb308181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb3077fe640 1 -- 10.20.193.187:0/2711324825 >> v1:10.20.193.78:6790/0 conn(0x7fb30805e4b0 legacy=0x7fb30813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395876436 0 0) 0x7fb3081112c0 con 0x7fb3081853c0 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): my global_id is 4141 2026-02-13T18:05:20.674 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d8003620 con 0x7fb3081853c0 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb306ffd640 1 -- 10.20.193.187:0/2711324825 >> v1:10.20.193.78:6789/0 conn(0x7fb30813f8b0 legacy=0x7fb308180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 495297783 0 0) 0x7fb2d8003620 con 0x7fb3081853c0 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3081112c0 con 0x7fb3081853c0 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2fc004c20 con 0x7fb3081853c0 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): dump: 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.675 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687350241 0 0) 0x7fb30810fdd0 con 0x7fb30805e4b0 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): my global_id is 4142 2026-02-13T18:05:20.676 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d8003620 con 0x7fb30805e4b0 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853672390 0 0) 0x7fb308112130 con 0x7fb30813f8b0 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient(hunting): my global_id is 4149 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30810fdd0 con 0x7fb30813f8b0 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2269075435 0 0) 0x7fb3081112c0 con 0x7fb3081853c0 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 >> v1:10.20.193.78:6790/0 conn(0x7fb30805e4b0 legacy=0x7fb30813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 >> v1:10.20.193.78:6789/0 conn(0x7fb30813f8b0 legacy=0x7fb308180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 monclient: found mon.b 2026-02-13T18:05:20.677 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb308111890 con 0x7fb3081853c0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 5 monclient: authenticate success, global_id 4141 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 monclient: _renew_subs 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb30810f6f0 con 0x7fb3081853c0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 monclient: _renew_subs 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb308110930 con 0x7fb3081853c0 2026-02-13T18:05:20.678 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2fc005120 con 0x7fb3081853c0 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2fc0054c0 con 0x7fb3081853c0 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb305ffb640 4 set_mon_vals no callback set 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: dump: 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:epoch 1 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:election_strategy: 3 2026-02-13T18:05:20.679 INFO:teuthology.orchestra.run.trial187.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fb2fc006dd0 con 0x7fb3081853c0 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 979406734 0 0) 0x7fb2fc0085c0 con 0x7fb3081853c0 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3080008e0 con 0x7fb3081853c0 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fb308095530 con 0x7fb3081853c0 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.680 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.667+0000 7fb2e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.706 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.699+0000 7fb30db20640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f6df89ae-d7d7-4616-9af9-d386764d842f", "id": 5}] 2026-02-13T18:05:20.706 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.699+0000 7fb30db20640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f6df89ae-d7d7-4616-9af9-d386764d842f", "id": 5}] 2026-02-13T18:05:20.706 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.699+0000 7fb30db20640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:20.706 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.699+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f6df89ae-d7d7-4616-9af9-d386764d842f", "id": 5} v 0) -- 0x7fb308093020 con 0x7fb3081853c0 2026-02-13T18:05:20.709 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb2e3fff640 1 -- 10.20.193.187:0/2711324825 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6df89ae-d7d7-4616-9af9-d386764d842f", "id": 5}]=0 v8) ==== 112+0+2 (unknown 215170038 0 1988412176) 0x7fb2fc0079f0 con 0x7fb3081853c0 2026-02-13T18:05:20.709 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb2e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f6df89ae-d7d7-4616-9af9-d386764d842f", "id": 5}] 2026-02-13T18:05:20.709 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb2e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.709 INFO:teuthology.orchestra.run.trial187.stdout:5 2026-02-13T18:05:20.710 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 10 monclient: shutdown 2026-02-13T18:05:20.710 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.710 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 >> v1:10.20.193.187:6789/0 conn(0x7fb3081853c0 legacy=0x7fb308181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.711 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 shutdown_connections 2026-02-13T18:05:20.711 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 >> 10.20.193.187:0/2711324825 conn(0x7fb3080545d0 msgr2=0x7fb3081a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.711 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 shutdown_connections 2026-02-13T18:05:20.711 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T18:05:20.703+0000 7fb30db20640 1 -- 10.20.193.187:0/2711324825 wait complete. 2026-02-13T18:05:20.717 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-13T18:05:20.718 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-13T18:05:20.720 INFO:tasks.ceph.osd.0:Started 2026-02-13T18:05:20.720 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-13T18:05:20.720 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-13T18:05:20.723 INFO:tasks.ceph.osd.1:Started 2026-02-13T18:05:20.723 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-13T18:05:20.723 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-13T18:05:20.725 INFO:tasks.ceph.osd.2:Started 2026-02-13T18:05:20.726 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-13T18:05:20.726 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-13T18:05:20.728 INFO:tasks.ceph.osd.3:Started 2026-02-13T18:05:20.728 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-13T18:05:20.728 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-13T18:05:20.730 INFO:tasks.ceph.osd.4:Started 2026-02-13T18:05:20.730 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-13T18:05:20.730 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-13T18:05:20.732 INFO:tasks.ceph.osd.5:Started 2026-02-13T18:05:20.732 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T18:05:20.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.784+0000 7f60c29c6640 10 monclient: get_monmap_and_config 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.784+0000 7f60c29c6640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.784+0000 7f60c29c6640 10 monclient: monmap: 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:20.789431+0000 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:20.789431+0000 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.794 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 Processor -- start 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- start start 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient: init 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient(hunting): picked mon.noname-b con 0x7f60bc08e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient(hunting): picked mon.noname-c con 0x7f60bc08eee0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient(hunting): picked mon.noname-a con 0x7f60bc057870 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc056e90 con 0x7f60bc057870 2026-02-13T18:05:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc0565f0 con 0x7f60bc08eee0 2026-02-13T18:05:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc0568d0 con 0x7f60bc08e400 2026-02-13T18:05:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient(hunting): authenticate will time out at 551.844567s 2026-02-13T18:05:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60bbfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f60bc08e400 0x7f60bc08e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42892/0 (socket says 10.20.193.78:42892) 2026-02-13T18:05:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60bbfff640 1 -- 10.20.193.78:0/2802782316 learned_addr learned my addr 10.20.193.78:0/2802782316 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:20.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60bbfff640 1 -- 10.20.193.78:0/2802782316 >> v1:10.20.193.78:6790/0 conn(0x7f60bc08e400 legacy=0x7f60bc08e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c0f3c640 1 -- 10.20.193.78:0/2802782316 >> v1:10.20.193.78:6789/0 conn(0x7f60bc057870 legacy=0x7f60bc1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60bb7fe640 1 -- 10.20.193.78:0/2802782316 >> v1:10.20.193.187:6789/0 conn(0x7f60bc08eee0 legacy=0x7f60bc183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357706361 0 0) 0x7f60bc0568d0 con 0x7f60bc08e400 2026-02-13T18:05:20.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): my global_id is 4160 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60a0003620 con 0x7f60bc08e400 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270243858 0 0) 0x7f60bc056e90 con 0x7f60bc057870 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient(hunting): my global_id is 4170 2026-02-13T18:05:20.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60bc0568d0 con 0x7f60bc057870 2026-02-13T18:05:20.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1615753154 0 0) 0x7f60a0003620 con 0x7f60bc08e400 2026-02-13T18:05:20.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 >> v1:10.20.193.187:6789/0 conn(0x7f60bc08eee0 legacy=0x7f60bc183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 >> v1:10.20.193.78:6789/0 conn(0x7f60bc057870 legacy=0x7f60bc1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 monclient: found mon.noname-b 2026-02-13T18:05:20.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc08f530 con 0x7f60bc08e400 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 5 monclient: authenticate success, global_id 4160 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f60a8003110 con 0x7f60bc08e400 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: dump: 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.809 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60a80033e0 con 0x7f60bc08e400 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 1 -- 10.20.193.78:0/2802782316 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f60a8004b50 con 0x7f60bc08e400 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60baffd640 10 monclient: dump: 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.810 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 4 set_mon_vals no callback set 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 10 monclient: shutdown 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- 10.20.193.78:0/2802782316 >> v1:10.20.193.78:6790/0 conn(0x7f60bc08e400 legacy=0x7f60bc08e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- 10.20.193.78:0/2802782316 shutdown_connections 2026-02-13T18:05:20.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- 10.20.193.78:0/2802782316 >> 10.20.193.78:0/2802782316 conn(0x7f60bc054e30 msgr2=0x7f60bc093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- 10.20.193.78:0/2802782316 shutdown_connections 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.788+0000 7f60c29c6640 1 -- 10.20.193.78:0/2802782316 wait complete. 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: build_initial_monmap 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: monmap: 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:20.812 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 Processor -- start 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 -- start start 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: init 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient(hunting): picked mon.noname-c con 0x7f60bc057870 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient(hunting): picked mon.noname-a con 0x7f60bc08e400 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient(hunting): picked mon.noname-b con 0x7f60bc08eee0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc13f5f0 con 0x7f60bc08e400 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc141950 con 0x7f60bc08eee0 2026-02-13T18:05:20.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60bc1410b0 con 0x7f60bc057870 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient(hunting): authenticate will time out at 551.848526s 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60bbfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f60bc057870 0x7f60bc1532f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42898/0 (socket says 10.20.193.78:42898) 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60bbfff640 1 -- 10.20.193.78:0/3413729355 learned_addr learned my addr 10.20.193.78:0/3413729355 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60bbfff640 1 -- 10.20.193.78:0/3413729355 >> v1:10.20.193.78:6790/0 conn(0x7f60bc057870 legacy=0x7f60bc1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60bb7fe640 1 -- 10.20.193.78:0/3413729355 >> v1:10.20.193.78:6789/0 conn(0x7f60bc08e400 legacy=0x7f60bc194590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961881822 0 0) 0x7f60bc1410b0 con 0x7f60bc057870 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): my global_id is 4163 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f608c003620 con 0x7f60bc057870 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619706673 0 0) 0x7f60bc13f5f0 con 0x7f60bc08e400 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): my global_id is 4173 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60bc1410b0 con 0x7f60bc08e400 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c0f3c640 1 -- 10.20.193.78:0/3413729355 >> v1:10.20.193.187:6789/0 conn(0x7f60bc08eee0 legacy=0x7f60bc195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 455173613 0 0) 0x7f60bc1410b0 con 0x7f60bc08e400 2026-02-13T18:05:20.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60bc13f5f0 con 0x7f60bc08e400 2026-02-13T18:05:20.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f60ac003380 con 0x7f60bc08e400 2026-02-13T18:05:20.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:20.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:20.816 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:20.816 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3802082286 0 0) 0x7f608c003620 con 0x7f60bc057870 2026-02-13T18:05:20.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60bc1410b0 con 0x7f60bc057870 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f60a80048e0 con 0x7f60bc057870 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.818 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994557377 0 0) 0x7f60bc141950 con 0x7f60bc08eee0 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient(hunting): my global_id is 4165 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f608c003620 con 0x7f60bc08eee0 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 101278928 0 0) 0x7f60bc13f5f0 con 0x7f60bc08e400 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 >> v1:10.20.193.78:6790/0 conn(0x7f60bc057870 legacy=0x7f60bc1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 >> v1:10.20.193.187:6789/0 conn(0x7f60bc08eee0 legacy=0x7f60bc195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 monclient: found mon.a 2026-02-13T18:05:20.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1422a0 con 0x7f60bc08e400 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 5 monclient: authenticate success, global_id 4173 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: _renew_subs 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc140150 con 0x7f60bc08e400 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: _renew_subs 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f60bc13edb0 con 0x7f60bc08e400 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60ac0039c0 con 0x7f60bc08e400 2026-02-13T18:05:20.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f60ac003d20 con 0x7f60bc08e400 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 10 monclient: dump: 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:20.821 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60ba7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f60ac004350 con 0x7f60bc08e400 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 381672645 0 0) 0x7f60ac007030 con 0x7f60bc08e400 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.792+0000 7f60c29c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.796+0000 7f60c29c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.796+0000 7f60c29c6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.796+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc141490 con 0x7f60bc08e400 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.796+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f60ac0069d0 con 0x7f60bc08e400 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.796+0000 7f60b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:20.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.796+0000 7f60b8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60bc050ff0 con 0x7f60bc08e400 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60b8ff9640 1 -- 10.20.193.78:0/3413729355 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 1759638122) 0x7f60ac006d40 con 0x7f60bc08e400 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60b8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:20.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60b8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:20.830 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:20.830 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":8,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:05:20.703785+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 10 monclient: shutdown 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 >> v1:10.20.193.78:6789/0 conn(0x7f60bc08e400 legacy=0x7f60bc194590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 shutdown_connections 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 >> 10.20.193.78:0/3413729355 conn(0x7f60bc054e30 msgr2=0x7f60bc088550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 shutdown_connections 2026-02-13T18:05:20.831 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:20.824+0000 7f60c29c6640 1 -- 10.20.193.78:0/3413729355 wait complete. 2026-02-13T18:05:20.839 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-13T18:05:20.839 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-13T18:05:21.084 INFO:tasks.ceph.mgr.x.trial187.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-13T18:05:21.142 INFO:tasks.ceph.mgr.x.trial187.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-13T18:05:21.142 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-13T18:05:21.136+0000 7ff633063a40 -1 Falling back to public interface 2026-02-13T18:05:21.147 INFO:tasks.ceph.mgr.x.trial187.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-13T18:05:21.149 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-13T18:05:21.144+0000 7fa5678e3a40 -1 Falling back to public interface 2026-02-13T18:05:21.173 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-13T18:05:21.168+0000 7f811dc75a40 -1 Falling back to public interface 2026-02-13T18:05:21.199 INFO:tasks.ceph.mgr.x.trial187.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-13T18:05:21.292 INFO:tasks.ceph.osd.3.trial187.stderr:2026-02-13T18:05:21.287+0000 7f06ef84aa40 -1 Falling back to public interface 2026-02-13T18:05:21.312 INFO:tasks.ceph.osd.5.trial187.stderr:2026-02-13T18:05:21.307+0000 7fdd967d9a40 -1 Falling back to public interface 2026-02-13T18:05:21.312 INFO:tasks.ceph.osd.4.trial187.stderr:2026-02-13T18:05:21.307+0000 7f92e01b5a40 -1 Falling back to public interface 2026-02-13T18:05:21.444 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T18:05:21.517 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient: get_monmap_and_config 2026-02-13T18:05:21.517 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient: build_initial_monmap 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient: monmap: 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:21.514557+0000 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:21.514557+0000 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:21.518 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:21.519 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:21.520 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 1 Processor -- start 2026-02-13T18:05:21.520 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 1 -- start start 2026-02-13T18:05:21.520 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient: init 2026-02-13T18:05:21.520 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient(hunting): picked mon.noname-b con 0x7f0f3413f950 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient(hunting): picked mon.noname-c con 0x7f0f34092360 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient(hunting): picked mon.noname-a con 0x7f0f34185570 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f340901b0 con 0x7f0f34185570 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3405d3f0 con 0x7f0f34092360 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3405d6d0 con 0x7f0f3413f950 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f3b304640 10 monclient(hunting): authenticate will time out at 552.570176s 2026-02-13T18:05:21.521 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f39079640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0f3413f950 0x7f0f3413fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42900/0 (socket says 10.20.193.78:42900) 2026-02-13T18:05:21.522 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.512+0000 7f0f39079640 1 -- 10.20.193.78:0/863035440 learned_addr learned my addr 10.20.193.78:0/863035440 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:21.526 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f39079640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6790/0 conn(0x7f0f3413f950 legacy=0x7f0f3413fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:21.526 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3987a640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6789/0 conn(0x7f0f34185570 legacy=0x7f0f341a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:21.526 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533546279 0 0) 0x7f0f3405d6d0 con 0x7f0f3413f950 2026-02-13T18:05:21.526 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): my global_id is 4166 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c003620 con 0x7f0f3413f950 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177270504 0 0) 0x7f0f340901b0 con 0x7f0f34185570 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): my global_id is 4176 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3405d6d0 con 0x7f0f34185570 2026-02-13T18:05:21.527 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3987a640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6789/0 conn(0x7f0f34185570 legacy=0x7f0f341a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3987a640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6789/0 conn(0x7f0f34185570 legacy=0x7f0f341a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3987a640 1 --1- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6789/0 conn(0x7f0f34185570 0x7f0f341a5950 :-1 s=OPENED pgs=36 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3987a640 1 --1- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6789/0 conn(0x7f0f34185570 0x7f0f341a5950 :-1 s=OPENED pgs=36 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6789/0 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f38878640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.187:6789/0 conn(0x7f0f34092360 legacy=0x7f0f34183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1777867253 0 0) 0x7f0f1c003620 con 0x7f0f3413f950 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.187:6789/0 conn(0x7f0f34092360 legacy=0x7f0f34183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6789/0 conn(0x7f0f34185570 legacy=0x7f0f341a5950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 monclient: found mon.noname-b 2026-02-13T18:05:21.528 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3405d9b0 con 0x7f0f3413f950 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0f24003110 con 0x7f0f3413f950 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 5 monclient: authenticate success, global_id 4166 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: dump: 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:21.529 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f240033e0 con 0x7f0f3413f950 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:21.530 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 1 -- 10.20.193.78:0/863035440 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0f24004b50 con 0x7f0f3413f950 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f23fff640 10 monclient: dump: 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:21.531 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 4 set_mon_vals no callback set 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: shutdown 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- 10.20.193.78:0/863035440 >> v1:10.20.193.78:6790/0 conn(0x7f0f3413f950 legacy=0x7f0f3413fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- 10.20.193.78:0/863035440 shutdown_connections 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- 10.20.193.78:0/863035440 >> 10.20.193.78:0/863035440 conn(0x7f0f34054a00 msgr2=0x7f0f34095e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- 10.20.193.78:0/863035440 shutdown_connections 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- 10.20.193.78:0/863035440 wait complete. 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: build_initial_monmap 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: monmap: 2026-02-13T18:05:21.532 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 Processor -- start 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- start start 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: init 2026-02-13T18:05:21.533 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient(hunting): picked mon.noname-a con 0x7f0f34092360 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient(hunting): picked mon.noname-b con 0x7f0f3413f950 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient(hunting): picked mon.noname-c con 0x7f0f34185570 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f34111e30 con 0x7f0f34092360 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f34110fc0 con 0x7f0f3413f950 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3410fad0 con 0x7f0f34185570 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f3b304640 10 monclient(hunting): authenticate will time out at 552.574850s 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f39079640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0f34092360 0x7f0f3413e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40342/0 (socket says 10.20.193.78:40342) 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.516+0000 7f0f39079640 1 -- 10.20.193.78:0/3092626221 learned_addr learned my addr 10.20.193.78:0/3092626221 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3987a640 1 -- 10.20.193.78:0/3092626221 >> v1:10.20.193.78:6790/0 conn(0x7f0f34185570 legacy=0x7f0f34181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:21.534 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f39079640 1 -- 10.20.193.78:0/3092626221 >> v1:10.20.193.78:6789/0 conn(0x7f0f34092360 legacy=0x7f0f3413e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082843374 0 0) 0x7f0f3410fad0 con 0x7f0f34185570 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): my global_id is 4169 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f04003620 con 0x7f0f34185570 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:05:21.535 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f38878640 1 -- 10.20.193.78:0/3092626221 >> v1:10.20.193.187:6789/0 conn(0x7f0f3413f950 legacy=0x7f0f341806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:21.537 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425800637 0 0) 0x7f0f34111e30 con 0x7f0f34092360 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): my global_id is 4179 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3410fad0 con 0x7f0f34092360 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844011852 0 0) 0x7f0f34110fc0 con 0x7f0f3413f950 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): my global_id is 4171 2026-02-13T18:05:21.538 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f34111e30 con 0x7f0f3413f950 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3719114410 0 0) 0x7f0f04003620 con 0x7f0f34185570 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f34110fc0 con 0x7f0f34185570 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0f300049f0 con 0x7f0f34185570 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:21.539 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1215917706 0 0) 0x7f0f34110fc0 con 0x7f0f34185570 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 >> v1:10.20.193.187:6789/0 conn(0x7f0f3413f950 legacy=0x7f0f341806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 >> v1:10.20.193.78:6789/0 conn(0x7f0f34092360 legacy=0x7f0f3413e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 monclient: found mon.c 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:21.540 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f34111590 con 0x7f0f34185570 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 5 monclient: authenticate success, global_id 4169 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 10 monclient: _renew_subs 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3410f480 con 0x7f0f34185570 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 10 monclient: _renew_subs 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f341108b0 con 0x7f0f34185570 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f30004ed0 con 0x7f0f34185570 2026-02-13T18:05:21.541 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0f30005230 con 0x7f0f34185570 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 10 monclient: dump: 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:21.542 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f0f30005850 con 0x7f0f34185570 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f237fe640 4 set_mon_vals no callback set 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.520+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 381672645 0 0) 0x7f0f30008450 con 0x7f0f34185570 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f3b304640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f3b304640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f3b304640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f340008e0 con 0x7f0f34185570 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f0f30007e20 con 0x7f0f34185570 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f21ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:21.543 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.524+0000 7f0f21ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:21.558 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:21.558 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f34096770 con 0x7f0f34185570 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f21ffb640 1 -- 10.20.193.78:0/3092626221 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 1759638122) 0x7f0f30008190 con 0x7f0f34185570 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f21ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f21ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stdout: 2026-02-13T18:05:21.559 INFO:teuthology.misc.health.trial078.stdout:{"epoch":8,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:05:20.703785+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:05:21.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 10 monclient: shutdown 2026-02-13T18:05:21.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:21.560 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 >> v1:10.20.193.78:6790/0 conn(0x7f0f34185570 legacy=0x7f0f34181de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:21.561 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 shutdown_connections 2026-02-13T18:05:21.561 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 >> 10.20.193.78:0/3092626221 conn(0x7f0f34054a00 msgr2=0x7f0f3408f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:21.561 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 shutdown_connections 2026-02-13T18:05:21.561 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:21.552+0000 7f0f3b304640 1 -- 10.20.193.78:0/3092626221 wait complete. 2026-02-13T18:05:21.569 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-13T18:05:21.651 INFO:tasks.ceph.mgr.x.trial187.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-13T18:05:21.651 INFO:tasks.ceph.mgr.x.trial187.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-13T18:05:21.652 INFO:tasks.ceph.mgr.x.trial187.stderr: from numpy import show_config as show_numpy_config 2026-02-13T18:05:21.746 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-13T18:05:21.740+0000 7fa5678e3a40 -1 osd.0 0 log_to_monitors true 2026-02-13T18:05:21.756 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-13T18:05:21.752+0000 7ff633063a40 -1 osd.1 0 log_to_monitors true 2026-02-13T18:05:21.791 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-13T18:05:21.784+0000 7f811dc75a40 -1 osd.2 0 log_to_monitors true 2026-02-13T18:05:22.042 INFO:tasks.ceph.osd.3.trial187.stderr:2026-02-13T18:05:22.035+0000 7f06ef84aa40 -1 osd.3 0 log_to_monitors true 2026-02-13T18:05:22.067 INFO:tasks.ceph.osd.5.trial187.stderr:2026-02-13T18:05:22.063+0000 7fdd967d9a40 -1 osd.5 0 log_to_monitors true 2026-02-13T18:05:22.070 INFO:tasks.ceph.osd.4.trial187.stderr:2026-02-13T18:05:22.063+0000 7f92e01b5a40 -1 osd.4 0 log_to_monitors true 2026-02-13T18:05:23.456 INFO:tasks.ceph.mgr.x.trial187.stderr:2026-02-13T18:05:23.451+0000 7f165eeb1640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T18:05:23.464 INFO:tasks.ceph.mgr.x.trial187.stderr:2026-02-13T18:05:23.459+0000 7f165eeb1640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-13T18:05:24.452 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-13T18:05:24.444+0000 7ff62efeb640 -1 osd.1 0 waiting for initial osdmap 2026-02-13T18:05:24.453 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-13T18:05:24.448+0000 7fa56386b640 -1 osd.0 0 waiting for initial osdmap 2026-02-13T18:05:24.453 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-13T18:05:24.448+0000 7f8119bfd640 -1 osd.2 0 waiting for initial osdmap 2026-02-13T18:05:24.455 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-13T18:05:24.448+0000 7ff62a6d3640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T18:05:24.455 INFO:tasks.ceph.osd.4.trial187.stderr:2026-02-13T18:05:24.451+0000 7f92dc13d640 -1 osd.4 0 waiting for initial osdmap 2026-02-13T18:05:24.456 INFO:tasks.ceph.osd.5.trial187.stderr:2026-02-13T18:05:24.451+0000 7fdd92761640 -1 osd.5 0 waiting for initial osdmap 2026-02-13T18:05:24.456 INFO:tasks.ceph.osd.3.trial187.stderr:2026-02-13T18:05:24.451+0000 7f06eb7d2640 -1 osd.3 0 waiting for initial osdmap 2026-02-13T18:05:24.457 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-13T18:05:24.452+0000 7fa55e752640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T18:05:24.458 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-13T18:05:24.452+0000 7f81152e5640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T18:05:24.458 INFO:tasks.ceph.osd.4.trial187.stderr:2026-02-13T18:05:24.451+0000 7f92d7024640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T18:05:24.459 INFO:tasks.ceph.osd.5.trial187.stderr:2026-02-13T18:05:24.455+0000 7fdd8d648640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T18:05:24.459 INFO:tasks.ceph.osd.3.trial187.stderr:2026-02-13T18:05:24.455+0000 7f06e6eba640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T18:05:28.173 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T18:05:28.227 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient: get_monmap_and_config 2026-02-13T18:05:28.227 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient: build_initial_monmap 2026-02-13T18:05:28.227 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient: monmap: 2026-02-13T18:05:28.227 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-13T18:05:28.227 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:28.223938+0000 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:28.223938+0000 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:28.228 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 1 Processor -- start 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 1 -- start start 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient: init 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient(hunting): picked mon.noname-a con 0x7ff14008e5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:28.230 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient(hunting): picked mon.noname-b con 0x7ff140057ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient(hunting): picked mon.noname-c con 0x7ff14008f0b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1400574f0 con 0x7ff14008e5d0 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140056c50 con 0x7ff14008f0b0 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140056f30 con 0x7ff140057ed0 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff14774c640 10 monclient(hunting): authenticate will time out at 559.279427s 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff1454c1640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff14008e5d0 0x7ff14008e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40380/0 (socket says 10.20.193.78:40380) 2026-02-13T18:05:28.231 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.220+0000 7ff1454c1640 1 -- 10.20.193.78:0/3304958181 learned_addr learned my addr 10.20.193.78:0/3304958181 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:28.239 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff1454c1640 1 -- 10.20.193.78:0/3304958181 >> v1:10.20.193.78:6789/0 conn(0x7ff14008e5d0 legacy=0x7ff14008e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.239 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff144cc0640 1 -- 10.20.193.78:0/3304958181 >> v1:10.20.193.78:6790/0 conn(0x7ff140057ed0 legacy=0x7ff140184050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.239 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff145cc2640 1 -- 10.20.193.78:0/3304958181 >> v1:10.20.193.187:6789/0 conn(0x7ff14008f0b0 legacy=0x7ff1401a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.239 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513634368 0 0) 0x7ff1400574f0 con 0x7ff14008e5d0 2026-02-13T18:05:28.239 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.239 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): my global_id is 4224 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff128003620 con 0x7ff14008e5d0 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742162635 0 0) 0x7ff140056f30 con 0x7ff140057ed0 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): my global_id is 4214 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1400574f0 con 0x7ff140057ed0 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850683477 0 0) 0x7ff140056c50 con 0x7ff14008f0b0 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.240 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient(hunting): my global_id is 4216 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff140056f30 con 0x7ff14008f0b0 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 276458894 0 0) 0x7ff1400574f0 con 0x7ff140057ed0 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 >> v1:10.20.193.187:6789/0 conn(0x7ff14008f0b0 legacy=0x7ff1401a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 >> v1:10.20.193.78:6789/0 conn(0x7ff14008e5d0 legacy=0x7ff14008e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 monclient: found mon.noname-b 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14008e230 con 0x7ff140057ed0 2026-02-13T18:05:28.241 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: _finish_auth 0 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff1340030e0 con 0x7ff140057ed0 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: dump: 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.242 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 5 monclient: authenticate success, global_id 4214 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1340033b0 con 0x7ff140057ed0 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 1 -- 10.20.193.78:0/3304958181 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff1340038c0 con 0x7ff140057ed0 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff12ffff640 10 monclient: dump: 2026-02-13T18:05:28.243 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 4 set_mon_vals no callback set 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 10 monclient: shutdown 2026-02-13T18:05:28.244 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 -- 10.20.193.78:0/3304958181 >> v1:10.20.193.78:6790/0 conn(0x7ff140057ed0 legacy=0x7ff140184050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 -- 10.20.193.78:0/3304958181 shutdown_connections 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 -- 10.20.193.78:0/3304958181 >> 10.20.193.78:0/3304958181 conn(0x7ff140054e40 msgr2=0x7ff140093bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 -- 10.20.193.78:0/3304958181 shutdown_connections 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 -- 10.20.193.78:0/3304958181 wait complete. 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 10 monclient: build_initial_monmap 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 10 monclient: monmap: 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:epoch 0 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:created 0.000000 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:28.245 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 1 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 Processor -- start 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 1 -- start start 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.224+0000 7ff14774c640 10 monclient: init 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient(hunting): picked mon.noname-b con 0x7ff140057ed0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient(hunting): picked mon.noname-c con 0x7ff14008e5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:28.246 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient(hunting): picked mon.noname-a con 0x7ff14008f0b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140153f40 con 0x7ff14008f0b0 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140141c50 con 0x7ff140057ed0 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14012dae0 con 0x7ff14008e5d0 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient(hunting): authenticate will time out at 559.284151s 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff144cc0640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff14008e5d0 0x7ff140153830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42946/0 (socket says 10.20.193.78:42946) 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff144cc0640 1 -- 10.20.193.78:0/1994582773 learned_addr learned my addr 10.20.193.78:0/1994582773 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff144cc0640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.78:6790/0 conn(0x7ff14008e5d0 legacy=0x7ff140153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff145cc2640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.78:6789/0 conn(0x7ff14008f0b0 legacy=0x7ff1401955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580259800 0 0) 0x7ff14012dae0 con 0x7ff14008e5d0 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.247 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): my global_id is 4217 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff110003620 con 0x7ff14008e5d0 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475309679 0 0) 0x7ff140153f40 con 0x7ff14008f0b0 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): my global_id is 4227 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff14012dae0 con 0x7ff14008f0b0 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff1454c1640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.187:6789/0 conn(0x7ff140057ed0 legacy=0x7ff140153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1763579696 0 0) 0x7ff110003620 con 0x7ff14008e5d0 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff140153f40 con 0x7ff14008e5d0 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff134003710 con 0x7ff14008e5d0 2026-02-13T18:05:28.248 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): dump: 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.249 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2679993856 0 0) 0x7ff14012dae0 con 0x7ff14008f0b0 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff110003620 con 0x7ff14008f0b0 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff13c0048d0 con 0x7ff14008f0b0 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): dump: 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.250 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919709292 0 0) 0x7ff140141c50 con 0x7ff140057ed0 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient(hunting): my global_id is 4219 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff14012dae0 con 0x7ff140057ed0 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2760602529 0 0) 0x7ff140153f40 con 0x7ff14008e5d0 2026-02-13T18:05:28.251 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.187:6789/0 conn(0x7ff140057ed0 legacy=0x7ff140153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.78:6789/0 conn(0x7ff14008f0b0 legacy=0x7ff1401955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 monclient: found mon.c 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14012bbf0 con 0x7ff14008e5d0 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 5 monclient: authenticate success, global_id 4217 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _renew_subs 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:28.252 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff14012c060 con 0x7ff14008e5d0 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _renew_subs 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff14012b240 con 0x7ff14008e5d0 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1340033b0 con 0x7ff14008e5d0 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff134004050 con 0x7ff14008e5d0 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 10 monclient: dump: 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:epoch 1 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.253 INFO:teuthology.misc.health.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr: 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12f7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14012d910 con 0x7ff14008e5d0 2026-02-13T18:05:28.254 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 4) ==== 50352+0+0 (unknown 1699159941 0 0) 0x7ff134004320 con 0x7ff14008e5d0 2026-02-13T18:05:28.255 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.228+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(13..13 src has 1..13) ==== 3147+0+0 (unknown 3073486651 0 0) 0x7ff13404c2b0 con 0x7ff14008e5d0 2026-02-13T18:05:28.255 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.232+0000 7ff1454c1640 10 monclient: get_auth_request con 0x7ff11003d760 auth_method 0 2026-02-13T18:05:28.255 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.232+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7ff1340176a0 con 0x7ff14008e5d0 2026-02-13T18:05:28.255 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.232+0000 7ff12dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:28.255 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.232+0000 7ff12dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:28.324 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff14774c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff14774c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff14774c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff140055410 con 0x7ff14008e5d0 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff12dffb640 1 -- 10.20.193.78:0/1994582773 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8931 (unknown 62554612 0 1269982447) 0x7ff134016f80 con 0x7ff14008e5d0 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff12dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.316+0000 7ff12dffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:28.325 INFO:teuthology.misc.health.trial078.stdout: 2026-02-13T18:05:28.326 INFO:teuthology.misc.health.trial078.stdout:{"epoch":13,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:05:27.467539+0000","last_up_change":"2026-02-13T18:05:25.449453+0000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T18:05:25.773956+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":425425936}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":425425936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":425425936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":425425936}]},"public_addr":"10.20.193.78:6804/425425936","cluster_addr":"10.20.193.78:6805/425425936","heartbeat_back_addr":"10.20.193.78:6807/425425936","heartbeat_front_addr":"10.20.193.78:6806/425425936","state":["exists","up"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":444681404}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":444681404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":444681404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":444681404}]},"public_addr":"10.20.193.78:6800/444681404","cluster_addr":"10.20.193.78:6801/444681404","heartbeat_back_addr":"10.20.193.78:6803/444681404","heartbeat_front_addr":"10.20.193.78:6802/444681404","state":["exists","up"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2589033462}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":2589033462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":2589033462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":2589033462}]},"public_addr":"10.20.193.78:6808/2589033462","cluster_addr":"10.20.193.78:6809/2589033462","heartbeat_back_addr":"10.20.193.78:6811/2589033462","heartbeat_front_addr":"10.20.193.78:6810/2589033462","state":["exists","up"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6800","nonce":1622449099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6801","nonce":1622449099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6803","nonce":1622449099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6802","nonce":1622449099}]},"public_addr":"10.20.193.187:6800/1622449099","cluster_addr":"10.20.193.187:6801/1622449099","heartbeat_back_addr":"10.20.193.187:6803/1622449099","heartbeat_front_addr":"10.20.193.187:6802/1622449099","state":["exists","up"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6807","nonce":218078640}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6809","nonce":218078640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6811","nonce":218078640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6810","nonce":218078640}]},"public_addr":"10.20.193.187:6807/218078640","cluster_addr":"10.20.193.187:6809/218078640","heartbeat_back_addr":"10.20.193.187:6811/218078640","heartbeat_front_addr":"10.20.193.187:6810/218078640","state":["exists","up"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6804","nonce":1501659775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6805","nonce":1501659775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6808","nonce":1501659775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6806","nonce":1501659775}]},"public_addr":"10.20.193.187:6804/1501659775","cluster_addr":"10.20.193.187:6805/1501659775","heartbeat_back_addr":"10.20.193.187:6808/1501659775","heartbeat_front_addr":"10.20.193.187:6806/1501659775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:05:28.327 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.187:6812/2668687789 conn(0x7ff11003d760 legacy=0x7ff11005dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.327 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 10 monclient: shutdown 2026-02-13T18:05:28.327 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:28.328 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 >> v1:10.20.193.78:6790/0 conn(0x7ff14008e5d0 legacy=0x7ff140153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.328 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 shutdown_connections 2026-02-13T18:05:28.328 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 >> 10.20.193.78:0/1994582773 conn(0x7ff140054e40 msgr2=0x7ff1401413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:28.328 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 shutdown_connections 2026-02-13T18:05:28.328 INFO:teuthology.misc.health.trial078.stderr:2026-02-13T18:05:28.320+0000 7ff14774c640 1 -- 10.20.193.78:0/1994582773 wait complete. 2026-02-13T18:05:28.334 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-13T18:05:28.334 INFO:tasks.ceph:Creating RBD pool 2026-02-13T18:05:28.335 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-13T18:05:28.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.388+0000 7f5b577ff640 10 monclient: get_monmap_and_config 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.388+0000 7f5b577ff640 10 monclient: build_initial_monmap 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.388+0000 7f5b577ff640 10 monclient: monmap: 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:28.393456+0000 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:28.393456+0000 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:28.397 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:28.398 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:28.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 Processor -- start 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- start start 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient: init 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient(hunting): picked mon.noname-b con 0x7f5b5008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient(hunting): picked mon.noname-c con 0x7f5b5008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient(hunting): picked mon.noname-a con 0x7f5b5008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50089e80 con 0x7f5b5008cdd0 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50088c20 con 0x7f5b5008dc80 2026-02-13T18:05:28.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50089ba0 con 0x7f5b5008c2f0 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient(hunting): authenticate will time out at 559.448590s 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b55574640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5b5008c2f0 0x7f5b5008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42948/0 (socket says 10.20.193.78:42948) 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b55574640 1 -- 10.20.193.78:0/2294206203 learned_addr learned my addr 10.20.193.78:0/2294206203 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b55d75640 1 --1- 10.20.193.78:0/2294206203 >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 0x7f5b501a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40408/0 (socket says 10.20.193.78:40408) 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b55d75640 1 -- 10.20.193.78:0/2294206203 >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 legacy=0x7f5b501a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b55574640 1 -- 10.20.193.78:0/2294206203 >> v1:10.20.193.78:6790/0 conn(0x7f5b5008c2f0 legacy=0x7f5b5008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b54d73640 1 -- 10.20.193.78:0/2294206203 >> v1:10.20.193.187:6789/0 conn(0x7f5b5008dc80 legacy=0x7f5b50181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063927398 0 0) 0x7f5b50089e80 con 0x7f5b5008cdd0 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): my global_id is 4230 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b38003620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653086209 0 0) 0x7f5b50089ba0 con 0x7f5b5008c2f0 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): my global_id is 4220 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b50089e80 con 0x7f5b5008c2f0 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915762563 0 0) 0x7f5b50088c20 con 0x7f5b5008dc80 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient(hunting): my global_id is 4222 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b50089ba0 con 0x7f5b5008dc80 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2427418501 0 0) 0x7f5b38003620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 >> v1:10.20.193.78:6790/0 conn(0x7f5b5008c2f0 legacy=0x7f5b5008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 >> v1:10.20.193.187:6789/0 conn(0x7f5b5008dc80 legacy=0x7f5b50181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 monclient: found mon.noname-a 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5008d370 con 0x7f5b5008cdd0 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: _finish_auth 0 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:28.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b4c004620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 5 monclient: authenticate success, global_id 4230 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: dump: 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.407 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b55d75640 1 --1- 10.20.193.78:0/2294206203 >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 0x7f5b501a3410 :-1 s=OPENED pgs=63 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f5b4c005fa0 mon_map magic: 0 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b4c0048f0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 4 set_mon_vals no callback set 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 10 monclient: shutdown 2026-02-13T18:05:28.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- 10.20.193.78:0/2294206203 >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 legacy=0x7f5b501a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 1 -- 10.20.193.78:0/2294206203 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b4c005fa0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b3ffff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- 10.20.193.78:0/2294206203 shutdown_connections 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.392+0000 7f5b577ff640 1 -- 10.20.193.78:0/2294206203 >> 10.20.193.78:0/2294206203 conn(0x7f5b50091720 msgr2=0x7f5b50091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 -- 10.20.193.78:0/2294206203 shutdown_connections 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 -- 10.20.193.78:0/2294206203 wait complete. 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient: build_initial_monmap 2026-02-13T18:05:28.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient: monmap: 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 Processor -- start 2026-02-13T18:05:28.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 -- start start 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient: init 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient(hunting): picked mon.noname-b con 0x7f5b5008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient(hunting): picked mon.noname-a con 0x7f5b5008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient(hunting): picked mon.noname-c con 0x7f5b5008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50057a70 con 0x7f5b5008cdd0 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50081e80 con 0x7f5b5008c2f0 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50082160 con 0x7f5b5008dc80 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b577ff640 10 monclient(hunting): authenticate will time out at 559.453278s 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b54d73640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 0x7f5b50085ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40416/0 (socket says 10.20.193.78:40416) 2026-02-13T18:05:28.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b54d73640 1 -- 10.20.193.78:0/1955115406 learned_addr learned my addr 10.20.193.78:0/1955115406 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b54d73640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 legacy=0x7f5b50085ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b55d75640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.78:6790/0 conn(0x7f5b5008dc80 legacy=0x7f5b50195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362605178 0 0) 0x7f5b50089ba0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): my global_id is 4233 2026-02-13T18:05:28.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b20003620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596016853 0 0) 0x7f5b50082160 con 0x7f5b5008dc80 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): my global_id is 4223 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b50089ba0 con 0x7f5b5008dc80 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b55574640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.187:6789/0 conn(0x7f5b5008c2f0 legacy=0x7f5b500857c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 237310083 0 0) 0x7f5b20003620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b50082160 con 0x7f5b5008cdd0 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b440034c0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:28.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): dump: 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:28.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1553423171 0 0) 0x7f5b50089ba0 con 0x7f5b5008dc80 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b20003620 con 0x7f5b5008dc80 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b4c005fa0 con 0x7f5b5008dc80 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): dump: 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.418 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508264062 0 0) 0x7f5b50081e80 con 0x7f5b5008c2f0 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 10 monclient(hunting): my global_id is 4225 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.396+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b50089ba0 con 0x7f5b5008c2f0 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2018406566 0 0) 0x7f5b50082160 con 0x7f5b5008cdd0 2026-02-13T18:05:28.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.78:6790/0 conn(0x7f5b5008dc80 legacy=0x7f5b50195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.187:6789/0 conn(0x7f5b5008c2f0 legacy=0x7f5b500857c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 monclient: found mon.a 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b500865e0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 5 monclient: authenticate success, global_id 4233 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 monclient: _renew_subs 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:28.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b50082720 con 0x7f5b5008cdd0 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 monclient: _renew_subs 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b50080c70 con 0x7f5b5008cdd0 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b44003c30 con 0x7f5b5008cdd0 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b440037c0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: dump: 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:28.421 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3f7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:28.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b5008f620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 4) ==== 50352+0+0 (unknown 1699159941 0 0) 0x7f5b440040c0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 3147+0+0 (unknown 3073486651 0 0) 0x7f5b4404c3d0 con 0x7f5b5008cdd0 2026-02-13T18:05:28.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b55574640 10 monclient: get_auth_request con 0x7f5b2003d750 auth_method 0 2026-02-13T18:05:28.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f5b5008f620 con 0x7f5b5008cdd0 2026-02-13T18:05:28.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:28.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.400+0000 7f5b3dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:28.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.492+0000 7f5b577ff640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T18:05:28.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.492+0000 7f5b577ff640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T18:05:28.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.492+0000 7f5b577ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:28.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.492+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f5b50090810 con 0x7f5b5008cdd0 2026-02-13T18:05:28.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:28.704+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5b4404a1c0 con 0x7f5b5008cdd0 2026-02-13T18:05:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.472+0000 7f5b3dffb640 1 -- 10.20.193.78:0/1955115406 <== mon.0 v1:10.20.193.78:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (unknown 1237045831 0 0) 0x7f5b50057a70 con 0x7f5b5008cdd0 2026-02-13T18:05:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.472+0000 7f5b3dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T18:05:29.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.472+0000 7f5b3dffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-13T18:05:29.480 INFO:teuthology.orchestra.run.trial078.stderr:pool 'rbd' created 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.187:6812/2668687789 conn(0x7f5b2003d750 legacy=0x7f5b2005dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 10 monclient: shutdown 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 >> v1:10.20.193.78:6789/0 conn(0x7f5b5008cdd0 legacy=0x7f5b50085ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 shutdown_connections 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 >> 10.20.193.78:0/1955115406 conn(0x7f5b50091720 msgr2=0x7f5b50058c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 shutdown_connections 2026-02-13T18:05:29.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.476+0000 7f5b577ff640 1 -- 10.20.193.78:0/1955115406 wait complete. 2026-02-13T18:05:29.493 DEBUG:teuthology.orchestra.run.trial078:> rbd --cluster ceph pool init rbd 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.504+0000 7fb40cf7f200 10 monclient: get_monmap_and_config 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.504+0000 7fb40cf7f200 10 monclient: build_initial_monmap 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.504+0000 7fb40cf7f200 10 monclient: monmap: 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:29.508818+0000 2026-02-13T18:05:29.512 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:29.508818+0000 2026-02-13T18:05:29.513 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:29.513 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.513 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:29.513 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:29.513 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:29.513 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.504+0000 7fb40cf7f200 1 Processor -- start 2026-02-13T18:05:29.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.504+0000 7fb40cf7f200 1 -- start start 2026-02-13T18:05:29.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.504+0000 7fb40cf7f200 10 monclient: init 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: _reopen_session rank -1 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient(hunting): picked mon.noname-b con 0x5606d0321b40 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient(hunting): picked mon.noname-a con 0x5606d02711a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient(hunting): picked mon.noname-c con 0x5606d0322620 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5606d01af630 con 0x5606d02711a0 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5606d00f7f60 con 0x5606d0322620 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5606d00df120 con 0x5606d0321b40 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient(hunting): _renew_subs 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient(hunting): authenticate will time out at 560.564157s 2026-02-13T18:05:29.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40b255640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x5606d02711a0 0x5606d03630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40432/0 (socket says 10.20.193.78:40432) 2026-02-13T18:05:29.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40b255640 1 -- 10.20.193.78:0/991992575 learned_addr learned my addr 10.20.193.78:0/991992575 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40b255640 1 -- 10.20.193.78:0/991992575 >> v1:10.20.193.78:6789/0 conn(0x5606d02711a0 legacy=0x5606d03630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40ba56640 1 -- 10.20.193.78:0/991992575 >> v1:10.20.193.78:6790/0 conn(0x5606d0321b40 legacy=0x5606d0321f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294515127 0 0) 0x5606d01af630 con 0x5606d02711a0 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): _negotiate 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): my global_id is 4236 2026-02-13T18:05:29.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3f8001e20 con 0x5606d02711a0 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982653736 0 0) 0x5606d00df120 con 0x5606d0321b40 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): _negotiate 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient(hunting): my global_id is 4226 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5606d01af630 con 0x5606d0321b40 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40ccdf640 1 -- 10.20.193.78:0/991992575 >> v1:10.20.193.187:6789/0 conn(0x5606d0322620 legacy=0x5606d0384810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3373153943 0 0) 0x7fb3f8001e20 con 0x5606d02711a0 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 >> v1:10.20.193.78:6790/0 conn(0x5606d0321b40 legacy=0x5606d0321f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 >> v1:10.20.193.187:6789/0 conn(0x5606d0322620 legacy=0x5606d0384810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: _finish_hunting 0 2026-02-13T18:05:29.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 monclient: found mon.noname-a 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d00e1f30 con 0x5606d02711a0 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: _finish_auth 0 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: _check_auth_tickets 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb3f4001910 con 0x5606d02711a0 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: dump: 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.524 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 5 monclient: authenticate success, global_id 4236 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3f4001be0 con 0x5606d02711a0 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:29.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 1 -- 10.20.193.78:0/991992575 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb3f4003350 con 0x5606d02711a0 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40aa54640 10 monclient: dump: 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:29.526 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: get_monmap_and_config success 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 4 set_mon_vals no callback set 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: shutdown 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- 10.20.193.78:0/991992575 >> v1:10.20.193.78:6789/0 conn(0x5606d02711a0 legacy=0x5606d03630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- 10.20.193.78:0/991992575 shutdown_connections 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- 10.20.193.78:0/991992575 >> 10.20.193.78:0/991992575 conn(0x5606d02751b0 msgr2=0x5606d02755b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- 10.20.193.78:0/991992575 shutdown_connections 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- 10.20.193.78:0/991992575 wait complete. 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: build_initial_monmap 2026-02-13T18:05:29.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: monmap: 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 Processor -- start 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 1 -- start start 2026-02-13T18:05:29.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.508+0000 7fb40cf7f200 10 monclient: init 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _reopen_session rank -1 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient(hunting): picked mon.noname-a con 0x5606d02711a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient(hunting): picked mon.noname-c con 0x5606d0321b40 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient(hunting): picked mon.noname-b con 0x5606d0322620 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5606d00a5690 con 0x5606d02711a0 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5606d00d02e0 con 0x5606d0322620 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5606d02f0b90 con 0x5606d0321b40 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient(hunting): _renew_subs 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient(hunting): authenticate will time out at 560.568120s 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40ba56640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x5606d02711a0 0x5606d0310160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40442/0 (socket says 10.20.193.78:40442) 2026-02-13T18:05:29.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40ba56640 1 -- 10.20.193.78:0/2106981465 learned_addr learned my addr 10.20.193.78:0/2106981465 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40ba56640 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.78:6789/0 conn(0x5606d02711a0 legacy=0x5606d0310160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40b255640 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.78:6790/0 conn(0x5606d0321b40 legacy=0x5606d0311190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.187:6789/0 conn(0x5606d0322620 legacy=0x5606d03128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326760724 0 0) 0x5606d00a5690 con 0x5606d02711a0 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): my global_id is 4239 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3ec001e20 con 0x5606d02711a0 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119599032 0 0) 0x5606d00e1f30 con 0x5606d0321b40 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:29.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): my global_id is 4229 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5606d00a5690 con 0x5606d0321b40 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153825410 0 0) 0x5606d00d02e0 con 0x5606d0322620 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): my global_id is 4231 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5606d00e1f30 con 0x5606d0322620 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 788007959 0 0) 0x7fb3ec001e20 con 0x5606d02711a0 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5606d00d02e0 con 0x5606d02711a0 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb400001c90 con 0x5606d02711a0 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:29.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): dump: 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3129363564 0 0) 0x5606d00a5690 con 0x5606d0321b40 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3ec001e20 con 0x5606d0321b40 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb3f40030e0 con 0x5606d0321b40 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): dump: 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.533 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 301996645 0 0) 0x5606d00e1f30 con 0x5606d0322620 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5606d00a5690 con 0x5606d0322620 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb3fc003050 con 0x5606d0322620 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient(hunting): dump: 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.534 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 182738233 0 0) 0x5606d00d02e0 con 0x5606d02711a0 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.78:6790/0 conn(0x5606d0321b40 legacy=0x5606d0311190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.187:6789/0 conn(0x5606d0322620 legacy=0x5606d03128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 monclient: found mon.a 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:29.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d0305680 con 0x5606d02711a0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 5 monclient: authenticate success, global_id 4239 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _renew_subs 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x5606d02ef0d0 con 0x5606d02711a0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _renew_subs 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x5606d02efe40 con 0x5606d02711a0 2026-02-13T18:05:29.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4000023f0 con 0x5606d02711a0 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb400002780 con 0x5606d02711a0 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 10 monclient: dump: 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:29.537 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40a253640 4 set_mon_vals no callback set 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb4000029d0 con 0x5606d02711a0 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3492+0+0 (unknown 1981866071 0 0) 0x7fb40004ade0 con 0x5606d02711a0 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.512+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5606d02ee8c0 con 0x5606d02711a0 2026-02-13T18:05:29.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:29.516+0000 7fb40b255640 10 monclient: get_auth_request con 0x7fb3ec03c1a0 auth_method 0 2026-02-13T18:05:30.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (unknown 2855932958 0 0) 0x7fb400015f30 con 0x5606d02711a0 2026-02-13T18:05:30.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb3f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T18:05:30.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb3f3fff640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-13T18:05:30.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40cf7f200 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:30.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb3f4001be0 con 0x5606d02711a0 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (unknown 3847591702 0 0) 0x7fb4000155e0 con 0x5606d02711a0 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb3f3fff640 10 monclient: handle_get_version_reply finishing 1 version 16 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40a253640 10 monclient: _renew_subs 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40a253640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40a253640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=16}) -- 0x7fb3e4002af0 con 0x5606d02711a0 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 11 ==== osd_map(16..16 src has 1..16) ==== 661+0+0 (unknown 220299294 0 0) 0x7fb400017390 con 0x5606d02711a0 2026-02-13T18:05:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6804/1501659775 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x5606d0315ff0 con 0x5606d03144e0 2026-02-13T18:05:30.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.480+0000 7fb40ccdf640 10 monclient: get_auth_request con 0x5606d03144e0 auth_method 0 2026-02-13T18:05:30.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 <== osd.5 v1:10.20.193.187:6804/1501659775 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 2685446591 0 0) 0x7fb3fc005730 con 0x5606d03144e0 2026-02-13T18:05:30.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6804/1501659775 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x5606d03f2ef0 con 0x5606d03144e0 2026-02-13T18:05:30.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 <== osd.5 v1:10.20.193.187:6804/1501659775 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2026326479 0 0) 0x7fb3fc005730 con 0x5606d03144e0 2026-02-13T18:05:30.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6804/1501659775 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x5606d03f2000 con 0x5606d03144e0 2026-02-13T18:05:30.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 <== osd.5 v1:10.20.193.187:6804/1501659775 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2039985091 0 0) 0x7fb3fc005730 con 0x5606d03144e0 2026-02-13T18:05:30.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb409a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:30.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:30.488+0000 7fb409a52640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fb3e8001f50 con 0x5606d02711a0 2026-02-13T18:05:31.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (unknown 2714712314 0 0) 0x7fb40001b1f0 con 0x5606d02711a0 2026-02-13T18:05:31.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb3f3fff640 10 monclient: _renew_subs 2026-02-13T18:05:31.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb3f3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:31.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=17}) -- 0x5606d00d02e0 con 0x5606d02711a0 2026-02-13T18:05:31.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 13 ==== osd_map(17..17 src has 1..17) ==== 629+0+0 (unknown 179780776 0 0) 0x7fb400020180 con 0x5606d02711a0 2026-02-13T18:05:31.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb40a253640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6804/1501659775 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fb3e4005860 con 0x5606d03144e0 2026-02-13T18:05:31.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 <== osd.5 v1:10.20.193.187:6804/1501659775 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 3115756469 0 0) 0x7fb3fc005730 con 0x5606d03144e0 2026-02-13T18:05:31.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb409a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:31.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:31.484+0000 7fb409a52640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7fb3e80033c0 con 0x5606d02711a0 2026-02-13T18:05:32.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:32.512+0000 7fb3f2ffd640 10 monclient: tick 2026-02-13T18:05:32.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:32.512+0000 7fb3f2ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:32.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:32.512+0000 7fb3f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:32.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:32.512+0000 7fb3f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.224+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (unknown 1250323290 0 0) 0x7fb40001d7d0 con 0x5606d02711a0 2026-02-13T18:05:33.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.224+0000 7fb3f3fff640 10 monclient: _renew_subs 2026-02-13T18:05:33.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.224+0000 7fb3f3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.224+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=18}) -- 0x5606d00e1f30 con 0x5606d02711a0 2026-02-13T18:05:33.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.224+0000 7fb3f3fff640 1 -- 10.20.193.78:0/2106981465 <== mon.0 v1:10.20.193.78:6789/0 15 ==== osd_map(18..18 src has 1..18) ==== 657+0+0 (unknown 197376724 0 0) 0x7fb400020380 con 0x5606d02711a0 2026-02-13T18:05:33.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.224+0000 7fb40a253640 1 -- 10.20.193.78:0/2106981465 --> v1:10.20.193.187:6804/1501659775 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7fb3e4005c40 con 0x5606d03144e0 2026-02-13T18:05:33.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 <== osd.5 v1:10.20.193.187:6804/1501659775 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 4030416863 0 0) 0x7fb3fc005730 con 0x5606d03144e0 2026-02-13T18:05:33.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.187:6804/1501659775 conn(0x5606d03144e0 legacy=0x5606d03148d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb3ec03c1a0 legacy=0x7fb3ec05c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 10 monclient: shutdown 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 >> v1:10.20.193.78:6789/0 conn(0x5606d02711a0 legacy=0x5606d0310160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40ccdf640 1 -- 10.20.193.78:0/2106981465 reap_dead start 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 shutdown_connections 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 >> 10.20.193.78:0/2106981465 conn(0x5606d02751b0 msgr2=0x5606d0275580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 shutdown_connections 2026-02-13T18:05:33.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.228+0000 7fb40cf7f200 1 -- 10.20.193.78:0/2106981465 wait complete. 2026-02-13T18:05:33.240 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-13T18:05:33.241 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-13T18:05:33.241 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-13T18:05:33.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient: get_monmap_and_config 2026-02-13T18:05:33.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient: monmap: 2026-02-13T18:05:33.339 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:33.336429+0000 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:33.336429+0000 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:33.340 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 1 Processor -- start 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 1 -- start start 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient: init 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient(hunting): picked mon.noname-a con 0x7f01d4085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient(hunting): picked mon.noname-c con 0x7f01d4085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient(hunting): picked mon.noname-b con 0x7f01d4181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d4088400 con 0x7f01d4085790 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d4088120 con 0x7f01d4085b60 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d408c550 con 0x7f01d4181d50 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d90db640 10 monclient(hunting): authenticate will time out at 564.391767s 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d2d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f01d4085790 0x7f01d4089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51422/0 (socket says 10.20.193.78:51422) 2026-02-13T18:05:33.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.332+0000 7f01d2d76640 1 -- 10.20.193.78:0/715268743 learned_addr learned my addr 10.20.193.78:0/715268743 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d3577640 1 -- 10.20.193.78:0/715268743 >> v1:10.20.193.78:6790/0 conn(0x7f01d4181d50 legacy=0x7f01d41a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d2d76640 1 -- 10.20.193.78:0/715268743 >> v1:10.20.193.78:6789/0 conn(0x7f01d4085790 legacy=0x7f01d4089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d2575640 1 -- 10.20.193.78:0/715268743 >> v1:10.20.193.187:6789/0 conn(0x7f01d4085b60 legacy=0x7f01d4085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716784498 0 0) 0x7f01d408c550 con 0x7f01d4181d50 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): my global_id is 4232 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c00058b0 con 0x7f01d4181d50 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801453735 0 0) 0x7f01c8002c60 con 0x7f01d4085790 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): my global_id is 4242 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01d408c550 con 0x7f01d4085790 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322531007 0 0) 0x7f01d4088120 con 0x7f01d4085b60 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient(hunting): my global_id is 4234 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c8002c60 con 0x7f01d4085b60 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2780972649 0 0) 0x7f01c00058b0 con 0x7f01d4181d50 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 >> v1:10.20.193.187:6789/0 conn(0x7f01d4085b60 legacy=0x7f01d4085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 >> v1:10.20.193.78:6789/0 conn(0x7f01d4085790 legacy=0x7f01d4089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 monclient: found mon.noname-b 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d4087540 con 0x7f01d4181d50 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01c4004670 con 0x7f01d4181d50 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: dump: 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.350 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 5 monclient: authenticate success, global_id 4232 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01c4004940 con 0x7f01d4181d50 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 1 -- 10.20.193.78:0/715268743 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01c4004dd0 con 0x7f01d4181d50 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d1d74640 10 monclient: dump: 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.351 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 4 set_mon_vals no callback set 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 10 monclient: shutdown 2026-02-13T18:05:33.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 -- 10.20.193.78:0/715268743 >> v1:10.20.193.78:6790/0 conn(0x7f01d4181d50 legacy=0x7f01d41a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 -- 10.20.193.78:0/715268743 shutdown_connections 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 -- 10.20.193.78:0/715268743 >> 10.20.193.78:0/715268743 conn(0x7f01d4091720 msgr2=0x7f01d4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 -- 10.20.193.78:0/715268743 shutdown_connections 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 -- 10.20.193.78:0/715268743 wait complete. 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 10 monclient: monmap: 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.353 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 Processor -- start 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 1 -- start start 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.336+0000 7f01d90db640 10 monclient: init 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient(hunting): picked mon.noname-a con 0x7f01d4085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient(hunting): picked mon.noname-b con 0x7f01d4085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient(hunting): picked mon.noname-c con 0x7f01d4181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d413f530 con 0x7f01d4085790 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d413f810 con 0x7f01d4085b60 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d405d6c0 con 0x7f01d4181d50 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient(hunting): authenticate will time out at 564.396419s 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d2d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f01d4085790 0x7f01d4150260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51424/0 (socket says 10.20.193.78:51424) 2026-02-13T18:05:33.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d2d76640 1 -- 10.20.193.78:0/3600195316 learned_addr learned my addr 10.20.193.78:0/3600195316 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d2d76640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.78:6789/0 conn(0x7f01d4085790 legacy=0x7f01d4150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d3577640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.78:6790/0 conn(0x7f01d4181d50 legacy=0x7f01d4175a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206281285 0 0) 0x7f01d413f530 con 0x7f01d4085790 2026-02-13T18:05:33.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): my global_id is 4245 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01a0003620 con 0x7f01d4085790 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838009247 0 0) 0x7f01d405d6c0 con 0x7f01d4181d50 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): my global_id is 4235 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01d413f530 con 0x7f01d4181d50 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d2575640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.187:6789/0 conn(0x7f01d4085b60 legacy=0x7f01d4174320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 529344965 0 0) 0x7f01a0003620 con 0x7f01d4085790 2026-02-13T18:05:33.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01d405d6c0 con 0x7f01d4085790 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01c8004a90 con 0x7f01d4085790 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): dump: 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.361 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1922514032 0 0) 0x7f01d413f530 con 0x7f01d4181d50 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01a0003620 con 0x7f01d4181d50 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01c4004c20 con 0x7f01d4181d50 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient(hunting): dump: 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.362 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 398376819 0 0) 0x7f01d405d6c0 con 0x7f01d4085790 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.78:6790/0 conn(0x7f01d4181d50 legacy=0x7f01d4175a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.187:6789/0 conn(0x7f01d4085b60 legacy=0x7f01d4174320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 monclient: found mon.a 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d4089da0 con 0x7f01d4085790 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 5 monclient: authenticate success, global_id 4245 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient: _renew_subs 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01d4088910 con 0x7f01d4085790 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient: _renew_subs 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f01d413ff70 con 0x7f01d4085790 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01c8005010 con 0x7f01d4085790 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01c8003570 con 0x7f01d4085790 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01b37fe640 10 monclient: dump: 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.365 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d1573640 4 set_mon_vals no callback set 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.340+0000 7f01d90db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01d90db640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01d90db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f01c8011860 con 0x7f01d4085790 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d40389c0 con 0x7f01d4085790 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f01c804c7b0 con 0x7f01d4085790 2026-02-13T18:05:33.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01d2575640 10 monclient: get_auth_request con 0x7f01a003d6e0 auth_method 0 2026-02-13T18:05:33.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f01d4088400 con 0x7f01d4085790 2026-02-13T18:05:33.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.344+0000 7f01b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.432+0000 7f01d90db640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.432+0000 7f01d90db640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.432+0000 7f01d90db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.432+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f01d408f600 con 0x7f01d4085790 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01b37fe640 1 -- 10.20.193.78:0/3600195316 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f01c8017920 con 0x7f01d4085790 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T18:05:33.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:33.442 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.187:6812/2668687789 conn(0x7f01a003d6e0 legacy=0x7f01a005db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 10 monclient: shutdown 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 >> v1:10.20.193.78:6789/0 conn(0x7f01d4085790 legacy=0x7f01d4150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 shutdown_connections 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 >> 10.20.193.78:0/3600195316 conn(0x7f01d4091720 msgr2=0x7f01d408b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 shutdown_connections 2026-02-13T18:05:33.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.436+0000 7f01d90db640 1 -- 10.20.193.78:0/3600195316 wait complete. 2026-02-13T18:05:33.451 INFO:teuthology.orchestra.run.trial078.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-13T18:05:33.452 INFO:tasks.ceph_manager:config epoch is 1 2026-02-13T18:05:33.452 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T18:05:33.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-13T18:05:33.452 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-13T18:05:33.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient: get_monmap_and_config 2026-02-13T18:05:33.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient: monmap: 2026-02-13T18:05:33.523 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.523 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.523 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:33.519798+0000 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:33.519798+0000 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:33.524 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 1 Processor -- start 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 1 -- start start 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient: init 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient(hunting): picked mon.noname-b con 0x7f5810085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient(hunting): picked mon.noname-c con 0x7f5810085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient(hunting): picked mon.noname-a con 0x7f5810181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5810088400 con 0x7f5810181d50 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5810088120 con 0x7f5810085b60 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581008c550 con 0x7f5810085790 2026-02-13T18:05:33.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5816d13640 10 monclient(hunting): authenticate will time out at 564.575165s 2026-02-13T18:05:33.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5814a88640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5810085790 0x7f5810089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57848/0 (socket says 10.20.193.78:57848) 2026-02-13T18:05:33.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.516+0000 7f5814a88640 1 -- 10.20.193.78:0/1954854936 learned_addr learned my addr 10.20.193.78:0/1954854936 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5815289640 1 -- 10.20.193.78:0/1954854936 >> v1:10.20.193.78:6789/0 conn(0x7f5810181d50 legacy=0x7f58101a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5814a88640 1 -- 10.20.193.78:0/1954854936 >> v1:10.20.193.78:6790/0 conn(0x7f5810085790 legacy=0x7f5810089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58069142 0 0) 0x7f580c0041c0 con 0x7f5810181d50 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): my global_id is 4248 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5807fff640 1 -- 10.20.193.78:0/1954854936 >> v1:10.20.193.187:6789/0 conn(0x7f5810085b60 legacy=0x7f5810085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57fc0058b0 con 0x7f5810181d50 2026-02-13T18:05:33.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449222409 0 0) 0x7f581008c550 con 0x7f5810085790 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient(hunting): my global_id is 4238 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f580c0041c0 con 0x7f5810085790 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3050831177 0 0) 0x7f57fc0058b0 con 0x7f5810181d50 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 >> v1:10.20.193.78:6790/0 conn(0x7f5810085790 legacy=0x7f5810089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 >> v1:10.20.193.187:6789/0 conn(0x7f5810085b60 legacy=0x7f5810085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 monclient: found mon.noname-a 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5810087540 con 0x7f5810181d50 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f580c004840 con 0x7f5810181d50 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 5 monclient: authenticate success, global_id 4248 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: dump: 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.536 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f580c004c20 con 0x7f5810181d50 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 1 -- 10.20.193.78:0/1954854936 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f580c004fb0 con 0x7f5810181d50 2026-02-13T18:05:33.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f58077fe640 10 monclient: dump: 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 4 set_mon_vals no callback set 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: shutdown 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- 10.20.193.78:0/1954854936 >> v1:10.20.193.78:6789/0 conn(0x7f5810181d50 legacy=0x7f58101a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- 10.20.193.78:0/1954854936 shutdown_connections 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- 10.20.193.78:0/1954854936 >> 10.20.193.78:0/1954854936 conn(0x7f5810091720 msgr2=0x7f5810091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- 10.20.193.78:0/1954854936 shutdown_connections 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- 10.20.193.78:0/1954854936 wait complete. 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: monmap: 2026-02-13T18:05:33.539 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 Processor -- start 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- start start 2026-02-13T18:05:33.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: init 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient(hunting): picked mon.noname-a con 0x7f5810085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient(hunting): picked mon.noname-c con 0x7f5810085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient(hunting): picked mon.noname-b con 0x7f5810181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581013f910 con 0x7f5810085790 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5810153f00 con 0x7f5810181d50 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581005d460 con 0x7f5810085b60 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5814a88640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5810085790 0x7f58101530e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51444/0 (socket says 10.20.193.78:51444) 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5814a88640 1 -- 10.20.193.78:0/916441289 learned_addr learned my addr 10.20.193.78:0/916441289 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.520+0000 7f5816d13640 10 monclient(hunting): authenticate will time out at 564.579903s 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5814a88640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.78:6789/0 conn(0x7f5810085790 legacy=0x7f58101530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5807fff640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.78:6790/0 conn(0x7f5810085b60 legacy=0x7f58101537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987926243 0 0) 0x7f581013f910 con 0x7f5810085790 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): my global_id is 4251 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57e0003620 con 0x7f5810085790 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5815289640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.187:6789/0 conn(0x7f5810181d50 legacy=0x7f5810175670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417460580 0 0) 0x7f581005d460 con 0x7f5810085b60 2026-02-13T18:05:33.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): my global_id is 4241 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f581013f910 con 0x7f5810085b60 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 999775832 0 0) 0x7f57e0003620 con 0x7f5810085790 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f581005d460 con 0x7f5810085790 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5800003360 con 0x7f5810085790 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): dump: 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.543 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3148097825 0 0) 0x7f581013f910 con 0x7f5810085b60 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57e0003620 con 0x7f5810085b60 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716514338 0 0) 0x7f5810153f00 con 0x7f5810181d50 2026-02-13T18:05:33.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): my global_id is 4243 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f581013f910 con 0x7f5810181d50 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57f8003380 con 0x7f5810085b60 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient(hunting): dump: 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.545 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3818998262 0 0) 0x7f581005d460 con 0x7f5810085790 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.78:6790/0 conn(0x7f5810085b60 legacy=0x7f58101537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.187:6789/0 conn(0x7f5810181d50 legacy=0x7f5810175670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 monclient: found mon.a 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5810088910 con 0x7f5810085790 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 5 monclient: authenticate success, global_id 4251 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 monclient: _renew_subs 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f581013e110 con 0x7f5810085790 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 monclient: _renew_subs 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5810140090 con 0x7f5810085790 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5800004b90 con 0x7f5810085790 2026-02-13T18:05:33.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5800004ef0 con 0x7f5810085790 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 10 monclient: dump: 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.548 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5806ffd640 4 set_mon_vals no callback set 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f58000051c0 con 0x7f5810085790 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58100389c0 con 0x7f5810085790 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f580004c650 con 0x7f5810085790 2026-02-13T18:05:33.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.524+0000 7f5807fff640 10 monclient: get_auth_request con 0x7f57e003d880 auth_method 0 2026-02-13T18:05:33.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.528+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f58000177c0 con 0x7f5810085790 2026-02-13T18:05:33.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.528+0000 7f58057fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.528+0000 7f58057fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:33.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-13T18:05:33.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-13T18:05:33.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5810090810 con 0x7f5810085790 2026-02-13T18:05:33.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f58057fa640 1 -- 10.20.193.78:0/916441289 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+95498 (unknown 481731318 0 3985095503) 0x7f58000170a0 con 0x7f5810085790 2026-02-13T18:05:33.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f58057fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-13T18:05:33.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f58057fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:33.640 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.187:6812/2668687789 conn(0x7f57e003d880 legacy=0x7f57e005dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 10 monclient: shutdown 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 >> v1:10.20.193.78:6789/0 conn(0x7f5810085790 legacy=0x7f58101530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 shutdown_connections 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 >> 10.20.193.78:0/916441289 conn(0x7f5810091720 msgr2=0x7f581005bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 shutdown_connections 2026-02-13T18:05:33.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.632+0000 7f5816d13640 1 -- 10.20.193.78:0/916441289 wait complete. 2026-02-13T18:05:33.650 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6812","nonce":2668687789}]},"active_addr":"10.20.193.187:6812/2668687789","active_change":"2026-02-13T18:05:21.721575+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.187:0","nonce":1683834306}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.187:0","nonce":2610567514}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.187:0","nonce":3843414593}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.187:0","nonce":543560415}]}]} 2026-02-13T18:05:33.654 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-13T18:05:33.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-13T18:05:33.654 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient: get_monmap_and_config 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient: monmap: 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:33.723572+0000 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:33.723572+0000 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.727 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.728 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.728 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:33.728 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:33.728 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 1 Processor -- start 2026-02-13T18:05:33.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 1 -- start start 2026-02-13T18:05:33.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient: init 2026-02-13T18:05:33.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient(hunting): picked mon.noname-c con 0x7fb05c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient(hunting): picked mon.noname-a con 0x7fb05c05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient(hunting): picked mon.noname-b con 0x7fb05c1853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c095530 con 0x7fb05c05e4b0 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c140390 con 0x7fb05c13f8b0 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c05d230 con 0x7fb05c1853c0 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb06246f640 10 monclient(hunting): authenticate will time out at 564.778710s 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb05b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb05c05e4b0 0x7fb05c183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51448/0 (socket says 10.20.193.78:51448) 2026-02-13T18:05:33.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.720+0000 7fb05b7fe640 1 -- 10.20.193.78:0/3744948520 learned_addr learned my addr 10.20.193.78:0/3744948520 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05b7fe640 1 -- 10.20.193.78:0/3744948520 >> v1:10.20.193.78:6789/0 conn(0x7fb05c05e4b0 legacy=0x7fb05c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb0609e5640 1 -- 10.20.193.78:0/3744948520 >> v1:10.20.193.78:6790/0 conn(0x7fb05c1853c0 legacy=0x7fb05c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861261325 0 0) 0x7fb04c002c60 con 0x7fb05c05e4b0 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): my global_id is 4254 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb040003620 con 0x7fb05c05e4b0 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145253050 0 0) 0x7fb05c05d230 con 0x7fb05c1853c0 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient(hunting): my global_id is 4244 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb04c002c60 con 0x7fb05c1853c0 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3602664912 0 0) 0x7fb040003620 con 0x7fb05c05e4b0 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 >> v1:10.20.193.78:6790/0 conn(0x7fb05c1853c0 legacy=0x7fb05c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 >> v1:10.20.193.187:6789/0 conn(0x7fb05c13f8b0 legacy=0x7fb05c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 monclient: found mon.noname-a 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c05d510 con 0x7fb05c05e4b0 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 5 monclient: authenticate success, global_id 4254 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c0032e0 con 0x7fb05c05e4b0 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: dump: 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.736 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb04c0049a0 con 0x7fb05c05e4b0 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 1 -- 10.20.193.78:0/3744948520 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c004d30 con 0x7fb05c05e4b0 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05affd640 10 monclient: dump: 2026-02-13T18:05:33.737 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 4 set_mon_vals no callback set 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: shutdown 2026-02-13T18:05:33.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- 10.20.193.78:0/3744948520 >> v1:10.20.193.78:6789/0 conn(0x7fb05c05e4b0 legacy=0x7fb05c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- 10.20.193.78:0/3744948520 shutdown_connections 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- 10.20.193.78:0/3744948520 >> 10.20.193.78:0/3744948520 conn(0x7fb05c0545d0 msgr2=0x7fb05c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- 10.20.193.78:0/3744948520 shutdown_connections 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- 10.20.193.78:0/3744948520 wait complete. 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: monmap: 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.739 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 Processor -- start 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- start start 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: init 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient(hunting): picked mon.noname-b con 0x7fb05c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient(hunting): picked mon.noname-c con 0x7fb05c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient(hunting): picked mon.noname-a con 0x7fb05c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c111e10 con 0x7fb05c1853c0 2026-02-13T18:05:33.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c110fa0 con 0x7fb05c05e4b0 2026-02-13T18:05:33.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c10fab0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb06246f640 10 monclient(hunting): authenticate will time out at 564.783399s 2026-02-13T18:05:33.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb05c13f8b0 0x7fb05c180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57880/0 (socket says 10.20.193.78:57880) 2026-02-13T18:05:33.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.724+0000 7fb05b7fe640 1 -- 10.20.193.78:0/29141913 learned_addr learned my addr 10.20.193.78:0/29141913 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb05b7fe640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.78:6790/0 conn(0x7fb05c13f8b0 legacy=0x7fb05c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb0609e5640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.78:6789/0 conn(0x7fb05c1853c0 legacy=0x7fb05c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb05bfff640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.187:6789/0 conn(0x7fb05c05e4b0 legacy=0x7fb05c13e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759445320 0 0) 0x7fb05c10fab0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): my global_id is 4247 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb02c003620 con 0x7fb05c13f8b0 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517178229 0 0) 0x7fb05c111e10 con 0x7fb05c1853c0 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): my global_id is 4257 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb05c10fab0 con 0x7fb05c1853c0 2026-02-13T18:05:33.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158391280 0 0) 0x7fb05c110fa0 con 0x7fb05c05e4b0 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): my global_id is 4246 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb05c111e10 con 0x7fb05c05e4b0 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3818419226 0 0) 0x7fb02c003620 con 0x7fb05c13f8b0 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb05c110fa0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c0030c0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.746 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 671309595 0 0) 0x7fb05c10fab0 con 0x7fb05c1853c0 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb02c003620 con 0x7fb05c1853c0 2026-02-13T18:05:33.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb050004900 con 0x7fb05c1853c0 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.748 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1139509782 0 0) 0x7fb05c110fa0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.187:6789/0 conn(0x7fb05c05e4b0 legacy=0x7fb05c13e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.78:6789/0 conn(0x7fb05c1853c0 legacy=0x7fb05c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 monclient: found mon.c 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c111570 con 0x7fb05c13f8b0 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 5 monclient: authenticate success, global_id 4247 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 monclient: _renew_subs 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb05c10f460 con 0x7fb05c13f8b0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 monclient: _renew_subs 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb05c110840 con 0x7fb05c13f8b0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb04c0049a0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c005370 con 0x7fb05c13f8b0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 10 monclient: dump: 2026-02-13T18:05:33.750 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb05a7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05c0008e0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb04c011a00 con 0x7fb05c13f8b0 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fb04c04c660 con 0x7fb05c13f8b0 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.728+0000 7fb05bfff640 10 monclient: get_auth_request con 0x7fb02c03d780 auth_method 0 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.732+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fb05c095530 con 0x7fb05c13f8b0 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.732+0000 7fb058ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.732+0000 7fb058ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:33.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb06246f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:33.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb06246f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:33.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb06246f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:33.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb05c093020 con 0x7fb05c13f8b0 2026-02-13T18:05:33.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb058ff9640 1 -- 10.20.193.78:0/29141913 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10847 (unknown 3338201251 0 1653934009) 0x7fb04c0177d0 con 0x7fb05c13f8b0 2026-02-13T18:05:33.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb058ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:33.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.816+0000 7fb058ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:33.825 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:33.825 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":18,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:05:32.486562+0000","last_up_change":"2026-02-13T18:05:25.449453+0000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T18:05:25.773956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T18:05:28.499550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":425425936}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":425425936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":425425936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":425425936}]},"public_addr":"10.20.193.78:6804/425425936","cluster_addr":"10.20.193.78:6805/425425936","heartbeat_back_addr":"10.20.193.78:6807/425425936","heartbeat_front_addr":"10.20.193.78:6806/425425936","state":["exists","up"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":444681404}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":444681404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":444681404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":444681404}]},"public_addr":"10.20.193.78:6800/444681404","cluster_addr":"10.20.193.78:6801/444681404","heartbeat_back_addr":"10.20.193.78:6803/444681404","heartbeat_front_addr":"10.20.193.78:6802/444681404","state":["exists","up"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2589033462}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":2589033462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":2589033462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":2589033462}]},"public_addr":"10.20.193.78:6808/2589033462","cluster_addr":"10.20.193.78:6809/2589033462","heartbeat_back_addr":"10.20.193.78:6811/2589033462","heartbeat_front_addr":"10.20.193.78:6810/2589033462","state":["exists","up"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6800","nonce":1622449099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6801","nonce":1622449099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6803","nonce":1622449099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6802","nonce":1622449099}]},"public_addr":"10.20.193.187:6800/1622449099","cluster_addr":"10.20.193.187:6801/1622449099","heartbeat_back_addr":"10.20.193.187:6803/1622449099","heartbeat_front_addr":"10.20.193.187:6802/1622449099","state":["exists","up"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6807","nonce":218078640}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6809","nonce":218078640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6811","nonce":218078640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6810","nonce":218078640}]},"public_addr":"10.20.193.187:6807/218078640","cluster_addr":"10.20.193.187:6809/218078640","heartbeat_back_addr":"10.20.193.187:6811/218078640","heartbeat_front_addr":"10.20.193.187:6810/218078640","state":["exists","up"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6804","nonce":1501659775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6805","nonce":1501659775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6808","nonce":1501659775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6806","nonce":1501659775}]},"public_addr":"10.20.193.187:6804/1501659775","cluster_addr":"10.20.193.187:6805/1501659775","heartbeat_back_addr":"10.20.193.187:6808/1501659775","heartbeat_front_addr":"10.20.193.187:6806/1501659775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:05:33.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb02c03d780 legacy=0x7fb02c05dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 10 monclient: shutdown 2026-02-13T18:05:33.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 >> v1:10.20.193.78:6790/0 conn(0x7fb05c13f8b0 legacy=0x7fb05c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 shutdown_connections 2026-02-13T18:05:33.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 >> 10.20.193.78:0/29141913 conn(0x7fb05c0545d0 msgr2=0x7fb05c08ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 shutdown_connections 2026-02-13T18:05:33.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.820+0000 7fb06246f640 1 -- 10.20.193.78:0/29141913 wait complete. 2026-02-13T18:05:33.837 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-13T18:05:33.837 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T18:05:33.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.888+0000 7f3a83873640 10 monclient: get_monmap_and_config 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.888+0000 7f3a83873640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.888+0000 7f3a83873640 10 monclient: monmap: 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:33.893189+0000 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:33.893189+0000 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.898 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.888+0000 7f3a83873640 1 Processor -- start 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- start start 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient: init 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient(hunting): picked mon.noname-c con 0x7f3a7c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient(hunting): picked mon.noname-b con 0x7f3a7c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient(hunting): picked mon.noname-a con 0x7f3a7c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c089e80 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c088c20 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c089ba0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient(hunting): authenticate will time out at 564.948363s 2026-02-13T18:05:33.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a80de7640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f3a7c08dc80 0x7f3a7c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57886/0 (socket says 10.20.193.78:57886) 2026-02-13T18:05:33.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a80de7640 1 -- 10.20.193.78:0/3804896317 learned_addr learned my addr 10.20.193.78:0/3804896317 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a81de9640 1 -- 10.20.193.78:0/3804896317 >> v1:10.20.193.78:6789/0 conn(0x7f3a7c08cdd0 legacy=0x7f3a7c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a80de7640 1 -- 10.20.193.78:0/3804896317 >> v1:10.20.193.78:6790/0 conn(0x7f3a7c08dc80 legacy=0x7f3a7c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a815e8640 1 -- 10.20.193.78:0/3804896317 >> v1:10.20.193.187:6789/0 conn(0x7f3a7c08c2f0 legacy=0x7f3a7c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369400283 0 0) 0x7f3a7c089e80 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): my global_id is 4260 2026-02-13T18:05:33.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a64003620 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102218744 0 0) 0x7f3a7c089ba0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): my global_id is 4250 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a7c089e80 con 0x7f3a7c08dc80 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473541631 0 0) 0x7f3a7c088c20 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient(hunting): my global_id is 4249 2026-02-13T18:05:33.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a7c089ba0 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 653176935 0 0) 0x7f3a64003620 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 >> v1:10.20.193.78:6790/0 conn(0x7f3a7c08dc80 legacy=0x7f3a7c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 >> v1:10.20.193.187:6789/0 conn(0x7f3a7c08c2f0 legacy=0x7f3a7c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 monclient: found mon.noname-a 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c08d370 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 5 monclient: authenticate success, global_id 4260 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a78004670 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: dump: 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.910 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a78004940 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 1 -- 10.20.193.78:0/3804896317 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a78004dd0 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a6bfff640 10 monclient: dump: 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.911 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 4 set_mon_vals no callback set 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 10 monclient: shutdown 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:33.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- 10.20.193.78:0/3804896317 >> v1:10.20.193.78:6789/0 conn(0x7f3a7c08cdd0 legacy=0x7f3a7c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- 10.20.193.78:0/3804896317 shutdown_connections 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- 10.20.193.78:0/3804896317 >> 10.20.193.78:0/3804896317 conn(0x7f3a7c091720 msgr2=0x7f3a7c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- 10.20.193.78:0/3804896317 shutdown_connections 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.892+0000 7f3a83873640 1 -- 10.20.193.78:0/3804896317 wait complete. 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient: build_initial_monmap 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient: monmap: 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:33.913 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 1 Processor -- start 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 1 -- start start 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient: init 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient(hunting): picked mon.noname-b con 0x7f3a7c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient(hunting): picked mon.noname-c con 0x7f3a7c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient(hunting): picked mon.noname-a con 0x7f3a7c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:33.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c05d410 con 0x7f3a7c08dc80 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c0802f0 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7c05de80 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a83873640 10 monclient(hunting): authenticate will time out at 564.953069s 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a81de9640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3a7c08dc80 0x7f3a7c1955e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51468/0 (socket says 10.20.193.78:51468) 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a81de9640 1 -- 10.20.193.78:0/2702961044 learned_addr learned my addr 10.20.193.78:0/2702961044 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a81de9640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.78:6789/0 conn(0x7f3a7c08dc80 legacy=0x7f3a7c1955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a80de7640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.78:6790/0 conn(0x7f3a7c08cdd0 legacy=0x7f3a7c083a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a815e8640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.187:6789/0 conn(0x7f3a7c08c2f0 legacy=0x7f3a7c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355920663 0 0) 0x7f3a7c05d410 con 0x7f3a7c08dc80 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): my global_id is 4263 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a4c003620 con 0x7f3a7c08dc80 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 917836356 0 0) 0x7f3a7c05de80 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): my global_id is 4253 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a7c05d410 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832392562 0 0) 0x7f3a7c0802f0 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:33.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): my global_id is 4252 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a7c05de80 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1407514500 0 0) 0x7f3a4c003620 con 0x7f3a7c08dc80 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a7c0802f0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a78004c20 con 0x7f3a7c08dc80 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.917 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3479475416 0 0) 0x7f3a7c05d410 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a4c003620 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a70002d80 con 0x7f3a7c08cdd0 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:33.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.896+0000 7f3a69ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 302369915 0 0) 0x7f3a7c05de80 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a7c05d410 con 0x7f3a7c08c2f0 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1831789173 0 0) 0x7f3a7c0802f0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.78:6790/0 conn(0x7f3a7c08cdd0 legacy=0x7f3a7c083a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.187:6789/0 conn(0x7f3a7c08c2f0 legacy=0x7f3a7c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 monclient: found mon.a 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c088910 con 0x7f3a7c08dc80 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:33.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 5 monclient: authenticate success, global_id 4263 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 monclient: _renew_subs 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7c082650 con 0x7f3a7c08dc80 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 monclient: _renew_subs 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a7c084190 con 0x7f3a7c08dc80 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a78004e00 con 0x7f3a7c08dc80 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a780053f0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:33.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: dump: 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a6b7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:33.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7c08f5e0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3a780055d0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f3a7804d910 con 0x7f3a7c08dc80 2026-02-13T18:05:33.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a815e8640 10 monclient: get_auth_request con 0x7f3a4c03d970 auth_method 0 2026-02-13T18:05:33.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f3a78018a90 con 0x7f3a7c08dc80 2026-02-13T18:05:33.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:33.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.900+0000 7f3a69ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:33.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:33.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:33.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:33.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a7c090810 con 0x7f3a7c08dc80 2026-02-13T18:05:33.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a69ffb640 1 -- 10.20.193.78:0/2702961044 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10847 (unknown 3338201251 0 1653934009) 0x7f3a780202c0 con 0x7f3a7c08dc80 2026-02-13T18:05:33.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a69ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:33.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a69ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:33.999 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:34.000 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":18,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:05:32.486562+0000","last_up_change":"2026-02-13T18:05:25.449453+0000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T18:05:25.773956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T18:05:28.499550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":425425936}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":425425936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":425425936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":425425936}]},"public_addr":"10.20.193.78:6804/425425936","cluster_addr":"10.20.193.78:6805/425425936","heartbeat_back_addr":"10.20.193.78:6807/425425936","heartbeat_front_addr":"10.20.193.78:6806/425425936","state":["exists","up"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":444681404}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":444681404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":444681404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":444681404}]},"public_addr":"10.20.193.78:6800/444681404","cluster_addr":"10.20.193.78:6801/444681404","heartbeat_back_addr":"10.20.193.78:6803/444681404","heartbeat_front_addr":"10.20.193.78:6802/444681404","state":["exists","up"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2589033462}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":2589033462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":2589033462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":2589033462}]},"public_addr":"10.20.193.78:6808/2589033462","cluster_addr":"10.20.193.78:6809/2589033462","heartbeat_back_addr":"10.20.193.78:6811/2589033462","heartbeat_front_addr":"10.20.193.78:6810/2589033462","state":["exists","up"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6800","nonce":1622449099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6801","nonce":1622449099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6803","nonce":1622449099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6802","nonce":1622449099}]},"public_addr":"10.20.193.187:6800/1622449099","cluster_addr":"10.20.193.187:6801/1622449099","heartbeat_back_addr":"10.20.193.187:6803/1622449099","heartbeat_front_addr":"10.20.193.187:6802/1622449099","state":["exists","up"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6807","nonce":218078640}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6809","nonce":218078640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6811","nonce":218078640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6810","nonce":218078640}]},"public_addr":"10.20.193.187:6807/218078640","cluster_addr":"10.20.193.187:6809/218078640","heartbeat_back_addr":"10.20.193.187:6811/218078640","heartbeat_front_addr":"10.20.193.187:6810/218078640","state":["exists","up"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6804","nonce":1501659775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6805","nonce":1501659775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6808","nonce":1501659775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6806","nonce":1501659775}]},"public_addr":"10.20.193.187:6804/1501659775","cluster_addr":"10.20.193.187:6805/1501659775","heartbeat_back_addr":"10.20.193.187:6808/1501659775","heartbeat_front_addr":"10.20.193.187:6806/1501659775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:05:34.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.187:6812/2668687789 conn(0x7f3a4c03d970 legacy=0x7f3a4c05de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 10 monclient: shutdown 2026-02-13T18:05:34.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 >> v1:10.20.193.78:6789/0 conn(0x7f3a7c08dc80 legacy=0x7f3a7c1955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 shutdown_connections 2026-02-13T18:05:34.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 >> 10.20.193.78:0/2702961044 conn(0x7f3a7c091720 msgr2=0x7f3a7c05b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 shutdown_connections 2026-02-13T18:05:34.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:33.992+0000 7f3a83873640 1 -- 10.20.193.78:0/2702961044 wait complete. 2026-02-13T18:05:34.010 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-13T18:05:34.011 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-13T18:05:34.011 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-13T18:05:34.012 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-13T18:05:34.012 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-13T18:05:34.013 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-13T18:05:34.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient: monmap: 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.073799+0000 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.073799+0000 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.078 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: monmap: 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.073844+0000 2026-02-13T18:05:34.079 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.073844+0000 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient: monmap: 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.074217+0000 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.074217+0000 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.081 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.082 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.082 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 1 Processor -- start 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 1 -- start start 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: init 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient(hunting): picked mon.noname-c con 0x7f69e413e910 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient(hunting): picked mon.noname-a con 0x7f69e4163d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient(hunting): picked mon.noname-b con 0x7f69e4185850 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 1 Processor -- start 2026-02-13T18:05:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4090f70 con 0x7f69e4163d50 2026-02-13T18:05:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4091250 con 0x7f69e413e910 2026-02-13T18:05:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4091530 con 0x7f69e4185850 2026-02-13T18:05:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient(hunting): authenticate will time out at 565.129087s 2026-02-13T18:05:34.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 1 Processor -- start 2026-02-13T18:05:34.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 1 -- start start 2026-02-13T18:05:34.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient: init 2026-02-13T18:05:34.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 1 -- start start 2026-02-13T18:05:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient: init 2026-02-13T18:05:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69e998d640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f69e4185850 0x7f69e41a5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57894/0 (socket says 10.20.193.78:57894) 2026-02-13T18:05:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69e998d640 1 -- 10.20.193.78:0/442847639 learned_addr learned my addr 10.20.193.78:0/442847639 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69e898b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f69e4163d50 0x7f69e4184130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51480/0 (socket says 10.20.193.78:51480) 2026-02-13T18:05:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient(hunting): picked mon.noname-c con 0x7f669c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient(hunting): picked mon.noname-b con 0x7f669c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient(hunting): picked mon.noname-a con 0x7f669c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c095530 con 0x7f669c1853c0 2026-02-13T18:05:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c140390 con 0x7f669c13f8b0 2026-02-13T18:05:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c05d230 con 0x7f669c05e4b0 2026-02-13T18:05:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a36c2640 10 monclient(hunting): authenticate will time out at 565.129445s 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient(hunting): picked mon.noname-c con 0x7f4a1813e910 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient(hunting): picked mon.noname-a con 0x7f4a18163d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient(hunting): picked mon.noname-b con 0x7f4a18185850 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18090f70 con 0x7f4a18163d50 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18091250 con 0x7f4a1813e910 2026-02-13T18:05:34.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18091530 con 0x7f4a18185850 2026-02-13T18:05:34.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1ed49640 10 monclient(hunting): authenticate will time out at 565.129510s 2026-02-13T18:05:34.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a1c38640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f669c1853c0 0x7f669c1a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51496/0 (socket says 10.20.193.78:51496) 2026-02-13T18:05:34.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a1c38640 1 -- 10.20.193.78:0/1386636642 learned_addr learned my addr 10.20.193.78:0/1386636642 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a17fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f4a18163d50 0x7f4a18184130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51502/0 (socket says 10.20.193.78:51502) 2026-02-13T18:05:34.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a17fff640 1 -- 10.20.193.78:0/3073590054 learned_addr learned my addr 10.20.193.78:0/3073590054 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient: monmap: 2026-02-13T18:05:34.092 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.092 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.075465+0000 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.075465+0000 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 1 Processor -- start 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 1 -- start start 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient: init 2026-02-13T18:05:34.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient(hunting): picked mon.noname-c con 0x7f35100561f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient(hunting): picked mon.noname-b con 0x7f3510056cd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient(hunting): picked mon.noname-a con 0x7f3510183670 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351008e7c0 con 0x7f3510183670 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351008eaa0 con 0x7f35100561f0 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351008ce00 con 0x7f3510056cd0 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f3514aa4640 10 monclient(hunting): authenticate will time out at 565.130651s 2026-02-13T18:05:34.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69e898b640 1 -- 10.20.193.78:0/442847639 >> v1:10.20.193.78:6789/0 conn(0x7f69e4163d50 legacy=0x7f69e4184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69e998d640 1 -- 10.20.193.78:0/442847639 >> v1:10.20.193.78:6790/0 conn(0x7f69e4185850 legacy=0x7f69e41a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009271303 0 0) 0x7f69e4090f70 con 0x7f69e4163d50 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): my global_id is 4266 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69e918c640 1 -- 10.20.193.78:0/442847639 >> v1:10.20.193.187:6789/0 conn(0x7f69e413e910 legacy=0x7f69e413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69cc003620 con 0x7f69e4163d50 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038935969 0 0) 0x7f69e4091530 con 0x7f69e4185850 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient(hunting): my global_id is 4256 2026-02-13T18:05:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e4090f70 con 0x7f69e4185850 2026-02-13T18:05:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f350dd74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f3510056cd0 0x7f3510181f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57922/0 (socket says 10.20.193.78:57922) 2026-02-13T18:05:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f350dd74640 1 -- 10.20.193.78:0/2694490343 learned_addr learned my addr 10.20.193.78:0/2694490343 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3472618209 0 0) 0x7f69cc003620 con 0x7f69e4163d50 2026-02-13T18:05:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 >> v1:10.20.193.78:6790/0 conn(0x7f69e4185850 legacy=0x7f69e41a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 >> v1:10.20.193.187:6789/0 conn(0x7f69e413e910 legacy=0x7f69e413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 monclient: found mon.noname-a 2026-02-13T18:05:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40921f0 con 0x7f69e4163d50 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 5 monclient: authenticate success, global_id 4266 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f69d8003190 con 0x7f69e4163d50 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: dump: 2026-02-13T18:05:34.099 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a1c38640 1 -- 10.20.193.78:0/1386636642 >> v1:10.20.193.78:6789/0 conn(0x7f669c1853c0 legacy=0x7f669c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a17fff640 1 -- 10.20.193.78:0/3073590054 >> v1:10.20.193.78:6789/0 conn(0x7f4a18163d50 legacy=0x7f4a18184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69d8003420 con 0x7f69e4163d50 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 1 -- 10.20.193.78:0/442847639 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f69d8004a90 con 0x7f69e4163d50 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69d3fff640 10 monclient: dump: 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.102 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f69eb417640 4 set_mon_vals no callback set 2026-02-13T18:05:34.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a1cabe640 1 -- 10.20.193.78:0/3073590054 >> v1:10.20.193.187:6789/0 conn(0x7f4a1813e910 legacy=0x7f4a1813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f66a1437640 1 -- 10.20.193.78:0/1386636642 >> v1:10.20.193.187:6789/0 conn(0x7f669c13f8b0 legacy=0x7f669c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394326287 0 0) 0x7f4a18090f70 con 0x7f4a18163d50 2026-02-13T18:05:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.072+0000 7f4a177fe640 10 monclient(hunting): my global_id is 4269 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a04003620 con 0x7f4a18163d50 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701483872 0 0) 0x7f6698004170 con 0x7f669c1853c0 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): my global_id is 4272 2026-02-13T18:05:34.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6684003620 con 0x7f669c1853c0 2026-02-13T18:05:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1154050113 0 0) 0x7f4a04003620 con 0x7f4a18163d50 2026-02-13T18:05:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 >> v1:10.20.193.78:6790/0 conn(0x7f4a18185850 legacy=0x7f4a181a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 >> v1:10.20.193.187:6789/0 conn(0x7f4a1813e910 legacy=0x7f4a1813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 monclient: found mon.noname-a 2026-02-13T18:05:34.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987281606 0 0) 0x7f668c002cb0 con 0x7f669c13f8b0 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient(hunting): my global_id is 4258 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a180921f0 con 0x7f4a18163d50 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4a00003110 con 0x7f4a18163d50 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6698004170 con 0x7f669c13f8b0 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: dump: 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.108 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: shutdown 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/442847639 >> v1:10.20.193.78:6789/0 conn(0x7f69e4163d50 legacy=0x7f69e4184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 5 monclient: authenticate success, global_id 4269 2026-02-13T18:05:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 89144462 0 0) 0x7f6684003620 con 0x7f669c1853c0 2026-02-13T18:05:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 >> v1:10.20.193.78:6790/0 conn(0x7f669c05e4b0 legacy=0x7f669c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:34.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 >> v1:10.20.193.187:6789/0 conn(0x7f669c13f8b0 legacy=0x7f669c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 monclient: found mon.noname-a 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/442847639 shutdown_connections 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/442847639 >> 10.20.193.78:0/442847639 conn(0x7f69e4095f10 msgr2=0x7f69e4096310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c05d510 con 0x7f669c1853c0 2026-02-13T18:05:34.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 5 monclient: authenticate success, global_id 4272 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f66980047f0 con 0x7f669c1853c0 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/442847639 shutdown_connections 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/442847639 wait complete. 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: dump: 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.113 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a000033e0 con 0x7f4a18163d50 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 1 -- 10.20.193.78:0/3073590054 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4a00004b50 con 0x7f4a18163d50 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a177fe640 10 monclient: dump: 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 4 set_mon_vals no callback set 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6698005eb0 con 0x7f669c1853c0 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 1 -- 10.20.193.78:0/1386636642 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6698006240 con 0x7f669c1853c0 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f668bfff640 10 monclient: dump: 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.116 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 4 set_mon_vals no callback set 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: shutdown 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- 10.20.193.78:0/3073590054 >> v1:10.20.193.78:6789/0 conn(0x7f4a18163d50 legacy=0x7f4a18184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- 10.20.193.78:0/3073590054 shutdown_connections 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- 10.20.193.78:0/3073590054 >> 10.20.193.78:0/3073590054 conn(0x7f4a18095f10 msgr2=0x7f4a18096310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: monmap: 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.118 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.119 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- 10.20.193.78:0/3073590054 shutdown_connections 2026-02-13T18:05:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- 10.20.193.78:0/3073590054 wait complete. 2026-02-13T18:05:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: shutdown 2026-02-13T18:05:34.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- 10.20.193.78:0/1386636642 >> v1:10.20.193.78:6789/0 conn(0x7f669c1853c0 legacy=0x7f669c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- 10.20.193.78:0/1386636642 shutdown_connections 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- 10.20.193.78:0/1386636642 >> 10.20.193.78:0/1386636642 conn(0x7f669c0545d0 msgr2=0x7f669c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- 10.20.193.78:0/1386636642 shutdown_connections 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- 10.20.193.78:0/1386636642 wait complete. 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 Processor -- start 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- start start 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: init 2026-02-13T18:05:34.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: monmap: 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.121 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient(hunting): picked mon.noname-c con 0x7f69e413e910 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient(hunting): picked mon.noname-a con 0x7f69e4163d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient(hunting): picked mon.noname-b con 0x7f69e4185850 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4166a90 con 0x7f69e4163d50 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4057e30 con 0x7f69e4185850 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4141140 con 0x7f69e413e910 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient(hunting): authenticate will time out at 565.133152s 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 Processor -- start 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- start start 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: init 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69e898b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f69e4163d50 0x7f69e412c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51514/0 (socket says 10.20.193.78:51514) 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69e898b640 1 -- 10.20.193.78:0/2945124053 learned_addr learned my addr 10.20.193.78:0/2945124053 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient(hunting): picked mon.noname-a con 0x7f4a1813e910 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient(hunting): picked mon.noname-c con 0x7f4a18163d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient(hunting): picked mon.noname-b con 0x7f4a18185850 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18166c90 con 0x7f4a1813e910 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18057e30 con 0x7f4a18185850 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18165e20 con 0x7f4a18163d50 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1ed49640 10 monclient(hunting): authenticate will time out at 565.133508s 2026-02-13T18:05:34.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: monmap: 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1cabe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f4a1813e910 0x7f4a181a6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51518/0 (socket says 10.20.193.78:51518) 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1cabe640 1 -- 10.20.193.78:0/1629687385 learned_addr learned my addr 10.20.193.78:0/1629687385 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350dd74640 1 -- 10.20.193.78:0/2694490343 >> v1:10.20.193.78:6790/0 conn(0x7f3510056cd0 legacy=0x7f3510181f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 Processor -- start 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- start start 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: init 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310886791 0 0) 0x7f351008ce00 con 0x7f3510056cd0 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient(hunting): my global_id is 4259 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34fc003620 con 0x7f3510056cd0 2026-02-13T18:05:34.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350ed76640 1 -- 10.20.193.78:0/2694490343 >> v1:10.20.193.78:6789/0 conn(0x7f3510183670 legacy=0x7f35101a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient(hunting): picked mon.noname-c con 0x7f669c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient(hunting): picked mon.noname-b con 0x7f669c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient(hunting): picked mon.noname-a con 0x7f669c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c12def0 con 0x7f669c1853c0 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c057e50 con 0x7f669c13f8b0 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c12e1d0 con 0x7f669c05e4b0 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a36c2640 10 monclient(hunting): authenticate will time out at 565.134139s 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350e575640 1 -- 10.20.193.78:0/2694490343 >> v1:10.20.193.187:6789/0 conn(0x7f35100561f0 legacy=0x7f35100565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a1437640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f669c05e4b0 0x7f669c1a0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57940/0 (socket says 10.20.193.78:57940) 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f66a1437640 1 -- 10.20.193.78:0/813967126 learned_addr learned my addr 10.20.193.78:0/813967126 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2032657884 0 0) 0x7f34fc003620 con 0x7f3510056cd0 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 >> v1:10.20.193.187:6789/0 conn(0x7f35100561f0 legacy=0x7f35100565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 >> v1:10.20.193.78:6789/0 conn(0x7f3510183670 legacy=0x7f35101a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient: monmap: 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.079765+0000 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.079765+0000 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.129 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 monclient: found mon.noname-b 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351008cb60 con 0x7f3510056cd0 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f3514aa4640 5 monclient: authenticate success, global_id 4259 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f3514aa4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34f8003110 con 0x7f3510056cd0 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f350d573640 10 monclient: dump: 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.130 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.131 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.131 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f3514aa4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 1 Processor -- start 2026-02-13T18:05:34.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 1 -- start start 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient: init 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient(hunting): picked mon.noname-b con 0x7f431813f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient(hunting): picked mon.noname-c con 0x7f431805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient(hunting): picked mon.noname-a con 0x7f43181853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4318095530 con 0x7f43181853c0 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4318140390 con 0x7f431805e4b0 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431805d230 con 0x7f431813f8b0 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431ef32640 10 monclient(hunting): authenticate will time out at 565.135252s 2026-02-13T18:05:34.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69e898b640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.78:6789/0 conn(0x7f69e4163d50 legacy=0x7f69e412c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453309661 0 0) 0x7f69e4166a90 con 0x7f69e4163d50 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): my global_id is 4278 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b4003620 con 0x7f69e4163d50 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69e998d640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.187:6789/0 conn(0x7f69e4185850 legacy=0x7f69e412dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3874908448 0 0) 0x7f69b4003620 con 0x7f69e4163d50 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69e4166a90 con 0x7f69e4163d50 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f69d8004a90 con 0x7f69e4163d50 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.133 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1cabe640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.78:6789/0 conn(0x7f4a1813e910 legacy=0x7f4a181a6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 45974026 0 0) 0x7f69e4166a90 con 0x7f69e4163d50 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.78:6790/0 conn(0x7f69e413e910 legacy=0x7f69e417f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.187:6789/0 conn(0x7f69e4185850 legacy=0x7f69e412dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 monclient: found mon.a 2026-02-13T18:05:34.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e408ed90 con 0x7f69e4163d50 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 5 monclient: authenticate success, global_id 4278 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: _renew_subs 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f69e4167030 con 0x7f69e4163d50 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f4a1d2bf640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.187:6789/0 conn(0x7f4a18185850 legacy=0x7f4a1812d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: _renew_subs 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f69e408e5e0 con 0x7f69e4163d50 2026-02-13T18:05:34.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431d4a8640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f43181853c0 0x7f43181a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51526/0 (socket says 10.20.193.78:51526) 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f431d4a8640 1 -- 10.20.193.78:0/3230925548 learned_addr learned my addr 10.20.193.78:0/3230925548 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.076+0000 7f430ffff640 1 --1- 10.20.193.78:0/3230925548 >> v1:10.20.193.187:6789/0 conn(0x7f431805e4b0 0x7f4318183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:59542/0 (socket says 10.20.193.78:59542) 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a17fff640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.78:6790/0 conn(0x7f4a18163d50 legacy=0x7f4a181824c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69d8003400 con 0x7f69e4163d50 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f69d8005260 con 0x7f69e4163d50 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 10 monclient: dump: 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.136 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d37fe640 4 set_mon_vals no callback set 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69eb417640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f69e405dc10 con 0x7f69e4163d50 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a1437640 1 -- 10.20.193.78:0/813967126 >> v1:10.20.193.78:6790/0 conn(0x7f669c05e4b0 legacy=0x7f669c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45976785 0 0) 0x7f669c12e1d0 con 0x7f669c05e4b0 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): my global_id is 4265 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34f80033e0 con 0x7f3510056cd0 2026-02-13T18:05:34.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350d573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350d573640 1 -- 10.20.193.78:0/2694490343 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34f8004b50 con 0x7f3510056cd0 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f666c003620 con 0x7f669c05e4b0 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350d573640 10 monclient: dump: 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 4 set_mon_vals no callback set 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1330828701 0 0) 0x7f666c003620 con 0x7f669c05e4b0 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f69d80118f0 con 0x7f69e4163d50 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f669c12e1d0 con 0x7f669c05e4b0 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f668c003710 con 0x7f669c05e4b0 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.139 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 441889174 0 0) 0x7f669c12e1d0 con 0x7f669c05e4b0 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 >> v1:10.20.193.187:6789/0 conn(0x7f669c13f8b0 legacy=0x7f669c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 >> v1:10.20.193.78:6789/0 conn(0x7f669c1853c0 legacy=0x7f669c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 monclient: found mon.c 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f69d804c590 con 0x7f69e4163d50 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c08a9a0 con 0x7f669c05e4b0 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 5 monclient: authenticate success, global_id 4265 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 10 monclient: _renew_subs 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f669c12dc10 con 0x7f669c05e4b0 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 10 monclient: _renew_subs 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f669c1a1480 con 0x7f669c05e4b0 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.187:6807/218078640 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69d80050b0 con 0x7f69b4062090 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f69d804c8d0 con 0x7f69e4163d50 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69d1ffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: shutdown 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- 10.20.193.78:0/2694490343 >> v1:10.20.193.78:6790/0 conn(0x7f3510056cd0 legacy=0x7f3510181f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- 10.20.193.78:0/2694490343 shutdown_connections 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- 10.20.193.78:0/2694490343 >> 10.20.193.78:0/2694490343 conn(0x7f3510054c90 msgr2=0x7f3510092960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f668c003c90 con 0x7f669c05e4b0 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f668c004030 con 0x7f669c05e4b0 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- 10.20.193.78:0/2694490343 shutdown_connections 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: dump: 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69e918c640 10 monclient: get_auth_request con 0x7f69b403d3e0 auth_method 0 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- 10.20.193.78:0/2694490343 wait complete. 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f668b7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f69e998d640 10 monclient: get_auth_request con 0x7f69b4062090 auth_method 0 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f669c093020 con 0x7f669c05e4b0 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: monmap: 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.143 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f668c004300 con 0x7f669c05e4b0 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 Processor -- start 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- start start 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: init 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f668c04c700 con 0x7f669c05e4b0 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715726016 0 0) 0x7f4a18166c90 con 0x7f4a1813e910 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): my global_id is 4281 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e8003620 con 0x7f4a1813e910 2026-02-13T18:05:34.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877592450 0 0) 0x7f4a18165e20 con 0x7f4a18163d50 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): my global_id is 4262 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a18166c90 con 0x7f4a18163d50 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.187:6800/1622449099 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f668c003e80 con 0x7f666c061fd0 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f668c04caf0 con 0x7f669c05e4b0 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f6689ffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753841164 0 0) 0x7f4a18057e30 con 0x7f4a18185850 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): my global_id is 4270 2026-02-13T18:05:34.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a18165e20 con 0x7f4a18185850 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient(hunting): picked mon.noname-b con 0x7f35100561f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient(hunting): picked mon.noname-c con 0x7f3510056cd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient(hunting): picked mon.noname-a con 0x7f3510183670 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351013af50 con 0x7f3510183670 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351013beb0 con 0x7f35100561f0 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351013c190 con 0x7f3510056cd0 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f3514aa4640 10 monclient(hunting): authenticate will time out at 565.138013s 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a1c38640 10 monclient: get_auth_request con 0x7f666c061fd0 auth_method 0 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350dd74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f3510056cd0 0x7f3510172250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57950/0 (socket says 10.20.193.78:57950) 2026-02-13T18:05:34.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f350dd74640 1 -- 10.20.193.78:0/992700193 learned_addr learned my addr 10.20.193.78:0/992700193 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3800028711 0 0) 0x7f4a18166c90 con 0x7f4a18163d50 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a18057e30 con 0x7f4a18163d50 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4a000048e0 con 0x7f4a18163d50 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): dump: 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 536577498 0 0) 0x7f49e8003620 con 0x7f4a1813e910 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a18166c90 con 0x7f4a1813e910 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4a08004890 con 0x7f4a1813e910 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): dump: 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.147 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 5741289 0 0) 0x7f4a18165e20 con 0x7f4a18185850 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49e8003620 con 0x7f4a18185850 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4a0c004280 con 0x7f4a18185850 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient(hunting): dump: 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430ffff640 1 -- 10.20.193.78:0/3230925548 >> v1:10.20.193.187:6789/0 conn(0x7f431805e4b0 legacy=0x7f4318183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 636966267 0 0) 0x7f4a18057e30 con 0x7f4a18163d50 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.187:6789/0 conn(0x7f4a18185850 legacy=0x7f4a1812d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.78:6789/0 conn(0x7f4a1813e910 legacy=0x7f4a181a6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 monclient: found mon.c 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a181669b0 con 0x7f4a18163d50 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 5 monclient: authenticate success, global_id 4262 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 10 monclient: _renew_subs 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1817f8e0 con 0x7f4a18163d50 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 10 monclient: _renew_subs 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a18181e10 con 0x7f4a18163d50 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128333518 0 0) 0x7f4300002c60 con 0x7f431805e4b0 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient(hunting): my global_id is 4273 2026-02-13T18:05:34.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a00004ac0 con 0x7f4a18163d50 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4a00005170 con 0x7f4a18163d50 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4304003620 con 0x7f431805e4b0 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: dump: 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a16ffd640 4 set_mon_vals no callback set 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4a18141410 con 0x7f4a18163d50 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1006245950 0 0) 0x7f4304003620 con 0x7f431805e4b0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 >> v1:10.20.193.78:6790/0 conn(0x7f431813f8b0 legacy=0x7f431813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431cca7640 1 -- 10.20.193.78:0/3230925548 >> v1:10.20.193.78:6790/0 conn(0x7f431813f8b0 legacy=0x7f431813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 >> v1:10.20.193.78:6789/0 conn(0x7f43181853c0 legacy=0x7f43181a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 monclient: found mon.noname-c 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431805d510 con 0x7f431805e4b0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f43000032e0 con 0x7f431805e4b0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: dump: 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.151 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 5 monclient: authenticate success, global_id 4273 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43000048e0 con 0x7f431805e4b0 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 1 -- 10.20.193.78:0/3230925548 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4300004c70 con 0x7f431805e4b0 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f430f7fe640 10 monclient: dump: 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 4 set_mon_vals no callback set 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4a00011800 con 0x7f4a18163d50 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f4a0004c340 con 0x7f4a18163d50 2026-02-13T18:05:34.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 10 monclient: shutdown 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6808/2589033462 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a00003380 con 0x7f49e80627c0 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f4a0004c730 con 0x7f4a18163d50 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a157fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 1 -- 10.20.193.78:0/3230925548 >> v1:10.20.193.187:6789/0 conn(0x7f431805e4b0 legacy=0x7f4318183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 1 -- 10.20.193.78:0/3230925548 shutdown_connections 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 1 -- 10.20.193.78:0/3230925548 >> 10.20.193.78:0/3230925548 conn(0x7f43180545d0 msgr2=0x7f43180549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 1 -- 10.20.193.78:0/3230925548 shutdown_connections 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 1 -- 10.20.193.78:0/3230925548 wait complete. 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1d2bf640 10 monclient: get_auth_request con 0x7f49e80627c0 auth_method 0 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f4a1cabe640 10 monclient: get_auth_request con 0x7f49e803db10 auth_method 0 2026-02-13T18:05:34.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f66a0c36640 10 monclient: get_auth_request con 0x7f666c03d320 auth_method 0 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 10 monclient: monmap: 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.080+0000 7f431ef32640 1 Processor -- start 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- start start 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: init 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f350dd74640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.78:6790/0 conn(0x7f3510056cd0 legacy=0x7f3510172250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient(hunting): picked mon.noname-c con 0x7f431805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient(hunting): picked mon.noname-a con 0x7f431813f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient(hunting): picked mon.noname-b con 0x7f43181853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4318111f20 con 0x7f431813f8b0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43181110b0 con 0x7f43181853c0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431810fbc0 con 0x7f431805e4b0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient(hunting): authenticate will time out at 565.140303s 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946343940 0 0) 0x7f351013c190 con 0x7f3510056cd0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): my global_id is 4268 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34dc003620 con 0x7f3510056cd0 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f431813f8b0 0x7f4318180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51542/0 (socket says 10.20.193.78:51542) 2026-02-13T18:05:34.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430ffff640 1 -- 10.20.193.78:0/1374092579 learned_addr learned my addr 10.20.193.78:0/1374092579 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f350e575640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.187:6789/0 conn(0x7f35100561f0 legacy=0x7f3510151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1671104441 0 0) 0x7f34dc003620 con 0x7f3510056cd0 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f351013c190 con 0x7f3510056cd0 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34f80048e0 con 0x7f3510056cd0 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): dump: 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372679371 0 0) 0x7f351013beb0 con 0x7f35100561f0 2026-02-13T18:05:34.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient(hunting): my global_id is 4276 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34dc003620 con 0x7f35100561f0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4010217733 0 0) 0x7f351013c190 con 0x7f3510056cd0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.187:6789/0 conn(0x7f35100561f0 legacy=0x7f3510151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.78:6789/0 conn(0x7f3510183670 legacy=0x7f3510173970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 monclient: found mon.c 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351013a4d0 con 0x7f3510056cd0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 5 monclient: authenticate success, global_id 4268 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 10 monclient: _renew_subs 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f351013fc50 con 0x7f3510056cd0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 10 monclient: _renew_subs 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3510139d70 con 0x7f3510056cd0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34f8003380 con 0x7f3510056cd0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34f8005320 con 0x7f3510056cd0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: dump: 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.157 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f350cd72640 4 set_mon_vals no callback set 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3510089b50 con 0x7f3510056cd0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f34f80119b0 con 0x7f3510056cd0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient: monmap: 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.087035+0000 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.087035+0000 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f34f804c5f0 con 0x7f3510056cd0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6804/425425936 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34f8005170 con 0x7f34dc062150 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f34f804c930 con 0x7f3510056cd0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f34f6ffd640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f350ed76640 10 monclient: get_auth_request con 0x7f34dc062150 auth_method 0 2026-02-13T18:05:34.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f350e575640 10 monclient: get_auth_request con 0x7f34dc03d520 auth_method 0 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 1 Processor -- start 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 1 -- start start 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient: init 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient(hunting): picked mon.noname-b con 0x7fa42408e610 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient(hunting): picked mon.noname-a con 0x7fa42408f0f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient(hunting): picked mon.noname-c con 0x7fa424058e80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa424057c90 con 0x7fa42408f0f0 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa424057f70 con 0x7fa424058e80 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa424094920 con 0x7fa42408e610 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa42b5ee640 10 monclient(hunting): authenticate will time out at 565.142238s 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa429b64640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fa424058e80 0x7fa4241a55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:59564/0 (socket says 10.20.193.78:59564) 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7fa429b64640 1 -- 10.20.193.78:0/3568145242 learned_addr learned my addr 10.20.193.78:0/3568145242 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430ffff640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.78:6789/0 conn(0x7f431813f8b0 legacy=0x7f4318180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431cca7640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.78:6790/0 conn(0x7f431805e4b0 legacy=0x7f431813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== osd.4 v1:10.20.193.187:6807/218078640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f69d80050b0 con 0x7f69b4062090 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332198500 0 0) 0x7f4318111f20 con 0x7f431813f8b0 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): my global_id is 4284 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e0003620 con 0x7f431813f8b0 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431d4a8640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.187:6789/0 conn(0x7f43181853c0 legacy=0x7f4318181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 336217158 0 0) 0x7f42e0003620 con 0x7f431813f8b0 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4318111f20 con 0x7f431813f8b0 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4300002ce0 con 0x7f431813f8b0 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.160 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430ffff640 1 --1- 10.20.193.78:0/1374092579 >> v1:10.20.193.78:6789/0 conn(0x7f431813f8b0 0x7f4318180590 :-1 s=OPENED pgs=84 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f4318111f20 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098243752 0 0) 0x7f43181110b0 con 0x7f43181853c0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): my global_id is 4279 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e0003620 con 0x7f43181853c0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3274186636 0 0) 0x7f42e0003620 con 0x7f43181853c0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43181110b0 con 0x7f43181853c0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4314004170 con 0x7f43181853c0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== osd.3 v1:10.20.193.187:6800/1622449099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f668c003e80 con 0x7f666c061fd0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1222660131 0 0) 0x7f43181110b0 con 0x7f43181853c0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.78:6790/0 conn(0x7f431805e4b0 legacy=0x7f431813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.78:6789/0 conn(0x7f431813f8b0 legacy=0x7f4318180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 monclient: found mon.b 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4318111680 con 0x7f43181853c0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1021364537 0 0) 0x7f4318111f20 con 0x7f431813f8b0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 5 monclient: authenticate success, global_id 4279 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _renew_subs 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f431810f570 con 0x7f43181853c0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _renew_subs 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f431813f370 con 0x7f43181853c0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43140047d0 con 0x7f43181853c0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f43140063f0 con 0x7f43181853c0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430d7fa640 10 monclient: dump: 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.162 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f430effd640 4 set_mon_vals no callback set 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.084+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4318093020 con 0x7f43181853c0 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== osd.2 v1:10.20.193.78:6808/2589033462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f4a00003380 con 0x7f49e80627c0 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4314012a80 con 0x7f43181853c0 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa429363640 1 -- 10.20.193.78:0/3568145242 >> v1:10.20.193.78:6790/0 conn(0x7fa42408e610 legacy=0x7fa42408e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f431404d7f0 con 0x7f43181853c0 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa428b62640 1 -- 10.20.193.78:0/3568145242 >> v1:10.20.193.78:6789/0 conn(0x7fa42408f0f0 legacy=0x7fa424183e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6804/1501659775 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4314004980 con 0x7f42e0062230 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f431404db30 con 0x7f43181853c0 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f430d7fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa429b64640 1 -- 10.20.193.78:0/3568145242 >> v1:10.20.193.187:6789/0 conn(0x7fa424058e80 legacy=0x7fa4241a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882514295 0 0) 0x7fa424094920 con 0x7fa42408e610 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f431cca7640 10 monclient: get_auth_request con 0x7f42e003d650 auth_method 0 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): my global_id is 4274 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa40c003620 con 0x7fa42408e610 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635089095 0 0) 0x7fa424057c90 con 0x7fa42408f0f0 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): my global_id is 4287 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa424094920 con 0x7fa42408f0f0 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031577437 0 0) 0x7fa424057f70 con 0x7fa424058e80 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f430ffff640 10 monclient: get_auth_request con 0x7f42e0062230 auth_method 0 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient(hunting): my global_id is 4282 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa424057c90 con 0x7fa424058e80 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 11103659 0 0) 0x7fa40c003620 con 0x7fa42408e610 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 >> v1:10.20.193.187:6789/0 conn(0x7fa424058e80 legacy=0x7fa4241a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 >> v1:10.20.193.78:6789/0 conn(0x7fa42408f0f0 legacy=0x7fa424183e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 monclient: found mon.noname-b 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa424090150 con 0x7fa42408e610 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa414003160 con 0x7fa42408e610 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: dump: 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.165 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 5 monclient: authenticate success, global_id 4274 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4140034a0 con 0x7fa42408e610 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 1 -- 10.20.193.78:0/3568145242 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa4140038c0 con 0x7fa42408e610 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa413fff640 10 monclient: dump: 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 4 set_mon_vals no callback set 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: shutdown 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- 10.20.193.78:0/3568145242 >> v1:10.20.193.78:6790/0 conn(0x7fa42408e610 legacy=0x7fa42408e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- 10.20.193.78:0/3568145242 shutdown_connections 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- 10.20.193.78:0/3568145242 >> 10.20.193.78:0/3568145242 conn(0x7fa424056ab0 msgr2=0x7fa424093c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- 10.20.193.78:0/3568145242 shutdown_connections 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- 10.20.193.78:0/3568145242 wait complete. 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: monmap: 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.166 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 Processor -- start 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- start start 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: init 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient(hunting): picked mon.noname-a con 0x7fa424058e80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient(hunting): picked mon.noname-b con 0x7fa42408e610 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient(hunting): picked mon.noname-c con 0x7fa42408f0f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa42412ef30 con 0x7fa424058e80 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa42405e4f0 con 0x7fa42408e610 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa424130fb0 con 0x7fa42408f0f0 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa42b5ee640 10 monclient(hunting): authenticate will time out at 565.146507s 2026-02-13T18:05:34.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== osd.0 v1:10.20.193.78:6804/425425936 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f34f8005170 con 0x7f34dc062150 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa429b64640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa42408f0f0 0x7fa424195b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57978/0 (socket says 10.20.193.78:57978) 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.088+0000 7fa429b64640 1 -- 10.20.193.78:0/2523813468 learned_addr learned my addr 10.20.193.78:0/2523813468 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa429b64640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.78:6790/0 conn(0x7fa42408f0f0 legacy=0x7fa424195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa429363640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.78:6789/0 conn(0x7fa424058e80 legacy=0x7fa42413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa428b62640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.187:6789/0 conn(0x7fa42408e610 legacy=0x7fa424194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326291748 0 0) 0x7fa424130fb0 con 0x7fa42408f0f0 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): my global_id is 4277 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f4003620 con 0x7fa42408f0f0 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255295901 0 0) 0x7fa42412ef30 con 0x7fa424058e80 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): my global_id is 4290 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa424130fb0 con 0x7fa424058e80 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661377895 0 0) 0x7fa424094920 con 0x7fa42408e610 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): my global_id is 4285 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa42412ef30 con 0x7fa42408e610 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 799723695 0 0) 0x7fa3f4003620 con 0x7fa42408f0f0 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa424094920 con 0x7fa42408f0f0 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa420004890 con 0x7fa42408f0f0 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1496985970 0 0) 0x7fa424130fb0 con 0x7fa424058e80 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3f4003620 con 0x7fa424058e80 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa414003710 con 0x7fa424058e80 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1444932476 0 0) 0x7fa424094920 con 0x7fa42408f0f0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.187:6789/0 conn(0x7fa42408e610 legacy=0x7fa424194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.78:6789/0 conn(0x7fa424058e80 legacy=0x7fa42413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 monclient: found mon.c 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa424131290 con 0x7fa42408f0f0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 5 monclient: authenticate success, global_id 4277 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 10 monclient: _renew_subs 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa42408d430 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 10 monclient: _renew_subs 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa424153320 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4200060a0 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa420006480 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa4137fe640 4 set_mon_vals no callback set 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: dump: 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa424092c10 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa4200066a0 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fa42004dae0 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== osd.5 v1:10.20.193.187:6804/1501659775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f4314004980 con 0x7f42e0062230 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6800/444681404 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4200062d0 con 0x7fa3f4062370 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fa42004ded0 con 0x7fa42408f0f0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa411ffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa429363640 10 monclient: get_auth_request con 0x7fa3f403d740 auth_method 0 2026-02-13T18:05:34.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7fa428b62640 10 monclient: get_auth_request con 0x7fa3f4062370 auth_method 0 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 --> v1:10.20.193.187:6807/218078640 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69e4166e10 con 0x7f69b4062090 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69d1ffb640 1 -- 10.20.193.78:0/2945124053 <== osd.4 v1:10.20.193.187:6807/218078640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f69e4166e10 con 0x7f69b4062090 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.187:6807/218078640 conn(0x7f69b4062090 legacy=0x7f69b40824c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.187:6812/2668687789 conn(0x7f69b403d3e0 legacy=0x7f69b405d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 10 monclient: shutdown 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 >> v1:10.20.193.78:6789/0 conn(0x7f69e4163d50 legacy=0x7f69e412c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69e998d640 1 -- 10.20.193.78:0/2945124053 reap_dead start 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 shutdown_connections 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 >> 10.20.193.78:0/2945124053 conn(0x7f69e4095f10 msgr2=0x7f69e4054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 shutdown_connections 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.092+0000 7f69eb417640 1 -- 10.20.193.78:0/2945124053 wait complete. 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 --> v1:10.20.193.187:6800/1622449099 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f669c192940 con 0x7f666c061fd0 2026-02-13T18:05:34.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f6689ffb640 1 -- 10.20.193.78:0/813967126 <== osd.3 v1:10.20.193.187:6800/1622449099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f669c192940 con 0x7f666c061fd0 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 >> v1:10.20.193.187:6800/1622449099 conn(0x7f666c061fd0 legacy=0x7f666c082400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 >> v1:10.20.193.187:6812/2668687789 conn(0x7f666c03d320 legacy=0x7f666c05d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 10 monclient: shutdown 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 >> v1:10.20.193.78:6790/0 conn(0x7f669c05e4b0 legacy=0x7f669c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a1c38640 1 -- 10.20.193.78:0/813967126 reap_dead start 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 shutdown_connections 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 >> 10.20.193.78:0/813967126 conn(0x7f669c0545d0 msgr2=0x7f669c08bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 shutdown_connections 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f66a36c2640 1 -- 10.20.193.78:0/813967126 wait complete. 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 --> v1:10.20.193.78:6808/2589033462 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a1805dc10 con 0x7f49e80627c0 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a157fa640 1 -- 10.20.193.78:0/1629687385 <== osd.2 v1:10.20.193.78:6808/2589033462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f4a0c0078e0 con 0x7f49e80627c0 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.78:6808/2589033462 conn(0x7f49e80627c0 legacy=0x7f49e8082bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.187:6812/2668687789 conn(0x7f49e803db10 legacy=0x7f49e805dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 10 monclient: shutdown 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 >> v1:10.20.193.78:6790/0 conn(0x7f4a18163d50 legacy=0x7f4a181824c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1d2bf640 1 -- 10.20.193.78:0/1629687385 reap_dead start 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 shutdown_connections 2026-02-13T18:05:34.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 >> 10.20.193.78:0/1629687385 conn(0x7f4a18095f10 msgr2=0x7f4a18054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 shutdown_connections 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f4a1ed49640 1 -- 10.20.193.78:0/1629687385 wait complete. 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 --> v1:10.20.193.78:6804/425425936 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3510055410 con 0x7f34dc062150 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== osd.1 v1:10.20.193.78:6800/444681404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fa4200062d0 con 0x7fa3f4062370 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f34f6ffd640 1 -- 10.20.193.78:0/992700193 <== osd.0 v1:10.20.193.78:6804/425425936 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f3510055410 con 0x7f34dc062150 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.78:6804/425425936 conn(0x7f34dc062150 legacy=0x7f34dc082580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.187:6812/2668687789 conn(0x7f34dc03d520 legacy=0x7f34dc05d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 10 monclient: shutdown 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 >> v1:10.20.193.78:6790/0 conn(0x7f3510056cd0 legacy=0x7f3510172250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f350ed76640 1 -- 10.20.193.78:0/992700193 reap_dead start 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 shutdown_connections 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 >> 10.20.193.78:0/992700193 conn(0x7f3510054c90 msgr2=0x7f3510089300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 shutdown_connections 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.096+0000 7f3514aa4640 1 -- 10.20.193.78:0/992700193 wait complete. 2026-02-13T18:05:34.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 --> v1:10.20.193.187:6804/1501659775 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f43181107e0 con 0x7f42e0062230 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f430d7fa640 1 -- 10.20.193.78:0/1374092579 <== osd.5 v1:10.20.193.187:6804/1501659775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f43181107e0 con 0x7f42e0062230 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.187:6804/1501659775 conn(0x7f42e0062230 legacy=0x7f42e0082660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.187:6812/2668687789 conn(0x7f42e003d650 legacy=0x7f42e005db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 10 monclient: shutdown 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 >> v1:10.20.193.187:6789/0 conn(0x7f43181853c0 legacy=0x7f4318181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431d4a8640 1 -- 10.20.193.78:0/1374092579 reap_dead start 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 shutdown_connections 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 >> 10.20.193.78:0/1374092579 conn(0x7f43180545d0 msgr2=0x7f43181a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 shutdown_connections 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.100+0000 7f431ef32640 1 -- 10.20.193.78:0/1374092579 wait complete. 2026-02-13T18:05:34.174 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:34.174 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T18:05:34.175 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:34.175 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T18:05:34.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 --> v1:10.20.193.78:6800/444681404 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4241401f0 con 0x7fa3f4062370 2026-02-13T18:05:34.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa411ffb640 1 -- 10.20.193.78:0/2523813468 <== osd.1 v1:10.20.193.78:6800/444681404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fa4241401f0 con 0x7fa3f4062370 2026-02-13T18:05:34.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.78:6800/444681404 conn(0x7fa3f4062370 legacy=0x7fa3f40827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa3f403d740 legacy=0x7fa3f405dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 10 monclient: shutdown 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 >> v1:10.20.193.78:6790/0 conn(0x7fa42408f0f0 legacy=0x7fa424195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa429b64640 1 -- 10.20.193.78:0/2523813468 reap_dead start 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 shutdown_connections 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 >> 10.20.193.78:0/2523813468 conn(0x7fa424056ab0 msgr2=0x7fa4241413a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 shutdown_connections 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.104+0000 7fa42b5ee640 1 -- 10.20.193.78:0/2523813468 wait complete. 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:34.176 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T18:05:34.176 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:34.176 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T18:05:34.177 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:34.177 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T18:05:34.177 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:34.177 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: monmap: 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.273636+0000 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.273636+0000 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.277 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: monmap: 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.273740+0000 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.273740+0000 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.278 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 1 Processor -- start 2026-02-13T18:05:34.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 1 Processor -- start 2026-02-13T18:05:34.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 1 -- start start 2026-02-13T18:05:34.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: init 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 1 -- start start 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: init 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f413f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient(hunting): picked mon.noname-a con 0x7ff8f405e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f41853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f4095530 con 0x7ff8f405e4b0 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f4140390 con 0x7ff8f413f8b0 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f405d230 con 0x7ff8f41853c0 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient(hunting): authenticate will time out at 565.328951s 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient(hunting): picked mon.noname-b con 0x7f387013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient(hunting): picked mon.noname-a con 0x7f387005e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient(hunting): picked mon.noname-c con 0x7f38701853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3870095530 con 0x7f387005e4b0 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3870140390 con 0x7f38701853c0 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387005d230 con 0x7f387013f8b0 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff8f405e4b0 0x7ff8f4183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51564/0 (socket says 10.20.193.78:51564) 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1d74640 1 -- 10.20.193.78:0/3694622766 learned_addr learned my addr 10.20.193.78:0/3694622766 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f2d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 0x7ff8f41a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57986/0 (socket says 10.20.193.78:57986) 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient(hunting): authenticate will time out at 565.329123s 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f387013f8b0 0x7f387013fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57990/0 (socket says 10.20.193.78:57990) 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386ffff640 1 -- 10.20.193.78:0/3956893819 learned_addr learned my addr 10.20.193.78:0/3956893819 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient: monmap: 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.282 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.276055+0000 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.276055+0000 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 1 Processor -- start 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 1 -- start start 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient: init 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7fa8366dd640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7fa8366dd640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7fa8366dd640 10 monclient: monmap: 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.283 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.276730+0000 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.276730+0000 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1d74640 1 -- 10.20.193.78:0/3694622766 >> v1:10.20.193.78:6789/0 conn(0x7ff8f405e4b0 legacy=0x7ff8f4183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f2d76640 1 -- 10.20.193.78:0/3694622766 >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 legacy=0x7ff8f41a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386ffff640 1 -- 10.20.193.78:0/3956893819 >> v1:10.20.193.78:6790/0 conn(0x7f387013f8b0 legacy=0x7f387013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386f7fe640 1 -- 10.20.193.78:0/3956893819 >> v1:10.20.193.78:6789/0 conn(0x7f387005e4b0 legacy=0x7f3870183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f2575640 1 -- 10.20.193.78:0/3694622766 >> v1:10.20.193.187:6789/0 conn(0x7ff8f413f8b0 legacy=0x7ff8f413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient(hunting): picked mon.noname-c con 0x7f7c8c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient(hunting): picked mon.noname-b con 0x7f7c8c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient(hunting): picked mon.noname-a con 0x7f7c8c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169077554 0 0) 0x7ff8f405d230 con 0x7ff8f41853c0 2026-02-13T18:05:34.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c095530 con 0x7f7c8c1853c0 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): my global_id is 4280 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e0003620 con 0x7ff8f41853c0 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c140390 con 0x7f7c8c13f8b0 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33024923 0 0) 0x7f387005d230 con 0x7f387013f8b0 2026-02-13T18:05:34.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): my global_id is 4283 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753079304 0 0) 0x7ff8dc002c60 con 0x7ff8f405e4b0 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient(hunting): my global_id is 4293 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f405d230 con 0x7ff8f405e4b0 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3854003620 con 0x7f387013f8b0 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260425547 0 0) 0x7f3860002cb0 con 0x7f387005e4b0 2026-02-13T18:05:34.287 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c05d230 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c91a15640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f7c8c05e4b0 0x7f7c8c183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58000/0 (socket says 10.20.193.78:58000) 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c944a1640 10 monclient(hunting): authenticate will time out at 565.331515s 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f7c91a15640 1 -- 10.20.193.78:0/2571648317 learned_addr learned my addr 10.20.193.78:0/2571648317 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient(hunting): my global_id is 4296 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f387005d230 con 0x7f387005e4b0 2026-02-13T18:05:34.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7fa8366dd640 1 Processor -- start 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 290636611 0 0) 0x7ff8e0003620 con 0x7ff8f41853c0 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 770366457 0 0) 0x7f3854003620 con 0x7f387013f8b0 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 >> v1:10.20.193.187:6789/0 conn(0x7f38701853c0 legacy=0x7f38701a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 >> v1:10.20.193.187:6789/0 conn(0x7ff8f413f8b0 legacy=0x7ff8f413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 >> v1:10.20.193.78:6789/0 conn(0x7ff8f405e4b0 legacy=0x7ff8f4183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7fa8366dd640 1 -- start start 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7fa8366dd640 10 monclient: init 2026-02-13T18:05:34.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 >> v1:10.20.193.78:6789/0 conn(0x7f387005e4b0 legacy=0x7f3870183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 monclient: found mon.noname-b 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387005d510 con 0x7f387013f8b0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 monclient: found mon.noname-b 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f405d510 con 0x7ff8f41853c0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff8e4004550 con 0x7ff8f41853c0 2026-02-13T18:05:34.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7efe67d15640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7efe67d15640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7efe67d15640 10 monclient: monmap: 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.277261+0000 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.277261+0000 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f385c003110 con 0x7f387013f8b0 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: dump: 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: dump: 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 5 monclient: authenticate success, global_id 4280 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 5 monclient: authenticate success, global_id 4283 2026-02-13T18:05:34.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f2d76640 1 --1- 10.20.193.78:0/3694622766 >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 0x7ff8f41a57a0 :-1 s=OPENED pgs=80 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7ff8e4005df0 mon_map magic: 0 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8e4004820 con 0x7ff8f41853c0 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f1573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7ff8f8ded640 4 set_mon_vals no callback set 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f385c0033e0 con 0x7f387013f8b0 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 1 -- 10.20.193.78:0/3956893819 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f385c004b50 con 0x7f387013f8b0 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f386effd640 10 monclient: dump: 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.272+0000 7f387634b640 4 set_mon_vals no callback set 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient(hunting): picked mon.noname-c con 0x7fa83013f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient(hunting): picked mon.noname-a con 0x7fa83005e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient(hunting): picked mon.noname-b con 0x7fa8301853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa830095530 con 0x7fa83005e4b0 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa830140390 con 0x7fa83013f8b0 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83005d230 con 0x7fa8301853c0 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa8366dd640 10 monclient(hunting): authenticate will time out at 565.332077s 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient: shutdown 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- 10.20.193.78:0/3956893819 >> v1:10.20.193.78:6790/0 conn(0x7f387013f8b0 legacy=0x7f387013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa834c53640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa8301853c0 0x7fa8301a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58016/0 (socket says 10.20.193.78:58016) 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa834c53640 1 -- 10.20.193.78:0/816249308 learned_addr learned my addr 10.20.193.78:0/816249308 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- 10.20.193.78:0/3956893819 shutdown_connections 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- 10.20.193.78:0/3956893819 >> 10.20.193.78:0/3956893819 conn(0x7f38700545d0 msgr2=0x7f38700549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- 10.20.193.78:0/3956893819 shutdown_connections 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- 10.20.193.78:0/3956893819 wait complete. 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient: shutdown 2026-02-13T18:05:34.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- 10.20.193.78:0/3694622766 >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 legacy=0x7ff8f41a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f1573640 1 -- 10.20.193.78:0/3694622766 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff8e4005df0 con 0x7ff8f41853c0 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f1573640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 1 Processor -- start 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- 10.20.193.78:0/3694622766 shutdown_connections 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- 10.20.193.78:0/3694622766 >> 10.20.193.78:0/3694622766 conn(0x7ff8f40545d0 msgr2=0x7ff8f40549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- 10.20.193.78:0/3694622766 shutdown_connections 2026-02-13T18:05:34.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- 10.20.193.78:0/3694622766 wait complete. 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 1 -- start start 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient: init 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient: monmap: 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.299 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient: get_monmap_and_config 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient: monmap: 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:34.278117+0000 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:34.278117+0000 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 Processor -- start 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient(hunting): picked mon.noname-a con 0x7efe6013f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient(hunting): picked mon.noname-c con 0x7efe6005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- start start 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient: init 2026-02-13T18:05:34.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient(hunting): picked mon.noname-b con 0x7efe601853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe60095530 con 0x7efe6013f8b0 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe60140390 con 0x7efe6005e4b0 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6005d230 con 0x7efe601853c0 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe67d15640 10 monclient(hunting): authenticate will time out at 565.332858s 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient: monmap: 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.302 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 1 Processor -- start 2026-02-13T18:05:34.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 1 -- start start 2026-02-13T18:05:34.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient: init 2026-02-13T18:05:34.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 Processor -- start 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient(hunting): picked mon.noname-c con 0x7f387005e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient(hunting): picked mon.noname-b con 0x7f387013f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- start start 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient: init 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient(hunting): picked mon.noname-a con 0x7f38701853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3870057e50 con 0x7f38701853c0 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387012dab0 con 0x7f387013f8b0 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387012dd90 con 0x7f387005e4b0 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f387634b640 10 monclient(hunting): authenticate will time out at 565.333200s 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient(hunting): picked mon.noname-a con 0x7ff8f413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f41853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f413f2b0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f412e2b0 con 0x7ff8f405e4b0 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f408a5b0 con 0x7ff8f41853c0 2026-02-13T18:05:34.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f8ded640 10 monclient(hunting): authenticate will time out at 565.333364s 2026-02-13T18:05:34.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:34.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient(hunting): picked mon.noname-b con 0x7faf6813f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient(hunting): picked mon.noname-c con 0x7faf6805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient(hunting): picked mon.noname-a con 0x7faf681853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf68095530 con 0x7faf681853c0 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf68140390 con 0x7faf6805e4b0 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6805d230 con 0x7faf6813f8b0 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf6d9d0640 10 monclient(hunting): authenticate will time out at 565.333472s 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91a15640 1 -- 10.20.193.78:0/2571648317 >> v1:10.20.193.78:6790/0 conn(0x7f7c8c05e4b0 legacy=0x7f7c8c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c92a17640 1 -- 10.20.193.78:0/2571648317 >> v1:10.20.193.78:6789/0 conn(0x7f7c8c1853c0 legacy=0x7f7c8c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333465524 0 0) 0x7f7c8c05d230 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient(hunting): my global_id is 4286 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c74003620 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe65a8a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efe6013f8b0 0x7efe6013fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51622/0 (socket says 10.20.193.78:51622) 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7efe65a8a640 1 -- 10.20.193.78:0/6839801 learned_addr learned my addr 10.20.193.78:0/6839801 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2537238767 0 0) 0x7f7c74003620 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c92216640 1 -- 10.20.193.78:0/2571648317 >> v1:10.20.193.187:6789/0 conn(0x7f7c8c13f8b0 legacy=0x7f7c8c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 >> v1:10.20.193.187:6789/0 conn(0x7f7c8c13f8b0 legacy=0x7f7c8c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 >> v1:10.20.193.78:6789/0 conn(0x7f7c8c1853c0 legacy=0x7f7c8c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 monclient: found mon.noname-b 2026-02-13T18:05:34.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f1d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff8f413f8b0 0x7ff8f4180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51654/0 (socket says 10.20.193.78:51654) 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7ff8f1d74640 1 -- 10.20.193.78:0/1553974179 learned_addr learned my addr 10.20.193.78:0/1553974179 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c05d510 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 5 monclient: authenticate success, global_id 4286 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7c80003110 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: dump: 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f386f7fe640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7f387013f8b0 0x7f38701a5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:59640/0 (socket says 10.20.193.78:59640) 2026-02-13T18:05:34.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f386f7fe640 1 -- 10.20.193.78:0/4144142269 learned_addr learned my addr 10.20.193.78:0/4144142269 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf677fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7faf681853c0 0x7faf681a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51668/0 (socket says 10.20.193.78:51668) 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7faf677fe640 1 -- 10.20.193.78:0/1136176348 learned_addr learned my addr 10.20.193.78:0/1136176348 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c800033e0 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 1 -- 10.20.193.78:0/2571648317 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7c80004b50 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c91214640 10 monclient: dump: 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.312 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 4 set_mon_vals no callback set 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa834c53640 1 -- 10.20.193.78:0/816249308 >> v1:10.20.193.78:6790/0 conn(0x7fa8301853c0 legacy=0x7fa8301a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: shutdown 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- 10.20.193.78:0/2571648317 >> v1:10.20.193.78:6790/0 conn(0x7f7c8c05e4b0 legacy=0x7f7c8c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- 10.20.193.78:0/2571648317 shutdown_connections 2026-02-13T18:05:34.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- 10.20.193.78:0/2571648317 >> 10.20.193.78:0/2571648317 conn(0x7f7c8c0545d0 msgr2=0x7f7c8c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- 10.20.193.78:0/2571648317 shutdown_connections 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- 10.20.193.78:0/2571648317 wait complete. 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46785365 0 0) 0x7fa83005d230 con 0x7fa8301853c0 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa82effd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa82effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa82effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa82effd640 10 monclient(hunting): my global_id is 4289 2026-02-13T18:05:34.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa814003620 con 0x7fa8301853c0 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: monmap: 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 Processor -- start 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- start start 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: init 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient(hunting): picked mon.noname-c con 0x7f7c8c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient(hunting): picked mon.noname-b con 0x7f7c8c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient(hunting): picked mon.noname-a con 0x7f7c8c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c112050 con 0x7f7c8c1853c0 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c1111e0 con 0x7f7c8c13f8b0 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c10fcf0 con 0x7f7c8c05e4b0 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.276+0000 7f7c944a1640 10 monclient(hunting): authenticate will time out at 565.335280s 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe65a8a640 1 -- 10.20.193.78:0/6839801 >> v1:10.20.193.78:6789/0 conn(0x7efe6013f8b0 legacy=0x7efe6013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82f7fe640 1 -- 10.20.193.78:0/816249308 >> v1:10.20.193.78:6789/0 conn(0x7fa83005e4b0 legacy=0x7fa830183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82ffff640 1 -- 10.20.193.78:0/816249308 >> v1:10.20.193.187:6789/0 conn(0x7fa83013f8b0 legacy=0x7fa83013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf677fe640 1 -- 10.20.193.78:0/1136176348 >> v1:10.20.193.78:6789/0 conn(0x7faf681853c0 legacy=0x7faf681a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c92a17640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7c8c1853c0 0x7f7c8c181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51678/0 (socket says 10.20.193.78:51678) 2026-02-13T18:05:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c92a17640 1 -- 10.20.193.78:0/3972549878 learned_addr learned my addr 10.20.193.78:0/3972549878 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf667fc640 1 -- 10.20.193.78:0/1136176348 >> v1:10.20.193.187:6789/0 conn(0x7faf6805e4b0 legacy=0x7faf68183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386f7fe640 1 -- 10.20.193.78:0/4144142269 >> v1:10.20.193.187:6789/0 conn(0x7f387013f8b0 legacy=0x7f38701a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386ffff640 1 -- 10.20.193.78:0/4144142269 >> v1:10.20.193.78:6790/0 conn(0x7f387005e4b0 legacy=0x7f38701a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe6628b640 1 -- 10.20.193.78:0/6839801 >> v1:10.20.193.78:6790/0 conn(0x7efe601853c0 legacy=0x7efe601a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f2d76640 1 -- 10.20.193.78:0/1553974179 >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 legacy=0x7ff8f4181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820763010 0 0) 0x7f387012dab0 con 0x7f387013f8b0 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): my global_id is 4297 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3840003620 con 0x7f387013f8b0 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013045670 0 0) 0x7f387012dd90 con 0x7f387005e4b0 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): my global_id is 4292 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f387012dab0 con 0x7f387005e4b0 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3926269743 0 0) 0x7fa814003620 con 0x7fa8301853c0 2026-02-13T18:05:34.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 >> v1:10.20.193.187:6789/0 conn(0x7fa83013f8b0 legacy=0x7fa83013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 >> v1:10.20.193.78:6789/0 conn(0x7fa83005e4b0 legacy=0x7fa830183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 monclient: found mon.noname-b 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83005d510 con 0x7fa8301853c0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa824004620 con 0x7fa8301853c0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195261192 0 0) 0x7ff8f408a5b0 con 0x7ff8f41853c0 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): my global_id is 4295 2026-02-13T18:05:34.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8c0003620 con 0x7ff8f41853c0 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: dump: 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 5 monclient: authenticate success, global_id 4289 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8240048f0 con 0x7fa8301853c0 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 1 -- 10.20.193.78:0/816249308 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa824006060 con 0x7fa8301853c0 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2910174486 0 0) 0x7f3840003620 con 0x7f387013f8b0 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f387012dd90 con 0x7f387013f8b0 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3860003710 con 0x7f387013f8b0 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82effd640 10 monclient: dump: 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 4 set_mon_vals no callback set 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): dump: 2026-02-13T18:05:34.321 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f2d76640 1 --1- 10.20.193.78:0/1553974179 >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 0x7ff8f4181cb0 :-1 s=OPENED pgs=86 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7ff8e4005df0 mon_map magic: 0 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 540767223 0 0) 0x7ff8c0003620 con 0x7ff8f41853c0 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8f408a5b0 con 0x7ff8f41853c0 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff8e4005df0 con 0x7ff8f41853c0 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): dump: 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.322 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1227461051 0 0) 0x7f387012dd90 con 0x7f387013f8b0 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 >> v1:10.20.193.78:6790/0 conn(0x7f387005e4b0 legacy=0x7f38701a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 >> v1:10.20.193.78:6789/0 conn(0x7f38701853c0 legacy=0x7f38701815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 monclient: found mon.b 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387008fd00 con 0x7f387013f8b0 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 5 monclient: authenticate success, global_id 4297 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 monclient: _renew_subs 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f387012c870 con 0x7f387013f8b0 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 monclient: _renew_subs 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f38701a6060 con 0x7f387013f8b0 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: shutdown 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- 10.20.193.78:0/816249308 >> v1:10.20.193.78:6790/0 conn(0x7fa8301853c0 legacy=0x7fa8301a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- 10.20.193.78:0/816249308 shutdown_connections 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- 10.20.193.78:0/816249308 >> 10.20.193.78:0/816249308 conn(0x7fa8300545d0 msgr2=0x7fa8300549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- 10.20.193.78:0/816249308 shutdown_connections 2026-02-13T18:05:34.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- 10.20.193.78:0/816249308 wait complete. 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38701a6710 con 0x7f387013f8b0 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3860003c90 con 0x7f387013f8b0 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3860003ff0 con 0x7f387013f8b0 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 10 monclient: dump: 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386e7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: monmap: 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 Processor -- start 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- start start 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: init 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f1d74640 1 -- 10.20.193.78:0/1553974179 >> v1:10.20.193.78:6789/0 conn(0x7ff8f413f8b0 legacy=0x7ff8f4180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867571470 0 0) 0x7ff8f413f2b0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): my global_id is 4311 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8c0003620 con 0x7ff8f413f8b0 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444961244 0 0) 0x7efe50002c60 con 0x7efe6013f8b0 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient(hunting): my global_id is 4308 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe65289640 1 -- 10.20.193.78:0/6839801 >> v1:10.20.193.187:6789/0 conn(0x7efe6005e4b0 legacy=0x7efe60183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe48003620 con 0x7efe6013f8b0 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient(hunting): picked mon.noname-c con 0x7fa83005e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient(hunting): picked mon.noname-a con 0x7fa83013f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient(hunting): picked mon.noname-b con 0x7fa8301853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa830112220 con 0x7fa83013f8b0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8301113b0 con 0x7fa8301853c0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83010fec0 con 0x7fa83005e4b0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa8366dd640 10 monclient(hunting): authenticate will time out at 565.338372s 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1609646163 0 0) 0x7ff8c0003620 con 0x7ff8f413f8b0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8f413f2b0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff8dc0048e0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c92a17640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.78:6789/0 conn(0x7f7c8c1853c0 legacy=0x7f7c8c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient(hunting): dump: 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.328 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa83005e4b0 0x7fa83013ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58052/0 (socket says 10.20.193.78:58052) 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7fa82ffff640 1 -- 10.20.193.78:0/2305486182 learned_addr learned my addr 10.20.193.78:0/2305486182 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 405414085 0 0) 0x7efe48003620 con 0x7efe6013f8b0 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 >> v1:10.20.193.78:6790/0 conn(0x7efe601853c0 legacy=0x7efe601a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 >> v1:10.20.193.187:6789/0 conn(0x7efe6005e4b0 legacy=0x7efe60183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 monclient: found mon.noname-a 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3860004210 con 0x7f387013f8b0 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6005d510 con 0x7efe6013f8b0 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efe500032e0 con 0x7efe6013f8b0 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 5 monclient: authenticate success, global_id 4308 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: dump: 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2512518299 0 0) 0x7ff8f413f2b0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 >> v1:10.20.193.78:6790/0 conn(0x7ff8f41853c0 legacy=0x7ff8f4181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 >> v1:10.20.193.187:6789/0 conn(0x7ff8f405e4b0 legacy=0x7ff8f41a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 monclient: found mon.a 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275302458 0 0) 0x7faf58004170 con 0x7faf681853c0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): my global_id is 4305 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f4057e50 con 0x7ff8f413f8b0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf54003620 con 0x7faf681853c0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3858810913 0 0) 0x7ff8f408a5b0 con 0x7ff8f41853c0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 5 monclient: authenticate success, global_id 4311 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 monclient: _renew_subs 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f41a6990 con 0x7ff8f413f8b0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220961208 0 0) 0x7f7c8c112050 con 0x7f7c8c1853c0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe500049a0 con 0x7efe6013f8b0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): my global_id is 4314 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 monclient: _renew_subs 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8f41a15a0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 1 -- 10.20.193.78:0/6839801 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efe50004d30 con 0x7efe6013f8b0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe64a88640 10 monclient: dump: 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.332 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 4 set_mon_vals no callback set 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c5c003620 con 0x7f7c8c1853c0 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f386004c6c0 con 0x7f387013f8b0 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c91a15640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.187:6789/0 conn(0x7f7c8c13f8b0 legacy=0x7f7c8c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096176061 0 0) 0x7faf50002cb0 con 0x7faf6805e4b0 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient(hunting): my global_id is 4294 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf58004170 con 0x7faf6805e4b0 2026-02-13T18:05:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf66ffd640 1 -- 10.20.193.78:0/1136176348 >> v1:10.20.193.78:6790/0 conn(0x7faf6813f8b0 legacy=0x7faf6813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f386ffff640 10 monclient: get_auth_request con 0x7f384003d4a0 auth_method 0 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8dc004d30 con 0x7ff8f413f8b0 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff8dc005090 con 0x7ff8f413f8b0 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 10 monclient: dump: 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f0d72640 4 set_mon_vals no callback set 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4203679533 0 0) 0x7faf54003620 con 0x7faf681853c0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 >> v1:10.20.193.78:6790/0 conn(0x7faf6813f8b0 legacy=0x7faf6813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 >> v1:10.20.193.187:6789/0 conn(0x7faf6805e4b0 legacy=0x7faf68183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 monclient: found mon.noname-a 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6805d510 con 0x7faf681853c0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 5 monclient: authenticate success, global_id 4305 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf580047f0 con 0x7faf681853c0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: dump: 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 10 monclient: shutdown 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 1 -- 10.20.193.78:0/6839801 >> v1:10.20.193.78:6789/0 conn(0x7efe6013f8b0 legacy=0x7efe6013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 1 -- 10.20.193.78:0/6839801 shutdown_connections 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 1 -- 10.20.193.78:0/6839801 >> 10.20.193.78:0/6839801 conn(0x7efe600545d0 msgr2=0x7efe600549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c92216640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.78:6790/0 conn(0x7f7c8c05e4b0 legacy=0x7f7c8c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 1 -- 10.20.193.78:0/6839801 shutdown_connections 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 1 -- 10.20.193.78:0/6839801 wait complete. 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4031681356 0 0) 0x7f7c5c003620 con 0x7f7c8c1853c0 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c8c112050 con 0x7f7c8c1853c0 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7c88004930 con 0x7f7c8c1853c0 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): dump: 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.336 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf58005eb0 con 0x7faf681853c0 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 1 -- 10.20.193.78:0/1136176348 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf58006240 con 0x7faf681853c0 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf65ffb640 10 monclient: dump: 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 4 set_mon_vals no callback set 2026-02-13T18:05:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3278211754 0 0) 0x7f7c8c112050 con 0x7f7c8c1853c0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.78:6790/0 conn(0x7f7c8c05e4b0 legacy=0x7f7c8c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.187:6789/0 conn(0x7f7c8c13f8b0 legacy=0x7f7c8c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 monclient: found mon.a 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c1117b0 con 0x7f7c8c1853c0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 5 monclient: authenticate success, global_id 4314 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 monclient: _renew_subs 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c10f820 con 0x7f7c8c1853c0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7ff8dc011720 con 0x7ff8f413f8b0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f40008e0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 10 monclient: shutdown 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 1 -- 10.20.193.78:0/1136176348 >> v1:10.20.193.78:6789/0 conn(0x7faf681853c0 legacy=0x7faf681a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 monclient: _renew_subs 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c8c110850 con 0x7f7c8c1853c0 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 1 -- 10.20.193.78:0/1136176348 shutdown_connections 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 1 -- 10.20.193.78:0/1136176348 >> 10.20.193.78:0/1136176348 conn(0x7faf680545d0 msgr2=0x7faf680549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 1 -- 10.20.193.78:0/1136176348 shutdown_connections 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 1 -- 10.20.193.78:0/1136176348 wait complete. 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7ff8dc04c640 con 0x7ff8f413f8b0 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c88004ed0 con 0x7f7c8c1853c0 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7c88005260 con 0x7f7c8c1853c0 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c90a13640 4 set_mon_vals no callback set 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c72ffd640 10 monclient: dump: 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.339 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7efe67d15640 10 monclient: monmap: 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 10 monclient: build_initial_monmap 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 10 monclient: monmap: 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:34.340 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c110b90 con 0x7f7c8c1853c0 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.280+0000 7faf6d9d0640 1 Processor -- start 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 1 -- start start 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: init 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 Processor -- start 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 -- start start 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: init 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient(hunting): picked mon.noname-a con 0x7faf6805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient(hunting): picked mon.noname-b con 0x7faf6813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient(hunting): picked mon.noname-c con 0x7faf681853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6812c430 con 0x7faf6805e4b0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf681a5a60 con 0x7faf6813f8b0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6812cc40 con 0x7faf681853c0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient(hunting): authenticate will time out at 565.340274s 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf667fc640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7faf6813f8b0 0x7faf68180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:59678/0 (socket says 10.20.193.78:59678) 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf667fc640 1 -- 10.20.193.78:0/153486934 learned_addr learned my addr 10.20.193.78:0/153486934 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82ffff640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.78:6790/0 conn(0x7fa83005e4b0 legacy=0x7fa83013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient(hunting): picked mon.noname-b con 0x7efe6005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient(hunting): picked mon.noname-c con 0x7efe6013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient(hunting): picked mon.noname-a con 0x7efe601853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe60112140 con 0x7efe601853c0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe601112d0 con 0x7efe6005e4b0 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82f7fe640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.78:6789/0 conn(0x7fa83013f8b0 legacy=0x7fa830180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6010fde0 con 0x7efe6013f8b0 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient(hunting): authenticate will time out at 565.340779s 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe65289640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7efe6013f8b0 0x7efe60180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58076/0 (socket says 10.20.193.78:58076) 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe65289640 1 -- 10.20.193.78:0/3231367998 learned_addr learned my addr 10.20.193.78:0/3231367998 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089170240 0 0) 0x7fa83010fec0 con 0x7fa83005e4b0 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): my global_id is 4301 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa800003620 con 0x7fa83005e4b0 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa834c53640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.187:6789/0 conn(0x7fa8301853c0 legacy=0x7fa830181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7ff8f2575640 10 monclient: get_auth_request con 0x7ff8c003d5e0 auth_method 0 2026-02-13T18:05:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1804016816 0 0) 0x7fa800003620 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa83010fec0 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa81c003420 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): dump: 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1993081956 0 0) 0x7fa83010fec0 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.187:6789/0 conn(0x7fa8301853c0 legacy=0x7fa830181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.78:6789/0 conn(0x7fa83013f8b0 legacy=0x7fa830180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 monclient: found mon.c 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830111980 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 5 monclient: authenticate success, global_id 4301 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 monclient: _renew_subs 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa83010f870 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 monclient: _renew_subs 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa830110bf0 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa81c003a30 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa81c003d90 con 0x7fa83005e4b0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82e7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 10 monclient: dump: 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f7c88005530 con 0x7f7c8c1853c0 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83008b9a0 con 0x7fa83005e4b0 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f3870095530 con 0x7f387013f8b0 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f386cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f386cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa81c004060 con 0x7fa83005e4b0 2026-02-13T18:05:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f7c8804d9b0 con 0x7f7c8c1853c0 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fa81c04c670 con 0x7fa83005e4b0 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf667fc640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.187:6789/0 conn(0x7faf6813f8b0 legacy=0x7faf68180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf677fe640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.78:6790/0 conn(0x7faf681853c0 legacy=0x7faf68181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf66ffd640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.78:6789/0 conn(0x7faf6805e4b0 legacy=0x7faf681a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe65289640 1 -- 10.20.193.78:0/3231367998 >> v1:10.20.193.78:6790/0 conn(0x7efe6013f8b0 legacy=0x7efe60180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985106336 0 0) 0x7faf681a5a60 con 0x7faf6813f8b0 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): my global_id is 4300 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe6628b640 1 -- 10.20.193.78:0/3231367998 >> v1:10.20.193.78:6789/0 conn(0x7efe601853c0 legacy=0x7efe60181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf38003620 con 0x7faf6813f8b0 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7ff8f4095530 con 0x7ff8f413f8b0 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7ff8daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7ff8daffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3839572186 0 0) 0x7faf38003620 con 0x7faf6813f8b0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf681a5a60 con 0x7faf6813f8b0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf50003530 con 0x7faf6813f8b0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): dump: 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353837762 0 0) 0x7faf6812c430 con 0x7faf6805e4b0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient(hunting): my global_id is 4317 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf38003620 con 0x7faf6805e4b0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270187706 0 0) 0x7efe60112140 con 0x7efe601853c0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): my global_id is 4320 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f7c92216640 10 monclient: get_auth_request con 0x7f7c5c03d450 auth_method 0 2026-02-13T18:05:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe30003620 con 0x7efe601853c0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2161440212 0 0) 0x7faf681a5a60 con 0x7faf6813f8b0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.78:6790/0 conn(0x7faf681853c0 legacy=0x7faf68181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.78:6789/0 conn(0x7faf6805e4b0 legacy=0x7faf681a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7fa82f7fe640 10 monclient: get_auth_request con 0x7fa80003d450 auth_method 0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 monclient: found mon.b 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6812cf20 con 0x7faf6813f8b0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 5 monclient: authenticate success, global_id 4300 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: _renew_subs 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf681a65c0 con 0x7faf6813f8b0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: _renew_subs 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faf68192120 con 0x7faf6813f8b0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f7c8c095530 con 0x7f7c8c1853c0 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f7c72ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7f7c72ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 802348513 0 0) 0x7efe30003620 con 0x7efe601853c0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe60112140 con 0x7efe601853c0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efe5c004890 con 0x7efe601853c0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): dump: 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf500039c0 con 0x7faf6813f8b0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf50003d20 con 0x7faf6813f8b0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3934998021 0 0) 0x7efe60112140 con 0x7efe601853c0 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf657fa640 4 set_mon_vals no callback set 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 >> v1:10.20.193.78:6790/0 conn(0x7efe6013f8b0 legacy=0x7efe60180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 >> v1:10.20.193.187:6789/0 conn(0x7efe6005e4b0 legacy=0x7efe6013ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 monclient: found mon.a 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf3ffff640 10 monclient: dump: 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe601118a0 con 0x7efe601853c0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 5 monclient: authenticate success, global_id 4320 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: _renew_subs 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe6010f7e0 con 0x7efe601853c0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: _renew_subs 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe60110940 con 0x7efe601853c0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.284+0000 7faf6d9d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf6d9d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf6d9d0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf681923b0 con 0x7faf6813f8b0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe67d15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe67d15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe67d15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe600008e0 con 0x7efe601853c0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7faf50003ff0 con 0x7faf6813f8b0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe5c004ed0 con 0x7efe601853c0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efe5c0052a0 con 0x7efe601853c0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 10 monclient: dump: 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4ffff640 4 set_mon_vals no callback set 2026-02-13T18:05:34.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7efe5c0054f0 con 0x7efe601853c0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fa830140390 con 0x7fa83005e4b0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7fa82cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7fa82cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7efe5c04da30 con 0x7efe601853c0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7faf5004c5d0 con 0x7faf6813f8b0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe65a8a640 10 monclient: get_auth_request con 0x7efe3003d4b0 auth_method 0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf66ffd640 10 monclient: get_auth_request con 0x7faf3803d590 auth_method 0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7efe5c018ba0 con 0x7efe601853c0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7efe4e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7faf68140390 con 0x7faf6813f8b0 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:34.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.288+0000 7faf3ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:34.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.372+0000 7f387634b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:34.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.372+0000 7f387634b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:34.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.372+0000 7f387634b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.372+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3870051150 con 0x7f387013f8b0 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f386cff9640 1 -- 10.20.193.78:0/4144142269 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7f3860017830 con 0x7f387013f8b0 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f386cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f386cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 >> v1:10.20.193.187:6812/2668687789 conn(0x7f384003d4a0 legacy=0x7f384005d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 10 monclient: shutdown 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 >> v1:10.20.193.187:6789/0 conn(0x7f387013f8b0 legacy=0x7f38701a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 shutdown_connections 2026-02-13T18:05:34.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 >> 10.20.193.78:0/4144142269 conn(0x7f38700545d0 msgr2=0x7f3870096590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 shutdown_connections 2026-02-13T18:05:34.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f387634b640 1 -- 10.20.193.78:0/4144142269 wait complete. 2026-02-13T18:05:34.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c944a1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:34.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c944a1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:34.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c944a1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7c8c051150 con 0x7f7c8c1853c0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c72ffd640 1 -- 10.20.193.78:0/3972549878 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7f7c88018b20 con 0x7f7c8c1853c0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c72ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.376+0000 7f7c72ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efe60110c80 con 0x7efe601853c0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe4e7fc640 1 -- 10.20.193.78:0/3231367998 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7efe5c018480 con 0x7efe601853c0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe4e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe4e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:34.385 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.187:6812/2668687789 conn(0x7f7c5c03d450 legacy=0x7f7c5c05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 10 monclient: shutdown 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 >> v1:10.20.193.78:6789/0 conn(0x7f7c8c1853c0 legacy=0x7f7c8c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 shutdown_connections 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 >> 10.20.193.78:0/3972549878 conn(0x7f7c8c0545d0 msgr2=0x7f7c8c1a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 shutdown_connections 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7f7c944a1640 1 -- 10.20.193.78:0/3972549878 wait complete. 2026-02-13T18:05:34.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 >> v1:10.20.193.187:6812/2668687789 conn(0x7efe3003d4b0 legacy=0x7efe3005d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 10 monclient: shutdown 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 >> v1:10.20.193.78:6789/0 conn(0x7efe601853c0 legacy=0x7efe60181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 shutdown_connections 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 >> 10.20.193.78:0/3231367998 conn(0x7efe600545d0 msgr2=0x7efe600965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 shutdown_connections 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7efe67d15640 1 -- 10.20.193.78:0/3231367998 wait complete. 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa8366dd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa8366dd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa8366dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa830051150 con 0x7fa83005e4b0 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa82cff9640 1 -- 10.20.193.78:0/2305486182 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7fa81c0177e0 con 0x7fa83005e4b0 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa82cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.380+0000 7fa82cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:34.387 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa80003d450 legacy=0x7fa80005d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 10 monclient: shutdown 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 >> v1:10.20.193.78:6790/0 conn(0x7fa83005e4b0 legacy=0x7fa83013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 shutdown_connections 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 >> 10.20.193.78:0/2305486182 conn(0x7fa8300545d0 msgr2=0x7fa8300965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 shutdown_connections 2026-02-13T18:05:34.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.384+0000 7fa8366dd640 1 -- 10.20.193.78:0/2305486182 wait complete. 2026-02-13T18:05:34.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-13T18:05:34.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-13T18:05:34.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-13T18:05:34.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff8f4093020 con 0x7ff8f413f8b0 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8daffd640 1 -- 10.20.193.78:0/1553974179 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7ff8dc0177b0 con 0x7ff8f413f8b0 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8daffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8daffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:34.401 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:34.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 >> v1:10.20.193.187:6812/2668687789 conn(0x7ff8c003d5e0 legacy=0x7ff8c005da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 10 monclient: shutdown 2026-02-13T18:05:34.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 >> v1:10.20.193.78:6789/0 conn(0x7ff8f413f8b0 legacy=0x7ff8f4180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 shutdown_connections 2026-02-13T18:05:34.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 >> 10.20.193.78:0/1553974179 conn(0x7ff8f40545d0 msgr2=0x7ff8f4096650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 shutdown_connections 2026-02-13T18:05:34.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.396+0000 7ff8f8ded640 1 -- 10.20.193.78:0/1553974179 wait complete. 2026-02-13T18:05:34.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:34.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:34.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:34.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faf68051150 con 0x7faf6813f8b0 2026-02-13T18:05:34.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf3ffff640 1 -- 10.20.193.78:0/153486934 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7faf50017680 con 0x7faf6813f8b0 2026-02-13T18:05:34.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:34.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf3ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:34.410 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.187:6812/2668687789 conn(0x7faf3803d590 legacy=0x7faf3805da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 10 monclient: shutdown 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 >> v1:10.20.193.187:6789/0 conn(0x7faf6813f8b0 legacy=0x7faf68180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 shutdown_connections 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 >> 10.20.193.78:0/153486934 conn(0x7faf680545d0 msgr2=0x7faf6808c070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 shutdown_connections 2026-02-13T18:05:34.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:34.404+0000 7faf6d9d0640 1 -- 10.20.193.78:0/153486934 wait complete. 2026-02-13T18:05:34.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2026-02-13T18:05:34.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-13T18:05:35.394 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T18:05:35.399 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T18:05:35.399 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T18:05:35.402 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T18:05:35.414 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T18:05:35.423 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T18:05:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient: get_monmap_and_config 2026-02-13T18:05:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient: monmap: 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:35.455019+0000 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:35.455019+0000 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:35.459 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 1 Processor -- start 2026-02-13T18:05:35.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 1 -- start start 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient: init 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient(hunting): picked mon.noname-a con 0x7f78e813f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient(hunting): picked mon.noname-c con 0x7f78e805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient(hunting): picked mon.noname-b con 0x7f78e81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8095530 con 0x7f78e813f8b0 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8140390 con 0x7f78e805e4b0 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e805d230 con 0x7f78e81853c0 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78eda21640 10 monclient(hunting): authenticate will time out at 566.510240s 2026-02-13T18:05:35.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78e77fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f78e81853c0 0x7f78e81a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58088/0 (socket says 10.20.193.78:58088) 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.452+0000 7f78e77fe640 1 -- 10.20.193.78:0/4288103080 learned_addr learned my addr 10.20.193.78:0/4288103080 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e77fe640 1 -- 10.20.193.78:0/4288103080 >> v1:10.20.193.78:6790/0 conn(0x7f78e81853c0 legacy=0x7f78e81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e6ffd640 1 -- 10.20.193.78:0/4288103080 >> v1:10.20.193.78:6789/0 conn(0x7f78e813f8b0 legacy=0x7f78e813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749910765 0 0) 0x7f78e805d230 con 0x7f78e81853c0 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): my global_id is 4304 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78d4003620 con 0x7f78e81853c0 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512891400 0 0) 0x7f78dc002cb0 con 0x7f78e813f8b0 2026-02-13T18:05:35.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient(hunting): my global_id is 4323 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78e805d230 con 0x7f78e813f8b0 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e67fc640 1 -- 10.20.193.78:0/4288103080 >> v1:10.20.193.187:6789/0 conn(0x7f78e805e4b0 legacy=0x7f78e8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2832733783 0 0) 0x7f78d4003620 con 0x7f78e81853c0 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 >> v1:10.20.193.187:6789/0 conn(0x7f78e805e4b0 legacy=0x7f78e8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 >> v1:10.20.193.78:6789/0 conn(0x7f78e813f8b0 legacy=0x7f78e813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 monclient: found mon.noname-b 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e805d510 con 0x7f78e81853c0 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f78d8004620 con 0x7f78e81853c0 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: dump: 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.468 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 5 monclient: authenticate success, global_id 4304 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78d80048f0 con 0x7f78e81853c0 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 1 -- 10.20.193.78:0/4288103080 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f78d8006060 con 0x7f78e81853c0 2026-02-13T18:05:35.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e5ffb640 10 monclient: dump: 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 4 set_mon_vals no callback set 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: shutdown 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- 10.20.193.78:0/4288103080 >> v1:10.20.193.78:6790/0 conn(0x7f78e81853c0 legacy=0x7f78e81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- 10.20.193.78:0/4288103080 shutdown_connections 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- 10.20.193.78:0/4288103080 >> 10.20.193.78:0/4288103080 conn(0x7f78e80545d0 msgr2=0x7f78e80549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- 10.20.193.78:0/4288103080 shutdown_connections 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- 10.20.193.78:0/4288103080 wait complete. 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: monmap: 2026-02-13T18:05:35.471 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 Processor -- start 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- start start 2026-02-13T18:05:35.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: init 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient(hunting): picked mon.noname-a con 0x7f78e805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient(hunting): picked mon.noname-b con 0x7f78e813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient(hunting): picked mon.noname-c con 0x7f78e81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8111320 con 0x7f78e805e4b0 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e812e240 con 0x7f78e813f8b0 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8057e50 con 0x7f78e81853c0 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78eda21640 10 monclient(hunting): authenticate will time out at 566.514243s 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e77fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f78e81853c0 0x7f78e8181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58096/0 (socket says 10.20.193.78:58096) 2026-02-13T18:05:35.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.456+0000 7f78e77fe640 1 -- 10.20.193.78:0/154430610 learned_addr learned my addr 10.20.193.78:0/154430610 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78e77fe640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.78:6790/0 conn(0x7f78e81853c0 legacy=0x7f78e8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78e6ffd640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.78:6789/0 conn(0x7f78e805e4b0 legacy=0x7f78e813eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692727400 0 0) 0x7f78e8057e50 con 0x7f78e81853c0 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): my global_id is 4307 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b8003620 con 0x7f78e81853c0 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78e67fc640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.187:6789/0 conn(0x7f78e813f8b0 legacy=0x7f78e8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3178405327 0 0) 0x7f78b8003620 con 0x7f78e81853c0 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78e8057e50 con 0x7f78e81853c0 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f78d8005df0 con 0x7f78e81853c0 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): dump: 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.478 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496465843 0 0) 0x7f78e8111320 con 0x7f78e805e4b0 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): my global_id is 4326 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b8003620 con 0x7f78e805e4b0 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604801330 0 0) 0x7f78d0002d50 con 0x7f78e813f8b0 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient(hunting): my global_id is 4306 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78e8111320 con 0x7f78e813f8b0 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4185987088 0 0) 0x7f78e8057e50 con 0x7f78e81853c0 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.187:6789/0 conn(0x7f78e813f8b0 legacy=0x7f78e8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.78:6789/0 conn(0x7f78e805e4b0 legacy=0x7f78e813eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 monclient: found mon.c 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e810fe30 con 0x7f78e81853c0 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 5 monclient: authenticate success, global_id 4307 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 monclient: _renew_subs 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78e8112190 con 0x7f78e81853c0 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 monclient: _renew_subs 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f78e8110990 con 0x7f78e81853c0 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78d80060f0 con 0x7f78e81853c0 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f78d8006640 con 0x7f78e81853c0 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78e57fa640 4 set_mon_vals no callback set 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: dump: 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.482 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e80008e0 con 0x7f78e81853c0 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f78d8012cd0 con 0x7f78e81853c0 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f78d804d940 con 0x7f78e81853c0 2026-02-13T18:05:35.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78e6ffd640 10 monclient: get_auth_request con 0x7f78b803d760 auth_method 0 2026-02-13T18:05:35.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f78d8018ac0 con 0x7f78e81853c0 2026-02-13T18:05:35.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.460+0000 7f78bffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:35.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient: get_monmap_and_config 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient: monmap: 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:35.498329+0000 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:35.498329+0000 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.502 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.503 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:35.503 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:35.503 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 1 Processor -- start 2026-02-13T18:05:35.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 1 -- start start 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient: init 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient(hunting): picked mon.noname-b con 0x7fcb2813f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient(hunting): picked mon.noname-a con 0x7fcb2805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient(hunting): picked mon.noname-c con 0x7fcb281853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb28095530 con 0x7fcb2805e4b0 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb28140390 con 0x7fcb281853c0 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2805d230 con 0x7fcb2813f8b0 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb30410640 10 monclient(hunting): authenticate will time out at 566.553981s 2026-02-13T18:05:35.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb2e185640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fcb2813f8b0 0x7fcb2813fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58100/0 (socket says 10.20.193.78:58100) 2026-02-13T18:05:35.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fcb2e185640 1 -- 10.20.193.78:0/2847173867 learned_addr learned my addr 10.20.193.78:0/2847173867 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient: get_monmap_and_config 2026-02-13T18:05:35.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient: monmap: 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:35.500128+0000 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:35.500128+0000 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 1 Processor -- start 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 1 -- start start 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient: init 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient: get_monmap_and_config 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient: monmap: 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.508 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:35.500621+0000 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:35.500621+0000 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:35.509 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:35.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient(hunting): picked mon.noname-b con 0x7feefc13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient(hunting): picked mon.noname-a con 0x7feefc05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient(hunting): picked mon.noname-c con 0x7feefc1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc095530 con 0x7feefc05e4b0 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc140390 con 0x7feefc1853c0 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc05d230 con 0x7feefc13f8b0 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef0358e640 10 monclient(hunting): authenticate will time out at 566.555277s 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef01303640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7feefc13f8b0 0x7feefc13fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58110/0 (socket says 10.20.193.78:58110) 2026-02-13T18:05:35.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7fef01303640 1 -- 10.20.193.78:0/4244648164 learned_addr learned my addr 10.20.193.78:0/4244648164 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 1 Processor -- start 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 1 -- start start 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient: init 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient(hunting): picked mon.noname-a con 0x7f481013f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient(hunting): picked mon.noname-c con 0x7f481005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient(hunting): picked mon.noname-b con 0x7f48101853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4810095530 con 0x7f481013f8b0 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4810140390 con 0x7f481005e4b0 2026-02-13T18:05:35.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481005d230 con 0x7f48101853c0 2026-02-13T18:05:35.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f4816482640 10 monclient(hunting): authenticate will time out at 566.555893s 2026-02-13T18:05:35.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f480ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f481013f8b0 0x7f481013fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51740/0 (socket says 10.20.193.78:51740) 2026-02-13T18:05:35.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.496+0000 7f480ffff640 1 -- 10.20.193.78:0/2109085920 learned_addr learned my addr 10.20.193.78:0/2109085920 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2e185640 1 -- 10.20.193.78:0/2847173867 >> v1:10.20.193.78:6790/0 conn(0x7fcb2813f8b0 legacy=0x7fcb2813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d984640 1 -- 10.20.193.78:0/2847173867 >> v1:10.20.193.78:6789/0 conn(0x7fcb2805e4b0 legacy=0x7fcb28183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854158366 0 0) 0x7fcb2805d230 con 0x7fcb2813f8b0 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): my global_id is 4310 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2e986640 1 -- 10.20.193.78:0/2847173867 >> v1:10.20.193.187:6789/0 conn(0x7fcb281853c0 legacy=0x7fcb281a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb10003620 con 0x7fcb2813f8b0 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379474481 0 0) 0x7fcb1c002cb0 con 0x7fcb2805e4b0 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient(hunting): my global_id is 4329 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb2805d230 con 0x7fcb2805e4b0 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 268356709 0 0) 0x7fcb10003620 con 0x7fcb2813f8b0 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 >> v1:10.20.193.187:6789/0 conn(0x7fcb281853c0 legacy=0x7fcb281a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 >> v1:10.20.193.78:6789/0 conn(0x7fcb2805e4b0 legacy=0x7fcb28183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 monclient: found mon.noname-b 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2805d510 con 0x7fcb2813f8b0 2026-02-13T18:05:35.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 5 monclient: authenticate success, global_id 4310 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb18003190 con 0x7fcb2813f8b0 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: dump: 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.519 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb18003420 con 0x7fcb2813f8b0 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 1 -- 10.20.193.78:0/2847173867 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb18004b50 con 0x7fcb2813f8b0 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d183640 10 monclient: dump: 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 4 set_mon_vals no callback set 2026-02-13T18:05:35.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: shutdown 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- 10.20.193.78:0/2847173867 >> v1:10.20.193.78:6790/0 conn(0x7fcb2813f8b0 legacy=0x7fcb2813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- 10.20.193.78:0/2847173867 shutdown_connections 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- 10.20.193.78:0/2847173867 >> 10.20.193.78:0/2847173867 conn(0x7fcb280545d0 msgr2=0x7fcb280549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- 10.20.193.78:0/2847173867 shutdown_connections 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- 10.20.193.78:0/2847173867 wait complete. 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: monmap: 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:35.522 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:35.523 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.523 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:35.523 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.523 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:35.523 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:35.523 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef01303640 1 -- 10.20.193.78:0/4244648164 >> v1:10.20.193.78:6790/0 conn(0x7feefc13f8b0 legacy=0x7feefc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef00b02640 1 -- 10.20.193.78:0/4244648164 >> v1:10.20.193.78:6789/0 conn(0x7feefc05e4b0 legacy=0x7feefc183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933103908 0 0) 0x7feefc05d230 con 0x7feefc13f8b0 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient(hunting): my global_id is 4313 2026-02-13T18:05:35.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 Processor -- start 2026-02-13T18:05:35.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee4003620 con 0x7feefc13f8b0 2026-02-13T18:05:35.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- start start 2026-02-13T18:05:35.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: init 2026-02-13T18:05:35.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1022352252 0 0) 0x7feee4003620 con 0x7feefc13f8b0 2026-02-13T18:05:35.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 >> v1:10.20.193.187:6789/0 conn(0x7feefc1853c0 legacy=0x7feefc1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef01b04640 1 -- 10.20.193.78:0/4244648164 >> v1:10.20.193.187:6789/0 conn(0x7feefc1853c0 legacy=0x7feefc1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 >> v1:10.20.193.78:6789/0 conn(0x7feefc05e4b0 legacy=0x7feefc183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 monclient: found mon.noname-b 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc05d510 con 0x7feefc13f8b0 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feeec003110 con 0x7feefc13f8b0 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: dump: 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 5 monclient: authenticate success, global_id 4313 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feeec0033e0 con 0x7feefc13f8b0 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 1 -- 10.20.193.78:0/4244648164 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feeec004b50 con 0x7feefc13f8b0 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7feeebfff640 10 monclient: dump: 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:35.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 4 set_mon_vals no callback set 2026-02-13T18:05:35.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:35.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient(hunting): picked mon.noname-b con 0x7fcb2805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient(hunting): picked mon.noname-c con 0x7fcb2813f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient(hunting): picked mon.noname-a con 0x7fcb281853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb28111f60 con 0x7fcb281853c0 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb281110f0 con 0x7fcb2805e4b0 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2810fc00 con 0x7fcb2813f8b0 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb30410640 10 monclient(hunting): authenticate will time out at 566.558062s 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f48149f8640 1 -- 10.20.193.78:0/2109085920 >> v1:10.20.193.78:6790/0 conn(0x7f48101853c0 legacy=0x7f48101a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480ffff640 1 -- 10.20.193.78:0/2109085920 >> v1:10.20.193.78:6789/0 conn(0x7f481013f8b0 legacy=0x7f481013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d984640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fcb2813f8b0 0x7fcb28180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58118/0 (socket says 10.20.193.78:58118) 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fcb2d984640 1 -- 10.20.193.78:0/1770261514 learned_addr learned my addr 10.20.193.78:0/1770261514 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415944557 0 0) 0x7f481005d230 con 0x7f48101853c0 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient(hunting): my global_id is 4316 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f4003620 con 0x7f48101853c0 2026-02-13T18:05:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480f7fe640 1 -- 10.20.193.78:0/2109085920 >> v1:10.20.193.187:6789/0 conn(0x7f481005e4b0 legacy=0x7f4810183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: shutdown 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- 10.20.193.78:0/4244648164 >> v1:10.20.193.78:6790/0 conn(0x7feefc13f8b0 legacy=0x7feefc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- 10.20.193.78:0/4244648164 shutdown_connections 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- 10.20.193.78:0/4244648164 >> 10.20.193.78:0/4244648164 conn(0x7feefc0545d0 msgr2=0x7feefc0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696985222 0 0) 0x7f47f4003620 con 0x7f48101853c0 2026-02-13T18:05:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 >> v1:10.20.193.187:6789/0 conn(0x7f481005e4b0 legacy=0x7f4810183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 >> v1:10.20.193.78:6789/0 conn(0x7f481013f8b0 legacy=0x7f481013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 monclient: found mon.noname-b 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481005d510 con 0x7f48101853c0 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4804004670 con 0x7f48101853c0 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 5 monclient: authenticate success, global_id 4316 2026-02-13T18:05:35.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- 10.20.193.78:0/4244648164 shutdown_connections 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: dump: 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.535 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- 10.20.193.78:0/4244648164 wait complete. 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4804004940 con 0x7f48101853c0 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 1 -- 10.20.193.78:0/2109085920 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4804004dd0 con 0x7f48101853c0 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480effd640 10 monclient: dump: 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:35.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 4 set_mon_vals no callback set 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: monmap: 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:35.538 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: shutdown 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- 10.20.193.78:0/2109085920 >> v1:10.20.193.78:6790/0 conn(0x7f48101853c0 legacy=0x7f48101a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- 10.20.193.78:0/2109085920 shutdown_connections 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- 10.20.193.78:0/2109085920 >> 10.20.193.78:0/2109085920 conn(0x7f48100545d0 msgr2=0x7f48100549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- 10.20.193.78:0/2109085920 shutdown_connections 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- 10.20.193.78:0/2109085920 wait complete. 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 Processor -- start 2026-02-13T18:05:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- start start 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: init 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: monmap: 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:35.540 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient(hunting): picked mon.noname-b con 0x7feefc05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient(hunting): picked mon.noname-c con 0x7feefc13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient(hunting): picked mon.noname-a con 0x7feefc1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc08a5b0 con 0x7feefc1853c0 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc057e50 con 0x7feefc05e4b0 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc1a68e0 con 0x7feefc13f8b0 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef0358e640 10 monclient(hunting): authenticate will time out at 566.559425s 2026-02-13T18:05:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef00b02640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7feefc13f8b0 0x7feefc180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58122/0 (socket says 10.20.193.78:58122) 2026-02-13T18:05:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef00b02640 1 -- 10.20.193.78:0/1066252212 learned_addr learned my addr 10.20.193.78:0/1066252212 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7fef01b04640 1 --1- 10.20.193.78:0/1066252212 >> v1:10.20.193.78:6789/0 conn(0x7feefc1853c0 0x7feefc181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51750/0 (socket says 10.20.193.78:51750) 2026-02-13T18:05:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 Processor -- start 2026-02-13T18:05:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- start start 2026-02-13T18:05:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: init 2026-02-13T18:05:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient(hunting): picked mon.noname-c con 0x7f481005e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient(hunting): picked mon.noname-b con 0x7f481013f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient(hunting): picked mon.noname-a con 0x7f48101853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4810112220 con 0x7f48101853c0 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48101113b0 con 0x7f481013f8b0 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481010fec0 con 0x7f481005e4b0 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f4816482640 10 monclient(hunting): authenticate will time out at 566.559956s 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f481005e4b0 0x7f481013ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58130/0 (socket says 10.20.193.78:58130) 2026-02-13T18:05:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.500+0000 7f480ffff640 1 -- 10.20.193.78:0/3451859697 learned_addr learned my addr 10.20.193.78:0/3451859697 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb2d984640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.78:6790/0 conn(0x7fcb2813f8b0 legacy=0x7fcb28180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb2e986640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.78:6789/0 conn(0x7fcb281853c0 legacy=0x7fcb28181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621733808 0 0) 0x7fcb2810fc00 con 0x7fcb2813f8b0 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): my global_id is 4319 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf8003620 con 0x7fcb2813f8b0 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863754384 0 0) 0x7fcb28111f60 con 0x7fcb281853c0 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): my global_id is 4332 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb2810fc00 con 0x7fcb281853c0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2864400663 0 0) 0x7fcaf8003620 con 0x7fcb2813f8b0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb28111f60 con 0x7fcb2813f8b0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb1c003710 con 0x7fcb2813f8b0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): dump: 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3756801120 0 0) 0x7fcb2810fc00 con 0x7fcb281853c0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcaf8003620 con 0x7fcb281853c0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb24004890 con 0x7fcb281853c0 2026-02-13T18:05:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient(hunting): dump: 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb2e185640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.187:6789/0 conn(0x7fcb2805e4b0 legacy=0x7fcb2813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient: get_monmap_and_config 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient: monmap: 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:35.506258+0000 2026-02-13T18:05:35.546 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:35.506258+0000 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1849495413 0 0) 0x7fcb28111f60 con 0x7fcb2813f8b0 2026-02-13T18:05:35.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.187:6789/0 conn(0x7fcb2805e4b0 legacy=0x7fcb2813ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.78:6789/0 conn(0x7fcb281853c0 legacy=0x7fcb28181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 monclient: found mon.c 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb281116c0 con 0x7fcb2813f8b0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 5 monclient: authenticate success, global_id 4319 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 monclient: _renew_subs 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2810f5b0 con 0x7fcb2813f8b0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 monclient: _renew_subs 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb2813f400 con 0x7fcb2813f8b0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb1c003c90 con 0x7fcb2813f8b0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb1c003ff0 con 0x7fcb2813f8b0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: dump: 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb2c982640 4 set_mon_vals no callback set 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 1 Processor -- start 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 1 -- start start 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient: init 2026-02-13T18:05:35.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb280008e0 con 0x7fcb2813f8b0 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fcb1c0042c0 con 0x7fcb2813f8b0 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6013f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient(hunting): picked mon.noname-b con 0x7f1c6005e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient(hunting): picked mon.noname-a con 0x7f1c601853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c60095530 con 0x7f1c601853c0 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c60140390 con 0x7f1c6013f8b0 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6005d230 con 0x7f1c6005e4b0 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c65ec0640 10 monclient(hunting): authenticate will time out at 566.561430s 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fcb1c04c640 con 0x7fcb2813f8b0 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef00b02640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.78:6790/0 conn(0x7feefc13f8b0 legacy=0x7feefc180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef01b04640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.78:6789/0 conn(0x7feefc1853c0 legacy=0x7feefc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb2e185640 10 monclient: get_auth_request con 0x7fcaf803d670 auth_method 0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196914291 0 0) 0x7feefc08a5b0 con 0x7feefc1853c0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): my global_id is 4335 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feecc003620 con 0x7feefc1853c0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef01303640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.187:6789/0 conn(0x7feefc05e4b0 legacy=0x7feefc1a1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3922543443 0 0) 0x7feecc003620 con 0x7feefc1853c0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feefc08a5b0 con 0x7feefc1853c0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feef8004810 con 0x7feefc1853c0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:35.552 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2751913175 0 0) 0x7feefc08a5b0 con 0x7feefc1853c0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.78:6790/0 conn(0x7feefc13f8b0 legacy=0x7feefc180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.187:6789/0 conn(0x7feefc05e4b0 legacy=0x7feefc1a1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 monclient: found mon.a 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc1a1720 con 0x7feefc1853c0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 5 monclient: authenticate success, global_id 4335 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 monclient: _renew_subs 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feefc12e1b0 con 0x7feefc1853c0 2026-02-13T18:05:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 monclient: _renew_subs 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feefc12c9b0 con 0x7feefc1853c0 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480ffff640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.78:6790/0 conn(0x7f481005e4b0 legacy=0x7f481013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f48149f8640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.78:6789/0 conn(0x7f48101853c0 legacy=0x7f4810181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c5ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f1c601853c0 0x7f1c601a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51774/0 (socket says 10.20.193.78:51774) 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f1c5ffff640 1 -- 10.20.193.78:0/1613801748 learned_addr learned my addr 10.20.193.78:0/1613801748 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feef8004a30 con 0x7feefc1853c0 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feef8005080 con 0x7feefc1853c0 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 10 monclient: dump: 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feeeb7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480f7fe640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.187:6789/0 conn(0x7f481013f8b0 legacy=0x7f4810180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516997586 0 0) 0x7f4810112220 con 0x7f48101853c0 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): my global_id is 4338 2026-02-13T18:05:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e0003620 con 0x7f48101853c0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589146487 0 0) 0x7f48101113b0 con 0x7f481013f8b0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): my global_id is 4324 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4810112220 con 0x7f481013f8b0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 502190047 0 0) 0x7f47e0003620 con 0x7f48101853c0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48101113b0 con 0x7f48101853c0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4804004c20 con 0x7f48101853c0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): dump: 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.556 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc0008e0 con 0x7feefc1853c0 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4289106344 0 0) 0x7f48101113b0 con 0x7f48101853c0 2026-02-13T18:05:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.78:6790/0 conn(0x7f481005e4b0 legacy=0x7f481013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.187:6789/0 conn(0x7f481013f8b0 legacy=0x7f4810180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 monclient: found mon.a 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4810111980 con 0x7f48101853c0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 5 monclient: authenticate success, global_id 4338 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 monclient: _renew_subs 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f481010f870 con 0x7f48101853c0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 monclient: _renew_subs 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4810110bf0 con 0x7f48101853c0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7feef8005350 con 0x7feefc1853c0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4804004940 con 0x7f48101853c0 2026-02-13T18:05:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f48040055a0 con 0x7f48101853c0 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480e7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 10 monclient: dump: 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7feef804d910 con 0x7feefc1853c0 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481008b9a0 con 0x7f48101853c0 2026-02-13T18:05:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4804005800 con 0x7f48101853c0 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fcb28095530 con 0x7fcb2813f8b0 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.504+0000 7fcb0effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7fef01303640 10 monclient: get_auth_request con 0x7feecc03d450 auth_method 0 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f480ffff640 10 monclient: get_auth_request con 0x7f47e003d4f0 auth_method 0 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5ffff640 1 -- 10.20.193.78:0/1613801748 >> v1:10.20.193.78:6789/0 conn(0x7f1c601853c0 legacy=0x7f1c601a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5effd640 1 -- 10.20.193.78:0/1613801748 >> v1:10.20.193.78:6790/0 conn(0x7f1c6005e4b0 legacy=0x7f1c60183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552004948 0 0) 0x7f1c6005d230 con 0x7f1c6005e4b0 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient(hunting): my global_id is 4322 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c44003620 con 0x7f1c6005e4b0 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient: get_monmap_and_config 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient: monmap: 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:35.510195+0000 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:35.510195+0000 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:35.561 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2729250259 0 0) 0x7f1c44003620 con 0x7f1c6005e4b0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 >> v1:10.20.193.187:6789/0 conn(0x7f1c6013f8b0 legacy=0x7f1c6013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 >> v1:10.20.193.78:6789/0 conn(0x7f1c601853c0 legacy=0x7f1c601a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 monclient: found mon.noname-b 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6005d510 con 0x7f1c6005e4b0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c50003160 con 0x7f1c6005e4b0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 5 monclient: authenticate success, global_id 4322 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: dump: 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c50003430 con 0x7f1c6005e4b0 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 1 -- 10.20.193.78:0/1613801748 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c500038c0 con 0x7f1c6005e4b0 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5e7fc640 10 monclient: dump: 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 4 set_mon_vals no callback set 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f480404c7f0 con 0x7f48101853c0 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 1 Processor -- start 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 1 -- start start 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient: init 2026-02-13T18:05:35.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7feefc140390 con 0x7feefc1853c0 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7feee9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7feee9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: shutdown 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- 10.20.193.78:0/1613801748 >> v1:10.20.193.78:6790/0 conn(0x7f1c6005e4b0 legacy=0x7f1c60183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- 10.20.193.78:0/1613801748 shutdown_connections 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- 10.20.193.78:0/1613801748 >> 10.20.193.78:0/1613801748 conn(0x7f1c600545d0 msgr2=0x7f1c600549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- 10.20.193.78:0/1613801748 shutdown_connections 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- 10.20.193.78:0/1613801748 wait complete. 2026-02-13T18:05:35.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient(hunting): picked mon.noname-b con 0x7f814413f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient(hunting): picked mon.noname-a con 0x7f814405e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient(hunting): picked mon.noname-c con 0x7f81441853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8144095530 con 0x7f814405e4b0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8144140390 con 0x7f81441853c0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814405d230 con 0x7f814413f8b0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 10 monclient(hunting): authenticate will time out at 566.565332s 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f81437fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f814405e4b0 0x7f8144183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51788/0 (socket says 10.20.193.78:51788) 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8143fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f814413f8b0 0x7f814413fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58136/0 (socket says 10.20.193.78:58136) 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f81437fe640 1 -- 10.20.193.78:0/4065709161 learned_addr learned my addr 10.20.193.78:0/4065709161 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: monmap: 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:35.565 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 Processor -- start 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- start start 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: init 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient(hunting): picked mon.noname-b con 0x7f1c6005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient(hunting): picked mon.noname-a con 0x7f1c601853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c60111da0 con 0x7f1c601853c0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c60110f30 con 0x7f1c6005e4b0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6010fa40 con 0x7f1c6013f8b0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c65ec0640 10 monclient(hunting): authenticate will time out at 566.566017s 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1c6013f8b0 0x7f1c60180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58148/0 (socket says 10.20.193.78:58148) 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f1c5effd640 1 -- 10.20.193.78:0/3150810699 learned_addr learned my addr 10.20.193.78:0/3150810699 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f81437fe640 1 -- 10.20.193.78:0/4065709161 >> v1:10.20.193.78:6789/0 conn(0x7f814405e4b0 legacy=0x7f8144183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8143fff640 1 -- 10.20.193.78:0/4065709161 >> v1:10.20.193.78:6790/0 conn(0x7f814413f8b0 legacy=0x7f814413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8148ed0640 1 -- 10.20.193.78:0/4065709161 >> v1:10.20.193.187:6789/0 conn(0x7f81441853c0 legacy=0x7f81441a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421339692 0 0) 0x7f814405d230 con 0x7f814413f8b0 2026-02-13T18:05:35.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): my global_id is 4325 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f4804018a60 con 0x7f48101853c0 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f480cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f480cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c003620 con 0x7f814413f8b0 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958187121 0 0) 0x7f81380041c0 con 0x7f81441853c0 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient(hunting): my global_id is 4327 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f814405d230 con 0x7f81441853c0 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2148044705 0 0) 0x7f812c003620 con 0x7f814413f8b0 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 >> v1:10.20.193.187:6789/0 conn(0x7f81441853c0 legacy=0x7f81441a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 >> v1:10.20.193.78:6789/0 conn(0x7f814405e4b0 legacy=0x7f8144183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 monclient: found mon.noname-b 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814405d510 con 0x7f814413f8b0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8130003110 con 0x7f814413f8b0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f8142ffd640 10 monclient: dump: 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 5 monclient: authenticate success, global_id 4325 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.508+0000 7f814a95a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81300033e0 con 0x7f814413f8b0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8142ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8142ffd640 1 -- 10.20.193.78:0/4065709161 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8130004a90 con 0x7f814413f8b0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8142ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8142ffd640 10 monclient: dump: 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.568 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 4 set_mon_vals no callback set 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c5effd640 1 -- 10.20.193.78:0/3150810699 >> v1:10.20.193.78:6790/0 conn(0x7f1c6013f8b0 legacy=0x7f1c60180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: shutdown 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- 10.20.193.78:0/4065709161 >> v1:10.20.193.78:6790/0 conn(0x7f814413f8b0 legacy=0x7f814413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- 10.20.193.78:0/4065709161 shutdown_connections 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- 10.20.193.78:0/4065709161 >> 10.20.193.78:0/4065709161 conn(0x7f81440545d0 msgr2=0x7f81440549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570269286 0 0) 0x7f1c6010fa40 con 0x7f1c6013f8b0 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): my global_id is 4328 2026-02-13T18:05:35.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c30003620 con 0x7f1c6013f8b0 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- 10.20.193.78:0/4065709161 shutdown_connections 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- 10.20.193.78:0/4065709161 wait complete. 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c5f7fe640 1 -- 10.20.193.78:0/3150810699 >> v1:10.20.193.187:6789/0 conn(0x7f1c6005e4b0 legacy=0x7f1c6013e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1898531458 0 0) 0x7f1c30003620 con 0x7f1c6013f8b0 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c6010fa40 con 0x7f1c6013f8b0 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c50003710 con 0x7f1c6013f8b0 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): dump: 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.570 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569238309 0 0) 0x7f1c60110f30 con 0x7f1c6005e4b0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient(hunting): my global_id is 4330 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c30003620 con 0x7f1c6005e4b0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3428024556 0 0) 0x7f1c6010fa40 con 0x7f1c6013f8b0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 >> v1:10.20.193.187:6789/0 conn(0x7f1c6005e4b0 legacy=0x7f1c6013e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 >> v1:10.20.193.78:6789/0 conn(0x7f1c601853c0 legacy=0x7f1c60181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 monclient: found mon.c 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c60111500 con 0x7f1c6013f8b0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 5 monclient: authenticate success, global_id 4328 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 monclient: _renew_subs 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6010f3f0 con 0x7f1c6013f8b0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: build_initial_monmap 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: monmap: 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:35.571 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 monclient: _renew_subs 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c601107d0 con 0x7f1c6013f8b0 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c50003430 con 0x7f1c6013f8b0 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c50003fc0 con 0x7f1c6013f8b0 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c5dffb640 4 set_mon_vals no callback set 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 10 monclient: dump: 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.572 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 Processor -- start 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- start start 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: init 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c20005130 con 0x7f1c6013f8b0 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient(hunting): picked mon.noname-b con 0x7f814405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient(hunting): picked mon.noname-a con 0x7f814413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient(hunting): picked mon.noname-c con 0x7f81441853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:35.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8144112010 con 0x7f814413f8b0 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81441111a0 con 0x7f814405e4b0 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1c500041a0 con 0x7f1c6013f8b0 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814410fcb0 con 0x7f81441853c0 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f814a95a640 10 monclient(hunting): authenticate will time out at 566.569522s 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f81437fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f814413f8b0 0x7f8144180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51808/0 (socket says 10.20.193.78:51808) 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8148ed0640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f81441853c0 0x7f8144181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58160/0 (socket says 10.20.193.78:58160) 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f81437fe640 1 -- 10.20.193.78:0/3277665496 learned_addr learned my addr 10.20.193.78:0/3277665496 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f1c5004c590 con 0x7f1c6013f8b0 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c5f7fe640 10 monclient: get_auth_request con 0x7f1c3003d520 auth_method 0 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8148ed0640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.78:6790/0 conn(0x7f81441853c0 legacy=0x7f8144181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f81437fe640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.78:6789/0 conn(0x7f814413f8b0 legacy=0x7f8144180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8143fff640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.187:6789/0 conn(0x7f814405e4b0 legacy=0x7f814413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382248621 0 0) 0x7f814410fcb0 con 0x7f81441853c0 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): my global_id is 4331 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8114003620 con 0x7f81441853c0 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406475530 0 0) 0x7f8144112010 con 0x7f814413f8b0 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 10 monclient(hunting): my global_id is 4344 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f814410fcb0 con 0x7f814413f8b0 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.512+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f1c50017700 con 0x7f1c6013f8b0 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f1c3bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f1c3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408997175 0 0) 0x7f81441111a0 con 0x7f814405e4b0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): my global_id is 4333 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8144112010 con 0x7f814405e4b0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1085468667 0 0) 0x7f8114003620 con 0x7f81441853c0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81441111a0 con 0x7f81441853c0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8138004190 con 0x7f81441853c0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.576 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2349837766 0 0) 0x7f814410fcb0 con 0x7f814413f8b0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8114003620 con 0x7f814413f8b0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8134003290 con 0x7f814413f8b0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3907553419 0 0) 0x7f8144112010 con 0x7f814405e4b0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f814410fcb0 con 0x7f814405e4b0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f81300048e0 con 0x7f814405e4b0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.577 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 919194923 0 0) 0x7f8114003620 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.78:6790/0 conn(0x7f81441853c0 legacy=0x7f8144181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.187:6789/0 conn(0x7f814405e4b0 legacy=0x7f814413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 monclient: found mon.a 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8144111770 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 5 monclient: authenticate success, global_id 4344 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 monclient: _renew_subs 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f814410f660 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 monclient: _renew_subs 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f814413f460 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8134004b90 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8134004f20 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f81427fc640 4 set_mon_vals no callback set 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: dump: 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f81340051f0 con 0x7f814413f8b0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81440008e0 con 0x7f814413f8b0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f813404c400 con 0x7f814413f8b0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8143fff640 10 monclient: get_auth_request con 0x7f811403d960 auth_method 0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f8144095530 con 0x7f814413f8b0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.516+0000 7f8140ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f78e8110c80 con 0x7f78e81853c0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78bffff640 1 -- 10.20.193.78:0/154430610 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7f78d801dd10 con 0x7f78e81853c0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78bffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78bffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:35.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.187:6812/2668687789 conn(0x7f78b803d760 legacy=0x7f78b805dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 10 monclient: shutdown 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 >> v1:10.20.193.78:6790/0 conn(0x7f78e81853c0 legacy=0x7f78e8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 shutdown_connections 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 >> 10.20.193.78:0/154430610 conn(0x7f78e80545d0 msgr2=0x7f78e81a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 shutdown_connections 2026-02-13T18:05:35.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.556+0000 7f78eda21640 1 -- 10.20.193.78:0/154430610 wait complete. 2026-02-13T18:05:35.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcb28093020 con 0x7fcb2813f8b0 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb0effd640 1 -- 10.20.193.78:0/1770261514 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7fcb1c0177b0 con 0x7fcb2813f8b0 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb0effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:35.602 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.187:6812/2668687789 conn(0x7fcaf803d670 legacy=0x7fcaf805db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 10 monclient: shutdown 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 >> v1:10.20.193.78:6790/0 conn(0x7fcb2813f8b0 legacy=0x7fcb28180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 shutdown_connections 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 >> 10.20.193.78:0/1770261514 conn(0x7fcb280545d0 msgr2=0x7fcb280943c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 shutdown_connections 2026-02-13T18:05:35.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.596+0000 7fcb30410640 1 -- 10.20.193.78:0/1770261514 wait complete. 2026-02-13T18:05:35.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:35.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:35.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4810051150 con 0x7f48101853c0 2026-02-13T18:05:35.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f480cff9640 1 -- 10.20.193.78:0/3451859697 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f48040202a0 con 0x7f48101853c0 2026-02-13T18:05:35.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f480cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:35.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f480cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:35.607 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.187:6812/2668687789 conn(0x7f47e003d4f0 legacy=0x7f47e005d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 10 monclient: shutdown 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 >> v1:10.20.193.78:6789/0 conn(0x7f48101853c0 legacy=0x7f4810181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 shutdown_connections 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 >> 10.20.193.78:0/3451859697 conn(0x7f48100545d0 msgr2=0x7f48100965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 shutdown_connections 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.600+0000 7f4816482640 1 -- 10.20.193.78:0/3451859697 wait complete. 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1c20005420 con 0x7f1c6013f8b0 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c3bfff640 1 -- 10.20.193.78:0/3150810699 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7f1c50016fe0 con 0x7f1c6013f8b0 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c3bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:35.609 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1c3003d520 legacy=0x7f1c3005d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 10 monclient: shutdown 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 >> v1:10.20.193.78:6790/0 conn(0x7f1c6013f8b0 legacy=0x7f1c60180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 shutdown_connections 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 >> 10.20.193.78:0/3150810699 conn(0x7f1c600545d0 msgr2=0x7f1c600965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 shutdown_connections 2026-02-13T18:05:35.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.604+0000 7f1c65ec0640 1 -- 10.20.193.78:0/3150810699 wait complete. 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feefc093020 con 0x7feefc1853c0 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7feee9ffb640 1 -- 10.20.193.78:0/1066252212 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7feef8018a20 con 0x7feefc1853c0 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7feee9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7feee9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:35.613 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:35.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.187:6812/2668687789 conn(0x7feecc03d450 legacy=0x7feecc05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 10 monclient: shutdown 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 >> v1:10.20.193.78:6789/0 conn(0x7feefc1853c0 legacy=0x7feefc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 shutdown_connections 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 >> 10.20.193.78:0/1066252212 conn(0x7feefc0545d0 msgr2=0x7feefc094360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 shutdown_connections 2026-02-13T18:05:35.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7fef0358e640 1 -- 10.20.193.78:0/1066252212 wait complete. 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f814a95a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f814a95a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f814a95a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8144093020 con 0x7f814413f8b0 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f8140ff9640 1 -- 10.20.193.78:0/3277665496 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7f8134017570 con 0x7f814413f8b0 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f8140ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.608+0000 7f8140ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:35.616 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-13T18:05:35.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.187:6812/2668687789 conn(0x7f811403d960 legacy=0x7f811405de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 10 monclient: shutdown 2026-02-13T18:05:35.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:35.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 >> v1:10.20.193.78:6789/0 conn(0x7f814413f8b0 legacy=0x7f8144180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:35.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 shutdown_connections 2026-02-13T18:05:35.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 >> 10.20.193.78:0/3277665496 conn(0x7f81440545d0 msgr2=0x7f8144096630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:35.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 shutdown_connections 2026-02-13T18:05:35.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:35.612+0000 7f814a95a640 1 -- 10.20.193.78:0/3277665496 wait complete. 2026-02-13T18:05:35.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-13T18:05:35.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-13T18:05:35.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-13T18:05:35.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2026-02-13T18:05:36.580 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T18:05:36.615 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T18:05:36.620 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T18:05:36.622 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T18:05:36.626 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T18:05:36.628 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T18:05:36.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.644+0000 7f67324ed640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.644+0000 7f67324ed640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.644+0000 7f67324ed640 10 monclient: monmap: 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.649194+0000 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.649194+0000 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.653 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.654 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.654 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.654 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 Processor -- start 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- start start 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient: init 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient(hunting): picked mon.noname-a con 0x7f672c13f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient(hunting): picked mon.noname-c con 0x7f672c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient(hunting): picked mon.noname-b con 0x7f672c1853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c095530 con 0x7f672c13f8b0 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c140390 con 0x7f672c05e4b0 2026-02-13T18:05:36.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c05d230 con 0x7f672c1853c0 2026-02-13T18:05:36.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient(hunting): authenticate will time out at 567.704742s 2026-02-13T18:05:36.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f6730a63640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f672c1853c0 0x7f672c1a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58172/0 (socket says 10.20.193.78:58172) 2026-02-13T18:05:36.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f6730a63640 1 -- 10.20.193.78:0/1152883492 learned_addr learned my addr 10.20.193.78:0/1152883492 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f6730a63640 1 -- 10.20.193.78:0/1152883492 >> v1:10.20.193.78:6790/0 conn(0x7f672c1853c0 legacy=0x7f672c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672bfff640 1 -- 10.20.193.78:0/1152883492 >> v1:10.20.193.78:6789/0 conn(0x7f672c13f8b0 legacy=0x7f672c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672b7fe640 1 -- 10.20.193.78:0/1152883492 >> v1:10.20.193.187:6789/0 conn(0x7f672c05e4b0 legacy=0x7f672c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044347189 0 0) 0x7f672c05d230 con 0x7f672c1853c0 2026-02-13T18:05:36.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): my global_id is 4334 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6710003620 con 0x7f672c1853c0 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832678953 0 0) 0x7f6718002cb0 con 0x7f672c13f8b0 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): my global_id is 4347 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f672c05d230 con 0x7f672c13f8b0 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 93921485 0 0) 0x7f671c002cb0 con 0x7f672c05e4b0 2026-02-13T18:05:36.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient(hunting): my global_id is 4336 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6718002cb0 con 0x7f672c05e4b0 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3416124344 0 0) 0x7f672c05d230 con 0x7f672c13f8b0 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 >> v1:10.20.193.78:6790/0 conn(0x7f672c1853c0 legacy=0x7f672c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 >> v1:10.20.193.187:6789/0 conn(0x7f672c05e4b0 legacy=0x7f672c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 monclient: found mon.noname-a 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c05d510 con 0x7f672c13f8b0 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f67180033b0 con 0x7f672c13f8b0 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: dump: 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.667 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 5 monclient: authenticate success, global_id 4347 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6718003710 con 0x7f672c13f8b0 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 1 -- 10.20.193.78:0/1152883492 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6718003550 con 0x7f672c13f8b0 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f672affd640 10 monclient: dump: 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 4 set_mon_vals no callback set 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 10 monclient: shutdown 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- 10.20.193.78:0/1152883492 >> v1:10.20.193.78:6789/0 conn(0x7f672c13f8b0 legacy=0x7f672c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- 10.20.193.78:0/1152883492 shutdown_connections 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.648+0000 7f67324ed640 1 -- 10.20.193.78:0/1152883492 >> 10.20.193.78:0/1152883492 conn(0x7f672c0545d0 msgr2=0x7f672c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- 10.20.193.78:0/1152883492 shutdown_connections 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- 10.20.193.78:0/1152883492 wait complete. 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: monmap: 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.670 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 Processor -- start 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- start start 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: init 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient(hunting): picked mon.noname-b con 0x7f672c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient(hunting): picked mon.noname-c con 0x7f672c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient(hunting): picked mon.noname-a con 0x7f672c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c111f70 con 0x7f672c1853c0 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c111100 con 0x7f672c05e4b0 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c10fc10 con 0x7f672c13f8b0 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient(hunting): authenticate will time out at 567.708979s 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6730a63640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f672c1853c0 0x7f672c181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51836/0 (socket says 10.20.193.78:51836) 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f672b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f672c13f8b0 0x7f672c180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58174/0 (socket says 10.20.193.78:58174) 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6730a63640 1 -- 10.20.193.78:0/2441168704 learned_addr learned my addr 10.20.193.78:0/2441168704 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6730a63640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.78:6789/0 conn(0x7f672c1853c0 legacy=0x7f672c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f672b7fe640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.78:6790/0 conn(0x7f672c13f8b0 legacy=0x7f672c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f672bfff640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.187:6789/0 conn(0x7f672c05e4b0 legacy=0x7f672c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344612214 0 0) 0x7f672c111f70 con 0x7f672c1853c0 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): my global_id is 4350 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66fc003620 con 0x7f672c1853c0 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034562360 0 0) 0x7f672c10fc10 con 0x7f672c13f8b0 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): my global_id is 4337 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f672c111f70 con 0x7f672c13f8b0 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343897099 0 0) 0x7f672c111100 con 0x7f672c05e4b0 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): my global_id is 4339 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f672c10fc10 con 0x7f672c05e4b0 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1364172860 0 0) 0x7f66fc003620 con 0x7f672c1853c0 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f672c111100 con 0x7f672c1853c0 2026-02-13T18:05:36.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6720004910 con 0x7f672c1853c0 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.675 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 68610523 0 0) 0x7f672c111100 con 0x7f672c1853c0 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.78:6790/0 conn(0x7f672c13f8b0 legacy=0x7f672c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.187:6789/0 conn(0x7f672c05e4b0 legacy=0x7f672c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 monclient: found mon.a 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c1116d0 con 0x7f672c1853c0 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 5 monclient: authenticate success, global_id 4350 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: _renew_subs 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f672c10f5c0 con 0x7f672c1853c0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: _renew_subs 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f672c13f3c0 con 0x7f672c1853c0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67200060a0 con 0x7f672c1853c0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6720006430 con 0x7f672c1853c0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f672a7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.652+0000 7f6728ff9640 10 monclient: dump: 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f6720006680 con 0x7f672c1853c0 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f67324ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f67324ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f67324ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c0008e0 con 0x7f672c1853c0 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f672004d9d0 con 0x7f672c1853c0 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f672bfff640 10 monclient: get_auth_request con 0x7f66fc03d450 auth_method 0 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f6720018b40 con 0x7f672c1853c0 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f6728ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.656+0000 7f6728ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:36.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7ff5d494d640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7ff5d494d640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7ff5d494d640 10 monclient: monmap: 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.681095+0000 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.681095+0000 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.685 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7f85fe620640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7f85fe620640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7f85fe620640 10 monclient: monmap: 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.681282+0000 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.681282+0000 2026-02-13T18:05:36.686 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7ff5d494d640 1 Processor -- start 2026-02-13T18:05:36.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7ff5d494d640 1 -- start start 2026-02-13T18:05:36.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.676+0000 7ff5d494d640 10 monclient: init 2026-02-13T18:05:36.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 Processor -- start 2026-02-13T18:05:36.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- start start 2026-02-13T18:05:36.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: init 2026-02-13T18:05:36.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient(hunting): picked mon.noname-c con 0x7ff5d00561f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient(hunting): picked mon.noname-b con 0x7ff5d0057f90 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient(hunting): picked mon.noname-a con 0x7ff5d0056cd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d0089dc0 con 0x7ff5d0056cd0 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d0089800 con 0x7ff5d00561f0 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d0089ae0 con 0x7ff5d0057f90 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient(hunting): authenticate will time out at 567.736280s 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cdd74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff5d0057f90 0x7ff5d0183e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58190/0 (socket says 10.20.193.78:58190) 2026-02-13T18:05:36.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cdd74640 1 -- 10.20.193.78:0/2501371640 learned_addr learned my addr 10.20.193.78:0/2501371640 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient(hunting): picked mon.noname-c con 0x7f85f813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient(hunting): picked mon.noname-a con 0x7f85f805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient(hunting): picked mon.noname-b con 0x7f85f81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f8095530 con 0x7f85f805e4b0 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f8140390 con 0x7f85f813f8b0 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f805d230 con 0x7f85f81853c0 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient(hunting): authenticate will time out at 567.736519s 2026-02-13T18:05:36.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f85f805e4b0 0x7f85f8183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51862/0 (socket says 10.20.193.78:51862) 2026-02-13T18:05:36.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f77fe640 1 -- 10.20.193.78:0/2181008155 learned_addr learned my addr 10.20.193.78:0/2181008155 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient: monmap: 2026-02-13T18:05:36.693 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.693 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.683703+0000 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.683703+0000 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.694 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cdd74640 1 -- 10.20.193.78:0/2501371640 >> v1:10.20.193.78:6790/0 conn(0x7ff5d0057f90 legacy=0x7ff5d0183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5ced76640 1 -- 10.20.193.78:0/2501371640 >> v1:10.20.193.78:6789/0 conn(0x7ff5d0056cd0 legacy=0x7ff5d01a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5ce575640 1 -- 10.20.193.78:0/2501371640 >> v1:10.20.193.187:6789/0 conn(0x7ff5d00561f0 legacy=0x7ff5d00565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f77fe640 1 -- 10.20.193.78:0/2181008155 >> v1:10.20.193.78:6789/0 conn(0x7f85f805e4b0 legacy=0x7f85f8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675946235 0 0) 0x7ff5d0089dc0 con 0x7ff5d0056cd0 2026-02-13T18:05:36.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): my global_id is 4353 2026-02-13T18:05:36.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5bc003620 con 0x7ff5d0056cd0 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 1 Processor -- start 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199996934 0 0) 0x7ff5d0089ae0 con 0x7ff5d0057f90 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): my global_id is 4340 2026-02-13T18:05:36.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d0089dc0 con 0x7ff5d0057f90 2026-02-13T18:05:36.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838409709 0 0) 0x7f85e8002c60 con 0x7f85f805e4b0 2026-02-13T18:05:36.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient(hunting): my global_id is 4356 2026-02-13T18:05:36.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85dc003620 con 0x7f85f805e4b0 2026-02-13T18:05:36.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 1 -- start start 2026-02-13T18:05:36.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient: init 2026-02-13T18:05:36.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f7fff640 1 -- 10.20.193.78:0/2181008155 >> v1:10.20.193.187:6789/0 conn(0x7f85f813f8b0 legacy=0x7f85f813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454661677 0 0) 0x7ff5d0089800 con 0x7ff5d00561f0 2026-02-13T18:05:36.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient(hunting): my global_id is 4342 2026-02-13T18:05:36.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d0089ae0 con 0x7ff5d00561f0 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2937052537 0 0) 0x7f85dc003620 con 0x7f85f805e4b0 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 >> v1:10.20.193.78:6790/0 conn(0x7f85f81853c0 legacy=0x7f85f81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 >> v1:10.20.193.187:6789/0 conn(0x7f85f813f8b0 legacy=0x7f85f813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 monclient: found mon.noname-a 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f805d510 con 0x7f85f805e4b0 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 5 monclient: authenticate success, global_id 4356 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85e8003360 con 0x7f85f805e4b0 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: dump: 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.702 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.703 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.703 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.703 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.703 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.703 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1097101162 0 0) 0x7ff5d0089dc0 con 0x7ff5d0057f90 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 >> v1:10.20.193.187:6789/0 conn(0x7ff5d00561f0 legacy=0x7ff5d00565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 >> v1:10.20.193.78:6789/0 conn(0x7ff5d0056cd0 legacy=0x7ff5d01a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 monclient: found mon.noname-b 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d005dab0 con 0x7ff5d0057f90 2026-02-13T18:05:36.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff5b8003110 con 0x7ff5d0057f90 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: dump: 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.705 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 5 monclient: authenticate success, global_id 4340 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85e80049a0 con 0x7f85f805e4b0 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 4 set_mon_vals no callback set 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 1 -- 10.20.193.78:0/2181008155 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85e8004df0 con 0x7f85f805e4b0 2026-02-13T18:05:36.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85f6ffd640 10 monclient: dump: 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.707 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5b80033e0 con 0x7ff5d0057f90 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 1 -- 10.20.193.78:0/2501371640 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff5b8004b50 con 0x7ff5d0057f90 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient(hunting): picked mon.noname-a con 0x7f391c08e370 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5cd573640 10 monclient: dump: 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.709 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.710 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.710 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.710 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 4 set_mon_vals no callback set 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient(hunting): picked mon.noname-b con 0x7f391c08af50 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient(hunting): picked mon.noname-c con 0x7f391c08ee50 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c08fc10 con 0x7f391c08e370 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c090050 con 0x7f391c08ee50 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c08bdf0 con 0x7f391c08af50 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f3920967640 10 monclient(hunting): authenticate will time out at 567.739431s 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f391b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f391c08e370 0x7f391c08e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51866/0 (socket says 10.20.193.78:51866) 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f391affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f391c08af50 0x7f391c181d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58194/0 (socket says 10.20.193.78:58194) 2026-02-13T18:05:36.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f391b7fe640 1 -- 10.20.193.78:0/3149272208 learned_addr learned my addr 10.20.193.78:0/3149272208 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: shutdown 2026-02-13T18:05:36.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- 10.20.193.78:0/2181008155 >> v1:10.20.193.78:6789/0 conn(0x7f85f805e4b0 legacy=0x7f85f8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 10 monclient: shutdown 2026-02-13T18:05:36.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- 10.20.193.78:0/2501371640 >> v1:10.20.193.78:6790/0 conn(0x7ff5d0057f90 legacy=0x7ff5d0183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- 10.20.193.78:0/2181008155 shutdown_connections 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- 10.20.193.78:0/2181008155 >> 10.20.193.78:0/2181008155 conn(0x7f85f80545d0 msgr2=0x7f85f80549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- 10.20.193.78:0/2181008155 shutdown_connections 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 1 -- 10.20.193.78:0/2181008155 wait complete. 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- 10.20.193.78:0/2501371640 shutdown_connections 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- 10.20.193.78:0/2501371640 >> 10.20.193.78:0/2501371640 conn(0x7ff5d0054e70 msgr2=0x7ff5d0093b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- 10.20.193.78:0/2501371640 shutdown_connections 2026-02-13T18:05:36.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7ff5d494d640 1 -- 10.20.193.78:0/2501371640 wait complete. 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.680+0000 7f85fe620640 10 monclient: monmap: 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.714 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: monmap: 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.715 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 Processor -- start 2026-02-13T18:05:36.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 -- start start 2026-02-13T18:05:36.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: init 2026-02-13T18:05:36.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 Processor -- start 2026-02-13T18:05:36.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- start start 2026-02-13T18:05:36.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: init 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient(hunting): picked mon.noname-b con 0x7f85f805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient(hunting): picked mon.noname-c con 0x7f85f813f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient(hunting): picked mon.noname-a con 0x7f85f81853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient(hunting): picked mon.noname-a con 0x7ff5d00561f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient(hunting): picked mon.noname-b con 0x7ff5d0056cd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f8111e90 con 0x7f85f81853c0 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f8111020 con 0x7f85f805e4b0 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f810fb30 con 0x7f85f813f8b0 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient(hunting): authenticate will time out at 567.740487s 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient(hunting): picked mon.noname-c con 0x7ff5d0057f90 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d0091030 con 0x7ff5d00561f0 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d005e3d0 con 0x7ff5d0056cd0 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d012ff30 con 0x7ff5d0057f90 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient(hunting): authenticate will time out at 567.740514s 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5ce575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff5d00561f0 0x7ff5d0153180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51884/0 (socket says 10.20.193.78:51884) 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5ce575640 1 -- 10.20.193.78:0/940784095 learned_addr learned my addr 10.20.193.78:0/940784095 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fcb96640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f85f81853c0 0x7f85f8181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51874/0 (socket says 10.20.193.78:51874) 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fcb96640 1 -- 10.20.193.78:0/242057377 learned_addr learned my addr 10.20.193.78:0/242057377 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f77fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f85f813f8b0 0x7f85f8180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58208/0 (socket says 10.20.193.78:58208) 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391b7fe640 1 -- 10.20.193.78:0/3149272208 >> v1:10.20.193.78:6789/0 conn(0x7f391c08e370 legacy=0x7f391c08e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391affd640 1 -- 10.20.193.78:0/3149272208 >> v1:10.20.193.78:6790/0 conn(0x7f391c08af50 legacy=0x7f391c181d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391bfff640 1 -- 10.20.193.78:0/3149272208 >> v1:10.20.193.187:6789/0 conn(0x7f391c08ee50 legacy=0x7f391c1a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929074527 0 0) 0x7f391c08fc10 con 0x7f391c08e370 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): my global_id is 4359 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3900003620 con 0x7f391c08e370 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453268092 0 0) 0x7f391c08bdf0 con 0x7f391c08af50 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient(hunting): my global_id is 4343 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f391c08fc10 con 0x7f391c08af50 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3702875258 0 0) 0x7f3900003620 con 0x7f391c08e370 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 >> v1:10.20.193.78:6790/0 conn(0x7f391c08af50 legacy=0x7f391c181d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 >> v1:10.20.193.187:6789/0 conn(0x7f391c08ee50 legacy=0x7f391c1a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 monclient: found mon.noname-a 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c08c0d0 con 0x7f391c08e370 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3908003110 con 0x7f391c08e370 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: dump: 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.722 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 5 monclient: authenticate success, global_id 4359 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39080033e0 con 0x7f391c08e370 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 1 -- 10.20.193.78:0/3149272208 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3908004b50 con 0x7f391c08e370 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391a7fc640 10 monclient: dump: 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.723 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 4 set_mon_vals no callback set 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: shutdown 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- 10.20.193.78:0/3149272208 >> v1:10.20.193.78:6789/0 conn(0x7f391c08e370 legacy=0x7f391c08e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- 10.20.193.78:0/3149272208 shutdown_connections 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- 10.20.193.78:0/3149272208 >> 10.20.193.78:0/3149272208 conn(0x7f391c0569b0 msgr2=0x7f391c093970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- 10.20.193.78:0/3149272208 shutdown_connections 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- 10.20.193.78:0/3149272208 wait complete. 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5ce575640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.78:6789/0 conn(0x7ff5d00561f0 legacy=0x7ff5d0153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fcb96640 1 -- 10.20.193.78:0/242057377 >> v1:10.20.193.78:6789/0 conn(0x7f85f81853c0 legacy=0x7f85f8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5ced76640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.78:6790/0 conn(0x7ff5d0057f90 legacy=0x7ff5d0195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164564280 0 0) 0x7ff5d0091030 con 0x7ff5d00561f0 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): my global_id is 4362 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff59c003620 con 0x7ff5d00561f0 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159519663 0 0) 0x7f85f8111e90 con 0x7f85f81853c0 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): my global_id is 4365 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f7fff640 1 -- 10.20.193.78:0/242057377 >> v1:10.20.193.187:6789/0 conn(0x7f85f805e4b0 legacy=0x7f85f813e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c8003620 con 0x7f85f81853c0 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5cdd74640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.187:6789/0 conn(0x7ff5d0056cd0 legacy=0x7ff5d0194390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: monmap: 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.726 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3060067446 0 0) 0x7ff59c003620 con 0x7ff5d00561f0 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5d0091030 con 0x7ff5d00561f0 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff5c40033f0 con 0x7ff5d00561f0 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): dump: 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 472653096 0 0) 0x7f85c8003620 con 0x7f85f81853c0 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f85f8111e90 con 0x7f85f81853c0 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85ec005880 con 0x7f85f81853c0 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): dump: 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.728 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 663508687 0 0) 0x7ff5d0091030 con 0x7ff5d00561f0 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.78:6790/0 conn(0x7ff5d0057f90 legacy=0x7ff5d0195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.187:6789/0 conn(0x7ff5d0056cd0 legacy=0x7ff5d0194390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566926430 0 0) 0x7f85f8111020 con 0x7f85f805e4b0 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient(hunting): my global_id is 4351 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 monclient: found mon.a 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d0132290 con 0x7ff5d00561f0 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c8003620 con 0x7f85f805e4b0 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 5 monclient: authenticate success, global_id 4362 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _renew_subs 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d01319f0 con 0x7ff5d00561f0 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 Processor -- start 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _renew_subs 2026-02-13T18:05:36.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3641897467 0 0) 0x7f85f8111e90 con 0x7f85f81853c0 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5d0130a90 con 0x7ff5d00561f0 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 >> v1:10.20.193.78:6790/0 conn(0x7f85f813f8b0 legacy=0x7f85f8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 >> v1:10.20.193.187:6789/0 conn(0x7f85f805e4b0 legacy=0x7f85f813e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 monclient: found mon.a 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- start start 2026-02-13T18:05:36.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: init 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f81115f0 con 0x7f85f81853c0 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5c40039c0 con 0x7ff5d00561f0 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff5c4003d60 con 0x7ff5d00561f0 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 10 monclient: dump: 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.732 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5ccd72640 4 set_mon_vals no callback set 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient(hunting): picked mon.noname-a con 0x7f391c08af50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient(hunting): picked mon.noname-c con 0x7f391c08e370 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient(hunting): picked mon.noname-b con 0x7f391c08ee50 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c082c20 con 0x7f391c08af50 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c08ab60 con 0x7f391c08ee50 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391c0810f0 con 0x7f391c08e370 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f3920967640 10 monclient(hunting): authenticate will time out at 567.743529s 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85ec003ea0 con 0x7f85f81853c0 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85ec004200 con 0x7f85f81853c0 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f67fc640 4 set_mon_vals no callback set 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85f4ff9640 10 monclient: dump: 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f391c08af50 0x7f391c0869f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51890/0 (socket says 10.20.193.78:51890) 2026-02-13T18:05:36.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f391b7fe640 1 -- 10.20.193.78:0/298259133 learned_addr learned my addr 10.20.193.78:0/298259133 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 5 monclient: authenticate success, global_id 4365 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: _renew_subs 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f85f810f4e0 con 0x7f85f81853c0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: _renew_subs 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f85f8110910 con 0x7f85f81853c0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff598005130 con 0x7ff5d00561f0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.684+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7ff5c4004000 con 0x7ff5d00561f0 2026-02-13T18:05:36.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7ff5c404c600 con 0x7ff5d00561f0 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85fe620640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85fe620640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85fe620640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f80008e0 con 0x7f85f81853c0 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7ff5cdd74640 10 monclient: get_auth_request con 0x7ff59c03d450 auth_method 0 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f85ec0044d0 con 0x7f85f81853c0 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f85ec04d9d0 con 0x7f85f81853c0 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f391b7fe640 1 -- 10.20.193.78:0/298259133 >> v1:10.20.193.78:6789/0 conn(0x7f391c08af50 legacy=0x7f391c0869f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f391bfff640 1 -- 10.20.193.78:0/298259133 >> v1:10.20.193.187:6789/0 conn(0x7f391c08ee50 legacy=0x7f391c195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569852 0 0) 0x7f391c08ab60 con 0x7f391c08ee50 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): my global_id is 4357 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7ff5c40176b0 con 0x7ff5d00561f0 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7ff5b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7ff5b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ec003620 con 0x7f391c08ee50 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1375459458 0 0) 0x7f38ec003620 con 0x7f391c08ee50 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f391c08ab60 con 0x7f391c08ee50 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3910004890 con 0x7f391c08ee50 2026-02-13T18:05:36.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): dump: 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 208225591 0 0) 0x7f391c08ab60 con 0x7f391c08ee50 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 >> v1:10.20.193.78:6790/0 conn(0x7f391c08e370 legacy=0x7f391c194630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 >> v1:10.20.193.78:6789/0 conn(0x7f391c08af50 legacy=0x7f391c0869f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 monclient: found mon.b 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c0834c0 con 0x7f391c08ee50 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 5 monclient: authenticate success, global_id 4357 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 monclient: _renew_subs 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f391c081de0 con 0x7f391c08ee50 2026-02-13T18:05:36.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 monclient: _renew_subs 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f391c0872d0 con 0x7f391c08ee50 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3910004ed0 con 0x7f391c08ee50 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f39100052a0 con 0x7f391c08ee50 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 10 monclient: dump: 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3919ffb640 4 set_mon_vals no callback set 2026-02-13T18:05:36.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f85f7fff640 10 monclient: get_auth_request con 0x7f85c803d520 auth_method 0 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c059220 con 0x7f391c08ee50 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3910005480 con 0x7f391c08ee50 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f391004d920 con 0x7f391c08ee50 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.688+0000 7f391b7fe640 10 monclient: get_auth_request con 0x7f38ec03d3e0 auth_method 0 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.692+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f85ec018b40 con 0x7f85f81853c0 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.692+0000 7f85f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.692+0000 7f85f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.692+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f3910018a40 con 0x7f391c08ee50 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.692+0000 7f38f7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.692+0000 7f38f7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: monmap: 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.713838+0000 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.713838+0000 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 1 Processor -- start 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 1 -- start start 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: init 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient(hunting): picked mon.noname-a con 0x7fa8c813f7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient(hunting): picked mon.noname-c con 0x7fa8c8095410 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient(hunting): picked mon.noname-b con 0x7fa8c81851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8140290 con 0x7fa8c813f7b0 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8094750 con 0x7fa8c8095410 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8093c80 con 0x7fa8c81851c0 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient(hunting): authenticate will time out at 567.769195s 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cd338640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa8c81851c0 0x7fa8c81a55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58246/0 (socket says 10.20.193.78:58246) 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cd338640 1 -- 10.20.193.78:0/325114319 learned_addr learned my addr 10.20.193.78:0/325114319 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient: monmap: 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.715478+0000 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.715478+0000 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.742 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 1 Processor -- start 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 1 -- start start 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient: init 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient(hunting): picked mon.noname-a con 0x7fb06413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient(hunting): picked mon.noname-c con 0x7fb06405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient(hunting): picked mon.noname-b con 0x7fb0641853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb064095530 con 0x7fb06413f8b0 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb064140390 con 0x7fb06405e4b0 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06405d230 con 0x7fb0641853c0 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb06abe3640 10 monclient(hunting): authenticate will time out at 567.770743s 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb05bfff640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fb06405e4b0 0x7fb064183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:59884/0 (socket says 10.20.193.78:59884) 2026-02-13T18:05:36.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fb05bfff640 1 -- 10.20.193.78:0/377964213 learned_addr learned my addr 10.20.193.78:0/377964213 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cd338640 1 -- 10.20.193.78:0/325114319 >> v1:10.20.193.78:6790/0 conn(0x7fa8c81851c0 legacy=0x7fa8c81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8ccb37640 1 -- 10.20.193.78:0/325114319 >> v1:10.20.193.78:6789/0 conn(0x7fa8c813f7b0 legacy=0x7fa8c813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309098293 0 0) 0x7fa8c8093c80 con 0x7fa8c81851c0 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient(hunting): my global_id is 4346 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8b4003620 con 0x7fa8c81851c0 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bffff640 1 -- 10.20.193.78:0/325114319 >> v1:10.20.193.187:6789/0 conn(0x7fa8c8095410 legacy=0x7fa8c8183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4252625735 0 0) 0x7fa8b4003620 con 0x7fa8c81851c0 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 >> v1:10.20.193.187:6789/0 conn(0x7fa8c8095410 legacy=0x7fa8c8183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 >> v1:10.20.193.78:6789/0 conn(0x7fa8c813f7b0 legacy=0x7fa8c813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 monclient: found mon.noname-b 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c8094190 con 0x7fa8c81851c0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 5 monclient: authenticate success, global_id 4346 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa8c4004620 con 0x7fa8c81851c0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: dump: 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8c40048f0 con 0x7fa8c81851c0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 1 -- 10.20.193.78:0/325114319 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa8c4006060 con 0x7fa8c81851c0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8bf7fe640 10 monclient: dump: 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.745 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.712+0000 7fa8cdb39640 4 set_mon_vals no callback set 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient: shutdown 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- 10.20.193.78:0/325114319 >> v1:10.20.193.78:6790/0 conn(0x7fa8c81851c0 legacy=0x7fa8c81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- 10.20.193.78:0/325114319 shutdown_connections 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- 10.20.193.78:0/325114319 >> 10.20.193.78:0/325114319 conn(0x7fa8c8054400 msgr2=0x7fa8c8054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- 10.20.193.78:0/325114319 shutdown_connections 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- 10.20.193.78:0/325114319 wait complete. 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient: monmap: 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 Processor -- start 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- start start 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient: init 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient(hunting): picked mon.noname-b con 0x7fa8c8095410 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient(hunting): picked mon.noname-a con 0x7fa8c813f7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient(hunting): picked mon.noname-c con 0x7fa8c81851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05bfff640 1 -- 10.20.193.78:0/377964213 >> v1:10.20.193.187:6789/0 conn(0x7fb06405e4b0 legacy=0x7fb064183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8111d50 con 0x7fa8c813f7b0 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8110ee0 con 0x7fa8c8095410 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c810f9f0 con 0x7fa8c81851c0 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cdb39640 10 monclient(hunting): authenticate will time out at 567.773169s 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cd338640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa8c81851c0 0x7fa8c8181bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58258/0 (socket says 10.20.193.78:58258) 2026-02-13T18:05:36.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cd338640 1 -- 10.20.193.78:0/385987215 learned_addr learned my addr 10.20.193.78:0/385987215 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554120382 0 0) 0x7fb04c002c60 con 0x7fb06405e4b0 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient(hunting): my global_id is 4363 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb050003620 con 0x7fb06405e4b0 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb068958640 1 -- 10.20.193.78:0/377964213 >> v1:10.20.193.78:6789/0 conn(0x7fb06413f8b0 legacy=0x7fb06413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375763897 0 0) 0x7fb050003620 con 0x7fb06405e4b0 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 >> v1:10.20.193.78:6790/0 conn(0x7fb0641853c0 legacy=0x7fb0641a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 >> v1:10.20.193.78:6789/0 conn(0x7fb06413f8b0 legacy=0x7fb06413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 monclient: found mon.noname-c 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06405d510 con 0x7fb06405e4b0 2026-02-13T18:05:36.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c0032e0 con 0x7fb06405e4b0 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 5 monclient: authenticate success, global_id 4363 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: dump: 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb04c0049a0 con 0x7fb06405e4b0 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 1 -- 10.20.193.78:0/377964213 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c004d30 con 0x7fb06405e4b0 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb05b7fe640 10 monclient: dump: 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 4 set_mon_vals no callback set 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: shutdown 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- 10.20.193.78:0/377964213 >> v1:10.20.193.187:6789/0 conn(0x7fb06405e4b0 legacy=0x7fb064183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- 10.20.193.78:0/377964213 shutdown_connections 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- 10.20.193.78:0/377964213 >> 10.20.193.78:0/377964213 conn(0x7fb0640545d0 msgr2=0x7fb0640549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- 10.20.193.78:0/377964213 shutdown_connections 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- 10.20.193.78:0/377964213 wait complete. 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: monmap: 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 Processor -- start 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- start start 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: init 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8cd338640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.78:6790/0 conn(0x7fa8c81851c0 legacy=0x7fa8c8181bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bffff640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.78:6789/0 conn(0x7fa8c813f7b0 legacy=0x7fa8c8180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8ccb37640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.187:6789/0 conn(0x7fa8c8095410 legacy=0x7fa8c813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347981838 0 0) 0x7fa8c810f9f0 con 0x7fa8c81851c0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 4349 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa898003620 con 0x7fa8c81851c0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient(hunting): picked mon.noname-a con 0x7fb06405e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient(hunting): picked mon.noname-b con 0x7fb06413f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient(hunting): picked mon.noname-c con 0x7fb0641853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb064111f20 con 0x7fb06405e4b0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939787964 0 0) 0x7fa8c8111d50 con 0x7fa8c813f7b0 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 4371 2026-02-13T18:05:36.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c810f9f0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0641110b0 con 0x7fb06413f8b0 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06410fbc0 con 0x7fb0641853c0 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb06abe3640 10 monclient(hunting): authenticate will time out at 567.775710s 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621763699 0 0) 0x7fa8c8110ee0 con 0x7fa8c8095410 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 4366 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c8111d50 con 0x7fa8c8095410 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb068958640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb06405e4b0 0x7fb06413ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51914/0 (socket says 10.20.193.78:51914) 2026-02-13T18:05:36.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fb068958640 1 -- 10.20.193.78:0/2403437890 learned_addr learned my addr 10.20.193.78:0/2403437890 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3057880644 0 0) 0x7fa8c810f9f0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c8110ee0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa8b0003380 con 0x7fa8c813f7b0 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.753 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 644068999 0 0) 0x7fa898003620 con 0x7fa8c81851c0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c810f9f0 con 0x7fa8c81851c0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2984694666 0 0) 0x7fa8c8111d50 con 0x7fa8c8095410 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa898003620 con 0x7fa8c8095410 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa8c4005fa0 con 0x7fa8c81851c0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa8b8003340 con 0x7fa8c8095410 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.716+0000 7fa8bd7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2484720994 0 0) 0x7fa8c8110ee0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.78:6790/0 conn(0x7fa8c81851c0 legacy=0x7fa8c8181bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.187:6789/0 conn(0x7fa8c8095410 legacy=0x7fa8c813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 monclient: found mon.a 2026-02-13T18:05:36.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c81114b0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 5 monclient: authenticate success, global_id 4371 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 monclient: _renew_subs 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c810f3a0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 monclient: _renew_subs 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8c81107d0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8b00039c0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa8b0003d50 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8beffd640 4 set_mon_vals no callback set 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 10 monclient: dump: 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c808b420 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa8b0003f30 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fa8b004c4e0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fa8ccb37640 10 monclient: get_auth_request con 0x7fa89803d9e0 auth_method 0 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb068958640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.78:6789/0 conn(0x7fb06405e4b0 legacy=0x7fb06413ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb069159640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.78:6790/0 conn(0x7fb0641853c0 legacy=0x7fb064181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb05bfff640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.187:6789/0 conn(0x7fb06413f8b0 legacy=0x7fb064180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899442234 0 0) 0x7fb06410fbc0 con 0x7fb0641853c0 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): my global_id is 4352 2026-02-13T18:05:36.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb034003620 con 0x7fb0641853c0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883412046 0 0) 0x7fb0641110b0 con 0x7fb06413f8b0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): my global_id is 4369 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb06410fbc0 con 0x7fb06413f8b0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4282594222 0 0) 0x7fb034003620 con 0x7fb0641853c0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0641110b0 con 0x7fb0641853c0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb0600057c0 con 0x7fb0641853c0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): dump: 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3398793386 0 0) 0x7fb06410fbc0 con 0x7fb06413f8b0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb034003620 con 0x7fb06413f8b0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb04c002b30 con 0x7fb06413f8b0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient(hunting): dump: 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1321038272 0 0) 0x7fb0641110b0 con 0x7fb0641853c0 2026-02-13T18:05:36.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.187:6789/0 conn(0x7fb06413f8b0 legacy=0x7fb064180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.78:6789/0 conn(0x7fb06405e4b0 legacy=0x7fb06413ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 monclient: found mon.c 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb064111680 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 5 monclient: authenticate success, global_id 4352 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 monclient: _renew_subs 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb06410f570 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 monclient: _renew_subs 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb06413f370 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb060003ea0 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb060005a90 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 10 monclient: dump: 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb05affd640 4 set_mon_vals no callback set 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb0600042f0 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0640008e0 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fb06004d8e0 con 0x7fb0641853c0 2026-02-13T18:05:36.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.720+0000 7fb068958640 10 monclient: get_auth_request con 0x7fb03403d6a0 auth_method 0 2026-02-13T18:05:36.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.724+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fa8b0017650 con 0x7fa8c813f7b0 2026-02-13T18:05:36.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.724+0000 7fa8bd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.724+0000 7fa8bd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:36.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.724+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fb060018a50 con 0x7fb0641853c0 2026-02-13T18:05:36.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.724+0000 7fb0597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.724+0000 7fb0597fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:36.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.764+0000 7f67324ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:36.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.764+0000 7f67324ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:36.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.764+0000 7f67324ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.764+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f672c093020 con 0x7f672c1853c0 2026-02-13T18:05:36.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f6728ff9640 1 -- 10.20.193.78:0/2441168704 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1444633209) 0x7f6720018420 con 0x7f672c1853c0 2026-02-13T18:05:36.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f6728ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T18:05:36.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f6728ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:36.773 INFO:teuthology.orchestra.run.trial078.stdout:47244640260 2026-02-13T18:05:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.187:6812/2668687789 conn(0x7f66fc03d450 legacy=0x7f66fc05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 10 monclient: shutdown 2026-02-13T18:05:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 >> v1:10.20.193.78:6789/0 conn(0x7f672c1853c0 legacy=0x7f672c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 shutdown_connections 2026-02-13T18:05:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 >> 10.20.193.78:0/2441168704 conn(0x7f672c0545d0 msgr2=0x7f672c096590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 shutdown_connections 2026-02-13T18:05:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.768+0000 7f67324ed640 1 -- 10.20.193.78:0/2441168704 wait complete. 2026-02-13T18:05:36.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.4 2026-02-13T18:05:36.786 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f85f8093020 con 0x7f85f81853c0 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85f4ff9640 1 -- 10.20.193.78:0/242057377 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1444633209) 0x7f85ec018420 con 0x7f85f81853c0 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85f4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T18:05:36.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85f4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:36.791 INFO:teuthology.orchestra.run.trial078.stdout:47244640260 2026-02-13T18:05:36.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:36.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:36.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff598005420 con 0x7ff5d00561f0 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 >> v1:10.20.193.187:6812/2668687789 conn(0x7f85c803d520 legacy=0x7f85c805d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 10 monclient: shutdown 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5b6ffd640 1 -- 10.20.193.78:0/940784095 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 847495621) 0x7ff5c401c9d0 con 0x7ff5d00561f0 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5b6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 >> v1:10.20.193.78:6789/0 conn(0x7f85f81853c0 legacy=0x7f85f8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.792 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 shutdown_connections 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 >> 10.20.193.78:0/242057377 conn(0x7f85f80545d0 msgr2=0x7f85f81a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 shutdown_connections 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f85fe620640 1 -- 10.20.193.78:0/242057377 wait complete. 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f3920967640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f3920967640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f3920967640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:05:36.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f391c082e60 con 0x7f391c08ee50 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f38f7fff640 1 -- 10.20.193.78:0/298259133 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 847495621) 0x7f391001dcf0 con 0x7f391c08ee50 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f38f7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7f38f7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.187:6812/2668687789 conn(0x7ff59c03d450 legacy=0x7ff59c05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 10 monclient: shutdown 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 >> v1:10.20.193.78:6789/0 conn(0x7ff5d00561f0 legacy=0x7ff5d0153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.784+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 shutdown_connections 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 >> 10.20.193.78:0/940784095 conn(0x7ff5d0054e70 msgr2=0x7ff5d008b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 shutdown_connections 2026-02-13T18:05:36.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7ff5d494d640 1 -- 10.20.193.78:0/940784095 wait complete. 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 >> v1:10.20.193.187:6812/2668687789 conn(0x7f38ec03d3e0 legacy=0x7f38ec05d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 10 monclient: shutdown 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 >> v1:10.20.193.187:6789/0 conn(0x7f391c08ee50 legacy=0x7f391c195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 shutdown_connections 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 >> 10.20.193.78:0/298259133 conn(0x7f391c0569b0 msgr2=0x7f391c057340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 shutdown_connections 2026-02-13T18:05:36.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.788+0000 7f3920967640 1 -- 10.20.193.78:0/298259133 wait complete. 2026-02-13T18:05:36.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.5 2026-02-13T18:05:36.802 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:36.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2026-02-13T18:05:36.804 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:36.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2026-02-13T18:05:36.806 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:36.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.812+0000 7fb06abe3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.812+0000 7fb06abe3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.812+0000 7fb06abe3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.812+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb064093020 con 0x7fb0641853c0 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb0597fa640 1 -- 10.20.193.78:0/2403437890 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7fb060018330 con 0x7fb0641853c0 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb0597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb0597fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:36.821 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb03403d6a0 legacy=0x7fb03405db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 10 monclient: shutdown 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 >> v1:10.20.193.78:6790/0 conn(0x7fb0641853c0 legacy=0x7fb064181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 shutdown_connections 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 >> 10.20.193.78:0/2403437890 conn(0x7fb0640545d0 msgr2=0x7fb0640965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 shutdown_connections 2026-02-13T18:05:36.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.816+0000 7fb06abe3640 1 -- 10.20.193.78:0/2403437890 wait complete. 2026-02-13T18:05:36.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.3 2026-02-13T18:05:36.833 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa8c80008e0 con 0x7fa8c813f7b0 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8bd7fa640 1 -- 10.20.193.78:0/385987215 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1444633209) 0x7fa8b0016f30 con 0x7fa8c813f7b0 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8bd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T18:05:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8bd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:36.839 INFO:teuthology.orchestra.run.trial078.stdout:47244640260 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa89803d9e0 legacy=0x7fa89805de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 10 monclient: shutdown 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 >> v1:10.20.193.78:6789/0 conn(0x7fa8c813f7b0 legacy=0x7fa8c8180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 shutdown_connections 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 >> 10.20.193.78:0/385987215 conn(0x7fa8c8054400 msgr2=0x7fa8c81a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 shutdown_connections 2026-02-13T18:05:36.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.832+0000 7fa8cdb39640 1 -- 10.20.193.78:0/385987215 wait complete. 2026-02-13T18:05:36.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.2 2026-02-13T18:05:36.850 DEBUG:teuthology.parallel:result is None 2026-02-13T18:05:36.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-13T18:05:36.851 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:05:36.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient: get_monmap_and_config 2026-02-13T18:05:36.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient: monmap: 2026-02-13T18:05:36.965 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.965 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.965 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:36.960100+0000 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:36.960100+0000 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 1 Processor -- start 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 1 -- start start 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient: init 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient(hunting): picked mon.noname-c con 0x7f28b813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient(hunting): picked mon.noname-a con 0x7f28b805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient(hunting): picked mon.noname-b con 0x7f28b81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b8095530 con 0x7f28b805e4b0 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b8140390 con 0x7f28b813f8b0 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b805d230 con 0x7f28b81853c0 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bfdff640 10 monclient(hunting): authenticate will time out at 568.015409s 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bd373640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f28b805e4b0 0x7f28b8183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51922/0 (socket says 10.20.193.78:51922) 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28be375640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f28b81853c0 0x7f28b81a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58274/0 (socket says 10.20.193.78:58274) 2026-02-13T18:05:36.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.956+0000 7f28bd373640 1 -- 10.20.193.78:0/391571753 learned_addr learned my addr 10.20.193.78:0/391571753 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bd373640 1 -- 10.20.193.78:0/391571753 >> v1:10.20.193.78:6789/0 conn(0x7f28b805e4b0 legacy=0x7f28b8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28be375640 1 -- 10.20.193.78:0/391571753 >> v1:10.20.193.78:6790/0 conn(0x7f28b81853c0 legacy=0x7f28b81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bdb74640 1 -- 10.20.193.78:0/391571753 >> v1:10.20.193.187:6789/0 conn(0x7f28b813f8b0 legacy=0x7f28b813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386997561 0 0) 0x7f28ac002c60 con 0x7f28b805e4b0 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): my global_id is 4374 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a0003620 con 0x7f28b805e4b0 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009603710 0 0) 0x7f28b805d230 con 0x7f28b81853c0 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): my global_id is 4355 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28ac002c60 con 0x7f28b81853c0 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897946351 0 0) 0x7f28a8002cb0 con 0x7f28b813f8b0 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient(hunting): my global_id is 4372 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b805d230 con 0x7f28b813f8b0 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1858975912 0 0) 0x7f28a0003620 con 0x7f28b805e4b0 2026-02-13T18:05:36.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 >> v1:10.20.193.78:6790/0 conn(0x7f28b81853c0 legacy=0x7f28b81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 >> v1:10.20.193.187:6789/0 conn(0x7f28b813f8b0 legacy=0x7f28b813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 monclient: found mon.noname-a 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b805d510 con 0x7f28b805e4b0 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f28ac0032e0 con 0x7f28b805e4b0 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: dump: 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.972 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 5 monclient: authenticate success, global_id 4374 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28ac0049a0 con 0x7f28b805e4b0 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 1 -- 10.20.193.78:0/391571753 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f28ac004d30 con 0x7f28b805e4b0 2026-02-13T18:05:36.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bcb72640 10 monclient: dump: 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 4 set_mon_vals no callback set 2026-02-13T18:05:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: shutdown 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 -- 10.20.193.78:0/391571753 >> v1:10.20.193.78:6789/0 conn(0x7f28b805e4b0 legacy=0x7f28b8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 -- 10.20.193.78:0/391571753 shutdown_connections 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 -- 10.20.193.78:0/391571753 >> 10.20.193.78:0/391571753 conn(0x7f28b80545d0 msgr2=0x7f28b80549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 -- 10.20.193.78:0/391571753 shutdown_connections 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 -- 10.20.193.78:0/391571753 wait complete. 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: build_initial_monmap 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: monmap: 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:36.975 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 Processor -- start 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 1 -- start start 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: init 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient(hunting): picked mon.noname-b con 0x7f28b805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.960+0000 7f28bfdff640 10 monclient(hunting): picked mon.noname-a con 0x7f28b813f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient(hunting): picked mon.noname-c con 0x7f28b81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b812cc40 con 0x7f28b813f8b0 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b8057e50 con 0x7f28b805e4b0 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b81a5bc0 con 0x7f28b81853c0 2026-02-13T18:05:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:36.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient(hunting): authenticate will time out at 568.020025s 2026-02-13T18:05:36.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bd373640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f28b813f8b0 0x7f28b8180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51924/0 (socket says 10.20.193.78:51924) 2026-02-13T18:05:36.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bd373640 1 -- 10.20.193.78:0/3790673244 learned_addr learned my addr 10.20.193.78:0/3790673244 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bd373640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.78:6789/0 conn(0x7f28b813f8b0 legacy=0x7f28b8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28be375640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.78:6790/0 conn(0x7f28b81853c0 legacy=0x7f28b8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485881058 0 0) 0x7f28b805d510 con 0x7f28b813f8b0 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): my global_id is 4377 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bdb74640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.187:6789/0 conn(0x7f28b805e4b0 legacy=0x7f28b81a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2888003620 con 0x7f28b813f8b0 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395229986 0 0) 0x7f28b81a5bc0 con 0x7f28b81853c0 2026-02-13T18:05:36.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): my global_id is 4358 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b805d510 con 0x7f28b81853c0 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919566130 0 0) 0x7f28b8057e50 con 0x7f28b805e4b0 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): my global_id is 4375 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b81a5bc0 con 0x7f28b805e4b0 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1764679670 0 0) 0x7f2888003620 con 0x7f28b813f8b0 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28b8057e50 con 0x7f28b813f8b0 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f28ac002b50 con 0x7f28b813f8b0 2026-02-13T18:05:36.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): dump: 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2513905076 0 0) 0x7f28b805d510 con 0x7f28b81853c0 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2888003620 con 0x7f28b81853c0 2026-02-13T18:05:36.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f28b4005df0 con 0x7f28b81853c0 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient(hunting): dump: 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 808828423 0 0) 0x7f28b8057e50 con 0x7f28b813f8b0 2026-02-13T18:05:36.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.78:6790/0 conn(0x7f28b81853c0 legacy=0x7f28b8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.187:6789/0 conn(0x7f28b805e4b0 legacy=0x7f28b81a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 monclient: found mon.a 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b812d4e0 con 0x7f28b813f8b0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 5 monclient: authenticate success, global_id 4377 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient: _renew_subs 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28b81a6720 con 0x7f28b813f8b0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient: _renew_subs 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f28b8191fe0 con 0x7f28b813f8b0 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28ac0049a0 con 0x7f28b813f8b0 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f28ac005250 con 0x7f28b813f8b0 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 10 monclient: dump: 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:36.985 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a7fff640 4 set_mon_vals no callback set 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b812d300 con 0x7f28b813f8b0 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f28ac0118e0 con 0x7f28b813f8b0 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.964+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f28ac04c550 con 0x7f28b813f8b0 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.968+0000 7f28bdb74640 10 monclient: get_auth_request con 0x7f288803d5c0 auth_method 0 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.968+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f28b812d300 con 0x7f28b813f8b0 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.968+0000 7f28a67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:36.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:36.968+0000 7f28a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28b808aa80 con 0x7f288803d5c0 2026-02-13T18:05:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28a67fc640 1 -- 10.20.193.78:0/3790673244 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34185 (unknown 2965378022 0 3381527813) 0x7f28b808aa80 con 0x7f288803d5c0 2026-02-13T18:05:37.059 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:37.060 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:05:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.187:6812/2668687789 conn(0x7f288803d5c0 legacy=0x7f288805da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 10 monclient: shutdown 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 >> v1:10.20.193.78:6789/0 conn(0x7f28b813f8b0 legacy=0x7f28b8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 shutdown_connections 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 >> 10.20.193.78:0/3790673244 conn(0x7f28b80545d0 msgr2=0x7f28b8096690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 shutdown_connections 2026-02-13T18:05:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.052+0000 7f28bfdff640 1 -- 10.20.193.78:0/3790673244 wait complete. 2026-02-13T18:05:37.071 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-13T18:05:35.728831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162784,"kb_used_data":1024,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566068256,"statfs":{"total":579820584960,"available":579653894144,"internally_reserved":0,"allocated":1048576,"data_stored":1350982,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":50697,"internal_metadata":165493239},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240332"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230342+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:05:33.230342+0000","last_peered":"2026-02-13T18:05:33.230342+0000","last_clean":"2026-02-13T18:05:33.230342+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:05:33.230342+0000","last_undegraded":"2026-02-13T18:05:33.230342+0000","last_fullsized":"2026-02-13T18:05:33.230342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228687+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:05:33.228687+0000","last_peered":"2026-02-13T18:05:33.228687+0000","last_clean":"2026-02-13T18:05:33.228687+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:05:33.228687+0000","last_undegraded":"2026-02-13T18:05:33.228687+0000","last_fullsized":"2026-02-13T18:05:33.228687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228716+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:05:33.228716+0000","last_peered":"2026-02-13T18:05:33.228716+0000","last_clean":"2026-02-13T18:05:33.228716+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:05:33.228716+0000","last_undegraded":"2026-02-13T18:05:33.228716+0000","last_fullsized":"2026-02-13T18:05:33.228716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232853+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:05:33.232853+0000","last_peered":"2026-02-13T18:05:33.232853+0000","last_clean":"2026-02-13T18:05:33.232853+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:05:33.232853+0000","last_undegraded":"2026-02-13T18:05:33.232853+0000","last_fullsized":"2026-02-13T18:05:33.232853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228475+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:05:33.228475+0000","last_peered":"2026-02-13T18:05:33.228475+0000","last_clean":"2026-02-13T18:05:33.228475+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:05:33.228475+0000","last_undegraded":"2026-02-13T18:05:33.228475+0000","last_fullsized":"2026-02-13T18:05:33.228475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230714+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:05:33.230714+0000","last_peered":"2026-02-13T18:05:33.230714+0000","last_clean":"2026-02-13T18:05:33.230714+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:05:33.230714+0000","last_undegraded":"2026-02-13T18:05:33.230714+0000","last_fullsized":"2026-02-13T18:05:33.230714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232365+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:05:33.232365+0000","last_peered":"2026-02-13T18:05:33.232365+0000","last_clean":"2026-02-13T18:05:33.232365+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:05:33.232365+0000","last_undegraded":"2026-02-13T18:05:33.232365+0000","last_fullsized":"2026-02-13T18:05:33.232365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:05:37.072 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient: get_monmap_and_config 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient: monmap: 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:37.128575+0000 2026-02-13T18:05:37.132 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:37.128575+0000 2026-02-13T18:05:37.133 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.133 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.133 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.133 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:37.133 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:37.133 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 1 Processor -- start 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 1 -- start start 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient: init 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient(hunting): picked mon.noname-c con 0x7fdbb008e920 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient(hunting): picked mon.noname-b con 0x7fdbb008d7b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 10 monclient(hunting): picked mon.noname-a con 0x7fdbb0184cb0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb005d030 con 0x7fdbb0184cb0 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.124+0000 7fdbb62da640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb005d730 con 0x7fdbb008e920 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb005e0d0 con 0x7fdbb008d7b0 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 10 monclient(hunting): authenticate will time out at 568.184019s 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaf7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fdbb008d7b0 0x7fdbb008f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58298/0 (socket says 10.20.193.78:58298) 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb4850640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fdbb0184cb0 0x7fdbb01a5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51932/0 (socket says 10.20.193.78:51932) 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaf7fe640 1 -- 10.20.193.78:0/1134850067 learned_addr learned my addr 10.20.193.78:0/1134850067 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaf7fe640 1 -- 10.20.193.78:0/1134850067 >> v1:10.20.193.78:6790/0 conn(0x7fdbb008d7b0 legacy=0x7fdbb008f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb4850640 1 -- 10.20.193.78:0/1134850067 >> v1:10.20.193.78:6789/0 conn(0x7fdbb0184cb0 legacy=0x7fdbb01a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaffff640 1 -- 10.20.193.78:0/1134850067 >> v1:10.20.193.187:6789/0 conn(0x7fdbb008e920 legacy=0x7fdbb008ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526508402 0 0) 0x7fdbb005d030 con 0x7fdbb0184cb0 2026-02-13T18:05:37.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): my global_id is 4380 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb94003620 con 0x7fdbb0184cb0 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308152319 0 0) 0x7fdbb005e0d0 con 0x7fdbb008d7b0 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient(hunting): my global_id is 4361 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb005d030 con 0x7fdbb008d7b0 2026-02-13T18:05:37.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447668806 0 0) 0x7fdb94003620 con 0x7fdbb0184cb0 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 >> v1:10.20.193.78:6790/0 conn(0x7fdbb008d7b0 legacy=0x7fdbb008f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 >> v1:10.20.193.187:6789/0 conn(0x7fdbb008e920 legacy=0x7fdbb008ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 monclient: found mon.noname-a 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb008cdd0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdba4004620 con 0x7fdbb0184cb0 2026-02-13T18:05:37.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: dump: 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.145 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 5 monclient: authenticate success, global_id 4380 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdba40048f0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 1 -- 10.20.193.78:0/1134850067 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdba4005fa0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbaeffd640 10 monclient: dump: 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.146 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 4 set_mon_vals no callback set 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 10 monclient: shutdown 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 1 -- 10.20.193.78:0/1134850067 >> v1:10.20.193.78:6789/0 conn(0x7fdbb0184cb0 legacy=0x7fdbb01a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 1 -- 10.20.193.78:0/1134850067 shutdown_connections 2026-02-13T18:05:37.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 1 -- 10.20.193.78:0/1134850067 >> 10.20.193.78:0/1134850067 conn(0x7fdbb008ff50 msgr2=0x7fdbb0090350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 1 -- 10.20.193.78:0/1134850067 shutdown_connections 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 1 -- 10.20.193.78:0/1134850067 wait complete. 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.128+0000 7fdbb62da640 10 monclient: monmap: 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 Processor -- start 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 -- start start 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: init 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient(hunting): picked mon.noname-b con 0x7fdbb008d7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient(hunting): picked mon.noname-a con 0x7fdbb008e920 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient(hunting): picked mon.noname-c con 0x7fdbb0184cb0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb0189000 con 0x7fdbb008e920 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb0184ac0 con 0x7fdbb008d7b0 2026-02-13T18:05:37.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb01892e0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient(hunting): authenticate will time out at 568.188622s 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbaf7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fdbb008e920 0x7fdbb0183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51944/0 (socket says 10.20.193.78:51944) 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbaf7fe640 1 -- 10.20.193.78:0/1638497218 learned_addr learned my addr 10.20.193.78:0/1638497218 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbaf7fe640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.78:6789/0 conn(0x7fdbb008e920 legacy=0x7fdbb0183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb4850640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.78:6790/0 conn(0x7fdbb0184cb0 legacy=0x7fdbb01843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbaffff640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.187:6789/0 conn(0x7fdbb008d7b0 legacy=0x7fdbb0142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230478911 0 0) 0x7fdbb01892e0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): my global_id is 4364 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb80003620 con 0x7fdbb0184cb0 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051716582 0 0) 0x7fdbb0189000 con 0x7fdbb008e920 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): my global_id is 4383 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb01892e0 con 0x7fdbb008e920 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418784483 0 0) 0x7fdbb0184ac0 con 0x7fdbb008d7b0 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): my global_id is 4381 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb0189000 con 0x7fdbb008d7b0 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2890969236 0 0) 0x7fdb80003620 con 0x7fdbb0184cb0 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbb0184ac0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdba4005df0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): dump: 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.152 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2724337433 0 0) 0x7fdbb01892e0 con 0x7fdbb008e920 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb80003620 con 0x7fdbb008e920 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdba00048e0 con 0x7fdbb008e920 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient(hunting): dump: 2026-02-13T18:05:37.153 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 386417829 0 0) 0x7fdbb0184ac0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.187:6789/0 conn(0x7fdbb008d7b0 legacy=0x7fdbb0142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.78:6789/0 conn(0x7fdbb008e920 legacy=0x7fdbb0183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 monclient: found mon.c 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb01a1010 con 0x7fdbb0184cb0 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 5 monclient: authenticate success, global_id 4364 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: _renew_subs 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb008b840 con 0x7fdbb0184cb0 2026-02-13T18:05:37.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: _renew_subs 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbb0188d20 con 0x7fdbb0184cb0 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdba40048f0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdba4006770 con 0x7fdbb0184cb0 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbacff9640 10 monclient: dump: 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.156 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbae7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.132+0000 7fdbb62da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fdba4012e00 con 0x7fdbb0184cb0 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbb62da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbb62da640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb00008e0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7fdba404d870 con 0x7fdbb0184cb0 2026-02-13T18:05:37.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbaffff640 10 monclient: get_auth_request con 0x7fdb8003d7b0 auth_method 0 2026-02-13T18:05:37.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fdba40189e0 con 0x7fdbb0184cb0 2026-02-13T18:05:37.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbacff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.136+0000 7fdbacff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:37.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbb00626c0 con 0x7fdb8003d7b0 2026-02-13T18:05:37.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbacff9640 1 -- 10.20.193.78:0/1638497218 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34185 (unknown 2965378022 0 3381527813) 0x7fdbb00626c0 con 0x7fdb8003d7b0 2026-02-13T18:05:37.227 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:37.228 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:05:37.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.187:6812/2668687789 conn(0x7fdb8003d7b0 legacy=0x7fdb8005dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 10 monclient: shutdown 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 >> v1:10.20.193.78:6790/0 conn(0x7fdbb0184cb0 legacy=0x7fdbb01843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 shutdown_connections 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 >> 10.20.193.78:0/1638497218 conn(0x7fdbb008ff50 msgr2=0x7fdbb0092840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 shutdown_connections 2026-02-13T18:05:37.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.220+0000 7fdbb62da640 1 -- 10.20.193.78:0/1638497218 wait complete. 2026-02-13T18:05:37.237 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-13T18:05:35.728831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162784,"kb_used_data":1024,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566068256,"statfs":{"total":579820584960,"available":579653894144,"internally_reserved":0,"allocated":1048576,"data_stored":1350982,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":50697,"internal_metadata":165493239},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240332"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230342+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:05:33.230342+0000","last_peered":"2026-02-13T18:05:33.230342+0000","last_clean":"2026-02-13T18:05:33.230342+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:05:33.230342+0000","last_undegraded":"2026-02-13T18:05:33.230342+0000","last_fullsized":"2026-02-13T18:05:33.230342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228687+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:05:33.228687+0000","last_peered":"2026-02-13T18:05:33.228687+0000","last_clean":"2026-02-13T18:05:33.228687+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:05:33.228687+0000","last_undegraded":"2026-02-13T18:05:33.228687+0000","last_fullsized":"2026-02-13T18:05:33.228687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228716+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:05:33.228716+0000","last_peered":"2026-02-13T18:05:33.228716+0000","last_clean":"2026-02-13T18:05:33.228716+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:05:33.228716+0000","last_undegraded":"2026-02-13T18:05:33.228716+0000","last_fullsized":"2026-02-13T18:05:33.228716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232853+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:05:33.232853+0000","last_peered":"2026-02-13T18:05:33.232853+0000","last_clean":"2026-02-13T18:05:33.232853+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:05:33.232853+0000","last_undegraded":"2026-02-13T18:05:33.232853+0000","last_fullsized":"2026-02-13T18:05:33.232853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228475+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:05:33.228475+0000","last_peered":"2026-02-13T18:05:33.228475+0000","last_clean":"2026-02-13T18:05:33.228475+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:05:33.228475+0000","last_undegraded":"2026-02-13T18:05:33.228475+0000","last_fullsized":"2026-02-13T18:05:33.228475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230714+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:05:33.230714+0000","last_peered":"2026-02-13T18:05:33.230714+0000","last_clean":"2026-02-13T18:05:33.230714+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:05:33.230714+0000","last_undegraded":"2026-02-13T18:05:33.230714+0000","last_fullsized":"2026-02-13T18:05:33.230714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232365+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:05:33.232365+0000","last_peered":"2026-02-13T18:05:33.232365+0000","last_clean":"2026-02-13T18:05:33.232365+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:05:33.232365+0000","last_undegraded":"2026-02-13T18:05:33.232365+0000","last_fullsized":"2026-02-13T18:05:33.232365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:05:37.239 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-13T18:05:37.239 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T18:05:37.239 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-13T18:05:37.239 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-13T18:05:37.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient: get_monmap_and_config 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient: monmap: 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:37.299321+0000 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:37.299321+0000 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.303 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.304 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.304 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:37.304 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:37.304 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 1 Processor -- start 2026-02-13T18:05:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 1 -- start start 2026-02-13T18:05:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient: init 2026-02-13T18:05:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient(hunting): picked mon.noname-b con 0x7f760008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient(hunting): picked mon.noname-c con 0x7f760008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient(hunting): picked mon.noname-a con 0x7f760008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7600089e80 con 0x7f760008cdd0 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7600088c20 con 0x7f760008dc80 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7600089ba0 con 0x7f760008c2f0 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f760797c640 10 monclient(hunting): authenticate will time out at 568.354463s 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f76056f1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f760008c2f0 0x7f760008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58312/0 (socket says 10.20.193.78:58312) 2026-02-13T18:05:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.296+0000 7f76056f1640 1 -- 10.20.193.78:0/1987935618 learned_addr learned my addr 10.20.193.78:0/1987935618 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f7605ef2640 1 -- 10.20.193.78:0/1987935618 >> v1:10.20.193.78:6789/0 conn(0x7f760008cdd0 legacy=0x7f76001a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f76056f1640 1 -- 10.20.193.78:0/1987935618 >> v1:10.20.193.78:6790/0 conn(0x7f760008c2f0 legacy=0x7f760008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f7604ef0640 1 -- 10.20.193.78:0/1987935618 >> v1:10.20.193.187:6789/0 conn(0x7f760008dc80 legacy=0x7f7600181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280277411 0 0) 0x7f7600089e80 con 0x7f760008cdd0 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): my global_id is 4386 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75e8003620 con 0x7f760008cdd0 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192927527 0 0) 0x7f7600089ba0 con 0x7f760008c2f0 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): my global_id is 4367 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7600089e80 con 0x7f760008c2f0 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487676988 0 0) 0x7f7600088c20 con 0x7f760008dc80 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient(hunting): my global_id is 4384 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7600089ba0 con 0x7f760008dc80 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3846382259 0 0) 0x7f75e8003620 con 0x7f760008cdd0 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 >> v1:10.20.193.78:6790/0 conn(0x7f760008c2f0 legacy=0x7f760008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 >> v1:10.20.193.187:6789/0 conn(0x7f760008dc80 legacy=0x7f7600181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 monclient: found mon.noname-a 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760008d370 con 0x7f760008cdd0 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f75fc004670 con 0x7f760008cdd0 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: dump: 2026-02-13T18:05:37.315 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 5 monclient: authenticate success, global_id 4386 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:37.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75fc004940 con 0x7f760008cdd0 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 1 -- 10.20.193.78:0/1987935618 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f75fc004dd0 con 0x7f760008cdd0 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f75effff640 10 monclient: dump: 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.317 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 4 set_mon_vals no callback set 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: shutdown 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- 10.20.193.78:0/1987935618 >> v1:10.20.193.78:6789/0 conn(0x7f760008cdd0 legacy=0x7f76001a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- 10.20.193.78:0/1987935618 shutdown_connections 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- 10.20.193.78:0/1987935618 >> 10.20.193.78:0/1987935618 conn(0x7f7600091720 msgr2=0x7f7600091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- 10.20.193.78:0/1987935618 shutdown_connections 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- 10.20.193.78:0/1987935618 wait complete. 2026-02-13T18:05:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: monmap: 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 Processor -- start 2026-02-13T18:05:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- start start 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: init 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient(hunting): picked mon.noname-b con 0x7f760008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient(hunting): picked mon.noname-c con 0x7f760008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient(hunting): picked mon.noname-a con 0x7f760008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7600082380 con 0x7f760008dc80 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7600085a00 con 0x7f760008c2f0 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7600088910 con 0x7f760008cdd0 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f760797c640 10 monclient(hunting): authenticate will time out at 568.358323s 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f7605ef2640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f760008dc80 0x7f76001953e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51954/0 (socket says 10.20.193.78:51954) 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.300+0000 7f7605ef2640 1 -- 10.20.193.78:0/4026653236 learned_addr learned my addr 10.20.193.78:0/4026653236 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f7605ef2640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.78:6789/0 conn(0x7f760008dc80 legacy=0x7f76001953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f7604ef0640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.78:6790/0 conn(0x7f760008cdd0 legacy=0x7f76000838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992857655 0 0) 0x7f7600082380 con 0x7f760008dc80 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): my global_id is 4389 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75d0003620 con 0x7f760008dc80 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315431970 0 0) 0x7f7600088910 con 0x7f760008cdd0 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): my global_id is 4370 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7600082380 con 0x7f760008cdd0 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f76056f1640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.187:6789/0 conn(0x7f760008c2f0 legacy=0x7f7600153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3324333535 0 0) 0x7f75d0003620 con 0x7f760008dc80 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7600088910 con 0x7f760008dc80 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f75fc004c20 con 0x7f760008dc80 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): dump: 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.322 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3509359061 0 0) 0x7f7600082380 con 0x7f760008cdd0 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75d0003620 con 0x7f760008cdd0 2026-02-13T18:05:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f75f40033c0 con 0x7f760008cdd0 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): dump: 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355134372 0 0) 0x7f7600085a00 con 0x7f760008c2f0 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient(hunting): my global_id is 4387 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7600082380 con 0x7f760008c2f0 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2132419980 0 0) 0x7f7600088910 con 0x7f760008dc80 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.78:6790/0 conn(0x7f760008cdd0 legacy=0x7f76000838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.187:6789/0 conn(0x7f760008c2f0 legacy=0x7f7600153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 monclient: found mon.a 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7600080020 con 0x7f760008dc80 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 5 monclient: authenticate success, global_id 4389 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 monclient: _renew_subs 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76000820a0 con 0x7f760008dc80 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 monclient: _renew_subs 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7600083fc0 con 0x7f760008dc80 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75fc004920 con 0x7f760008dc80 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f75fc0055a0 con 0x7f760008dc80 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75ef7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 10 monclient: dump: 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.327 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760008f620 con 0x7f760008dc80 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f75fc005780 con 0x7f760008dc80 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f75fc04d970 con 0x7f760008dc80 2026-02-13T18:05:37.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.304+0000 7f76056f1640 10 monclient: get_auth_request con 0x7f75d003d830 auth_method 0 2026-02-13T18:05:37.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.308+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f760008f620 con 0x7f760008dc80 2026-02-13T18:05:37.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.308+0000 7f75edffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.308+0000 7f75edffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:37.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7600081ae0 con 0x7f760008dc80 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f75edffb640 1 -- 10.20.193.78:0/4026653236 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f7600081ae0 con 0x7f760008dc80 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f75edffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f75edffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:37.422 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:37.423 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-13T18:05:37.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.187:6812/2668687789 conn(0x7f75d003d830 legacy=0x7f75d005dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 10 monclient: shutdown 2026-02-13T18:05:37.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 >> v1:10.20.193.78:6789/0 conn(0x7f760008dc80 legacy=0x7f76001953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 shutdown_connections 2026-02-13T18:05:37.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 >> 10.20.193.78:0/4026653236 conn(0x7f7600091720 msgr2=0x7f760005b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 shutdown_connections 2026-02-13T18:05:37.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.416+0000 7f760797c640 1 -- 10.20.193.78:0/4026653236 wait complete. 2026-02-13T18:05:37.433 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-13T18:05:37.433 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-13T18:05:37.458 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-13T18:05:37.459 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient: get_monmap_and_config 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient: monmap: 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:37.527504+0000 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:37.527504+0000 2026-02-13T18:05:37.531 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.532 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.532 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.532 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:37.532 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:37.532 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 1 Processor -- start 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 1 -- start start 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient: init 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient(hunting): picked mon.noname-b con 0x7f61c808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient(hunting): picked mon.noname-a con 0x7f61c808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient(hunting): picked mon.noname-c con 0x7f61c808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c8089e80 con 0x7f61c808dc80 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c8088c20 con 0x7f61c808cdd0 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c8089ba0 con 0x7f61c808c2f0 2026-02-13T18:05:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61ccb66640 10 monclient(hunting): authenticate will time out at 568.583055s 2026-02-13T18:05:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61c6575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f61c808c2f0 0x7f61c808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58338/0 (socket says 10.20.193.78:58338) 2026-02-13T18:05:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.524+0000 7f61c6575640 1 -- 10.20.193.78:0/2113922050 learned_addr learned my addr 10.20.193.78:0/2113922050 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c6575640 1 -- 10.20.193.78:0/2113922050 >> v1:10.20.193.78:6790/0 conn(0x7f61c808c2f0 legacy=0x7f61c808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5d74640 1 -- 10.20.193.78:0/2113922050 >> v1:10.20.193.78:6789/0 conn(0x7f61c808dc80 legacy=0x7f61c8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857205260 0 0) 0x7f61c8089ba0 con 0x7f61c808c2f0 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): my global_id is 4373 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61b4003620 con 0x7f61c808c2f0 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333609402 0 0) 0x7f61c8089e80 con 0x7f61c808dc80 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient(hunting): my global_id is 4392 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c8089ba0 con 0x7f61c808dc80 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c6d76640 1 -- 10.20.193.78:0/2113922050 >> v1:10.20.193.187:6789/0 conn(0x7f61c808cdd0 legacy=0x7f61c81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1866427750 0 0) 0x7f61b4003620 con 0x7f61c808c2f0 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 >> v1:10.20.193.187:6789/0 conn(0x7f61c808cdd0 legacy=0x7f61c81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 >> v1:10.20.193.78:6789/0 conn(0x7f61c808dc80 legacy=0x7f61c8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 monclient: found mon.noname-b 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c808d370 con 0x7f61c808c2f0 2026-02-13T18:05:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 5 monclient: authenticate success, global_id 4373 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f61bc003190 con 0x7f61c808c2f0 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: dump: 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.541 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61bc003420 con 0x7f61c808c2f0 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 1 -- 10.20.193.78:0/2113922050 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f61bc004b50 con 0x7f61c808c2f0 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c5573640 10 monclient: dump: 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 4 set_mon_vals no callback set 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: shutdown 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- 10.20.193.78:0/2113922050 >> v1:10.20.193.78:6790/0 conn(0x7f61c808c2f0 legacy=0x7f61c808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- 10.20.193.78:0/2113922050 shutdown_connections 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- 10.20.193.78:0/2113922050 >> 10.20.193.78:0/2113922050 conn(0x7f61c8091720 msgr2=0x7f61c8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- 10.20.193.78:0/2113922050 shutdown_connections 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- 10.20.193.78:0/2113922050 wait complete. 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: monmap: 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:37.544 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 Processor -- start 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- start start 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: init 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient(hunting): picked mon.noname-c con 0x7f61c808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient(hunting): picked mon.noname-b con 0x7f61c808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient(hunting): picked mon.noname-a con 0x7f61c808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c80821b0 con 0x7f61c808dc80 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c8082490 con 0x7f61c808cdd0 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c80813e0 con 0x7f61c808c2f0 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61ccb66640 10 monclient(hunting): authenticate will time out at 568.586874s 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c6575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f61c808c2f0 0x7f61c81338b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58346/0 (socket says 10.20.193.78:58346) 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.528+0000 7f61c6575640 1 -- 10.20.193.78:0/229696206 learned_addr learned my addr 10.20.193.78:0/229696206 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61c6575640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.78:6790/0 conn(0x7f61c808c2f0 legacy=0x7f61c81338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61c6d76640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.78:6789/0 conn(0x7f61c808dc80 legacy=0x7f61c81a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049356398 0 0) 0x7f61c80821b0 con 0x7f61c808dc80 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): my global_id is 4395 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6194003620 con 0x7f61c808dc80 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231063419 0 0) 0x7f61c80813e0 con 0x7f61c808c2f0 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): my global_id is 4376 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c80821b0 con 0x7f61c808c2f0 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61c5d74640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.187:6789/0 conn(0x7f61c808cdd0 legacy=0x7f61c80839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:05:37.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1956879143 0 0) 0x7f6194003620 con 0x7f61c808dc80 2026-02-13T18:05:37.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61c80813e0 con 0x7f61c808dc80 2026-02-13T18:05:37.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2603498536 0 0) 0x7f61c80821b0 con 0x7f61c808c2f0 2026-02-13T18:05:37.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6194003620 con 0x7f61c808c2f0 2026-02-13T18:05:37.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322110255 0 0) 0x7f61c8082490 con 0x7f61c808cdd0 2026-02-13T18:05:37.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): my global_id is 4393 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c80821b0 con 0x7f61c808cdd0 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f61b8004890 con 0x7f61c808dc80 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): dump: 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.551 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f61bc003190 con 0x7f61c808c2f0 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient(hunting): dump: 2026-02-13T18:05:37.552 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1931963686 0 0) 0x7f61c80813e0 con 0x7f61c808dc80 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.78:6790/0 conn(0x7f61c808c2f0 legacy=0x7f61c81338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.187:6789/0 conn(0x7f61c808cdd0 legacy=0x7f61c80839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 monclient: found mon.a 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c8080130 con 0x7f61c808dc80 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 5 monclient: authenticate success, global_id 4395 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 10 monclient: _renew_subs 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61c81332d0 con 0x7f61c808dc80 2026-02-13T18:05:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 10 monclient: _renew_subs 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f61c8080e60 con 0x7f61c808dc80 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61b8004ed0 con 0x7f61c808dc80 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f61b8005260 con 0x7f61c808dc80 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61c4d72640 4 set_mon_vals no callback set 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.532+0000 7f61aeffd640 10 monclient: dump: 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.555 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61ccb66640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61ccb66640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61ccb66640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c808f600 con 0x7f61c808dc80 2026-02-13T18:05:37.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f61b8005440 con 0x7f61c808dc80 2026-02-13T18:05:37.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f61b804d900 con 0x7f61c808dc80 2026-02-13T18:05:37.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61c6575640 10 monclient: get_auth_request con 0x7f619403d800 auth_method 0 2026-02-13T18:05:37.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f61b8018a10 con 0x7f61c808dc80 2026-02-13T18:05:37.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.536+0000 7f61aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61c8090810 con 0x7f61c808dc80 2026-02-13T18:05:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61aeffd640 1 -- 10.20.193.78:0/229696206 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10847 (unknown 3338201251 0 1653934009) 0x7f61b801dcd0 con 0x7f61c808dc80 2026-02-13T18:05:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:05:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:37.631 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:37.632 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":18,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:05:32.486562+0000","last_up_change":"2026-02-13T18:05:25.449453+0000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T18:05:25.773956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T18:05:28.499550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":425425936}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":425425936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":425425936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":425425936}]},"public_addr":"10.20.193.78:6804/425425936","cluster_addr":"10.20.193.78:6805/425425936","heartbeat_back_addr":"10.20.193.78:6807/425425936","heartbeat_front_addr":"10.20.193.78:6806/425425936","state":["exists","up"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":444681404}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":444681404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":444681404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":444681404}]},"public_addr":"10.20.193.78:6800/444681404","cluster_addr":"10.20.193.78:6801/444681404","heartbeat_back_addr":"10.20.193.78:6803/444681404","heartbeat_front_addr":"10.20.193.78:6802/444681404","state":["exists","up"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2589033462}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":2589033462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":2589033462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":2589033462}]},"public_addr":"10.20.193.78:6808/2589033462","cluster_addr":"10.20.193.78:6809/2589033462","heartbeat_back_addr":"10.20.193.78:6811/2589033462","heartbeat_front_addr":"10.20.193.78:6810/2589033462","state":["exists","up"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6800","nonce":1622449099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6801","nonce":1622449099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6803","nonce":1622449099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6802","nonce":1622449099}]},"public_addr":"10.20.193.187:6800/1622449099","cluster_addr":"10.20.193.187:6801/1622449099","heartbeat_back_addr":"10.20.193.187:6803/1622449099","heartbeat_front_addr":"10.20.193.187:6802/1622449099","state":["exists","up"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6807","nonce":218078640}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6809","nonce":218078640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6811","nonce":218078640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6810","nonce":218078640}]},"public_addr":"10.20.193.187:6807/218078640","cluster_addr":"10.20.193.187:6809/218078640","heartbeat_back_addr":"10.20.193.187:6811/218078640","heartbeat_front_addr":"10.20.193.187:6810/218078640","state":["exists","up"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6804","nonce":1501659775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6805","nonce":1501659775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6808","nonce":1501659775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6806","nonce":1501659775}]},"public_addr":"10.20.193.187:6804/1501659775","cluster_addr":"10.20.193.187:6805/1501659775","heartbeat_back_addr":"10.20.193.187:6808/1501659775","heartbeat_front_addr":"10.20.193.187:6806/1501659775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:05:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.187:6812/2668687789 conn(0x7f619403d800 legacy=0x7f619405dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 10 monclient: shutdown 2026-02-13T18:05:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 >> v1:10.20.193.78:6789/0 conn(0x7f61c808dc80 legacy=0x7f61c81a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 shutdown_connections 2026-02-13T18:05:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 >> 10.20.193.78:0/229696206 conn(0x7f61c8091720 msgr2=0x7f61c805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 shutdown_connections 2026-02-13T18:05:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.624+0000 7f61ccb66640 1 -- 10.20.193.78:0/229696206 wait complete. 2026-02-13T18:05:37.642 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T18:05:25.773956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-13T18:05:28.499550+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 18, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T18:05:37.642 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-13T18:05:37.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient: get_monmap_and_config 2026-02-13T18:05:37.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient: monmap: 2026-02-13T18:05:37.713 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.713 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:37.709747+0000 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:37.709747+0000 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:37.714 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 1 Processor -- start 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 1 -- start start 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient: init 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient(hunting): picked mon.noname-a con 0x7f0c6008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient(hunting): picked mon.noname-b con 0x7f0c6008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60089e80 con 0x7f0c6008dc80 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60088c20 con 0x7f0c6008c2f0 2026-02-13T18:05:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60089ba0 con 0x7f0c6008cdd0 2026-02-13T18:05:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 10 monclient(hunting): authenticate will time out at 568.765147s 2026-02-13T18:05:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5dd74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0c6008dc80 0x7f0c60181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51980/0 (socket says 10.20.193.78:51980) 2026-02-13T18:05:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5dd74640 1 -- 10.20.193.78:0/2208019385 learned_addr learned my addr 10.20.193.78:0/2208019385 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5ed76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0c6008cdd0 0x7f0c601a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58360/0 (socket says 10.20.193.78:58360) 2026-02-13T18:05:37.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5ed76640 1 -- 10.20.193.78:0/2208019385 >> v1:10.20.193.78:6790/0 conn(0x7f0c6008cdd0 legacy=0x7f0c601a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5dd74640 1 -- 10.20.193.78:0/2208019385 >> v1:10.20.193.78:6789/0 conn(0x7f0c6008dc80 legacy=0x7f0c60181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5e575640 1 -- 10.20.193.78:0/2208019385 >> v1:10.20.193.187:6789/0 conn(0x7f0c6008c2f0 legacy=0x7f0c6008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557820385 0 0) 0x7f0c60089ba0 con 0x7f0c6008cdd0 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): my global_id is 4379 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c4c003620 con 0x7f0c6008cdd0 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301801792 0 0) 0x7f0c60089e80 con 0x7f0c6008dc80 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): my global_id is 4398 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c60089ba0 con 0x7f0c6008dc80 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624957086 0 0) 0x7f0c60088c20 con 0x7f0c6008c2f0 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient(hunting): my global_id is 4396 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c60089e80 con 0x7f0c6008c2f0 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1653080422 0 0) 0x7f0c4c003620 con 0x7f0c6008cdd0 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 >> v1:10.20.193.187:6789/0 conn(0x7f0c6008c2f0 legacy=0x7f0c6008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 >> v1:10.20.193.78:6789/0 conn(0x7f0c6008dc80 legacy=0x7f0c60181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 monclient: found mon.noname-b 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6008d370 con 0x7f0c6008cdd0 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0c50004620 con 0x7f0c6008cdd0 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:37.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c5d573640 10 monclient: dump: 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 5 monclient: authenticate success, global_id 4379 2026-02-13T18:05:37.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.708+0000 7f0c64849640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c500048f0 con 0x7f0c6008cdd0 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5d573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5d573640 1 -- 10.20.193.78:0/2208019385 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0c50005fa0 con 0x7f0c6008cdd0 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5d573640 10 monclient: dump: 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.728 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 4 set_mon_vals no callback set 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: shutdown 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- 10.20.193.78:0/2208019385 >> v1:10.20.193.78:6790/0 conn(0x7f0c6008cdd0 legacy=0x7f0c601a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- 10.20.193.78:0/2208019385 shutdown_connections 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- 10.20.193.78:0/2208019385 >> 10.20.193.78:0/2208019385 conn(0x7f0c60091720 msgr2=0x7f0c60091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- 10.20.193.78:0/2208019385 shutdown_connections 2026-02-13T18:05:37.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- 10.20.193.78:0/2208019385 wait complete. 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: monmap: 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 Processor -- start 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- start start 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: init 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient(hunting): picked mon.noname-b con 0x7f0c6008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient(hunting): picked mon.noname-a con 0x7f0c6008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60087230 con 0x7f0c6008dc80 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60088910 con 0x7f0c6008c2f0 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60082410 con 0x7f0c6008cdd0 2026-02-13T18:05:37.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c64849640 10 monclient(hunting): authenticate will time out at 568.769774s 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5dd74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0c6008cdd0 0x7f0c60083940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58362/0 (socket says 10.20.193.78:58362) 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5dd74640 1 -- 10.20.193.78:0/1178943087 learned_addr learned my addr 10.20.193.78:0/1178943087 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5ed76640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.78:6789/0 conn(0x7f0c6008dc80 legacy=0x7f0c60195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.712+0000 7f0c5dd74640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.78:6790/0 conn(0x7f0c6008cdd0 legacy=0x7f0c60083940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c5e575640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.187:6789/0 conn(0x7f0c6008c2f0 legacy=0x7f0c60153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095007654 0 0) 0x7f0c60087230 con 0x7f0c6008dc80 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): my global_id is 4401 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c2c003620 con 0x7f0c6008dc80 2026-02-13T18:05:37.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764266223 0 0) 0x7f0c60082410 con 0x7f0c6008cdd0 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): my global_id is 4382 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c60087230 con 0x7f0c6008cdd0 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064316267 0 0) 0x7f0c60088910 con 0x7f0c6008c2f0 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): my global_id is 4399 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c60082410 con 0x7f0c6008c2f0 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4027892303 0 0) 0x7f0c2c003620 con 0x7f0c6008dc80 2026-02-13T18:05:37.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c60088910 con 0x7f0c6008dc80 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0c50005df0 con 0x7f0c6008dc80 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): dump: 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.734 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2013936792 0 0) 0x7f0c60087230 con 0x7f0c6008cdd0 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c2c003620 con 0x7f0c6008cdd0 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0c48003410 con 0x7f0c6008cdd0 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient(hunting): dump: 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.735 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2192152030 0 0) 0x7f0c60082410 con 0x7f0c6008c2f0 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c60087230 con 0x7f0c6008c2f0 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2282841856 0 0) 0x7f0c60088910 con 0x7f0c6008dc80 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.78:6790/0 conn(0x7f0c6008cdd0 legacy=0x7f0c60083940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.187:6789/0 conn(0x7f0c6008c2f0 legacy=0x7f0c60153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 monclient: found mon.a 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c60081b70 con 0x7f0c6008dc80 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 5 monclient: authenticate success, global_id 4401 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 monclient: _renew_subs 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c60080c10 con 0x7f0c6008dc80 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 monclient: _renew_subs 2026-02-13T18:05:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c60084220 con 0x7f0c6008dc80 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c500065c0 con 0x7f0c6008dc80 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0c50006770 con 0x7f0c6008dc80 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c5cd72640 4 set_mon_vals no callback set 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 10 monclient: dump: 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.738 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6008f620 con 0x7f0c6008dc80 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0c50012e00 con 0x7f0c6008dc80 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f0c5004d740 con 0x7f0c6008dc80 2026-02-13T18:05:37.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.716+0000 7f0c5e575640 10 monclient: get_auth_request con 0x7f0c2c03d920 auth_method 0 2026-02-13T18:05:37.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.720+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f0c6008f620 con 0x7f0c6008dc80 2026-02-13T18:05:37.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.720+0000 7f0c46ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.720+0000 7f0c46ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:37.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0c60090810 con 0x7f0c6008dc80 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c46ffd640 1 -- 10.20.193.78:0/1178943087 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (unknown 4068545244 0 2170607528) 0x7f0c500188d0 con 0x7f0c6008dc80 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c46ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c46ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:37.814 INFO:teuthology.orchestra.run.trial078.stdout:pg_num: 1 2026-02-13T18:05:37.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.187:6812/2668687789 conn(0x7f0c2c03d920 legacy=0x7f0c2c05ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 10 monclient: shutdown 2026-02-13T18:05:37.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 >> v1:10.20.193.78:6789/0 conn(0x7f0c6008dc80 legacy=0x7f0c60195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 shutdown_connections 2026-02-13T18:05:37.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 >> 10.20.193.78:0/1178943087 conn(0x7f0c60091720 msgr2=0x7f0c60058b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 shutdown_connections 2026-02-13T18:05:37.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.808+0000 7f0c64849640 1 -- 10.20.193.78:0/1178943087 wait complete. 2026-02-13T18:05:37.825 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-13T18:05:37.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient: get_monmap_and_config 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient: monmap: 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:37.886244+0000 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:37.886244+0000 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:37.890 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:37.891 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 1 Processor -- start 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 1 -- start start 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient: init 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient(hunting): picked mon.noname-a con 0x7f31f013f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient(hunting): picked mon.noname-c con 0x7f31f005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient(hunting): picked mon.noname-b con 0x7f31f01853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f0095530 con 0x7f31f013f8b0 2026-02-13T18:05:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f0140390 con 0x7f31f005e4b0 2026-02-13T18:05:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f005d230 con 0x7f31f01853c0 2026-02-13T18:05:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31f69fc640 10 monclient(hunting): authenticate will time out at 568.941805s 2026-02-13T18:05:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31effff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f31f013f8b0 0x7f31f013fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:51988/0 (socket says 10.20.193.78:51988) 2026-02-13T18:05:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.884+0000 7f31effff640 1 -- 10.20.193.78:0/4028178967 learned_addr learned my addr 10.20.193.78:0/4028178967 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f4f72640 1 -- 10.20.193.78:0/4028178967 >> v1:10.20.193.78:6790/0 conn(0x7f31f01853c0 legacy=0x7f31f01a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31effff640 1 -- 10.20.193.78:0/4028178967 >> v1:10.20.193.78:6789/0 conn(0x7f31f013f8b0 legacy=0x7f31f013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647050126 0 0) 0x7f31dc002c60 con 0x7f31f013f8b0 2026-02-13T18:05:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): my global_id is 4404 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31d4003620 con 0x7f31f013f8b0 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31ef7fe640 1 -- 10.20.193.78:0/4028178967 >> v1:10.20.193.187:6789/0 conn(0x7f31f005e4b0 legacy=0x7f31f0183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012474438 0 0) 0x7f31f005d230 con 0x7f31f01853c0 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient(hunting): my global_id is 4385 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31dc002c60 con 0x7f31f01853c0 2026-02-13T18:05:37.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3325242660 0 0) 0x7f31d4003620 con 0x7f31f013f8b0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 >> v1:10.20.193.78:6790/0 conn(0x7f31f01853c0 legacy=0x7f31f01a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 >> v1:10.20.193.187:6789/0 conn(0x7f31f005e4b0 legacy=0x7f31f0183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 monclient: found mon.noname-a 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f005d510 con 0x7f31f013f8b0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f31dc0032e0 con 0x7f31f013f8b0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: dump: 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 5 monclient: authenticate success, global_id 4404 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31dc0049a0 con 0x7f31f013f8b0 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 1 -- 10.20.193.78:0/4028178967 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f31dc004d30 con 0x7f31f013f8b0 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31eeffd640 10 monclient: dump: 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.900 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 4 set_mon_vals no callback set 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: shutdown 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- 10.20.193.78:0/4028178967 >> v1:10.20.193.78:6789/0 conn(0x7f31f013f8b0 legacy=0x7f31f013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- 10.20.193.78:0/4028178967 shutdown_connections 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- 10.20.193.78:0/4028178967 >> 10.20.193.78:0/4028178967 conn(0x7f31f00545d0 msgr2=0x7f31f00549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- 10.20.193.78:0/4028178967 shutdown_connections 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- 10.20.193.78:0/4028178967 wait complete. 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: build_initial_monmap 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: monmap: 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:37.902 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 Processor -- start 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- start start 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: init 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient(hunting): picked mon.noname-b con 0x7f31f005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient(hunting): picked mon.noname-c con 0x7f31f013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient(hunting): picked mon.noname-a con 0x7f31f01853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f008a5b0 con 0x7f31f01853c0 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f012de80 con 0x7f31f005e4b0 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f012e160 con 0x7f31f013f8b0 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:37.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f69fc640 10 monclient(hunting): authenticate will time out at 568.945758s 2026-02-13T18:05:37.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f4f72640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f31f01853c0 0x7f31f0181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52000/0 (socket says 10.20.193.78:52000) 2026-02-13T18:05:37.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f4f72640 1 -- 10.20.193.78:0/1949126111 learned_addr learned my addr 10.20.193.78:0/1949126111 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:37.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.888+0000 7f31f4f72640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.78:6789/0 conn(0x7f31f01853c0 legacy=0x7f31f0181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ef7fe640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.78:6790/0 conn(0x7f31f013f8b0 legacy=0x7f31f0180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706716791 0 0) 0x7f31f008a5b0 con 0x7f31f01853c0 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31effff640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.187:6789/0 conn(0x7f31f005e4b0 legacy=0x7f31f01a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): my global_id is 4407 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c0003620 con 0x7f31f01853c0 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774354455 0 0) 0x7f31f012e160 con 0x7f31f013f8b0 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): my global_id is 4388 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31f008a5b0 con 0x7f31f013f8b0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785213021 0 0) 0x7f31f012de80 con 0x7f31f005e4b0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _negotiate 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): my global_id is 4402 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31f012e160 con 0x7f31f005e4b0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1855577536 0 0) 0x7f31c0003620 con 0x7f31f01853c0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31f012de80 con 0x7f31f01853c0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f31e4004900 con 0x7f31f01853c0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): dump: 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:37.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1998149875 0 0) 0x7f31f008a5b0 con 0x7f31f013f8b0 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31c0003620 con 0x7f31f013f8b0 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f31e00032e0 con 0x7f31f013f8b0 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient(hunting): dump: 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.911 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3610508479 0 0) 0x7f31f012de80 con 0x7f31f01853c0 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.78:6790/0 conn(0x7f31f013f8b0 legacy=0x7f31f0180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.187:6789/0 conn(0x7f31f005e4b0 legacy=0x7f31f01a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: _finish_hunting 0 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 monclient: found mon.a 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f012c960 con 0x7f31f01853c0 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: _finish_auth 0 2026-02-13T18:05:37.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 5 monclient: authenticate success, global_id 4407 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 monclient: _renew_subs 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31f01a1480 con 0x7f31f01853c0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 monclient: _renew_subs 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f31f0192940 con 0x7f31f01853c0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31e4004ed0 con 0x7f31f01853c0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f31e4005260 con 0x7f31f01853c0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ee7fc640 4 set_mon_vals no callback set 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 10 monclient: dump: 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f01a6e40 con 0x7f31f01853c0 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f31e4005530 con 0x7f31f01853c0 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f31e404d9a0 con 0x7f31f01853c0 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.892+0000 7f31effff640 10 monclient: get_auth_request con 0x7f31c003d800 auth_method 0 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.896+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f31e4018ab0 con 0x7f31f01853c0 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.896+0000 7f31ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.896+0000 7f31ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f31f0051150 con 0x7f31f01853c0 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31ecff9640 1 -- 10.20.193.78:0/1949126111 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) ==== 92+0+10 (unknown 1614612280 0 265718887) 0x7f31e401dd70 con 0x7f31f01853c0 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T18:05:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31ecff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:37.987 INFO:teuthology.orchestra.run.trial078.stdout:pg_num: 8 2026-02-13T18:05:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.187:6812/2668687789 conn(0x7f31c003d800 legacy=0x7f31c005dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 10 monclient: shutdown 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 >> v1:10.20.193.78:6789/0 conn(0x7f31f01853c0 legacy=0x7f31f0181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 shutdown_connections 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 >> 10.20.193.78:0/1949126111 conn(0x7f31f00545d0 msgr2=0x7f31f0094360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 shutdown_connections 2026-02-13T18:05:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:37.980+0000 7f31f69fc640 1 -- 10.20.193.78:0/1949126111 wait complete. 2026-02-13T18:05:37.996 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-13T18:05:37.996 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:05:38.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient: monmap: 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.055398+0000 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.055398+0000 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.059 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.060 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.060 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.060 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 1 Processor -- start 2026-02-13T18:05:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 1 -- start start 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient: init 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient(hunting): picked mon.noname-c con 0x7ff43813f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient(hunting): picked mon.noname-a con 0x7ff438095410 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient(hunting): picked mon.noname-b con 0x7ff4381851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438140290 con 0x7ff438095410 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438094750 con 0x7ff43813f7b0 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438093c80 con 0x7ff4381851c0 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff43c9fd640 10 monclient(hunting): authenticate will time out at 569.110855s 2026-02-13T18:05:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff436ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff438095410 0x7ff438183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52012/0 (socket says 10.20.193.78:52012) 2026-02-13T18:05:38.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff436ffd640 1 -- 10.20.193.78:0/2803865936 learned_addr learned my addr 10.20.193.78:0/2803865936 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.052+0000 7ff437fff640 1 --1- 10.20.193.78:0/2803865936 >> v1:10.20.193.78:6790/0 conn(0x7ff4381851c0 0x7ff4381a55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58382/0 (socket says 10.20.193.78:58382) 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff436ffd640 1 -- 10.20.193.78:0/2803865936 >> v1:10.20.193.78:6789/0 conn(0x7ff438095410 legacy=0x7ff438183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff437fff640 1 -- 10.20.193.78:0/2803865936 >> v1:10.20.193.78:6790/0 conn(0x7ff4381851c0 legacy=0x7ff4381a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089854373 0 0) 0x7ff428002c60 con 0x7ff438095410 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): my global_id is 4410 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff41c003620 con 0x7ff438095410 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540107558 0 0) 0x7ff438093c80 con 0x7ff4381851c0 2026-02-13T18:05:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient(hunting): my global_id is 4391 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff428002c60 con 0x7ff4381851c0 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4377fe640 1 -- 10.20.193.78:0/2803865936 >> v1:10.20.193.187:6789/0 conn(0x7ff43813f7b0 legacy=0x7ff43813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2763057172 0 0) 0x7ff428002c60 con 0x7ff4381851c0 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 >> v1:10.20.193.187:6789/0 conn(0x7ff43813f7b0 legacy=0x7ff43813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 >> v1:10.20.193.78:6789/0 conn(0x7ff438095410 legacy=0x7ff438183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 monclient: found mon.noname-b 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff438094190 con 0x7ff4381851c0 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 5 monclient: authenticate success, global_id 4391 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c004620 con 0x7ff4381851c0 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: dump: 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.071 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff437fff640 1 --1- 10.20.193.78:0/2803865936 >> v1:10.20.193.78:6790/0 conn(0x7ff4381851c0 0x7ff4381a55a0 :-1 s=OPENED pgs=128 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7ff42c005fa0 mon_map magic: 0 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff42c0048f0 con 0x7ff4381851c0 2026-02-13T18:05:38.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 4 set_mon_vals no callback set 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: shutdown 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- 10.20.193.78:0/2803865936 >> v1:10.20.193.78:6790/0 conn(0x7ff4381851c0 legacy=0x7ff4381a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 1 -- 10.20.193.78:0/2803865936 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c005fa0 con 0x7ff4381851c0 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4367fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- 10.20.193.78:0/2803865936 shutdown_connections 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- 10.20.193.78:0/2803865936 >> 10.20.193.78:0/2803865936 conn(0x7ff438054400 msgr2=0x7ff438054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- 10.20.193.78:0/2803865936 shutdown_connections 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- 10.20.193.78:0/2803865936 wait complete. 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: monmap: 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 Processor -- start 2026-02-13T18:05:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- start start 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: init 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient(hunting): picked mon.noname-c con 0x7ff438095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient(hunting): picked mon.noname-b con 0x7ff43813f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient(hunting): picked mon.noname-a con 0x7ff4381851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438111c90 con 0x7ff4381851c0 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438110e20 con 0x7ff43813f7b0 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43810f930 con 0x7ff438095410 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff43c9fd640 10 monclient(hunting): authenticate will time out at 569.114828s 2026-02-13T18:05:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4377fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff438095410 0x7ff43813e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58386/0 (socket says 10.20.193.78:58386) 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.056+0000 7ff4377fe640 1 -- 10.20.193.78:0/1398655827 learned_addr learned my addr 10.20.193.78:0/1398655827 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff4377fe640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.78:6790/0 conn(0x7ff438095410 legacy=0x7ff43813e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff437fff640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.78:6789/0 conn(0x7ff4381851c0 legacy=0x7ff438181bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164756921 0 0) 0x7ff43810f930 con 0x7ff438095410 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): my global_id is 4394 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff408003620 con 0x7ff438095410 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12150911 0 0) 0x7ff438111c90 con 0x7ff4381851c0 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): my global_id is 4413 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff43810f930 con 0x7ff4381851c0 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff436ffd640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.187:6789/0 conn(0x7ff43813f7b0 legacy=0x7ff438180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 501197923 0 0) 0x7ff408003620 con 0x7ff438095410 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff438111c90 con 0x7ff438095410 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff424003420 con 0x7ff438095410 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): dump: 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.077 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225419782 0 0) 0x7ff438110e20 con 0x7ff43813f7b0 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): my global_id is 4408 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff408003620 con 0x7ff43813f7b0 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2564620670 0 0) 0x7ff43810f930 con 0x7ff4381851c0 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff438110e20 con 0x7ff4381851c0 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c005df0 con 0x7ff4381851c0 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient(hunting): dump: 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.079 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3365072410 0 0) 0x7ff438111c90 con 0x7ff438095410 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.187:6789/0 conn(0x7ff43813f7b0 legacy=0x7ff438180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.78:6789/0 conn(0x7ff4381851c0 legacy=0x7ff438181bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 monclient: found mon.c 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4381113f0 con 0x7ff438095410 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 5 monclient: authenticate success, global_id 4394 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 monclient: _renew_subs 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff43810f250 con 0x7ff438095410 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 monclient: _renew_subs 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff4381106c0 con 0x7ff438095410 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4240039c0 con 0x7ff438095410 2026-02-13T18:05:38.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff424003d20 con 0x7ff438095410 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 10 monclient: dump: 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.082 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff435ffb640 4 set_mon_vals no callback set 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff438050ff0 con 0x7ff438095410 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7ff424003ec0 con 0x7ff438095410 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7ff42404c560 con 0x7ff438095410 2026-02-13T18:05:38.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.060+0000 7ff436ffd640 10 monclient: get_auth_request con 0x7ff40803d890 auth_method 0 2026-02-13T18:05:38.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.064+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7ff424017670 con 0x7ff438095410 2026-02-13T18:05:38.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.064+0000 7ff413fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.064+0000 7ff413fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:38.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.148+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4381a6bb0 con 0x7ff40803d890 2026-02-13T18:05:38.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.148+0000 7ff413fff640 1 -- 10.20.193.78:0/1398655827 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34185 (unknown 2965378022 0 961059163) 0x7ff4381a6bb0 con 0x7ff40803d890 2026-02-13T18:05:38.157 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:38.158 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:05:38.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.187:6812/2668687789 conn(0x7ff40803d890 legacy=0x7ff40805dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 10 monclient: shutdown 2026-02-13T18:05:38.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 >> v1:10.20.193.78:6790/0 conn(0x7ff438095410 legacy=0x7ff43813e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 shutdown_connections 2026-02-13T18:05:38.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 >> 10.20.193.78:0/1398655827 conn(0x7ff438054400 msgr2=0x7ff438089630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 shutdown_connections 2026-02-13T18:05:38.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.152+0000 7ff43c9fd640 1 -- 10.20.193.78:0/1398655827 wait complete. 2026-02-13T18:05:38.167 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-13T18:05:37.729019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162784,"kb_used_data":1024,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566068256,"statfs":{"total":579820584960,"available":579653894144,"internally_reserved":0,"allocated":1048576,"data_stored":1350982,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":50697,"internal_metadata":165493239},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.240519"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230342+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:05:33.230342+0000","last_peered":"2026-02-13T18:05:33.230342+0000","last_clean":"2026-02-13T18:05:33.230342+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:05:33.230342+0000","last_undegraded":"2026-02-13T18:05:33.230342+0000","last_fullsized":"2026-02-13T18:05:33.230342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228687+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:05:33.228687+0000","last_peered":"2026-02-13T18:05:33.228687+0000","last_clean":"2026-02-13T18:05:33.228687+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:05:33.228687+0000","last_undegraded":"2026-02-13T18:05:33.228687+0000","last_fullsized":"2026-02-13T18:05:33.228687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228716+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:05:33.228716+0000","last_peered":"2026-02-13T18:05:33.228716+0000","last_clean":"2026-02-13T18:05:33.228716+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:05:33.228716+0000","last_undegraded":"2026-02-13T18:05:33.228716+0000","last_fullsized":"2026-02-13T18:05:33.228716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232853+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:05:33.232853+0000","last_peered":"2026-02-13T18:05:33.232853+0000","last_clean":"2026-02-13T18:05:33.232853+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:05:33.232853+0000","last_undegraded":"2026-02-13T18:05:33.232853+0000","last_fullsized":"2026-02-13T18:05:33.232853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228475+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:05:33.228475+0000","last_peered":"2026-02-13T18:05:33.228475+0000","last_clean":"2026-02-13T18:05:33.228475+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:05:33.228475+0000","last_undegraded":"2026-02-13T18:05:33.228475+0000","last_fullsized":"2026-02-13T18:05:33.228475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230714+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:05:33.230714+0000","last_peered":"2026-02-13T18:05:33.230714+0000","last_clean":"2026-02-13T18:05:33.230714+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:05:33.230714+0000","last_undegraded":"2026-02-13T18:05:33.230714+0000","last_fullsized":"2026-02-13T18:05:33.230714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232365+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:05:33.232365+0000","last_peered":"2026-02-13T18:05:33.232365+0000","last_clean":"2026-02-13T18:05:33.232365+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:05:33.232365+0000","last_undegraded":"2026-02-13T18:05:33.232365+0000","last_fullsized":"2026-02-13T18:05:33.232365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:05:38.168 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:05:38.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.220+0000 7f6ca208e640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.220+0000 7f6ca208e640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.220+0000 7f6ca208e640 10 monclient: monmap: 2026-02-13T18:05:38.228 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.228 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.228 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.224695+0000 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.224695+0000 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.229 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.220+0000 7f6ca208e640 1 Processor -- start 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.220+0000 7f6ca208e640 1 -- start start 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.220+0000 7f6ca208e640 10 monclient: init 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient(hunting): picked mon.noname-a con 0x7f6c9c085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient(hunting): picked mon.noname-c con 0x7f6c9c085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient(hunting): picked mon.noname-b con 0x7f6c9c181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c088400 con 0x7f6c9c085790 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c088120 con 0x7f6c9c085b60 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c08c550 con 0x7f6c9c181d50 2026-02-13T18:05:38.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient(hunting): authenticate will time out at 569.280134s 2026-02-13T18:05:38.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6c9c085790 0x7f6c9c089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52032/0 (socket says 10.20.193.78:52032) 2026-02-13T18:05:38.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9b7fe640 1 -- 10.20.193.78:0/862956570 learned_addr learned my addr 10.20.193.78:0/862956570 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9bfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f6c9c181d50 0x7f6c9c1a2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58394/0 (socket says 10.20.193.78:58394) 2026-02-13T18:05:38.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9bfff640 1 -- 10.20.193.78:0/862956570 >> v1:10.20.193.78:6790/0 conn(0x7f6c9c181d50 legacy=0x7f6c9c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9b7fe640 1 -- 10.20.193.78:0/862956570 >> v1:10.20.193.78:6789/0 conn(0x7f6c9c085790 legacy=0x7f6c9c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898978830 0 0) 0x7f6c9c08c550 con 0x7f6c9c181d50 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9affd640 1 -- 10.20.193.78:0/862956570 >> v1:10.20.193.187:6789/0 conn(0x7f6c9c085b60 legacy=0x7f6c9c085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): my global_id is 4397 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c80003620 con 0x7f6c9c181d50 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155836027 0 0) 0x7f6c88002c60 con 0x7f6c9c085790 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient(hunting): my global_id is 4416 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c9c08c550 con 0x7f6c9c085790 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3990267501 0 0) 0x7f6c80003620 con 0x7f6c9c181d50 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 >> v1:10.20.193.187:6789/0 conn(0x7f6c9c085b60 legacy=0x7f6c9c085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 >> v1:10.20.193.78:6789/0 conn(0x7f6c9c085790 legacy=0x7f6c9c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 monclient: found mon.noname-b 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c087540 con 0x7f6c9c181d50 2026-02-13T18:05:38.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c900046a0 con 0x7f6c9c181d50 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: dump: 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.241 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 5 monclient: authenticate success, global_id 4397 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c90004930 con 0x7f6c9c181d50 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 1 -- 10.20.193.78:0/862956570 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c90005fa0 con 0x7f6c9c181d50 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 4 set_mon_vals no callback set 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6c9a7fc640 10 monclient: dump: 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: shutdown 2026-02-13T18:05:38.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- 10.20.193.78:0/862956570 >> v1:10.20.193.78:6790/0 conn(0x7f6c9c181d50 legacy=0x7f6c9c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- 10.20.193.78:0/862956570 shutdown_connections 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- 10.20.193.78:0/862956570 >> 10.20.193.78:0/862956570 conn(0x7f6c9c091720 msgr2=0x7f6c9c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- 10.20.193.78:0/862956570 shutdown_connections 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- 10.20.193.78:0/862956570 wait complete. 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: monmap: 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:38.244 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 Processor -- start 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 1 -- start start 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.224+0000 7f6ca208e640 10 monclient: init 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient(hunting): picked mon.noname-c con 0x7f6c9c085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient(hunting): picked mon.noname-b con 0x7f6c9c085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient(hunting): picked mon.noname-a con 0x7f6c9c181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c13f280 con 0x7f6c9c181d50 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c13c560 con 0x7f6c9c085b60 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9c13f560 con 0x7f6c9c085790 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient(hunting): authenticate will time out at 569.284242s 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c9b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f6c9c085790 0x7f6c9c13b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58402/0 (socket says 10.20.193.78:58402) 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c9b7fe640 1 -- 10.20.193.78:0/627712825 learned_addr learned my addr 10.20.193.78:0/627712825 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c9b7fe640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.78:6790/0 conn(0x7f6c9c085790 legacy=0x7f6c9c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c9bfff640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.78:6789/0 conn(0x7f6c9c181d50 legacy=0x7f6c9c1752b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456589822 0 0) 0x7f6c9c13f560 con 0x7f6c9c085790 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): my global_id is 4400 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c6c003620 con 0x7f6c9c085790 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227517330 0 0) 0x7f6c9c13f280 con 0x7f6c9c181d50 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): my global_id is 4419 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c9affd640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.187:6789/0 conn(0x7f6c9c085b60 legacy=0x7f6c9c13be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c9c13f560 con 0x7f6c9c181d50 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172764090 0 0) 0x7f6c9c13c560 con 0x7f6c9c085b60 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): my global_id is 4414 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c9c13f280 con 0x7f6c9c085b60 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 212947149 0 0) 0x7f6c6c003620 con 0x7f6c9c085790 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c9c13c560 con 0x7f6c9c085790 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c880048e0 con 0x7f6c9c085790 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): dump: 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.248 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3840556055 0 0) 0x7f6c9c13f560 con 0x7f6c9c181d50 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c6c003620 con 0x7f6c9c181d50 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c90005fa0 con 0x7f6c9c181d50 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient(hunting): dump: 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3803595863 0 0) 0x7f6c9c13c560 con 0x7f6c9c085790 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.187:6789/0 conn(0x7f6c9c085b60 legacy=0x7f6c9c13be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.78:6789/0 conn(0x7f6c9c181d50 legacy=0x7f6c9c1752b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 monclient: found mon.c 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c089da0 con 0x7f6c9c085790 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 5 monclient: authenticate success, global_id 4400 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _renew_subs 2026-02-13T18:05:38.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9c13efa0 con 0x7f6c9c085790 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _renew_subs 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c9c13fce0 con 0x7f6c9c085790 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c88004d30 con 0x7f6c9c085790 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c88005090 con 0x7f6c9c085790 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 10 monclient: dump: 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.252 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c99ffb640 4 set_mon_vals no callback set 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f6c88011720 con 0x7f6c9c085790 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c9c0389c0 con 0x7f6c9c085790 2026-02-13T18:05:38.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.228+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f6c8804c510 con 0x7f6c9c085790 2026-02-13T18:05:38.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.232+0000 7f6c9affd640 10 monclient: get_auth_request con 0x7f6c6c03d5c0 auth_method 0 2026-02-13T18:05:38.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.232+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f6c9c088400 con 0x7f6c9c085790 2026-02-13T18:05:38.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.232+0000 7f6c77fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.232+0000 7f6c77fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:38.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.324+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c9c090810 con 0x7f6c6c03d5c0 2026-02-13T18:05:38.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.324+0000 7f6c77fff640 1 -- 10.20.193.78:0/627712825 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34185 (unknown 2965378022 0 961059163) 0x7f6c9c090810 con 0x7f6c6c03d5c0 2026-02-13T18:05:38.334 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:05:38.335 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:05:38.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.187:6812/2668687789 conn(0x7f6c6c03d5c0 legacy=0x7f6c6c05da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 10 monclient: shutdown 2026-02-13T18:05:38.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 >> v1:10.20.193.78:6790/0 conn(0x7f6c9c085790 legacy=0x7f6c9c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 shutdown_connections 2026-02-13T18:05:38.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 >> 10.20.193.78:0/627712825 conn(0x7f6c9c091720 msgr2=0x7f6c9c05b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 shutdown_connections 2026-02-13T18:05:38.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.328+0000 7f6ca208e640 1 -- 10.20.193.78:0/627712825 wait complete. 2026-02-13T18:05:38.343 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-13T18:05:37.729019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162784,"kb_used_data":1024,"kb_used_omap":49,"kb_used_meta":161614,"kb_avail":566068256,"statfs":{"total":579820584960,"available":579653894144,"internally_reserved":0,"allocated":1048576,"data_stored":1350982,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":50697,"internal_metadata":165493239},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.240519"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230342+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:05:33.230342+0000","last_peered":"2026-02-13T18:05:33.230342+0000","last_clean":"2026-02-13T18:05:33.230342+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:05:33.230342+0000","last_undegraded":"2026-02-13T18:05:33.230342+0000","last_fullsized":"2026-02-13T18:05:33.230342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228687+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:05:33.228687+0000","last_peered":"2026-02-13T18:05:33.228687+0000","last_clean":"2026-02-13T18:05:33.228687+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:05:33.228687+0000","last_undegraded":"2026-02-13T18:05:33.228687+0000","last_fullsized":"2026-02-13T18:05:33.228687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228716+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:05:33.228716+0000","last_peered":"2026-02-13T18:05:33.228716+0000","last_clean":"2026-02-13T18:05:33.228716+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:05:33.228716+0000","last_undegraded":"2026-02-13T18:05:33.228716+0000","last_fullsized":"2026-02-13T18:05:33.228716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232853+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:05:33.232853+0000","last_peered":"2026-02-13T18:05:33.232853+0000","last_clean":"2026-02-13T18:05:33.232853+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:05:33.232853+0000","last_undegraded":"2026-02-13T18:05:33.232853+0000","last_fullsized":"2026-02-13T18:05:33.232853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.228475+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:05:33.228475+0000","last_peered":"2026-02-13T18:05:33.228475+0000","last_clean":"2026-02-13T18:05:33.228475+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:05:33.228475+0000","last_undegraded":"2026-02-13T18:05:33.228475+0000","last_fullsized":"2026-02-13T18:05:33.228475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230714+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:05:33.230714+0000","last_peered":"2026-02-13T18:05:33.230714+0000","last_clean":"2026-02-13T18:05:33.230714+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:05:33.230714+0000","last_undegraded":"2026-02-13T18:05:33.230714+0000","last_fullsized":"2026-02-13T18:05:33.230714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.232365+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:05:33.232365+0000","last_peered":"2026-02-13T18:05:33.232365+0000","last_clean":"2026-02-13T18:05:33.232365+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:05:33.232365+0000","last_undegraded":"2026-02-13T18:05:33.232365+0000","last_fullsized":"2026-02-13T18:05:33.232365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T18:05:33.230421+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:05:33.230421+0000","last_peered":"2026-02-13T18:05:33.230421+0000","last_clean":"2026-02-13T18:05:33.230421+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:05:33.230421+0000","last_undegraded":"2026-02-13T18:05:33.230421+0000","last_fullsized":"2026-02-13T18:05:33.230421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":577776,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:05:38.345 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-13T18:05:38.345 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_netsplit_grace_period 30 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.408+0000 7f4b9ae5c640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.408+0000 7f4b9ae5c640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.408+0000 7f4b9ae5c640 10 monclient: monmap: 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.413380+0000 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.413380+0000 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.417 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.418 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.418 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.418 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.418 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 Processor -- start 2026-02-13T18:05:38.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- start start 2026-02-13T18:05:38.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient: init 2026-02-13T18:05:38.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient(hunting): picked mon.noname-b con 0x7f4b9405e570 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient(hunting): picked mon.noname-c con 0x7f4b9408cad0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient(hunting): picked mon.noname-a con 0x7f4b9408cf30 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9405e940 con 0x7f4b9408cf30 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9408e000 con 0x7f4b9408cad0 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b94084e70 con 0x7f4b9405e570 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient(hunting): authenticate will time out at 569.468555s 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b98bd1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4b9405e570 0x7f4b9408c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58412/0 (socket says 10.20.193.78:58412) 2026-02-13T18:05:38.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b98bd1640 1 -- 10.20.193.78:0/2037839545 learned_addr learned my addr 10.20.193.78:0/2037839545 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b98bd1640 1 -- 10.20.193.78:0/2037839545 >> v1:10.20.193.78:6790/0 conn(0x7f4b9405e570 legacy=0x7f4b9408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b993d2640 1 -- 10.20.193.78:0/2037839545 >> v1:10.20.193.78:6789/0 conn(0x7f4b9408cf30 legacy=0x7f4b941aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525333739 0 0) 0x7f4b94084e70 con 0x7f4b9405e570 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): my global_id is 4403 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b80003620 con 0x7f4b9405e570 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8bfff640 1 -- 10.20.193.78:0/2037839545 >> v1:10.20.193.187:6789/0 conn(0x7f4b9408cad0 legacy=0x7f4b94188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844537299 0 0) 0x7f4b9405e940 con 0x7f4b9408cf30 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): my global_id is 4422 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b94084e70 con 0x7f4b9408cf30 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678346659 0 0) 0x7f4b9408e000 con 0x7f4b9408cad0 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient(hunting): my global_id is 4417 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b9405e940 con 0x7f4b9408cad0 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3816697906 0 0) 0x7f4b80003620 con 0x7f4b9405e570 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 >> v1:10.20.193.187:6789/0 conn(0x7f4b9408cad0 legacy=0x7f4b94188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 >> v1:10.20.193.78:6789/0 conn(0x7f4b9408cf30 legacy=0x7f4b941aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 monclient: found mon.noname-b 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b940845d0 con 0x7f4b9405e570 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4b84003110 con 0x7f4b9405e570 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: dump: 2026-02-13T18:05:38.430 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 5 monclient: authenticate success, global_id 4403 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b840033e0 con 0x7f4b9405e570 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 1 -- 10.20.193.78:0/2037839545 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4b84004b50 con 0x7f4b9405e570 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b8b7fe640 10 monclient: dump: 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 4 set_mon_vals no callback set 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 10 monclient: shutdown 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/2037839545 >> v1:10.20.193.78:6790/0 conn(0x7f4b9405e570 legacy=0x7f4b9408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/2037839545 shutdown_connections 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/2037839545 >> 10.20.193.78:0/2037839545 conn(0x7f4b94091720 msgr2=0x7f4b94091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/2037839545 shutdown_connections 2026-02-13T18:05:38.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.412+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/2037839545 wait complete. 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: monmap: 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:38.434 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 Processor -- start 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- start start 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: init 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient(hunting): picked mon.noname-c con 0x7f4b9405e570 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient(hunting): picked mon.noname-a con 0x7f4b9408cad0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient(hunting): picked mon.noname-b con 0x7f4b9408cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9405d080 con 0x7f4b9408cad0 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9405d360 con 0x7f4b9408cf30 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9405a400 con 0x7f4b9405e570 2026-02-13T18:05:38.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient(hunting): authenticate will time out at 569.472728s 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b98bd1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4b9405e570 0x7f4b940595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58414/0 (socket says 10.20.193.78:58414) 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b98bd1640 1 -- 10.20.193.78:0/3537818430 learned_addr learned my addr 10.20.193.78:0/3537818430 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b98bd1640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.78:6790/0 conn(0x7f4b9405e570 legacy=0x7f4b940595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b8bfff640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.78:6789/0 conn(0x7f4b9408cad0 legacy=0x7f4b94059cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520735884 0 0) 0x7f4b9405a400 con 0x7f4b9405e570 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): my global_id is 4406 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b64003620 con 0x7f4b9405e570 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152254034 0 0) 0x7f4b9405d080 con 0x7f4b9408cad0 2026-02-13T18:05:38.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): my global_id is 4425 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b9405a400 con 0x7f4b9408cad0 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b993d2640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.187:6789/0 conn(0x7f4b9408cf30 legacy=0x7f4b94240d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 908718716 0 0) 0x7f4b64003620 con 0x7f4b9405e570 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b9405d080 con 0x7f4b9405e570 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4b84002b70 con 0x7f4b9405e570 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): dump: 2026-02-13T18:05:38.437 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769101752 0 0) 0x7f4b9405d360 con 0x7f4b9408cf30 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): my global_id is 4420 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b64003620 con 0x7f4b9408cf30 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 794496325 0 0) 0x7f4b9405a400 con 0x7f4b9408cad0 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b9405d360 con 0x7f4b9408cad0 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4b7c0033c0 con 0x7f4b9408cad0 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient(hunting): dump: 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.439 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1598601728 0 0) 0x7f4b9405d080 con 0x7f4b9405e570 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.187:6789/0 conn(0x7f4b9408cf30 legacy=0x7f4b94240d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.78:6789/0 conn(0x7f4b9408cad0 legacy=0x7f4b94059cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 monclient: found mon.c 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b94088910 con 0x7f4b9405e570 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 5 monclient: authenticate success, global_id 4406 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _renew_subs 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9405cda0 con 0x7f4b9405e570 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _renew_subs 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b9405dae0 con 0x7f4b9405e570 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b840033e0 con 0x7f4b9405e570 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4b840052e0 con 0x7f4b9405e570 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b897fa640 10 monclient: dump: 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.442 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b8affd640 4 set_mon_vals no callback set 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.416+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9408f620 con 0x7f4b9405e570 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.420+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4b84011970 con 0x7f4b9405e570 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.420+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 3958412776 0 0) 0x7f4b8404c560 con 0x7f4b9405e570 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.420+0000 7f4b8bfff640 10 monclient: get_auth_request con 0x7f4b6403d880 auth_method 0 2026-02-13T18:05:38.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.420+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f4b9408f620 con 0x7f4b9405e570 2026-02-13T18:05:38.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.420+0000 7f4b897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.420+0000 7f4b897fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:38.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.508+0000 7f4b9ae5c640 10 start_mon_command cmd=[{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-13T18:05:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.508+0000 7f4b9ae5c640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-13T18:05:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.508+0000 7f4b9ae5c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.508+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 --> v1:10.20.193.78:6790/0 -- mon_command([{prefix=config set, name=mon_netsplit_grace_period}] v 0) -- 0x7f4b9405de20 con 0x7f4b9405e570 2026-02-13T18:05:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b897fa640 1 -- 10.20.193.78:0/3537818430 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{prefix=config set, name=mon_netsplit_grace_period}]=0 v2)=0 v2) ==== 124+0+0 (unknown 948039188 0 0) 0x7f4b84017730 con 0x7f4b9405e570 2026-02-13T18:05:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-13T18:05:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b897fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.187:6812/2668687789 conn(0x7f4b6403d880 legacy=0x7f4b6405dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 10 monclient: shutdown 2026-02-13T18:05:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 >> v1:10.20.193.78:6790/0 conn(0x7f4b9405e570 legacy=0x7f4b940595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 shutdown_connections 2026-02-13T18:05:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 >> 10.20.193.78:0/3537818430 conn(0x7f4b94091720 msgr2=0x7f4b94089110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 shutdown_connections 2026-02-13T18:05:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.512+0000 7f4b9ae5c640 1 -- 10.20.193.78:0/3537818430 wait complete. 2026-02-13T18:05:38.528 DEBUG:tasks.mon_thrash:Yielding 2026-02-13T18:05:38.529 INFO:teuthology.run_tasks:Running task rados... 2026-02-13T18:05:38.544 INFO:tasks.rados:Beginning rados... 2026-02-13T18:05:38.544 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-13T18:05:38.545 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-13T18:05:38.545 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-13T18:05:38.545 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-13T18:05:38.559 INFO:tasks.rados:joining rados 2026-02-13T18:05:38.559 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-13T18:05:38.559 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771005938, revive delay: 90.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-13T18:05:38.560 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:05:38.560 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:05:38.561 INFO:tasks.rados:clients are ['client.0'] 2026-02-13T18:05:38.561 INFO:tasks.rados:starting run 0 out of 1 2026-02-13T18:05:38.561 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-13T18:05:38.561 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-13T18:05:38.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient: monmap: 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.619980+0000 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.619980+0000 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.624 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.625 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.625 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 1 Processor -- start 2026-02-13T18:05:38.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 1 -- start start 2026-02-13T18:05:38.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient: init 2026-02-13T18:05:38.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient(hunting): picked mon.noname-b con 0x7fc6b808e370 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient(hunting): picked mon.noname-c con 0x7fc6b808af50 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient(hunting): picked mon.noname-a con 0x7fc6b808ee50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b808fc10 con 0x7fc6b808ee50 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b8090050 con 0x7fc6b808af50 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b808bdf0 con 0x7fc6b808e370 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bec78640 10 monclient(hunting): authenticate will time out at 569.675351s 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bdc76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fc6b808e370 0x7fc6b808e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58422/0 (socket says 10.20.193.78:58422) 2026-02-13T18:05:38.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.616+0000 7fc6bdc76640 1 -- 10.20.193.78:0/995666195 learned_addr learned my addr 10.20.193.78:0/995666195 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: monmap: 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.622053+0000 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.622053+0000 2026-02-13T18:05:38.629 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 1 Processor -- start 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 1 -- start start 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: init 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient(hunting): picked mon.noname-a con 0x7f80441429f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient(hunting): picked mon.noname-b con 0x7f8044090170 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient(hunting): picked mon.noname-c con 0x7f80441434d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80440566b0 con 0x7f80441429f0 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8044057170 con 0x7f80441434d0 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8044057450 con 0x7f8044090170 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient(hunting): authenticate will time out at 569.677290s 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804903f640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f80441429f0 0x7f8044142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52076/0 (socket says 10.20.193.78:52076) 2026-02-13T18:05:38.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804903f640 1 -- 10.20.193.78:0/3815005323 learned_addr learned my addr 10.20.193.78:0/3815005323 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bdc76640 1 -- 10.20.193.78:0/995666195 >> v1:10.20.193.78:6790/0 conn(0x7fc6b808e370 legacy=0x7fc6b808e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6be477640 1 -- 10.20.193.78:0/995666195 >> v1:10.20.193.78:6789/0 conn(0x7fc6b808ee50 legacy=0x7fc6b81a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571485689 0 0) 0x7fc6b808bdf0 con 0x7fc6b808e370 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): my global_id is 4409 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a0003620 con 0x7fc6b808e370 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297967231 0 0) 0x7fc6b808fc10 con 0x7fc6b808ee50 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient(hunting): my global_id is 4428 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bd475640 1 -- 10.20.193.78:0/995666195 >> v1:10.20.193.187:6789/0 conn(0x7fc6b808af50 legacy=0x7fc6b8181d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6b808bdf0 con 0x7fc6b808ee50 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1724679782 0 0) 0x7fc6a0003620 con 0x7fc6b808e370 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 >> v1:10.20.193.187:6789/0 conn(0x7fc6b808af50 legacy=0x7fc6b8181d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 >> v1:10.20.193.78:6789/0 conn(0x7fc6b808ee50 legacy=0x7fc6b81a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 monclient: found mon.noname-b 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b808c0d0 con 0x7fc6b808e370 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6a8003110 con 0x7fc6b808e370 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 5 monclient: authenticate success, global_id 4409 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: dump: 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.637 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6a80033e0 con 0x7fc6b808e370 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 1 -- 10.20.193.78:0/995666195 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6a8004b50 con 0x7fc6b808e370 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bcc74640 10 monclient: dump: 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 4 set_mon_vals no callback set 2026-02-13T18:05:38.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: shutdown 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- 10.20.193.78:0/995666195 >> v1:10.20.193.78:6790/0 conn(0x7fc6b808e370 legacy=0x7fc6b808e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- 10.20.193.78:0/995666195 shutdown_connections 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- 10.20.193.78:0/995666195 >> 10.20.193.78:0/995666195 conn(0x7fc6b80569b0 msgr2=0x7fc6b8093970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- 10.20.193.78:0/995666195 shutdown_connections 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- 10.20.193.78:0/995666195 wait complete. 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: monmap: 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:38.640 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 Processor -- start 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- start start 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: init 2026-02-13T18:05:38.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient(hunting): picked mon.noname-b con 0x7fc6b808af50 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient(hunting): picked mon.noname-c con 0x7fc6b808e370 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient(hunting): picked mon.noname-a con 0x7fc6b808ee50 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b811ddf0 con 0x7fc6b808ee50 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b811e0d0 con 0x7fc6b808af50 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b8058160 con 0x7fc6b808e370 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bec78640 10 monclient(hunting): authenticate will time out at 569.679405s 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6be477640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc6b808ee50 0x7fc6b81a2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52082/0 (socket says 10.20.193.78:52082) 2026-02-13T18:05:38.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6be477640 1 -- 10.20.193.78:0/1366003297 learned_addr learned my addr 10.20.193.78:0/1366003297 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7fc6bd475640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fc6b808e370 0x7fc6b8057a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58434/0 (socket says 10.20.193.78:58434) 2026-02-13T18:05:38.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804903f640 1 -- 10.20.193.78:0/3815005323 >> v1:10.20.193.78:6789/0 conn(0x7f80441429f0 legacy=0x7f8044142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740418811 0 0) 0x7f80440566b0 con 0x7f80441429f0 2026-02-13T18:05:38.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient(hunting): my global_id is 4431 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f802c003620 con 0x7f80441429f0 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8049840640 1 -- 10.20.193.78:0/3815005323 >> v1:10.20.193.187:6789/0 conn(0x7f80441434d0 legacy=0x7f80441a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1829098695 0 0) 0x7f802c003620 con 0x7f80441429f0 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 >> v1:10.20.193.78:6790/0 conn(0x7f8044090170 legacy=0x7f8044183fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 >> v1:10.20.193.187:6789/0 conn(0x7f80441434d0 legacy=0x7f80441a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 monclient: found mon.noname-a 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80440908b0 con 0x7f80441429f0 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8034003110 con 0x7f80441429f0 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: dump: 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.647 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 5 monclient: authenticate success, global_id 4431 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80340033e0 con 0x7f80441429f0 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 1 -- 10.20.193.78:0/3815005323 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8034004b50 con 0x7f80441429f0 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f8033fff640 10 monclient: dump: 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.648 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.620+0000 7f804b2ca640 4 set_mon_vals no callback set 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient: shutdown 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- 10.20.193.78:0/3815005323 >> v1:10.20.193.78:6789/0 conn(0x7f80441429f0 legacy=0x7f8044142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- 10.20.193.78:0/3815005323 shutdown_connections 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- 10.20.193.78:0/3815005323 >> 10.20.193.78:0/3815005323 conn(0x7f804405e3a0 msgr2=0x7f8044095eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- 10.20.193.78:0/3815005323 shutdown_connections 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- 10.20.193.78:0/3815005323 wait complete. 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient: monmap: 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:38.650 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 Processor -- start 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- start start 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient: init 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient(hunting): picked mon.noname-c con 0x7f8044090170 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient(hunting): picked mon.noname-b con 0x7f80441429f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient(hunting): picked mon.noname-a con 0x7f80441434d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8044142170 con 0x7f80441434d0 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80440590f0 con 0x7f80441429f0 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f804412fff0 con 0x7f8044090170 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804b2ca640 10 monclient(hunting): authenticate will time out at 569.681308s 2026-02-13T18:05:38.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8049840640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 0x7f8044195d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52098/0 (socket says 10.20.193.78:52098) 2026-02-13T18:05:38.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8049840640 1 -- 10.20.193.78:0/4186569331 learned_addr learned my addr 10.20.193.78:0/4186569331 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6be477640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.78:6789/0 conn(0x7fc6b808ee50 legacy=0x7fc6b81a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bd475640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.78:6790/0 conn(0x7fc6b808e370 legacy=0x7fc6b8057a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140345111 0 0) 0x7fc6b8058160 con 0x7fc6b808e370 2026-02-13T18:05:38.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): my global_id is 4412 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc688003620 con 0x7fc6b808e370 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653025408 0 0) 0x7fc6b811ddf0 con 0x7fc6b808ee50 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): my global_id is 4434 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6b8058160 con 0x7fc6b808ee50 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bdc76640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.187:6789/0 conn(0x7fc6b808af50 legacy=0x7fc6b8057340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3215686622 0 0) 0x7fc688003620 con 0x7fc6b808e370 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6b811ddf0 con 0x7fc6b808e370 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6ac003380 con 0x7fc6b808e370 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:38.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): dump: 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2825359958 0 0) 0x7fc6b8058160 con 0x7fc6b808ee50 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc688003620 con 0x7fc6b808ee50 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682198392 0 0) 0x7fc6b811e0d0 con 0x7fc6b808af50 2026-02-13T18:05:38.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): my global_id is 4429 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6b8058160 con 0x7fc6b808af50 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6b40049a0 con 0x7fc6b808ee50 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient(hunting): dump: 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.657 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 762093245 0 0) 0x7fc6b811ddf0 con 0x7fc6b808e370 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.187:6789/0 conn(0x7fc6b808af50 legacy=0x7fc6b8057340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.78:6789/0 conn(0x7fc6b808ee50 legacy=0x7fc6b81a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 monclient: found mon.c 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b811d7b0 con 0x7fc6b808e370 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 5 monclient: authenticate success, global_id 4412 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 monclient: _renew_subs 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b80586b0 con 0x7fc6b808e370 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 monclient: _renew_subs 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6b808a2e0 con 0x7fc6b808e370 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6ac0039c0 con 0x7fc6b808e370 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6ac003d20 con 0x7fc6b808e370 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 10 monclient: dump: 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.659 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a7fff640 4 set_mon_vals no callback set 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b811e410 con 0x7fc6b808e370 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fc6ac003f00 con 0x7fc6b808e370 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7fc6ac04c4e0 con 0x7fc6b808e370 2026-02-13T18:05:38.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7fc6bdc76640 10 monclient: get_auth_request con 0x7fc68803d830 auth_method 0 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8049840640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 legacy=0x7f8044195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960251586 0 0) 0x7f8044142170 con 0x7f80441434d0 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): my global_id is 4437 2026-02-13T18:05:38.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8014003620 con 0x7f80441434d0 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804883e640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.187:6789/0 conn(0x7f80441429f0 legacy=0x7f8044194610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f804903f640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6790/0 conn(0x7f8044090170 legacy=0x7f80441532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3287453898 0 0) 0x7f8014003620 con 0x7f80441434d0 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8044142170 con 0x7f80441434d0 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8040004930 con 0x7f80441434d0 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332097941 0 0) 0x7f80440590f0 con 0x7f80441429f0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 10 monclient(hunting): my global_id is 4432 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8014003620 con 0x7f80441429f0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.624+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3385604725 0 0) 0x7f8044142170 con 0x7f80441434d0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6790/0 conn(0x7f8044090170 legacy=0x7f80441532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.187:6789/0 conn(0x7f80441429f0 legacy=0x7f8044194610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 monclient: found mon.a 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8044131ab0 con 0x7f80441434d0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 5 monclient: authenticate success, global_id 4437 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 monclient: _renew_subs 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8044132350 con 0x7f80441434d0 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 monclient: _renew_subs 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8044130d20 con 0x7f80441434d0 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8040004ed0 con 0x7f80441434d0 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8040005260 con 0x7f80441434d0 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: dump: 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f80337fe640 4 set_mon_vals no callback set 2026-02-13T18:05:38.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8044095010 con 0x7f80441434d0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f80400054f0 con 0x7f80441434d0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7f804004da00 con 0x7f80441434d0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f804903f640 10 monclient: get_auth_request con 0x7f801403d590 auth_method 0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fc6ac017670 con 0x7fc6b808e370 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7fc6a67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7fc6a67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f8044095010 con 0x7f80441434d0 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.628+0000 7f8031ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:38.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.720+0000 7f804b2ca640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T18:05:38.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.720+0000 7f804b2ca640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T18:05:38.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.720+0000 7f804b2ca640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.720+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7f8044051150 con 0x7f80441434d0 2026-02-13T18:05:38.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:05:38.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:38.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc6b8050ff0 con 0x7fc6b808e370 2026-02-13T18:05:38.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6a67fc640 1 -- 10.20.193.78:0/1366003297 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3508151983) 0x7fc6ac016f50 con 0x7fc6b808e370 2026-02-13T18:05:38.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6a67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:38.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6a67fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:38.758 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc68803d830 legacy=0x7fc68805dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 10 monclient: shutdown 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 >> v1:10.20.193.78:6790/0 conn(0x7fc6b808e370 legacy=0x7fc6b8057a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 shutdown_connections 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 >> 10.20.193.78:0/1366003297 conn(0x7fc6b80569b0 msgr2=0x7fc6b8126050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 shutdown_connections 2026-02-13T18:05:38.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.752+0000 7fc6bec78640 1 -- 10.20.193.78:0/1366003297 wait complete. 2026-02-13T18:05:38.769 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:05:38.769 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:05:38.769 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:05:38.770 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:05:38.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.868+0000 7f017c123640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.868+0000 7f017c123640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.868+0000 7f017c123640 10 monclient: monmap: 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.872885+0000 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.872885+0000 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.877 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.868+0000 7f017c123640 1 Processor -- start 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.868+0000 7f017c123640 1 -- start start 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.868+0000 7f017c123640 10 monclient: init 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient(hunting): picked mon.noname-c con 0x7f017408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient(hunting): picked mon.noname-b con 0x7f017408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient(hunting): picked mon.noname-a con 0x7f017408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0174089e80 con 0x7f017408cdd0 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0174088c20 con 0x7f017408c2f0 2026-02-13T18:05:38.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0174089ba0 con 0x7f017408dc80 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient(hunting): authenticate will time out at 569.928288s 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0179697640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f017408dc80 0x7f0174181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58450/0 (socket says 10.20.193.78:58450) 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0179697640 1 -- 10.20.193.78:0/1844902442 learned_addr learned my addr 10.20.193.78:0/1844902442 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017a699640 1 -- 10.20.193.78:0/1844902442 >> v1:10.20.193.78:6789/0 conn(0x7f017408cdd0 legacy=0x7f01741a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0179697640 1 -- 10.20.193.78:0/1844902442 >> v1:10.20.193.78:6790/0 conn(0x7f017408dc80 legacy=0x7f0174181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0179e98640 1 -- 10.20.193.78:0/1844902442 >> v1:10.20.193.187:6789/0 conn(0x7f017408c2f0 legacy=0x7f017408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837412672 0 0) 0x7f0174089ba0 con 0x7f017408dc80 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): my global_id is 4415 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f015c003620 con 0x7f017408dc80 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105197371 0 0) 0x7f0174089e80 con 0x7f017408cdd0 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): my global_id is 4440 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0174089ba0 con 0x7f017408cdd0 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763021206 0 0) 0x7f0174088c20 con 0x7f017408c2f0 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient(hunting): my global_id is 4435 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0174089e80 con 0x7f017408c2f0 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1196145904 0 0) 0x7f015c003620 con 0x7f017408dc80 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 >> v1:10.20.193.187:6789/0 conn(0x7f017408c2f0 legacy=0x7f017408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 >> v1:10.20.193.78:6789/0 conn(0x7f017408cdd0 legacy=0x7f01741a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 monclient: found mon.noname-b 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017408d370 con 0x7f017408dc80 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 5 monclient: authenticate success, global_id 4415 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0168003040 con 0x7f017408dc80 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: dump: 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.887 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0168003310 con 0x7f017408dc80 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 1 -- 10.20.193.78:0/1844902442 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01680049a0 con 0x7f017408dc80 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f0178e96640 10 monclient: dump: 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.888 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 4 set_mon_vals no callback set 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient: shutdown 2026-02-13T18:05:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- 10.20.193.78:0/1844902442 >> v1:10.20.193.78:6790/0 conn(0x7f017408dc80 legacy=0x7f0174181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- 10.20.193.78:0/1844902442 shutdown_connections 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- 10.20.193.78:0/1844902442 >> 10.20.193.78:0/1844902442 conn(0x7f0174091720 msgr2=0x7f0174091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- 10.20.193.78:0/1844902442 shutdown_connections 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 1 -- 10.20.193.78:0/1844902442 wait complete. 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.872+0000 7f017c123640 10 monclient: monmap: 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:38.890 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 Processor -- start 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- start start 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: init 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient(hunting): picked mon.noname-c con 0x7f017408c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient(hunting): picked mon.noname-b con 0x7f017408cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient(hunting): picked mon.noname-a con 0x7f017408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017405dde0 con 0x7f017408dc80 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017407e0b0 con 0x7f017408cdd0 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017407fb70 con 0x7f017408c2f0 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient(hunting): authenticate will time out at 569.932377s 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f0179e98640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f017408c2f0 0x7f01741510e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58456/0 (socket says 10.20.193.78:58456) 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f0179e98640 1 -- 10.20.193.78:0/3424383781 learned_addr learned my addr 10.20.193.78:0/3424383781 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017a699640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f017408dc80 0x7f0174193450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52110/0 (socket says 10.20.193.78:52110) 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017a699640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017408dc80 legacy=0x7f0174193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f0179e98640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6790/0 conn(0x7f017408c2f0 legacy=0x7f01741510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201427930 0 0) 0x7f017405dde0 con 0x7f017408dc80 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): my global_id is 4443 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0144003620 con 0x7f017408dc80 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f0179697640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.187:6789/0 conn(0x7f017408cdd0 legacy=0x7f0174083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494893206 0 0) 0x7f017407fb70 con 0x7f017408c2f0 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): my global_id is 4418 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017405dde0 con 0x7f017408c2f0 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481798649 0 0) 0x7f017407e0b0 con 0x7f017408cdd0 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): my global_id is 4438 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017407fb70 con 0x7f017408cdd0 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 125714596 0 0) 0x7f0144003620 con 0x7f017408dc80 2026-02-13T18:05:38.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f017407e0b0 con 0x7f017408dc80 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0170004900 con 0x7f017408dc80 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): dump: 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.900 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1857761170 0 0) 0x7f017405dde0 con 0x7f017408c2f0 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0144003620 con 0x7f017408c2f0 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f01640033f0 con 0x7f017408c2f0 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient(hunting): dump: 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.901 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1001657764 0 0) 0x7f017407e0b0 con 0x7f017408dc80 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6790/0 conn(0x7f017408c2f0 legacy=0x7f01741510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.187:6789/0 conn(0x7f017408cdd0 legacy=0x7f0174083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 monclient: found mon.a 2026-02-13T18:05:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0174088910 con 0x7f017408dc80 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 5 monclient: authenticate success, global_id 4443 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: _renew_subs 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f017407ec10 con 0x7f017408dc80 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: _renew_subs 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0174084240 con 0x7f017408dc80 2026-02-13T18:05:38.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0170004ed0 con 0x7f017408dc80 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0170005230 con 0x7f017408dc80 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f01627fc640 10 monclient: dump: 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.904 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f0163fff640 4 set_mon_vals no callback set 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.876+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f017408f620 con 0x7f017405aeb0 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f01700053d0 con 0x7f017408dc80 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7f017004d8d0 con 0x7f017408dc80 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f0179697640 10 monclient: get_auth_request con 0x7f014403d5c0 auth_method 0 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f0179e98640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017405aeb0 legacy=0x7f017404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724602723 0 0) 0x7f0144003620 con 0x7f017405aeb0 2026-02-13T18:05:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient(hunting): my global_id is 4446 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017407e0b0 con 0x7f017405aeb0 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3471833209 0 0) 0x7f017407e0b0 con 0x7f017405aeb0 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0144003620 con 0x7f017405aeb0 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0164003b80 con 0x7f017405aeb0 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient: dump: 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.906 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2040154807 0 0) 0x7f0144003620 con 0x7f017405aeb0 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0174090810 con 0x7f017405aeb0 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f01640058c0 con 0x7f017405aeb0 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017405aeb0 legacy=0x7f017404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.880+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017405aeb0 legacy=0x7f017404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.884+0000 7f017c123640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.884+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f01740510e0 con 0x7f017405b280 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f0179e98640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017405b280 legacy=0x7f0174195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359773538 0 0) 0x7f01740510e0 con 0x7f017405b280 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient(hunting): my global_id is 4449 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0144003620 con 0x7f017405b280 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3299461226 0 0) 0x7f0144003620 con 0x7f017405b280 2026-02-13T18:05:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01740510e0 con 0x7f017405b280 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0164004210 con 0x7f017405b280 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient: dump: 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2428073057 0 0) 0x7f01740510e0 con 0x7f017405b280 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f017404d910 con 0x7f017405b280 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4509 (unknown 0 0 334762882) 0x7f0164005a70 con 0x7f017405b280 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017405b280 legacy=0x7f0174195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f01627fc640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017405b280 legacy=0x7f0174195b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:38.910 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 4, 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 20291, 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 19, 2026-02-13T18:05:38.911 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:38.912 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:38.913 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:05:38.914 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:38.915 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:05:38.916 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:38.917 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:38.918 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.919 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:05:38.920 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:05:38.921 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:05:38.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.187:6812/2668687789 conn(0x7f014403d5c0 legacy=0x7f014405da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 10 monclient: shutdown 2026-02-13T18:05:38.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:38.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 >> v1:10.20.193.78:6789/0 conn(0x7f017408dc80 legacy=0x7f0174193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:38.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017a699640 1 -- 10.20.193.78:0/3424383781 reap_dead start 2026-02-13T18:05:38.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017a699640 1 -- 10.20.193.78:0/3424383781 reap_dead start 2026-02-13T18:05:38.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 shutdown_connections 2026-02-13T18:05:38.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 >> 10.20.193.78:0/3424383781 conn(0x7f0174091720 msgr2=0x7f017408ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:38.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 shutdown_connections 2026-02-13T18:05:38.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.888+0000 7f017c123640 1 -- 10.20.193.78:0/3424383781 wait complete. 2026-02-13T18:05:38.923 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:05:38.923 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:05:38.923 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient: get_monmap_and_config 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient: build_initial_monmap 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient: monmap: 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:38.991770+0000 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:38.991770+0000 2026-02-13T18:05:38.995 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:38.996 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:38.996 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:38.996 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:38.996 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 1 Processor -- start 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 1 -- start start 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient: init 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient(hunting): picked mon.noname-c con 0x7fa2f808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient(hunting): picked mon.noname-b con 0x7fa2f808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient(hunting): picked mon.noname-a con 0x7fa2f808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f8089e80 con 0x7fa2f808cdd0 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f8088c20 con 0x7fa2f808c2f0 2026-02-13T18:05:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f8089ba0 con 0x7fa2f808dc80 2026-02-13T18:05:38.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:38.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2ff0b5640 10 monclient(hunting): authenticate will time out at 570.046950s 2026-02-13T18:05:38.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2effff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa2f808dc80 0x7fa2f8181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58466/0 (socket says 10.20.193.78:58466) 2026-02-13T18:05:38.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.988+0000 7fa2effff640 1 -- 10.20.193.78:0/2931559499 learned_addr learned my addr 10.20.193.78:0/2931559499 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:39.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2effff640 1 -- 10.20.193.78:0/2931559499 >> v1:10.20.193.78:6790/0 conn(0x7fa2f808dc80 legacy=0x7fa2f8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2fd62b640 1 -- 10.20.193.78:0/2931559499 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808cdd0 legacy=0x7fa2f81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2fce2a640 1 -- 10.20.193.78:0/2931559499 >> v1:10.20.193.187:6789/0 conn(0x7fa2f808c2f0 legacy=0x7fa2f808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124657177 0 0) 0x7fa2f8089ba0 con 0x7fa2f808dc80 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): my global_id is 4421 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e4003620 con 0x7fa2f808dc80 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019336900 0 0) 0x7fa2f8089e80 con 0x7fa2f808cdd0 2026-02-13T18:05:39.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): my global_id is 4452 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f8089ba0 con 0x7fa2f808cdd0 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864372613 0 0) 0x7fa2f8088c20 con 0x7fa2f808c2f0 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient(hunting): my global_id is 4441 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f8089e80 con 0x7fa2f808c2f0 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2144050903 0 0) 0x7fa2e4003620 con 0x7fa2f808dc80 2026-02-13T18:05:39.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 >> v1:10.20.193.187:6789/0 conn(0x7fa2f808c2f0 legacy=0x7fa2f808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808cdd0 legacy=0x7fa2f81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 monclient: found mon.noname-b 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f808d370 con 0x7fa2f808dc80 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 5 monclient: authenticate success, global_id 4421 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa2e0003110 con 0x7fa2f808dc80 2026-02-13T18:05:39.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: dump: 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.005 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2e00033e0 con 0x7fa2f808dc80 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 1 -- 10.20.193.78:0/2931559499 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa2e0004b50 con 0x7fa2f808dc80 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ef7fe640 10 monclient: dump: 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.006 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 4 set_mon_vals no callback set 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: shutdown 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/2931559499 >> v1:10.20.193.78:6790/0 conn(0x7fa2f808dc80 legacy=0x7fa2f8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/2931559499 shutdown_connections 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/2931559499 >> 10.20.193.78:0/2931559499 conn(0x7fa2f8091720 msgr2=0x7fa2f8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:39.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/2931559499 shutdown_connections 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/2931559499 wait complete. 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: build_initial_monmap 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: monmap: 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:39.008 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 Processor -- start 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- start start 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: init 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient(hunting): picked mon.noname-b con 0x7fa2f808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient(hunting): picked mon.noname-c con 0x7fa2f808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient(hunting): picked mon.noname-a con 0x7fa2f808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f8082370 con 0x7fa2f808dc80 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f805de60 con 0x7fa2f808c2f0 2026-02-13T18:05:39.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f8153f60 con 0x7fa2f808cdd0 2026-02-13T18:05:39.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2ff0b5640 10 monclient(hunting): authenticate will time out at 570.050891s 2026-02-13T18:05:39.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2effff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa2f808cdd0 0x7fa2f81943d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58472/0 (socket says 10.20.193.78:58472) 2026-02-13T18:05:39.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.992+0000 7fa2effff640 1 -- 10.20.193.78:0/1129787674 learned_addr learned my addr 10.20.193.78:0/1129787674 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:39.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2effff640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f808cdd0 legacy=0x7fa2f81943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fd62b640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808dc80 legacy=0x7fa2f8195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fd62b640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808dc80 legacy=0x7fa2f8195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T18:05:39.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fd62b640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808dc80 legacy=0x7fa2f8195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fd62b640 1 --1- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808dc80 0x7fa2f8195af0 :-1 s=OPENED pgs=154 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fd62b640 1 --1- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808dc80 0x7fa2f8195af0 :-1 s=OPENED pgs=154 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6789/0 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801311057 0 0) 0x7fa2f8153f60 con 0x7fa2f808cdd0 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): my global_id is 4424 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c8003620 con 0x7fa2f808cdd0 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fce2a640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.187:6789/0 conn(0x7fa2f808c2f0 legacy=0x7fa2f80838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 808799666 0 0) 0x7fa2c8003620 con 0x7fa2f808cdd0 2026-02-13T18:05:39.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2f8153f60 con 0x7fa2f808cdd0 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa2e00048e0 con 0x7fa2f808cdd0 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): dump: 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289785907 0 0) 0x7fa2f805de60 con 0x7fa2f808c2f0 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient(hunting): my global_id is 4444 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c8003620 con 0x7fa2f808c2f0 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2621724050 0 0) 0x7fa2f8153f60 con 0x7fa2f808cdd0 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.187:6789/0 conn(0x7fa2f808c2f0 legacy=0x7fa2f80838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6789/0 conn(0x7fa2f808dc80 legacy=0x7fa2f8195af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 monclient: found mon.c 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f8080010 con 0x7fa2f808cdd0 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 5 monclient: authenticate success, global_id 4424 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 10 monclient: _renew_subs 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f8082090 con 0x7fa2f808cdd0 2026-02-13T18:05:39.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 10 monclient: _renew_subs 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2f8083fb0 con 0x7fa2f808cdd0 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2e00033c0 con 0x7fa2f808cdd0 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa2e0004b50 con 0x7fa2f808cdd0 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 10 monclient: dump: 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.020 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2eeffd640 4 set_mon_vals no callback set 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2f808f620 con 0x7fa2f8153070 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa2e0011810 con 0x7fa2f808cdd0 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7fa2e004c560 con 0x7fa2f808cdd0 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:38.996+0000 7fa2fd62b640 10 monclient: get_auth_request con 0x7fa2c803d520 auth_method 0 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2fce2a640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f8153070 legacy=0x7fa2f807a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502333796 0 0) 0x7fa2c8003620 con 0x7fa2f8153070 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient(hunting): my global_id is 4427 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f8153f60 con 0x7fa2f8153070 2026-02-13T18:05:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2065533584 0 0) 0x7fa2f8153f60 con 0x7fa2f8153070 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2c8003620 con 0x7fa2f8153070 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa2e8003230 con 0x7fa2f8153070 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient: dump: 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.023 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1919872730 0 0) 0x7fa2c8003620 con 0x7fa2f8153070 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2f8090810 con 0x7fa2f8153070 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa2e80058c0 con 0x7fa2f8153070 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f8153070 legacy=0x7fa2f807a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.000+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f8153070 legacy=0x7fa2f807a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:05:39.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2f80510e0 con 0x7fa2f807aae0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2fce2a640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f807aae0 legacy=0x7fa2f8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729618258 0 0) 0x7fa2f80510e0 con 0x7fa2f807aae0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient(hunting): my global_id is 4430 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c8003620 con 0x7fa2f807aae0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3275198644 0 0) 0x7fa2c8003620 con 0x7fa2f807aae0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2f80510e0 con 0x7fa2f807aae0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa2e8003ae0 con 0x7fa2f807aae0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient: dump: 2026-02-13T18:05:39.025 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3300274096 0 0) 0x7fa2f80510e0 con 0x7fa2f807aae0 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2f8153440 con 0x7fa2f807aae0 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 3572083225) 0x7fa2e8005a70 con 0x7fa2f807aae0 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:05:39.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f807aae0 legacy=0x7fa2f8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ed7fa640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f807aae0 legacy=0x7fa2f8198220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 4, 2026-02-13T18:05:39.027 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 20395, 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 19, 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:39.028 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:39.029 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:05:39.030 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:39.031 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.032 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:39.033 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:05:39.034 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:05:39.035 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.036 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:05:39.037 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:05:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa2c803d520 legacy=0x7fa2c805d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 10 monclient: shutdown 2026-02-13T18:05:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 >> v1:10.20.193.78:6790/0 conn(0x7fa2f808cdd0 legacy=0x7fa2f81943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2fd62b640 1 -- 10.20.193.78:0/1129787674 reap_dead start 2026-02-13T18:05:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2fd62b640 1 -- 10.20.193.78:0/1129787674 reap_dead start 2026-02-13T18:05:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 shutdown_connections 2026-02-13T18:05:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 >> 10.20.193.78:0/1129787674 conn(0x7fa2f8091720 msgr2=0x7fa2f805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 shutdown_connections 2026-02-13T18:05:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.004+0000 7fa2ff0b5640 1 -- 10.20.193.78:0/1129787674 wait complete. 2026-02-13T18:05:39.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:05:39.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:05:39.039 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:05:39.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.100+0000 7f8453a64640 10 monclient: get_monmap_and_config 2026-02-13T18:05:39.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.100+0000 7f8453a64640 10 monclient: build_initial_monmap 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.100+0000 7f8453a64640 10 monclient: monmap: 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:39.105162+0000 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:39.105162+0000 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:39.109 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.100+0000 7f8453a64640 1 Processor -- start 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- start start 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient: init 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient(hunting): picked mon.noname-c con 0x7f844c084930 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient(hunting): picked mon.noname-b con 0x7f844c08d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient(hunting): picked mon.noname-a con 0x7f844c1831f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c08da30 con 0x7f844c1831f0 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c089e60 con 0x7f844c084930 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c085410 con 0x7f844c08d5f0 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient(hunting): authenticate will time out at 570.160522s 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8450fd8640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f844c08d5f0 0x7f844c181ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58500/0 (socket says 10.20.193.78:58500) 2026-02-13T18:05:39.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8450fd8640 1 -- 10.20.193.78:0/1441454346 learned_addr learned my addr 10.20.193.78:0/1441454346 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:39.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8451fda640 1 -- 10.20.193.78:0/1441454346 >> v1:10.20.193.78:6789/0 conn(0x7f844c1831f0 legacy=0x7f844c1a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8450fd8640 1 -- 10.20.193.78:0/1441454346 >> v1:10.20.193.78:6790/0 conn(0x7f844c08d5f0 legacy=0x7f844c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f84517d9640 1 -- 10.20.193.78:0/1441454346 >> v1:10.20.193.187:6789/0 conn(0x7f844c084930 legacy=0x7f844c084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801464565 0 0) 0x7f84480041c0 con 0x7f844c1831f0 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): my global_id is 4458 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8434003620 con 0x7f844c1831f0 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2748531388 0 0) 0x7f844c085410 con 0x7f844c08d5f0 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): my global_id is 4433 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84480041c0 con 0x7f844c08d5f0 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650529422 0 0) 0x7f844c089e60 con 0x7f844c084930 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient(hunting): my global_id is 4447 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c085410 con 0x7f844c084930 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 233011165 0 0) 0x7f8434003620 con 0x7f844c1831f0 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 >> v1:10.20.193.78:6790/0 conn(0x7f844c08d5f0 legacy=0x7f844c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 >> v1:10.20.193.187:6789/0 conn(0x7f844c084930 legacy=0x7f844c084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 monclient: found mon.noname-a 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c089b80 con 0x7f844c1831f0 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8448004840 con 0x7f844c1831f0 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: dump: 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.122 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 5 monclient: authenticate success, global_id 4458 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8448004c20 con 0x7f844c1831f0 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 1 -- 10.20.193.78:0/1441454346 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8448004fb0 con 0x7f844c1831f0 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f843bfff640 10 monclient: dump: 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.123 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 4 set_mon_vals no callback set 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 10 monclient: shutdown 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- 10.20.193.78:0/1441454346 >> v1:10.20.193.78:6789/0 conn(0x7f844c1831f0 legacy=0x7f844c1a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- 10.20.193.78:0/1441454346 shutdown_connections 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- 10.20.193.78:0/1441454346 >> 10.20.193.78:0/1441454346 conn(0x7f844c091720 msgr2=0x7f844c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- 10.20.193.78:0/1441454346 shutdown_connections 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.104+0000 7f8453a64640 1 -- 10.20.193.78:0/1441454346 wait complete. 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: build_initial_monmap 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: monmap: 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:39.125 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 Processor -- start 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 -- start start 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: init 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient(hunting): picked mon.noname-b con 0x7f844c084930 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient(hunting): picked mon.noname-c con 0x7f844c08d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient(hunting): picked mon.noname-a con 0x7f844c1831f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c07ea80 con 0x7f844c1831f0 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c07ed60 con 0x7f844c084930 2026-02-13T18:05:39.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844c082b70 con 0x7f844c08d5f0 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient(hunting): authenticate will time out at 570.165055s 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8450fd8640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f844c08d5f0 0x7f844c172e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58504/0 (socket says 10.20.193.78:58504) 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8450fd8640 1 -- 10.20.193.78:0/2635182255 learned_addr learned my addr 10.20.193.78:0/2635182255 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8450fd8640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.78:6790/0 conn(0x7f844c08d5f0 legacy=0x7f844c172e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8451fda640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.78:6789/0 conn(0x7f844c1831f0 legacy=0x7f844c174520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f84517d9640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c084930 legacy=0x7f844c131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652196823 0 0) 0x7f844c082b70 con 0x7f844c08d5f0 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): my global_id is 4436 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f841c003620 con 0x7f844c08d5f0 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954643807 0 0) 0x7f844c07ea80 con 0x7f844c1831f0 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): my global_id is 4461 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c082b70 con 0x7f844c1831f0 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044043444 0 0) 0x7f844c07ed60 con 0x7f844c084930 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): my global_id is 4450 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c07ea80 con 0x7f844c084930 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3375127682 0 0) 0x7f841c003620 con 0x7f844c08d5f0 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f844c07ed60 con 0x7f844c08d5f0 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8440003400 con 0x7f844c08d5f0 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.129 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2050775878 0 0) 0x7f844c082b70 con 0x7f844c1831f0 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f841c003620 con 0x7f844c1831f0 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8448004a60 con 0x7f844c1831f0 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient(hunting): dump: 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.130 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 744087352 0 0) 0x7f844c07ed60 con 0x7f844c08d5f0 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c084930 legacy=0x7f844c131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.78:6789/0 conn(0x7f844c1831f0 legacy=0x7f844c174520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 monclient: found mon.c 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c05dcd0 con 0x7f844c08d5f0 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 5 monclient: authenticate success, global_id 4436 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: _renew_subs 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f844c088910 con 0x7f844c08d5f0 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: _renew_subs 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f844c0863c0 con 0x7f844c08d5f0 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8440004b90 con 0x7f844c08d5f0 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8440004f20 con 0x7f844c08d5f0 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f8439ffb640 10 monclient: dump: 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.133 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.108+0000 7f843b7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8453a64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f844c0389c0 con 0x7f844c05c9e0 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f8440005170 con 0x7f844c08d5f0 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7f844004c570 con 0x7f844c08d5f0 2026-02-13T18:05:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8451fda640 10 monclient: get_auth_request con 0x7f841c03d550 auth_method 0 2026-02-13T18:05:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f84517d9640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c05c9e0 legacy=0x7f844c058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509855131 0 0) 0x7f844c0389c0 con 0x7f844c05c9e0 2026-02-13T18:05:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient(hunting): my global_id is 4453 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c07ed60 con 0x7f844c05c9e0 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3652730551 0 0) 0x7f844c07ed60 con 0x7f844c05c9e0 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f844c0389c0 con 0x7f844c05c9e0 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f843c003ae0 con 0x7f844c05c9e0 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient: dump: 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4017617789 0 0) 0x7f844c0389c0 con 0x7f844c05c9e0 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f844c08f620 con 0x7f844c05c9e0 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f843c0058c0 con 0x7f844c05c9e0 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c05c9e0 legacy=0x7f844c058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.112+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c05c9e0 legacy=0x7f844c058010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.116+0000 7f8453a64640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.116+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f844c090810 con 0x7f844c132300 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f84517d9640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c132300 legacy=0x7f844c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210352994 0 0) 0x7f844c090810 con 0x7f844c132300 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient(hunting): my global_id is 4456 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c0389c0 con 0x7f844c132300 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 655592985 0 0) 0x7f844c0389c0 con 0x7f844c132300 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f844c090810 con 0x7f844c132300 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f843c004200 con 0x7f844c132300 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient: dump: 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2899822070 0 0) 0x7f844c090810 con 0x7f844c132300 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f844c0510e0 con 0x7f844c132300 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 2842875555) 0x7f843c004530 con 0x7f844c132300 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:05:39.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c132300 legacy=0x7f844c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8439ffb640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6789/0 conn(0x7f844c132300 legacy=0x7f844c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 4, 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 20483, 2026-02-13T18:05:39.142 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 19, 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:39.143 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:39.144 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:39.145 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:39.146 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:39.147 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.148 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:39.149 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.150 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:05:39.151 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:05:39.152 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.187:6812/2668687789 conn(0x7f841c03d550 legacy=0x7f841c05da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 10 monclient: shutdown 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 >> v1:10.20.193.78:6790/0 conn(0x7f844c08d5f0 legacy=0x7f844c172e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8451fda640 1 -- 10.20.193.78:0/2635182255 reap_dead start 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 shutdown_connections 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 >> 10.20.193.78:0/2635182255 conn(0x7f844c091720 msgr2=0x7f844c1a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 shutdown_connections 2026-02-13T18:05:39.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.120+0000 7f8453a64640 1 -- 10.20.193.78:0/2635182255 wait complete. 2026-02-13T18:05:39.154 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:05:39.154 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T18:05:39.154 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:05:39.154 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T18:05:39.154 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T18:05:39.154 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T18:05:39.154 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8049840640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 legacy=0x7f8044195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8049840640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 legacy=0x7f8044195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8049840640 1 --1- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 0x7f8044195d30 :-1 s=OPENED pgs=148 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8049840640 1 --1- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 0x7f8044195d30 :-1 s=OPENED pgs=148 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient: ms_handle_reset current mon v1:10.20.193.78:6789/0 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80441434d0 legacy=0x7f8044195d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient(hunting): picked mon.b con 0x7f80441429f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient(hunting): picked mon.c con 0x7f8044090170 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient(hunting): picked mon.a con 0x7f80140a53c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8044142170 con 0x7f80140a53c0 2026-02-13T18:05:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80440590f0 con 0x7f80441429f0 2026-02-13T18:05:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80140c9500 con 0x7f8044090170 2026-02-13T18:05:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f804903f640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80140a53c0 legacy=0x7f80140c5840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.152+0000 7f8031ffb640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8049840640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6790/0 conn(0x7f8044090170 legacy=0x7f80140a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f804883e640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.187:6789/0 conn(0x7f80441429f0 legacy=0x7f8014081ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59775019 0 0) 0x7f80140c9500 con 0x7f8044090170 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f80140c84d0 con 0x7f8044090170 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681449564 0 0) 0x7f80440590f0 con 0x7f80441429f0 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.187:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f80140c9500 con 0x7f80441429f0 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2796344251 0 0) 0x7f80140c84d0 con 0x7f8044090170 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.187:6789/0 conn(0x7f80441429f0 legacy=0x7f8014081ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6789/0 conn(0x7f80140a53c0 legacy=0x7f80140c5840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 monclient: found mon.c 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f80140ca7a0 con 0x7f8044090170 2026-02-13T18:05:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7f8044142170 con 0x7f8044090170 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8040017bf0 con 0x7f8044090170 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: dump: 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80400203d0 con 0x7f8044090170 2026-02-13T18:05:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f80337fe640 4 set_mon_vals no callback set 2026-02-13T18:05:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.156+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f804004b590 con 0x7f8044090170 2026-02-13T18:05:39.166 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T18:05:39.166 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:05:39.166 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient: get_monmap_and_config 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient: build_initial_monmap 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient: monmap: 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:39.264394+0000 2026-02-13T18:05:39.268 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:39.264394+0000 2026-02-13T18:05:39.269 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:39.269 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.269 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:39.269 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:39.269 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:39.269 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 1 Processor -- start 2026-02-13T18:05:39.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 1 -- start start 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient: init 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient(hunting): picked mon.noname-c con 0x7f1eb808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient(hunting): picked mon.noname-a con 0x7f1eb808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient(hunting): picked mon.noname-b con 0x7f1eb808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb8089e80 con 0x7f1eb808dc80 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb8088c20 con 0x7f1eb808c2f0 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb8089ba0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1ebdbd2640 10 monclient(hunting): authenticate will time out at 570.319716s 2026-02-13T18:05:39.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1eb6ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f1eb808dc80 legacy=0x7f1eb8181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1eb7fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 0x7f1eb81a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58536/0 (socket says 10.20.193.78:58536) 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.260+0000 7f1eb7fff640 1 -- 10.20.193.78:0/518011307 learned_addr learned my addr 10.20.193.78:0/518011307 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb7fff640 1 -- 10.20.193.78:0/518011307 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 legacy=0x7f1eb81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb77fe640 1 -- 10.20.193.78:0/518011307 >> v1:10.20.193.187:6789/0 conn(0x7f1eb808c2f0 legacy=0x7f1eb808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377775405 0 0) 0x7f1eb8089ba0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): my global_id is 4439 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e9c003620 con 0x7f1eb808cdd0 2026-02-13T18:05:39.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491290225 0 0) 0x7f1eb8088c20 con 0x7f1eb808c2f0 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient(hunting): my global_id is 4459 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eb8089ba0 con 0x7f1eb808c2f0 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3304273573 0 0) 0x7f1e9c003620 con 0x7f1eb808cdd0 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 >> v1:10.20.193.187:6789/0 conn(0x7f1eb808c2f0 legacy=0x7f1eb808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 >> v1:10.20.193.78:6789/0 conn(0x7f1eb808dc80 legacy=0x7f1eb8181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 monclient: found mon.noname-b 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb808d370 con 0x7f1eb808cdd0 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1eac004620 con 0x7f1eb808cdd0 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: dump: 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.278 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 5 monclient: authenticate success, global_id 4439 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1eac0048f0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 1 -- 10.20.193.78:0/518011307 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1eac006060 con 0x7f1eb808cdd0 2026-02-13T18:05:39.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1eb67fc640 10 monclient: dump: 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.280 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 4 set_mon_vals no callback set 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 10 monclient: shutdown 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/518011307 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 legacy=0x7f1eb81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/518011307 shutdown_connections 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/518011307 >> 10.20.193.78:0/518011307 conn(0x7f1eb8091720 msgr2=0x7f1eb8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/518011307 shutdown_connections 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/518011307 wait complete. 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 10 monclient: build_initial_monmap 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 10 monclient: monmap: 2026-02-13T18:05:39.281 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 Processor -- start 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 1 -- start start 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.264+0000 7f1ebdbd2640 10 monclient: init 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient(hunting): picked mon.noname-a con 0x7f1eb808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient(hunting): picked mon.noname-c con 0x7f1eb808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1eb77fe640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f1eb808c2f0 legacy=0x7f1eb8152eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient(hunting): picked mon.noname-b con 0x7f1eb808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb8081ff0 con 0x7f1eb808c2f0 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb8080e80 con 0x7f1eb808dc80 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb80822d0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient(hunting): authenticate will time out at 570.324340s 2026-02-13T18:05:39.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1eb6ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 0x7f1eb80837e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:58550/0 (socket says 10.20.193.78:58550) 2026-02-13T18:05:39.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1eb6ffd640 1 -- 10.20.193.78:0/3706465238 learned_addr learned my addr 10.20.193.78:0/3706465238 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:39.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1eb6ffd640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 legacy=0x7f1eb80837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904866040 0 0) 0x7f1eb80822d0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): my global_id is 4442 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e88003620 con 0x7f1eb808cdd0 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1eb7fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.187:6789/0 conn(0x7f1eb808dc80 legacy=0x7f1eb8195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3937593908 0 0) 0x7f1e88003620 con 0x7f1eb808cdd0 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1eb80822d0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1ea80045c0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): dump: 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.291 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592003833 0 0) 0x7f1eb8080e80 con 0x7f1eb808dc80 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient(hunting): my global_id is 4462 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e88003620 con 0x7f1eb808dc80 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3490672052 0 0) 0x7f1eb80822d0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.187:6789/0 conn(0x7f1eb808dc80 legacy=0x7f1eb8195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6789/0 conn(0x7f1eb808c2f0 legacy=0x7f1eb8152eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 monclient: found mon.c 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb8081d10 con 0x7f1eb808cdd0 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 5 monclient: authenticate success, global_id 4442 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _renew_subs 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb8083ef0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _renew_subs 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1eb8196b30 con 0x7f1eb808cdd0 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ea8004890 con 0x7f1eb808cdd0 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1ea8004bf0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1eb5ffb640 4 set_mon_vals no callback set 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1e93fff640 10 monclient: dump: 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.294 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.268+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb808f620 con 0x7f1eb808cdd0 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb6ffd640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 legacy=0x7f1eb80837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T18:05:39.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb6ffd640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 legacy=0x7f1eb80837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb6ffd640 1 --1- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 0x7f1eb80837e0 :-1 s=OPENED pgs=152 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb6ffd640 1 --1- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 0x7f1eb80837e0 :-1 s=OPENED pgs=152 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: ms_handle_reset current mon v1:10.20.193.78:6790/0 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1eb808cdd0 legacy=0x7f1eb80837e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): picked mon.a con 0x7f1eb808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): picked mon.c con 0x7f1e880052b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): picked mon.b con 0x7f1eb808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb77fe640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6789/0 conn(0x7f1eb808c2f0 legacy=0x7f1e88004910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1eb80822d0 con 0x7f1eb808c2f0 2026-02-13T18:05:39.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1eb8081ff0 con 0x7f1eb808dc80 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1eb8080e80 con 0x7f1e880052b0 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1ea8004ec0 con 0x7f1eb808cdd0 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb77fe640 10 monclient(hunting): get_auth_request con 0x7f1e880a6340 auth_method 0 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb6ffd640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1e880052b0 legacy=0x7f1e88046a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb7fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.187:6789/0 conn(0x7f1eb808dc80 legacy=0x7f1e88068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096980582 0 0) 0x7f1eb8080e80 con 0x7f1e880052b0 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f1e8806b110 con 0x7f1e880052b0 2026-02-13T18:05:39.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901387197 0 0) 0x7f1eb8081ff0 con 0x7f1eb808dc80 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.187:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f1eb8080e80 con 0x7f1eb808dc80 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2950931012 0 0) 0x7f1e8806b110 con 0x7f1e880052b0 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.187:6789/0 conn(0x7f1eb808dc80 legacy=0x7f1e88068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6789/0 conn(0x7f1eb808c2f0 legacy=0x7f1e88004910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 monclient: found mon.c 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f1e8806d3e0 con 0x7f1e880052b0 2026-02-13T18:05:39.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb80822d0 con 0x7f1e880052b0 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _finish_auth 0 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1ea80055c0 con 0x7f1e880052b0 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: dump: 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:39.299 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ea8017780 con 0x7f1e880052b0 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1eb57fa640 4 set_mon_vals no callback set 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1ea80130e0 con 0x7f1e880052b0 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.272+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 6 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7f1ea804ed60 con 0x7f1e880052b0 2026-02-13T18:05:39.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.276+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f1eb808f620 con 0x7f1e880052b0 2026-02-13T18:05:39.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.276+0000 7f1e93fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:39.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.276+0000 7f1e93fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1eb8087190 con 0x7f1e880052b0 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1e93fff640 1 -- 10.20.193.78:0/3706465238 <== mon.2 v1:10.20.193.78:6790/0 8 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3508151983) 0x7f1ea801f020 con 0x7f1e880052b0 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1e93fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:39.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1e93fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:39.404 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1e880a6340 legacy=0x7f1e880c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 10 monclient: shutdown 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 >> v1:10.20.193.78:6790/0 conn(0x7f1e880052b0 legacy=0x7f1e88046a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 shutdown_connections 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 >> 10.20.193.78:0/3706465238 conn(0x7f1eb8091720 msgr2=0x7f1eb8058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 shutdown_connections 2026-02-13T18:05:39.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:39.396+0000 7f1ebdbd2640 1 -- 10.20.193.78:0/3706465238 wait complete. 2026-02-13T18:05:41.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:41.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:41.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:41.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:41.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:41.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:41.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:41.623+0000 7f8030ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:42.416 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:05:42.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient: get_monmap_and_config 2026-02-13T18:05:42.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient: build_initial_monmap 2026-02-13T18:05:42.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient: monmap: 2026-02-13T18:05:42.488 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:42.488 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:42.488 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:42.483197+0000 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:42.483197+0000 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 1 Processor -- start 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 1 -- start start 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient: init 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:42.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient(hunting): picked mon.noname-b con 0x7f66dc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient(hunting): picked mon.noname-c con 0x7f66dc08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient(hunting): picked mon.noname-a con 0x7f66dc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc089e80 con 0x7f66dc08cdd0 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc088c20 con 0x7f66dc08dc80 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc089ba0 con 0x7f66dc08c2f0 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e2f7c640 10 monclient(hunting): authenticate will time out at 573.538318s 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e14f2640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f66dc08cdd0 legacy=0x7f66dc1a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e0cf1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f66dc08c2f0 0x7f66dc08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52910/0 (socket says 10.20.193.78:52910) 2026-02-13T18:05:42.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.479+0000 7f66e0cf1640 1 -- 10.20.193.78:0/500935142 learned_addr learned my addr 10.20.193.78:0/500935142 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:42.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e0cf1640 1 -- 10.20.193.78:0/500935142 >> v1:10.20.193.78:6790/0 conn(0x7f66dc08c2f0 legacy=0x7f66dc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351581457 0 0) 0x7f66dc089ba0 con 0x7f66dc08c2f0 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient(hunting): my global_id is 4445 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c8003620 con 0x7f66dc08c2f0 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d3fff640 1 -- 10.20.193.78:0/500935142 >> v1:10.20.193.187:6789/0 conn(0x7f66dc08dc80 legacy=0x7f66dc181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1854441528 0 0) 0x7f66c8003620 con 0x7f66dc08c2f0 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 >> v1:10.20.193.187:6789/0 conn(0x7f66dc08dc80 legacy=0x7f66dc181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 >> v1:10.20.193.78:6789/0 conn(0x7f66dc08cdd0 legacy=0x7f66dc1a3410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:42.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 monclient: found mon.noname-b 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc08d370 con 0x7f66dc08c2f0 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f66cc003110 con 0x7f66dc08c2f0 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:42.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: dump: 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 5 monclient: authenticate success, global_id 4445 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66cc0033e0 con 0x7f66dc08c2f0 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 1 -- 10.20.193.78:0/500935142 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f66cc004b50 con 0x7f66dc08c2f0 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d37fe640 10 monclient: dump: 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.500 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 4 set_mon_vals no callback set 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: shutdown 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- 10.20.193.78:0/500935142 >> v1:10.20.193.78:6790/0 conn(0x7f66dc08c2f0 legacy=0x7f66dc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:42.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- 10.20.193.78:0/500935142 shutdown_connections 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- 10.20.193.78:0/500935142 >> 10.20.193.78:0/500935142 conn(0x7f66dc091720 msgr2=0x7f66dc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- 10.20.193.78:0/500935142 shutdown_connections 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- 10.20.193.78:0/500935142 wait complete. 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: build_initial_monmap 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: monmap: 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:42.502 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 Processor -- start 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- start start 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: init 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient(hunting): picked mon.noname-c con 0x7f66dc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient(hunting): picked mon.noname-a con 0x7f66dc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient(hunting): picked mon.noname-b con 0x7f66dc08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc07f7b0 con 0x7f66dc08cdd0 2026-02-13T18:05:42.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc057910 con 0x7f66dc08dc80 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc088910 con 0x7f66dc08c2f0 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66d3fff640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f66dc08cdd0 legacy=0x7f66dc192080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e2f7c640 10 monclient(hunting): authenticate will time out at 573.542899s 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e0cf1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f66dc08c2f0 0x7f66dc151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52912/0 (socket says 10.20.193.78:52912) 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.483+0000 7f66e0cf1640 1 -- 10.20.193.78:0/3861325647 learned_addr learned my addr 10.20.193.78:0/3861325647 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e0cf1640 1 -- 10.20.193.78:0/3861325647 >> v1:10.20.193.78:6790/0 conn(0x7f66dc08c2f0 legacy=0x7f66dc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e14f2640 1 -- 10.20.193.78:0/3861325647 >> v1:10.20.193.187:6789/0 conn(0x7f66dc08dc80 legacy=0x7f66dc1937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866851842 0 0) 0x7f66dc088910 con 0x7f66dc08c2f0 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:42.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): my global_id is 4448 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ac003620 con 0x7f66dc08c2f0 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543001392 0 0) 0x7f66dc057910 con 0x7f66dc08dc80 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): my global_id is 4468 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66dc088910 con 0x7f66dc08dc80 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3950982387 0 0) 0x7f66ac003620 con 0x7f66dc08c2f0 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66dc057910 con 0x7f66dc08c2f0 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f66cc0048e0 con 0x7f66dc08c2f0 2026-02-13T18:05:42.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): dump: 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:42.506 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4101994080 0 0) 0x7f66dc088910 con 0x7f66dc08dc80 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66ac003620 con 0x7f66dc08dc80 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f66d8005870 con 0x7f66dc08dc80 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient(hunting): dump: 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.507 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3934938469 0 0) 0x7f66dc057910 con 0x7f66dc08c2f0 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 >> v1:10.20.193.187:6789/0 conn(0x7f66dc08dc80 legacy=0x7f66dc1937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 >> v1:10.20.193.78:6789/0 conn(0x7f66dc08cdd0 legacy=0x7f66dc192080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: _finish_hunting 0 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 monclient: found mon.c 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:42.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc07dcf0 con 0x7f66dc08c2f0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: _finish_auth 0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: _check_auth_tickets 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 5 monclient: authenticate success, global_id 4448 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 monclient: _renew_subs 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc080a30 con 0x7f66dc08c2f0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 monclient: _renew_subs 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f66dc07e850 con 0x7f66dc08c2f0 2026-02-13T18:05:42.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66cc004b80 con 0x7f66dc08c2f0 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f66cc005170 con 0x7f66dc08c2f0 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 10 monclient: dump: 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:42.510 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d2ffd640 4 set_mon_vals no callback set 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc08f620 con 0x7f66dc08c2f0 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f66cc011800 con 0x7f66dc08c2f0 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7f66cc04c510 con 0x7f66dc08c2f0 2026-02-13T18:05:42.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.487+0000 7f66d3fff640 10 monclient: get_auth_request con 0x7f66ac03d640 auth_method 0 2026-02-13T18:05:42.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.491+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f66dc08f620 con 0x7f66dc08c2f0 2026-02-13T18:05:42.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.491+0000 7f66d17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:42.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.491+0000 7f66d17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:42.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66dc090810 con 0x7f66dc08c2f0 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66d17fa640 1 -- 10.20.193.78:0/3861325647 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1921443219) 0x7f66cc017640 con 0x7f66dc08c2f0 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66d17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66d17fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:42.620 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:05:42.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 >> v1:10.20.193.187:6812/2668687789 conn(0x7f66ac03d640 legacy=0x7f66ac05daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:42.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 10 monclient: shutdown 2026-02-13T18:05:42.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:42.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 >> v1:10.20.193.78:6790/0 conn(0x7f66dc08c2f0 legacy=0x7f66dc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:42.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 shutdown_connections 2026-02-13T18:05:42.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 >> 10.20.193.78:0/3861325647 conn(0x7f66dc091720 msgr2=0x7f66dc05ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:42.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 shutdown_connections 2026-02-13T18:05:42.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.611+0000 7f66e2f7c640 1 -- 10.20.193.78:0/3861325647 wait complete. 2026-02-13T18:05:42.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:42.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:42.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:42.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:43.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:43.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:43.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:43.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:43.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:43.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:44.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:44.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:44.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:44.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:44.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:44.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:45.630 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:05:45.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:45.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:45.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:45.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient: get_monmap_and_config 2026-02-13T18:05:45.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient: build_initial_monmap 2026-02-13T18:05:45.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient: monmap: 2026-02-13T18:05:45.706 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:45.706 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:45.706 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:45.699595+0000 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:45.699595+0000 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:45.707 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 1 Processor -- start 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 1 -- start start 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient: init 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient(hunting): picked mon.noname-b con 0x7f775008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient(hunting): picked mon.noname-c con 0x7f775008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:45.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient(hunting): picked mon.noname-a con 0x7f775008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750089e80 con 0x7f775008cdd0 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750088c20 con 0x7f775008dc80 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750089ba0 con 0x7f775008c2f0 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7757593640 10 monclient(hunting): authenticate will time out at 576.754770s 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7755b09640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77501a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7755308640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 0x7f775008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52928/0 (socket says 10.20.193.78:52928) 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.695+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 learned_addr learned my addr 10.20.193.78:0/1761607222 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.699+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 legacy=0x7f775008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:45.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.699+0000 7f7754b07640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.187:6789/0 conn(0x7f775008dc80 legacy=0x7f7750181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:45.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:45.899+0000 7f7755b09640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77501a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:46.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:46.303+0000 7f7755b09640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77501a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:46.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:46.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:46.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:46.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:46.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:46.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:47.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:47.107+0000 7f7755b09640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77501a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:47.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:47.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:47.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:47.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:47.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:47.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:48.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:48.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:48.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:48.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.635+0000 7f80327fc640 10 monclient: _renew_subs 2026-02-13T18:05:48.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.635+0000 7f80327fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:48.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.635+0000 7f80327fc640 1 -- 10.20.193.78:0/4186569331 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=20}) -- 0x7f80200035a0 con 0x7f8044090170 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): tick 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 monclient(hunting): continuing hunt 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 legacy=0x7f775008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.187:6789/0 conn(0x7f775008dc80 legacy=0x7f7750181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:48.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77501a3410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): picked mon.noname-a con 0x7f775008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): picked mon.noname-b con 0x7f775008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): picked mon.noname-c con 0x7f775008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775008d370 con 0x7f775008cdd0 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77340238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750089e80 con 0x7f775008dc80 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773406a180 con 0x7f775008c2f0 2026-02-13T18:05:48.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.695+0000 7f773effd640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:48.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.699+0000 7f7754b07640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 legacy=0x7f77340450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:48.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.699+0000 7f7755b09640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.187:6789/0 conn(0x7f775008dc80 legacy=0x7f77340668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:48.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:48.899+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77340238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:49.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:49.303+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77340238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:49.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:49.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:49.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:49.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:49.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:49.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:50.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:50.107+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77340238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:50.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:50.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:50.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:50.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:50.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:50.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:51.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:51.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:51.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:51.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.623+0000 7f8030ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:51.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): tick 2026-02-13T18:05:51.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:05:51.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 monclient(hunting): continuing hunt 2026-02-13T18:05:51.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:05:51.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 legacy=0x7f77340450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:51.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.187:6789/0 conn(0x7f775008dc80 legacy=0x7f77340668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f77340238d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): picked mon.noname-b con 0x7f775008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): picked mon.noname-a con 0x7f775008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): picked mon.noname-c con 0x7f775008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773406b4e0 con 0x7f775008cdd0 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775008d370 con 0x7f775008dc80 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7734069320 con 0x7f775008c2f0 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f773effd640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:51.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f7754b07640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f7734023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:51.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f7755308640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 legacy=0x7f7734045020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:51.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.699+0000 7f7755b09640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.187:6789/0 conn(0x7f775008dc80 legacy=0x7f77340668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:51.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:51.903+0000 7f7754b07640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f7734023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:52.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:52.307+0000 7f7754b07640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f7734023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:52.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:52.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:52.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:52.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:52.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:52.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.111+0000 7f7754b07640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f7734023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:53.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.623+0000 7f8030ff9640 10 monclient: tick 2026-02-13T18:05:53.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.623+0000 7f8030ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.623+0000 7f8030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230447268 0 0) 0x7f7734069320 con 0x7f775008c2f0 2026-02-13T18:05:53.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient(hunting): my global_id is 4451 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7738003620 con 0x7f775008c2f0 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3646826381 0 0) 0x7f7738003620 con 0x7f775008c2f0 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.187:6789/0 conn(0x7f775008dc80 legacy=0x7f77340668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6789/0 conn(0x7f775008cdd0 legacy=0x7f7734023890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 monclient: found mon.noname-b 2026-02-13T18:05:53.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77340695b0 con 0x7f775008c2f0 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: _finish_auth 0 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7740003140 con 0x7f775008c2f0 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 5 monclient: authenticate success, global_id 4451 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:53.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: dump: 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:53.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7740003480 con 0x7f775008c2f0 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 1 -- 10.20.193.78:0/1761607222 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7740004b50 con 0x7f775008c2f0 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f773ffff640 10 monclient: dump: 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.665 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 4 set_mon_vals no callback set 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: shutdown 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- 10.20.193.78:0/1761607222 >> v1:10.20.193.78:6790/0 conn(0x7f775008c2f0 legacy=0x7f7734045020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- 10.20.193.78:0/1761607222 shutdown_connections 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- 10.20.193.78:0/1761607222 >> 10.20.193.78:0/1761607222 conn(0x7f7750091720 msgr2=0x7f7750091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- 10.20.193.78:0/1761607222 shutdown_connections 2026-02-13T18:05:53.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- 10.20.193.78:0/1761607222 wait complete. 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: build_initial_monmap 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: monmap: 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:53.667 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 Processor -- start 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- start start 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: init 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient(hunting): picked mon.noname-a con 0x7f775008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient(hunting): picked mon.noname-b con 0x7f775008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient(hunting): picked mon.noname-c con 0x7f775008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7755308640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f775008c2f0 legacy=0x7f77500857c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750082530 con 0x7f775008c2f0 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77500865e0 con 0x7f775008cdd0 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750082810 con 0x7f775008dc80 2026-02-13T18:05:53.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:53.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7757593640 10 monclient(hunting): authenticate will time out at 584.711319s 2026-02-13T18:05:53.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7755b09640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f775008dc80 0x7f775023ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41302/0 (socket says 10.20.193.78:41302) 2026-02-13T18:05:53.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.651+0000 7f7755b09640 1 -- 10.20.193.78:0/1728299371 learned_addr learned my addr 10.20.193.78:0/1728299371 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7755b09640 1 -- 10.20.193.78:0/1728299371 >> v1:10.20.193.78:6790/0 conn(0x7f775008dc80 legacy=0x7f775023ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7754b07640 1 -- 10.20.193.78:0/1728299371 >> v1:10.20.193.187:6789/0 conn(0x7f775008cdd0 legacy=0x7f7750085ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259633815 0 0) 0x7f7750082810 con 0x7f775008dc80 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): my global_id is 4454 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7720003620 con 0x7f775008dc80 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 74449836 0 0) 0x7f7720003620 con 0x7f775008dc80 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7750082810 con 0x7f775008dc80 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f774c005bb0 con 0x7f775008dc80 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): dump: 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.673 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2977179798 0 0) 0x7f7750082810 con 0x7f775008dc80 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 >> v1:10.20.193.187:6789/0 conn(0x7f775008cdd0 legacy=0x7f7750085ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 >> v1:10.20.193.78:6789/0 conn(0x7f775008c2f0 legacy=0x7f77500857c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:53.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 monclient: found mon.c 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7750057bf0 con 0x7f775008dc80 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 5 monclient: authenticate success, global_id 4454 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 monclient: _renew_subs 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7750082250 con 0x7f775008dc80 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 monclient: _renew_subs 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7750083eb0 con 0x7f775008dc80 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f774c0060f0 con 0x7f775008dc80 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f774c006450 con 0x7f775008dc80 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 10 monclient: dump: 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.676 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773f7fe640 4 set_mon_vals no callback set 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775008f620 con 0x7f775008dc80 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f774c006670 con 0x7f775008dc80 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 4227202387 0 0) 0x7f774c04dad0 con 0x7f775008dc80 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.655+0000 7f7755308640 10 monclient: get_auth_request con 0x7f772003d2f0 auth_method 0 2026-02-13T18:05:53.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.659+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f775008f620 con 0x7f775008dc80 2026-02-13T18:05:53.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.659+0000 7f773dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.659+0000 7f773dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:53.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 6 ==== osd_map(20..20 src has 1..20) ==== 743+0+0 (unknown 184731211 0 0) 0x7f80400161f0 con 0x7f8044090170 2026-02-13T18:05:53.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f8031ffb640 1 -- 10.20.193.78:0/4186569331 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]=0 pool 'unique_pool_0' created v20) ==== 130+0+0 (unknown 3098031066 0 0) 0x7f8040021400 con 0x7f8044090170 2026-02-13T18:05:53.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f8031ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T18:05:53.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f8031ffb640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' created 2026-02-13T18:05:53.719 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_0' created 2026-02-13T18:05:53.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.187:6812/2668687789 conn(0x7f801403d590 legacy=0x7f801405da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 10 monclient: shutdown 2026-02-13T18:05:53.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:53.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 >> v1:10.20.193.78:6790/0 conn(0x7f8044090170 legacy=0x7f80140a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 shutdown_connections 2026-02-13T18:05:53.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 >> 10.20.193.78:0/4186569331 conn(0x7f804405e3a0 msgr2=0x7f8044089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:53.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 shutdown_connections 2026-02-13T18:05:53.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.711+0000 7f804b2ca640 1 -- 10.20.193.78:0/4186569331 wait complete. 2026-02-13T18:05:53.733 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-13T18:05:53.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:05:53.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:53.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7750090810 con 0x7f775008dc80 2026-02-13T18:05:53.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f773dffb640 1 -- 10.20.193.78:0/1728299371 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1597 (unknown 254746657 0 1766130106) 0x7f774c018c00 con 0x7f775008dc80 2026-02-13T18:05:53.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f773dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:05:53.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f773dffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:53.787 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:05:53.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 >> v1:10.20.193.187:6812/2668687789 conn(0x7f772003d2f0 legacy=0x7f772005d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 10 monclient: shutdown 2026-02-13T18:05:53.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:53.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 >> v1:10.20.193.78:6790/0 conn(0x7f775008dc80 legacy=0x7f775023ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 shutdown_connections 2026-02-13T18:05:53.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 >> 10.20.193.78:0/1728299371 conn(0x7f7750091720 msgr2=0x7f7750059040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:53.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 shutdown_connections 2026-02-13T18:05:53.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.779+0000 7f7757593640 1 -- 10.20.193.78:0/1728299371 wait complete. 2026-02-13T18:05:53.800 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:05:53.800 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:05:53.800 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient: get_monmap_and_config 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient: build_initial_monmap 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient: monmap: 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:53.795025+0000 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:53.795025+0000 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.803 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 1 Processor -- start 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 1 -- start start 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient: init 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f0f10142880 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f10143360 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:53.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f101854d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1005ea60 con 0x7f0f10143360 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f10094d90 con 0x7f0f10142880 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1005d150 con 0x7f0f101854d0 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0ffff640 10 monclient(hunting): authenticate will time out at 584.850651s 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0e7fc640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f0f10143360 legacy=0x7f0f10183db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0f7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0f101854d0 0x7f0f101a58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41304/0 (socket says 10.20.193.78:41304) 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.791+0000 7f0f0f7fe640 1 -- 10.20.193.78:0/3767720271 learned_addr learned my addr 10.20.193.78:0/3767720271 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0f7fe640 1 -- 10.20.193.78:0/3767720271 >> v1:10.20.193.78:6790/0 conn(0x7f0f101854d0 legacy=0x7f0f101a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0effd640 1 -- 10.20.193.78:0/3767720271 >> v1:10.20.193.187:6789/0 conn(0x7f0f10142880 legacy=0x7f0f10142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395278132 0 0) 0x7f0f1005d150 con 0x7f0f101854d0 2026-02-13T18:05:53.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): my global_id is 4457 2026-02-13T18:05:53.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0efc003620 con 0x7f0f101854d0 2026-02-13T18:05:53.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913340386 0 0) 0x7f0f10094d90 con 0x7f0f10142880 2026-02-13T18:05:53.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient(hunting): my global_id is 4471 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1005d150 con 0x7f0f10142880 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 504274907 0 0) 0x7f0efc003620 con 0x7f0f101854d0 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 >> v1:10.20.193.187:6789/0 conn(0x7f0f10142880 legacy=0x7f0f10142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 >> v1:10.20.193.78:6789/0 conn(0x7f0f10143360 legacy=0x7f0f10183db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 monclient: found mon.noname-b 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:53.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1005d430 con 0x7f0f101854d0 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: _finish_auth 0 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 5 monclient: authenticate success, global_id 4457 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0f00004620 con 0x7f0f101854d0 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: dump: 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.813 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f000048f0 con 0x7f0f101854d0 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:53.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 4 set_mon_vals no callback set 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 1 -- 10.20.193.78:0/3767720271 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0f00006060 con 0x7f0f101854d0 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0dffb640 10 monclient: dump: 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.815 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: shutdown 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3767720271 >> v1:10.20.193.78:6790/0 conn(0x7f0f101854d0 legacy=0x7f0f101a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3767720271 shutdown_connections 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3767720271 >> 10.20.193.78:0/3767720271 conn(0x7f0f100545d0 msgr2=0x7f0f100549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3767720271 shutdown_connections 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3767720271 wait complete. 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: build_initial_monmap 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: monmap: 2026-02-13T18:05:53.816 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 Processor -- start 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- start start 2026-02-13T18:05:53.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: init 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f10142880 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f0f10143360 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f101854d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1019e300 con 0x7f0f101854d0 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1019fb00 con 0x7f0f10142880 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f101a6b90 con 0x7f0f10143360 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0ffff640 10 monclient(hunting): authenticate will time out at 584.854818s 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0f7fe640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f0f101854d0 legacy=0x7f0f10130a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0e7fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0f10143360 0x7f0f10183db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41320/0 (socket says 10.20.193.78:41320) 2026-02-13T18:05:53.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.795+0000 7f0f0e7fc640 1 -- 10.20.193.78:0/3765955497 learned_addr learned my addr 10.20.193.78:0/3765955497 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0e7fc640 1 -- 10.20.193.78:0/3765955497 >> v1:10.20.193.78:6790/0 conn(0x7f0f10143360 legacy=0x7f0f10183db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724285593 0 0) 0x7f0f101a6b90 con 0x7f0f10143360 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): my global_id is 4460 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0edc003620 con 0x7f0f10143360 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0effd640 1 -- 10.20.193.78:0/3765955497 >> v1:10.20.193.187:6789/0 conn(0x7f0f10142880 legacy=0x7f0f1012fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1407035278 0 0) 0x7f0edc003620 con 0x7f0f10143360 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f101a6b90 con 0x7f0f10143360 2026-02-13T18:05:53.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0ef80045c0 con 0x7f0f10143360 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): dump: 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.820 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708168259 0 0) 0x7f0f1019fb00 con 0x7f0f10142880 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient(hunting): my global_id is 4474 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0edc003620 con 0x7f0f10142880 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3511469273 0 0) 0x7f0f101a6b90 con 0x7f0f10143360 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 >> v1:10.20.193.187:6789/0 conn(0x7f0f10142880 legacy=0x7f0f1012fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 >> v1:10.20.193.78:6789/0 conn(0x7f0f101854d0 legacy=0x7f0f10130a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:53.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 monclient: found mon.c 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f101a0660 con 0x7f0f10143360 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 5 monclient: authenticate success, global_id 4460 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 monclient: _renew_subs 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1019ee60 con 0x7f0f10143360 2026-02-13T18:05:53.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 monclient: _renew_subs 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f1008edf0 con 0x7f0f10143360 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ef8004890 con 0x7f0f10143360 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0ef8004bf0 con 0x7f0f10143360 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0d7fa640 4 set_mon_vals no callback set 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 10 monclient: dump: 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.823 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f101a6db0 con 0x7f0f10143360 2026-02-13T18:05:53.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0ef8004ec0 con 0x7f0f10143360 2026-02-13T18:05:53.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 1021882515 0 0) 0x7f0ef804c750 con 0x7f0f10143360 2026-02-13T18:05:53.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.799+0000 7f0f0effd640 10 monclient: get_auth_request con 0x7f0edc03d4f0 auth_method 0 2026-02-13T18:05:53.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.803+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f0ef8017730 con 0x7f0f10143360 2026-02-13T18:05:53.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.803+0000 7f0eef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.803+0000 7f0eef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient: get_monmap_and_config 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient: build_initial_monmap 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient: monmap: 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:53.858018+0000 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:53.858018+0000 2026-02-13T18:05:53.862 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:53.863 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.863 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:53.863 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:53.863 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:53.863 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 1 Processor -- start 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 1 -- start start 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient: init 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient(hunting): picked mon.noname-c con 0x7ffb3013f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient(hunting): picked mon.noname-b con 0x7ffb3005e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient(hunting): picked mon.noname-a con 0x7ffb301853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb30095530 con 0x7ffb301853c0 2026-02-13T18:05:53.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb30140390 con 0x7ffb3013f8b0 2026-02-13T18:05:53.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3005d230 con 0x7ffb3005e4b0 2026-02-13T18:05:53.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:53.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb38064640 10 monclient(hunting): authenticate will time out at 584.913620s 2026-02-13T18:05:53.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb365da640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7ffb301853c0 legacy=0x7ffb301a57a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:53.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb355d8640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ffb3005e4b0 0x7ffb30183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41326/0 (socket says 10.20.193.78:41326) 2026-02-13T18:05:53.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb355d8640 1 -- 10.20.193.78:0/396692669 learned_addr learned my addr 10.20.193.78:0/396692669 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:53.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb355d8640 1 -- 10.20.193.78:0/396692669 >> v1:10.20.193.78:6790/0 conn(0x7ffb3005e4b0 legacy=0x7ffb30183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.855+0000 7ffb35dd9640 1 -- 10.20.193.78:0/396692669 >> v1:10.20.193.187:6789/0 conn(0x7ffb3013f8b0 legacy=0x7ffb3013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917862697 0 0) 0x7ffb3005d230 con 0x7ffb3005e4b0 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): my global_id is 4463 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb18003620 con 0x7ffb3005e4b0 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659060850 0 0) 0x7ffb20002cb0 con 0x7ffb3013f8b0 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient(hunting): my global_id is 4477 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb3005d230 con 0x7ffb3013f8b0 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1033746495 0 0) 0x7ffb18003620 con 0x7ffb3005e4b0 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 >> v1:10.20.193.187:6789/0 conn(0x7ffb3013f8b0 legacy=0x7ffb3013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 >> v1:10.20.193.78:6789/0 conn(0x7ffb301853c0 legacy=0x7ffb301a57a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: _finish_hunting 0 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 monclient: found mon.noname-b 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3005d510 con 0x7ffb3005e4b0 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: _finish_auth 0 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 5 monclient: authenticate success, global_id 4463 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb24003110 con 0x7ffb3005e4b0 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: dump: 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb240033e0 con 0x7ffb3005e4b0 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 1 -- 10.20.193.78:0/396692669 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb24004b50 con 0x7ffb3005e4b0 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb34dd7640 10 monclient: dump: 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.876 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 4 set_mon_vals no callback set 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: shutdown 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:53.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- 10.20.193.78:0/396692669 >> v1:10.20.193.78:6790/0 conn(0x7ffb3005e4b0 legacy=0x7ffb30183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- 10.20.193.78:0/396692669 shutdown_connections 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- 10.20.193.78:0/396692669 >> 10.20.193.78:0/396692669 conn(0x7ffb300545d0 msgr2=0x7ffb300549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- 10.20.193.78:0/396692669 shutdown_connections 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- 10.20.193.78:0/396692669 wait complete. 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: build_initial_monmap 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: monmap: 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:53.878 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 Processor -- start 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- start start 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: init 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:05:53.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient(hunting): picked mon.noname-b con 0x7ffb3005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient(hunting): picked mon.noname-a con 0x7ffb3013f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient(hunting): picked mon.noname-c con 0x7ffb301853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3010f710 con 0x7ffb3013f8b0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb301111d0 con 0x7ffb3005e4b0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3010fce0 con 0x7ffb301853c0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb38064640 10 monclient(hunting): authenticate will time out at 584.917653s 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb355d8640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7ffb3013f8b0 legacy=0x7ffb30180590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb365da640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ffb301853c0 0x7ffb30181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41334/0 (socket says 10.20.193.78:41334) 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb365da640 1 -- 10.20.193.78:0/2612515542 learned_addr learned my addr 10.20.193.78:0/2612515542 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:53.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb365da640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb301853c0 legacy=0x7ffb30181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.859+0000 7ffb35dd9640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.187:6789/0 conn(0x7ffb3005e4b0 legacy=0x7ffb3013eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243442191 0 0) 0x7ffb3010fce0 con 0x7ffb301853c0 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): my global_id is 4466 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb00003620 con 0x7ffb301853c0 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231922131 0 0) 0x7ffb301111d0 con 0x7ffb3005e4b0 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): my global_id is 4480 2026-02-13T18:05:53.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb3010fce0 con 0x7ffb3005e4b0 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1530834004 0 0) 0x7ffb00003620 con 0x7ffb301853c0 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb301111d0 con 0x7ffb301853c0 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb2c0059c0 con 0x7ffb301853c0 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): dump: 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.882 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1809737826 0 0) 0x7ffb3010fce0 con 0x7ffb3005e4b0 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb00003620 con 0x7ffb3005e4b0 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb20002c80 con 0x7ffb3005e4b0 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): dump: 2026-02-13T18:05:53.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1834481610 0 0) 0x7ffb301111d0 con 0x7ffb301853c0 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.187:6789/0 conn(0x7ffb3005e4b0 legacy=0x7ffb3013eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6789/0 conn(0x7ffb3013f8b0 legacy=0x7ffb30180590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:53.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 monclient: found mon.c 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb30112040 con 0x7ffb301853c0 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 5 monclient: authenticate success, global_id 4466 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 10 monclient: _renew_subs 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3013f260 con 0x7ffb301853c0 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 10 monclient: _renew_subs 2026-02-13T18:05:53.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb30110a10 con 0x7ffb301853c0 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb2c005c90 con 0x7ffb301853c0 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb2c005ff0 con 0x7ffb301853c0 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: dump: 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.886 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1ffff640 4 set_mon_vals no callback set 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7ffb2c0062c0 con 0x7ffb301853c0 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 1021882515 0 0) 0x7ffb2c04dad0 con 0x7ffb301853c0 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb3012d9e0 con 0x7ffb3012d610 2026-02-13T18:05:53.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb35dd9640 10 monclient: get_auth_request con 0x7ffb0003d610 auth_method 0 2026-02-13T18:05:53.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb355d8640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb3012d610 legacy=0x7ffb3008d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753555415 0 0) 0x7ffb3012d9e0 con 0x7ffb3012d610 2026-02-13T18:05:53.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient(hunting): my global_id is 4469 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb301111d0 con 0x7ffb3012d610 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4160981226 0 0) 0x7ffb301111d0 con 0x7ffb3012d610 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb3012d9e0 con 0x7ffb3012d610 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb24003170 con 0x7ffb3012d610 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 10 monclient: dump: 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.891 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3183780962 0 0) 0x7ffb3012d9e0 con 0x7ffb3012d610 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.863+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb300008e0 con 0x7ffb3012d610 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ffb24002b30 con 0x7ffb3012d610 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb1e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb1e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:53.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb3012d610 legacy=0x7ffb3008d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb3012d610 legacy=0x7ffb3008d0b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb38064640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.867+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb30093020 con 0x7ffb30184ba0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb355d8640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb30184ba0 legacy=0x7ffb3008bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497630731 0 0) 0x7ffb30093020 con 0x7ffb30184ba0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient(hunting): my global_id is 4472 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb3012d9e0 con 0x7ffb30184ba0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 967630316 0 0) 0x7ffb3012d9e0 con 0x7ffb30184ba0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb30093020 con 0x7ffb30184ba0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ffb24004c80 con 0x7ffb30184ba0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:53.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient: dump: 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1585959871 0 0) 0x7ffb30093020 con 0x7ffb30184ba0 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffb30090840 con 0x7ffb30184ba0 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4495 (unknown 0 0 2798066996) 0x7ffb240061a0 con 0x7ffb30184ba0 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:05:53.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb30184ba0 legacy=0x7ffb3008bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb1e7fc640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb30184ba0 legacy=0x7ffb3008bf30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 6, 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 35262, 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:05:53.895 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:53.896 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:53.897 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:05:53.898 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:53.899 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:53.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:53.901 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:53.902 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:53.903 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:05:53.904 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:05:53.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.187:6812/2668687789 conn(0x7ffb0003d610 legacy=0x7ffb0005dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 10 monclient: shutdown 2026-02-13T18:05:53.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:53.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 >> v1:10.20.193.78:6790/0 conn(0x7ffb301853c0 legacy=0x7ffb30181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:53.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb365da640 1 -- 10.20.193.78:0/2612515542 reap_dead start 2026-02-13T18:05:53.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb365da640 1 -- 10.20.193.78:0/2612515542 reap_dead start 2026-02-13T18:05:53.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 shutdown_connections 2026-02-13T18:05:53.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 >> 10.20.193.78:0/2612515542 conn(0x7ffb300545d0 msgr2=0x7ffb300965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:53.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 shutdown_connections 2026-02-13T18:05:53.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.871+0000 7ffb38064640 1 -- 10.20.193.78:0/2612515542 wait complete. 2026-02-13T18:05:53.906 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:05:53.906 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:05:53.906 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:05:53.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.891+0000 7f0f0ffff640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-13T18:05:53.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.891+0000 7f0f0ffff640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-13T18:05:53.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.891+0000 7f0f0ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:53.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.891+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} v 0) -- 0x7f0f10051150 con 0x7f0f10143360 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient: get_monmap_and_config 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient: build_initial_monmap 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient: monmap: 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:54.004713+0000 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:54.004713+0000 2026-02-13T18:05:54.008 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:54.009 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.009 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:54.009 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:05:54.009 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:05:54.009 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 1 Processor -- start 2026-02-13T18:05:54.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 1 -- start start 2026-02-13T18:05:54.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient: init 2026-02-13T18:05:54.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:54.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:05:54.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient(hunting): picked mon.noname-b con 0x7f9d2408cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient(hunting): picked mon.noname-a con 0x7f9d2408d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient(hunting): picked mon.noname-c con 0x7f9d2408d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d24085ad0 con 0x7f9d2408d190 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d24085ee0 con 0x7f9d2408d5d0 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2408e000 con 0x7f9d2408cdc0 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d290f9640 10 monclient(hunting): authenticate will time out at 585.059864s 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d22575640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f9d2408d190 legacy=0x7f9d24183cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d22d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9d2408cdc0 0x7f9d2408c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41360/0 (socket says 10.20.193.78:41360) 2026-02-13T18:05:54.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:53.999+0000 7f9d22d76640 1 -- 10.20.193.78:0/1521759635 learned_addr learned my addr 10.20.193.78:0/1521759635 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d22d76640 1 -- 10.20.193.78:0/1521759635 >> v1:10.20.193.78:6790/0 conn(0x7f9d2408cdc0 legacy=0x7f9d2408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d23577640 1 -- 10.20.193.78:0/1521759635 >> v1:10.20.193.187:6789/0 conn(0x7f9d2408d5d0 legacy=0x7f9d241a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18922937 0 0) 0x7f9d2408e000 con 0x7f9d2408cdc0 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): my global_id is 4475 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d10003620 con 0x7f9d2408cdc0 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840607657 0 0) 0x7f9d140041c0 con 0x7f9d2408d5d0 2026-02-13T18:05:54.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient(hunting): my global_id is 4483 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d2408e000 con 0x7f9d2408d5d0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3338854637 0 0) 0x7f9d10003620 con 0x7f9d2408cdc0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 >> v1:10.20.193.187:6789/0 conn(0x7f9d2408d5d0 legacy=0x7f9d241a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 >> v1:10.20.193.78:6789/0 conn(0x7f9d2408d190 legacy=0x7f9d24183cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: _finish_hunting 0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 monclient: found mon.noname-b 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d24086f80 con 0x7f9d2408cdc0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: _finish_auth 0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: _check_auth_tickets 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d18003110 con 0x7f9d2408cdc0 2026-02-13T18:05:54.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: dump: 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 5 monclient: authenticate success, global_id 4475 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d180033e0 con 0x7f9d2408cdc0 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:54.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 1 -- 10.20.193.78:0/1521759635 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d18004b50 con 0x7f9d2408cdc0 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d21d74640 10 monclient: dump: 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 10 monclient: get_monmap_and_config success 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 4 set_mon_vals no callback set 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 10 monclient: shutdown 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 -- 10.20.193.78:0/1521759635 >> v1:10.20.193.78:6790/0 conn(0x7f9d2408cdc0 legacy=0x7f9d2408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 -- 10.20.193.78:0/1521759635 shutdown_connections 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 -- 10.20.193.78:0/1521759635 >> 10.20.193.78:0/1521759635 conn(0x7f9d24091720 msgr2=0x7f9d24091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 -- 10.20.193.78:0/1521759635 shutdown_connections 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 -- 10.20.193.78:0/1521759635 wait complete. 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 10 monclient: build_initial_monmap 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 10 monclient: monmap: 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 Processor -- start 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 1 -- start start 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.003+0000 7f9d290f9640 10 monclient: init 2026-02-13T18:05:54.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient: _reopen_session rank -1 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient(hunting): picked mon.noname-b con 0x7f9d2408cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient(hunting): picked mon.noname-c con 0x7f9d2408d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient(hunting): picked mon.noname-a con 0x7f9d2408d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d24088910 con 0x7f9d2408d5d0 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d24083400 con 0x7f9d2408cdc0 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d240810a0 con 0x7f9d2408d190 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient(hunting): _renew_subs 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient(hunting): authenticate will time out at 585.064414s 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d23577640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f9d2408d5d0 legacy=0x7f9d241957f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d22575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9d2408d190 0x7f9d241940d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:41366/0 (socket says 10.20.193.78:41366) 2026-02-13T18:05:54.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d22575640 1 -- 10.20.193.78:0/1565723140 learned_addr learned my addr 10.20.193.78:0/1565723140 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d22575640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.78:6790/0 conn(0x7f9d2408d190 legacy=0x7f9d241940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d22d76640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2408cdc0 legacy=0x7f9d24084930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858883972 0 0) 0x7f9d240810a0 con 0x7f9d2408d190 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): my global_id is 4478 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf0003620 con 0x7f9d2408d190 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2924612790 0 0) 0x7f9cf0003620 con 0x7f9d2408d190 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d240810a0 con 0x7f9d2408d190 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d0c0045c0 con 0x7f9d2408d190 2026-02-13T18:05:54.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): dump: 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506455729 0 0) 0x7f9d24083400 con 0x7f9d2408cdc0 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient(hunting): my global_id is 4486 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf0003620 con 0x7f9d2408cdc0 2026-02-13T18:05:54.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3083308663 0 0) 0x7f9d240810a0 con 0x7f9d2408d190 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2408cdc0 legacy=0x7f9d24084930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.78:6789/0 conn(0x7f9d2408d5d0 legacy=0x7f9d241957f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient: _finish_hunting 0 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 monclient: found mon.c 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d24083120 con 0x7f9d2408d190 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient: _finish_auth 0 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient: _check_auth_tickets 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 5 monclient: authenticate success, global_id 4478 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient: _renew_subs 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d24085040 con 0x7f9d2408d190 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient: _renew_subs 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d24152d50 con 0x7f9d2408d190 2026-02-13T18:05:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d22575640 1 --1- 10.20.193.78:0/1565723140 >> v1:10.20.193.78:6790/0 conn(0x7f9d2408d190 0x7f9d241940d0 :-1 s=OPENED pgs=168 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f9d0c004890 config(0 keys) 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d0c004890 con 0x7f9d2408d190 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d037fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d21573640 4 set_mon_vals no callback set 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.007+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d2408f620 con 0x7f9d2407b550 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d0c004bf0 con 0x7f9d2408d190 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient: dump: 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9d0c004ec0 con 0x7f9d2408d190 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d23577640 10 monclient: get_auth_request con 0x7f9cf003d470 auth_method 0 2026-02-13T18:05:54.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d22d76640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 legacy=0x7f9d2404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051647775 0 0) 0x7f9cf0003620 con 0x7f9d2407b550 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient(hunting): my global_id is 4489 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d240810a0 con 0x7f9d2407b550 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1677582263 0 0) 0x7f9d240810a0 con 0x7f9d2407b550 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cf0003620 con 0x7f9d2407b550 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d180048e0 con 0x7f9d2407b550 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 10 monclient: dump: 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.026 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d22d76640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 legacy=0x7f9d2404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d22d76640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 legacy=0x7f9d2404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d22d76640 1 --1- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 0x7f9d2404d200 :-1 s=OPENED pgs=180 gs=5 cs=1 l=1).handle_message read tag failed 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d22d76640 1 --1- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 0x7f9d2404d200 :-1 s=OPENED pgs=180 gs=5 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 legacy=0x7f9d2404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b550 legacy=0x7f9d2404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:54.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.011+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d240810a0 con 0x7f9cf005f3d0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d22d76640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9cf005f3d0 legacy=0x7f9cf005f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593138398 0 0) 0x7f9d240810a0 con 0x7f9cf005f3d0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient(hunting): my global_id is 4492 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d24083400 con 0x7f9cf005f3d0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1246839001 0 0) 0x7f9d24083400 con 0x7f9cf005f3d0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d240810a0 con 0x7f9cf005f3d0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d18002d10 con 0x7f9cf005f3d0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient: dump: 2026-02-13T18:05:54.028 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4080644715 0 0) 0x7f9d240810a0 con 0x7f9cf005f3d0 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d18003540 con 0x7f9cf005f3d0 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9d18007a20 con 0x7f9cf005f3d0 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9cf005f3d0 legacy=0x7f9cf005f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.015+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9cf005f3d0 legacy=0x7f9cf005f7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.019+0000 7f9d290f9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:05:54.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.019+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d24082c60 con 0x7f9d2407b920 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d22d76640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b920 legacy=0x7f9d24197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379521336 0 0) 0x7f9d24082c60 con 0x7f9d2407b920 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient(hunting): _negotiate 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient(hunting): my global_id is 4495 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d240810a0 con 0x7f9d2407b920 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 578513694 0 0) 0x7f9d240810a0 con 0x7f9d2407b920 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d24082c60 con 0x7f9d2407b920 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9d180053a0 con 0x7f9d2407b920 2026-02-13T18:05:54.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient: dump: 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1746415446 0 0) 0x7f9d24082c60 con 0x7f9d2407b920 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d24090810 con 0x7f9d2407b920 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4664 (unknown 0 0 1357225773) 0x7f9d18007240 con 0x7f9d2407b920 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b920 legacy=0x7f9d24197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6789/0 conn(0x7f9d2407b920 legacy=0x7f9d24197f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d23577640 1 -- 10.20.193.78:0/1565723140 reap_dead start 2026-02-13T18:05:54.031 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 6, 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 35390, 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:54.032 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:05:54.033 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:05:54.034 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.035 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:05:54.036 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:05:54.037 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9cf003d470 legacy=0x7f9cf005d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 10 monclient: shutdown 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 >> v1:10.20.193.78:6790/0 conn(0x7f9d2408d190 legacy=0x7f9d241940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d037fe640 1 -- 10.20.193.78:0/1565723140 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 1021882515 0 0) 0x7f9d0c04c7d0 con 0x7f9d2408d190 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 shutdown_connections 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 >> 10.20.193.78:0/1565723140 conn(0x7f9d24091720 msgr2=0x7f9d24089b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 shutdown_connections 2026-02-13T18:05:54.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.023+0000 7f9d290f9640 1 -- 10.20.193.78:0/1565723140 wait complete. 2026-02-13T18:05:54.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:05:54.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:05:54.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.715+0000 7f0eef7fe640 1 -- 10.20.193.78:0/3765955497 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]=0 enabled application 'rados' on pool 'unique_pool_0' v21) ==== 197+0+0 (unknown 555284988 0 0) 0x7f0ef8017010 con 0x7f0f10143360 2026-02-13T18:05:54.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.715+0000 7f0eef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-13T18:05:54.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.715+0000 7f0eef7fe640 10 monclient: _finish_command 2 = system:0 enabled application 'rados' on pool 'unique_pool_0' 2026-02-13T18:05:54.725 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-13T18:05:54.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 >> v1:10.20.193.187:6812/2668687789 conn(0x7f0edc03d4f0 legacy=0x7f0edc05d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 10 monclient: shutdown 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 >> v1:10.20.193.78:6790/0 conn(0x7f0f10143360 legacy=0x7f0f10183db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 shutdown_connections 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 >> 10.20.193.78:0/3765955497 conn(0x7f0f100545d0 msgr2=0x7f0f1019acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 shutdown_connections 2026-02-13T18:05:54.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:05:54.719+0000 7f0f0ffff640 1 -- 10.20.193.78:0/3765955497 wait complete. 2026-02-13T18:05:55.741 DEBUG:teuthology.orchestra.run.trial187:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2026-02-13T18:05:55.769 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight read -> 100 2026-02-13T18:05:55.769 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight write -> 50 2026-02-13T18:05:55.769 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight delete -> 50 2026-02-13T18:05:55.769 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight snap_create -> 50 2026-02-13T18:05:55.769 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight snap_remove -> 50 2026-02-13T18:05:55.769 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight rollback -> 50 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight copy_from -> 50 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout:adding op weight write_excl -> 50 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout:ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - None) 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout:Configuration: 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout: Number of operations: 4000 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout: Number of objects: 50 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout: Max in flight operations: 16 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout: Object size (in bytes): 4000000 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout: Write stride min: 400000 2026-02-13T18:05:55.770 INFO:tasks.rados.rados.0.trial187.stdout: Write stride max: 800000 2026-02-13T18:05:56.730 INFO:tasks.rados.rados.0.trial187.stdout:1: write initial oid 1 2026-02-13T18:05:56.730 INFO:tasks.rados.rados.0.trial187.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-13T18:05:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1: writing trial18717860-1 from 416807 to 892056 tid 1 2026-02-13T18:05:56.738 INFO:tasks.rados.rados.0.trial187.stdout:1: writing trial18717860-1 from 1542129 to 2016807 tid 2 2026-02-13T18:05:56.738 INFO:tasks.rados.rados.0.trial187.stdout:2: write initial oid 2 2026-02-13T18:05:56.739 INFO:tasks.rados.rados.0.trial187.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-13T18:05:56.742 INFO:tasks.rados.rados.0.trial187.stdout:2: writing trial18717860-2 from 416807 to 892056 tid 1 2026-02-13T18:05:56.746 INFO:tasks.rados.rados.0.trial187.stdout:2: writing trial18717860-2 from 1542129 to 2016807 tid 2 2026-02-13T18:05:56.746 INFO:tasks.rados.rados.0.trial187.stdout:3: write initial oid 3 2026-02-13T18:05:56.746 INFO:tasks.rados.rados.0.trial187.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-13T18:05:56.750 INFO:tasks.rados.rados.0.trial187.stdout:3: writing trial18717860-3 from 433614 to 984112 tid 1 2026-02-13T18:05:56.754 INFO:tasks.rados.rados.0.trial187.stdout:3: writing trial18717860-3 from 1600611 to 2033614 tid 2 2026-02-13T18:05:56.754 INFO:tasks.rados.rados.0.trial187.stdout:4: write initial oid 4 2026-02-13T18:05:56.754 INFO:tasks.rados.rados.0.trial187.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-13T18:05:56.758 INFO:tasks.rados.rados.0.trial187.stdout:4: writing trial18717860-4 from 450421 to 1076168 tid 1 2026-02-13T18:05:56.762 INFO:tasks.rados.rados.0.trial187.stdout:4: writing trial18717860-4 from 1659093 to 2050421 tid 2 2026-02-13T18:05:56.762 INFO:tasks.rados.rados.0.trial187.stdout:5: write initial oid 5 2026-02-13T18:05:56.762 INFO:tasks.rados.rados.0.trial187.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-13T18:05:56.766 INFO:tasks.rados.rados.0.trial187.stdout:5: writing trial18717860-5 from 467228 to 1168224 tid 1 2026-02-13T18:05:56.769 INFO:tasks.rados.rados.0.trial187.stdout:5: writing trial18717860-5 from 1717575 to 2067228 tid 2 2026-02-13T18:05:56.769 INFO:tasks.rados.rados.0.trial187.stdout:6: write initial oid 6 2026-02-13T18:05:56.770 INFO:tasks.rados.rados.0.trial187.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-13T18:05:56.774 INFO:tasks.rados.rados.0.trial187.stdout:6: writing trial18717860-6 from 484035 to 1260280 tid 1 2026-02-13T18:05:56.777 INFO:tasks.rados.rados.0.trial187.stdout:6: writing trial18717860-6 from 2059704 to 2084035 tid 2 2026-02-13T18:05:56.777 INFO:tasks.rados.rados.0.trial187.stdout:7: write initial oid 7 2026-02-13T18:05:56.777 INFO:tasks.rados.rados.0.trial187.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-13T18:05:56.780 INFO:tasks.rados.rados.0.trial187.stdout:7: writing trial18717860-7 from 500842 to 952336 tid 1 2026-02-13T18:05:56.785 INFO:tasks.rados.rados.0.trial187.stdout:7: writing trial18717860-7 from 1718186 to 2100842 tid 2 2026-02-13T18:05:56.785 INFO:tasks.rados.rados.0.trial187.stdout:8: write initial oid 8 2026-02-13T18:05:56.785 INFO:tasks.rados.rados.0.trial187.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-13T18:05:56.789 INFO:tasks.rados.rados.0.trial187.stdout:8: writing trial18717860-8 from 517649 to 1044392 tid 1 2026-02-13T18:05:56.793 INFO:tasks.rados.rados.0.trial187.stdout:8: writing trial18717860-8 from 1776668 to 2117649 tid 2 2026-02-13T18:05:56.793 INFO:tasks.rados.rados.0.trial187.stdout:9: write initial oid 9 2026-02-13T18:05:56.793 INFO:tasks.rados.rados.0.trial187.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-13T18:05:56.797 INFO:tasks.rados.rados.0.trial187.stdout:9: writing trial18717860-9 from 534456 to 1252801 tid 1 2026-02-13T18:05:56.801 INFO:tasks.rados.rados.0.trial187.stdout:9: writing trial18717860-9 from 1951503 to 2134456 tid 2 2026-02-13T18:05:56.801 INFO:tasks.rados.rados.0.trial187.stdout:10: write initial oid 10 2026-02-13T18:05:56.801 INFO:tasks.rados.rados.0.trial187.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-13T18:05:56.806 INFO:tasks.rados.rados.0.trial187.stdout:10: writing trial18717860-10 from 551263 to 1344857 tid 1 2026-02-13T18:05:56.809 INFO:tasks.rados.rados.0.trial187.stdout:10: writing trial18717860-10 from 1893632 to 2151263 tid 2 2026-02-13T18:05:56.809 INFO:tasks.rados.rados.0.trial187.stdout:11: write initial oid 11 2026-02-13T18:05:56.809 INFO:tasks.rados.rados.0.trial187.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-13T18:05:56.812 INFO:tasks.rados.rados.0.trial187.stdout:11: writing trial18717860-11 from 568070 to 1036913 tid 1 2026-02-13T18:05:56.817 INFO:tasks.rados.rados.0.trial187.stdout:11: writing trial18717860-11 from 1552114 to 2168070 tid 2 2026-02-13T18:05:56.817 INFO:tasks.rados.rados.0.trial187.stdout:12: write initial oid 12 2026-02-13T18:05:56.817 INFO:tasks.rados.rados.0.trial187.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-13T18:05:56.821 INFO:tasks.rados.rados.0.trial187.stdout:12: writing trial18717860-12 from 584877 to 1128969 tid 1 2026-02-13T18:05:56.825 INFO:tasks.rados.rados.0.trial187.stdout:12: writing trial18717860-12 from 1610596 to 2172599 tid 2 2026-02-13T18:05:56.825 INFO:tasks.rados.rados.0.trial187.stdout:13: write initial oid 13 2026-02-13T18:05:56.826 INFO:tasks.rados.rados.0.trial187.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-13T18:05:56.829 INFO:tasks.rados.rados.0.trial187.stdout:13: writing trial18717860-13 from 601684 to 1221025 tid 1 2026-02-13T18:05:56.833 INFO:tasks.rados.rados.0.trial187.stdout:13: writing trial18717860-13 from 1669078 to 2201684 tid 2 2026-02-13T18:05:56.833 INFO:tasks.rados.rados.0.trial187.stdout:14: write initial oid 14 2026-02-13T18:05:56.833 INFO:tasks.rados.rados.0.trial187.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-13T18:05:56.838 INFO:tasks.rados.rados.0.trial187.stdout:14: writing trial18717860-14 from 618491 to 1313081 tid 1 2026-02-13T18:05:56.841 INFO:tasks.rados.rados.0.trial187.stdout:14: writing trial18717860-14 from 2011207 to 2218491 tid 2 2026-02-13T18:05:56.841 INFO:tasks.rados.rados.0.trial187.stdout:15: write initial oid 15 2026-02-13T18:05:56.841 INFO:tasks.rados.rados.0.trial187.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-13T18:05:56.846 INFO:tasks.rados.rados.0.trial187.stdout:15: writing trial18717860-15 from 635298 to 1405137 tid 1 2026-02-13T18:05:56.850 INFO:tasks.rados.rados.0.trial187.stdout:15: writing trial18717860-15 from 2069689 to 2235298 tid 2 2026-02-13T18:05:56.850 INFO:tasks.rados.rados.0.trial187.stdout:16: write initial oid 16 2026-02-13T18:05:56.850 INFO:tasks.rados.rados.0.trial187.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-13T18:05:56.854 INFO:tasks.rados.rados.0.trial187.stdout:16: writing trial18717860-16 from 652105 to 1097193 tid 1 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:16: writing trial18717860-16 from 1728171 to 2181159 tid 2 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: finishing write tid 1 to trial18717860-1 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: finishing write tid 2 to trial18717860-1 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: finishing write tid 3 to trial18717860-1 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: finishing write tid 4 to trial18717860-1 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: oid 1 updating version 0 to 3 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: oid 1 version 3 is already newer than 2 2026-02-13T18:05:56.859 INFO:tasks.rados.rados.0.trial187.stdout:1: oid 1 version 3 is already newer than 1 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:2: finishing write tid 1 to trial18717860-2 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:2: finishing write tid 2 to trial18717860-2 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:1: done (15 left) 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:17: write initial oid 17 2026-02-13T18:05:56.860 INFO:tasks.rados.rados.0.trial187.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-13T18:05:56.863 INFO:tasks.rados.rados.0.trial187.stdout:17: writing trial18717860-17 from 668912 to 1305602 tid 1 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:17: writing trial18717860-17 from 1903006 to 2268912 tid 2 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:2: finishing write tid 3 to trial18717860-2 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:2: finishing write tid 4 to trial18717860-2 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:2: oid 2 updating version 0 to 2 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:2: oid 2 version 2 is already newer than 1 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:2: oid 2 updating version 2 to 3 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-13T18:05:56.868 INFO:tasks.rados.rados.0.trial187.stdout:3: finishing write tid 1 to trial18717860-3 2026-02-13T18:05:56.869 INFO:tasks.rados.rados.0.trial187.stdout:3: finishing write tid 2 to trial18717860-3 2026-02-13T18:05:56.869 INFO:tasks.rados.rados.0.trial187.stdout:3: finishing write tid 3 to trial18717860-3 2026-02-13T18:05:56.869 INFO:tasks.rados.rados.0.trial187.stdout:2: done (15 left) 2026-02-13T18:05:56.869 INFO:tasks.rados.rados.0.trial187.stdout:18: write initial oid 18 2026-02-13T18:05:56.869 INFO:tasks.rados.rados.0.trial187.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-13T18:05:56.872 INFO:tasks.rados.rados.0.trial187.stdout:18: writing trial18717860-18 from 685719 to 1397658 tid 1 2026-02-13T18:05:56.876 INFO:tasks.rados.rados.0.trial187.stdout:18: writing trial18717860-18 from 1845135 to 2285719 tid 2 2026-02-13T18:05:56.876 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.876 INFO:tasks.rados.rados.0.trial187.stdout:3: finishing write tid 4 to trial18717860-3 2026-02-13T18:05:56.876 INFO:tasks.rados.rados.0.trial187.stdout:3: oid 3 updating version 0 to 3 2026-02-13T18:05:56.876 INFO:tasks.rados.rados.0.trial187.stdout:3: oid 3 version 3 is already newer than 1 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:3: oid 3 version 3 is already newer than 2 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:4: finishing write tid 1 to trial18717860-4 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:4: finishing write tid 2 to trial18717860-4 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:4: finishing write tid 3 to trial18717860-4 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:3: done (15 left) 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:19: write initial oid 19 2026-02-13T18:05:56.877 INFO:tasks.rados.rados.0.trial187.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-13T18:05:56.881 INFO:tasks.rados.rados.0.trial187.stdout:19: writing trial18717860-19 from 702526 to 1489714 tid 1 2026-02-13T18:05:56.885 INFO:tasks.rados.rados.0.trial187.stdout:19: writing trial18717860-19 from 1903617 to 2302526 tid 2 2026-02-13T18:05:56.885 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.885 INFO:tasks.rados.rados.0.trial187.stdout:4: finishing write tid 4 to trial18717860-4 2026-02-13T18:05:56.885 INFO:tasks.rados.rados.0.trial187.stdout:4: oid 4 updating version 0 to 2 2026-02-13T18:05:56.885 INFO:tasks.rados.rados.0.trial187.stdout:4: oid 4 version 2 is already newer than 1 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:4: oid 4 updating version 2 to 3 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:5: finishing write tid 1 to trial18717860-5 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:4: done (15 left) 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:20: write initial oid 20 2026-02-13T18:05:56.886 INFO:tasks.rados.rados.0.trial187.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-13T18:05:56.889 INFO:tasks.rados.rados.0.trial187.stdout:20: writing trial18717860-20 from 719333 to 1181770 tid 1 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout:20: writing trial18717860-20 from 1962099 to 2319333 tid 2 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout:5: finishing write tid 2 to trial18717860-5 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout:5: finishing write tid 3 to trial18717860-5 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout:5: finishing write tid 4 to trial18717860-5 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout:5: oid 5 updating version 0 to 1 2026-02-13T18:05:56.894 INFO:tasks.rados.rados.0.trial187.stdout:5: oid 5 updating version 1 to 2 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:5: oid 5 updating version 2 to 3 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:6: finishing write tid 1 to trial18717860-6 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:6: finishing write tid 2 to trial18717860-6 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:5: done (15 left) 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:21: write initial oid 21 2026-02-13T18:05:56.895 INFO:tasks.rados.rados.0.trial187.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-13T18:05:56.898 INFO:tasks.rados.rados.0.trial187.stdout:21: writing trial18717860-21 from 736140 to 1273826 tid 1 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:21: writing trial18717860-21 from 2020581 to 2336140 tid 2 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:6: finishing write tid 3 to trial18717860-6 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:6: finishing write tid 4 to trial18717860-6 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:6: oid 6 updating version 0 to 1 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:6: oid 6 updating version 1 to 2 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:6: oid 6 updating version 2 to 3 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:7: finishing write tid 1 to trial18717860-7 2026-02-13T18:05:56.903 INFO:tasks.rados.rados.0.trial187.stdout:7: finishing write tid 2 to trial18717860-7 2026-02-13T18:05:56.904 INFO:tasks.rados.rados.0.trial187.stdout:7: finishing write tid 3 to trial18717860-7 2026-02-13T18:05:56.904 INFO:tasks.rados.rados.0.trial187.stdout:6: done (15 left) 2026-02-13T18:05:56.904 INFO:tasks.rados.rados.0.trial187.stdout:22: write initial oid 22 2026-02-13T18:05:56.904 INFO:tasks.rados.rados.0.trial187.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-13T18:05:56.907 INFO:tasks.rados.rados.0.trial187.stdout:22: writing trial18717860-22 from 752947 to 1365882 tid 1 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:22: writing trial18717860-22 from 1962710 to 2352947 tid 2 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:7: finishing write tid 4 to trial18717860-7 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:7: oid 7 updating version 0 to 3 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:7: oid 7 version 3 is already newer than 2 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:7: oid 7 version 3 is already newer than 1 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-13T18:05:56.913 INFO:tasks.rados.rados.0.trial187.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: finishing write tid 1 to trial18717860-8 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: finishing write tid 2 to trial18717860-8 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: finishing write tid 3 to trial18717860-8 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: finishing write tid 4 to trial18717860-8 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: oid 8 updating version 0 to 2 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: oid 8 version 2 is already newer than 1 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: oid 8 updating version 2 to 3 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:9: finishing write tid 1 to trial18717860-9 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:9: finishing write tid 2 to trial18717860-9 2026-02-13T18:05:56.914 INFO:tasks.rados.rados.0.trial187.stdout:9: finishing write tid 3 to trial18717860-9 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:9: finishing write tid 4 to trial18717860-9 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:9: oid 9 updating version 0 to 5 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:9: oid 9 version 5 is already newer than 4 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:9: oid 9 updating version 5 to 6 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: finishing write tid 1 to trial18717860-10 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: finishing write tid 2 to trial18717860-10 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: finishing write tid 3 to trial18717860-10 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: finishing write tid 4 to trial18717860-10 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: oid 10 updating version 0 to 1 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: oid 10 updating version 1 to 2 2026-02-13T18:05:56.915 INFO:tasks.rados.rados.0.trial187.stdout:10: oid 10 updating version 2 to 3 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: finishing write tid 1 to trial18717860-11 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: finishing write tid 2 to trial18717860-11 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: finishing write tid 3 to trial18717860-11 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: finishing write tid 4 to trial18717860-11 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: oid 11 updating version 0 to 1 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: oid 11 updating version 1 to 3 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: oid 11 version 3 is already newer than 2 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 3 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:12: finishing write tid 1 to trial18717860-12 2026-02-13T18:05:56.916 INFO:tasks.rados.rados.0.trial187.stdout:12: finishing write tid 2 to trial18717860-12 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:12: finishing write tid 3 to trial18717860-12 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:12: finishing write tid 4 to trial18717860-12 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:12: oid 12 updating version 0 to 4 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:12: oid 12 updating version 4 to 5 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:12: oid 12 updating version 5 to 6 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 6 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:13: finishing write tid 1 to trial18717860-13 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:13: finishing write tid 2 to trial18717860-13 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:13: finishing write tid 3 to trial18717860-13 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:13: finishing write tid 4 to trial18717860-13 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:13: oid 13 updating version 0 to 4 2026-02-13T18:05:56.917 INFO:tasks.rados.rados.0.trial187.stdout:13: oid 13 updating version 4 to 5 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:13: oid 13 updating version 5 to 6 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: finishing write tid 1 to trial18717860-14 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: finishing write tid 2 to trial18717860-14 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: finishing write tid 3 to trial18717860-14 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: finishing write tid 4 to trial18717860-14 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: oid 14 updating version 0 to 3 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: oid 14 version 3 is already newer than 2 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: oid 14 version 3 is already newer than 1 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 3 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-13T18:05:56.918 INFO:tasks.rados.rados.0.trial187.stdout:15: finishing write tid 1 to trial18717860-15 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: finishing write tid 2 to trial18717860-15 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: finishing write tid 3 to trial18717860-15 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: finishing write tid 4 to trial18717860-15 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: oid 15 updating version 0 to 5 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: oid 15 version 5 is already newer than 4 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: oid 15 updating version 5 to 6 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:16: finishing write tid 1 to trial18717860-16 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:7: done (15 left) 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:8: done (14 left) 2026-02-13T18:05:56.919 INFO:tasks.rados.rados.0.trial187.stdout:9: done (13 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:10: done (12 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:11: done (11 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:12: done (10 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:13: done (9 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:14: done (8 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:15: done (7 left) 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:23: write initial oid 23 2026-02-13T18:05:56.920 INFO:tasks.rados.rados.0.trial187.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-13T18:05:56.921 INFO:tasks.rados.rados.0.trial187.stdout:23: writing trial18717860-23 from 769754 to 1457938 tid 1 2026-02-13T18:05:56.921 INFO:tasks.rados.rados.0.trial187.stdout:23: writing trial18717860-23 from 2021192 to 2369754 tid 2 2026-02-13T18:05:56.921 INFO:tasks.rados.rados.0.trial187.stdout:24: write initial oid 24 2026-02-13T18:05:56.921 INFO:tasks.rados.rados.0.trial187.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-13T18:05:56.925 INFO:tasks.rados.rados.0.trial187.stdout:24: writing trial18717860-24 from 786561 to 1266347 tid 1 2026-02-13T18:05:56.928 INFO:tasks.rados.rados.0.trial187.stdout:24: writing trial18717860-24 from 1796027 to 2263691 tid 2 2026-02-13T18:05:56.929 INFO:tasks.rados.rados.0.trial187.stdout:25: write initial oid 25 2026-02-13T18:05:56.929 INFO:tasks.rados.rados.0.trial187.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-13T18:05:56.932 INFO:tasks.rados.rados.0.trial187.stdout:25: writing trial18717860-25 from 403368 to 958403 tid 1 2026-02-13T18:05:56.937 INFO:tasks.rados.rados.0.trial187.stdout:25: writing trial18717860-25 from 1454509 to 2182184 tid 2 2026-02-13T18:05:56.937 INFO:tasks.rados.rados.0.trial187.stdout:26: write initial oid 26 2026-02-13T18:05:56.937 INFO:tasks.rados.rados.0.trial187.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-13T18:05:56.940 INFO:tasks.rados.rados.0.trial187.stdout:26: writing trial18717860-26 from 420175 to 1050459 tid 1 2026-02-13T18:05:56.945 INFO:tasks.rados.rados.0.trial187.stdout:26: writing trial18717860-26 from 1796638 to 2267971 tid 2 2026-02-13T18:05:56.945 INFO:tasks.rados.rados.0.trial187.stdout:27: write initial oid 27 2026-02-13T18:05:56.945 INFO:tasks.rados.rados.0.trial187.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-13T18:05:56.949 INFO:tasks.rados.rados.0.trial187.stdout:27: writing trial18717860-27 from 436982 to 1142515 tid 1 2026-02-13T18:05:56.954 INFO:tasks.rados.rados.0.trial187.stdout:27: writing trial18717860-27 from 1855120 to 2436982 tid 2 2026-02-13T18:05:56.954 INFO:tasks.rados.rados.0.trial187.stdout:28: write initial oid 28 2026-02-13T18:05:56.954 INFO:tasks.rados.rados.0.trial187.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-13T18:05:56.958 INFO:tasks.rados.rados.0.trial187.stdout:28: writing trial18717860-28 from 453789 to 1234571 tid 1 2026-02-13T18:05:56.963 INFO:tasks.rados.rados.0.trial187.stdout:28: writing trial18717860-28 from 1913602 to 2388604 tid 2 2026-02-13T18:05:56.963 INFO:tasks.rados.rados.0.trial187.stdout:29: write initial oid 29 2026-02-13T18:05:56.963 INFO:tasks.rados.rados.0.trial187.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-13T18:05:56.966 INFO:tasks.rados.rados.0.trial187.stdout:29: writing trial18717860-29 from 470596 to 926627 tid 1 2026-02-13T18:05:56.971 INFO:tasks.rados.rados.0.trial187.stdout:29: writing trial18717860-29 from 1572084 to 2190744 tid 2 2026-02-13T18:05:56.971 INFO:tasks.rados.rados.0.trial187.stdout:30: write initial oid 30 2026-02-13T18:05:56.971 INFO:tasks.rados.rados.0.trial187.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-13T18:05:56.975 INFO:tasks.rados.rados.0.trial187.stdout:30: writing trial18717860-30 from 487403 to 1018683 tid 1 2026-02-13T18:05:56.978 INFO:tasks.rados.rados.0.trial187.stdout:30: writing trial18717860-30 from 1514213 to 1992884 tid 2 2026-02-13T18:05:56.978 INFO:tasks.rados.rados.0.trial187.stdout:31: write initial oid 31 2026-02-13T18:05:56.979 INFO:tasks.rados.rados.0.trial187.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-13T18:05:56.982 INFO:tasks.rados.rados.0.trial187.stdout:31: writing trial18717860-31 from 504210 to 1110739 tid 1 2026-02-13T18:05:56.987 INFO:tasks.rados.rados.0.trial187.stdout:31: writing trial18717860-31 from 1572695 to 2195024 tid 2 2026-02-13T18:05:56.987 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:56.987 INFO:tasks.rados.rados.0.trial187.stdout:16: finishing write tid 2 to trial18717860-16 2026-02-13T18:05:56.987 INFO:tasks.rados.rados.0.trial187.stdout:16: finishing write tid 3 to trial18717860-16 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:16: finishing write tid 4 to trial18717860-16 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:16: oid 16 updating version 0 to 3 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:16: oid 16 version 3 is already newer than 2 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:16: oid 16 version 3 is already newer than 1 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 3 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:17: finishing write tid 1 to trial18717860-17 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:17: finishing write tid 2 to trial18717860-17 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:17: finishing write tid 3 to trial18717860-17 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:17: finishing write tid 4 to trial18717860-17 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:17: oid 17 updating version 0 to 8 2026-02-13T18:05:56.988 INFO:tasks.rados.rados.0.trial187.stdout:17: oid 17 version 8 is already newer than 7 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:17: oid 17 updating version 8 to 9 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 9 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:18: finishing write tid 1 to trial18717860-18 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:18: finishing write tid 2 to trial18717860-18 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:19: finishing write tid 1 to trial18717860-19 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:16: done (15 left) 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:17: done (14 left) 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:32: write initial oid 32 2026-02-13T18:05:56.989 INFO:tasks.rados.rados.0.trial187.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-13T18:05:56.991 INFO:tasks.rados.rados.0.trial187.stdout:32: writing trial18717860-32 from 521017 to 1319148 tid 1 2026-02-13T18:05:56.995 INFO:tasks.rados.rados.0.trial187.stdout:32: writing trial18717860-32 from 1747530 to 2229870 tid 2 2026-02-13T18:05:56.995 INFO:tasks.rados.rados.0.trial187.stdout:33: write initial oid 33 2026-02-13T18:05:56.995 INFO:tasks.rados.rados.0.trial187.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-13T18:05:56.999 INFO:tasks.rados.rados.0.trial187.stdout:33: writing trial18717860-33 from 537824 to 1011204 tid 1 2026-02-13T18:05:57.004 INFO:tasks.rados.rados.0.trial187.stdout:33: writing trial18717860-33 from 1806012 to 2432010 tid 2 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: finishing write tid 2 to trial18717860-19 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: finishing write tid 3 to trial18717860-19 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: finishing write tid 4 to trial18717860-19 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: oid 19 updating version 0 to 7 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: oid 19 updating version 7 to 9 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: oid 19 version 9 is already newer than 8 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 9 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:18: finishing write tid 3 to trial18717860-18 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:18: finishing write tid 4 to trial18717860-18 2026-02-13T18:05:57.005 INFO:tasks.rados.rados.0.trial187.stdout:18: oid 18 updating version 0 to 9 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:18: oid 18 version 9 is already newer than 8 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:18: oid 18 version 9 is already newer than 7 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 9 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:20: finishing write tid 1 to trial18717860-20 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:20: finishing write tid 2 to trial18717860-20 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:20: finishing write tid 3 to trial18717860-20 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:18: done (15 left) 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:19: done (14 left) 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:34: write initial oid 34 2026-02-13T18:05:57.006 INFO:tasks.rados.rados.0.trial187.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-13T18:05:57.008 INFO:tasks.rados.rados.0.trial187.stdout:34: writing trial18717860-34 from 554631 to 1103260 tid 1 2026-02-13T18:05:57.012 INFO:tasks.rados.rados.0.trial187.stdout:34: writing trial18717860-34 from 1748141 to 2234150 tid 2 2026-02-13T18:05:57.012 INFO:tasks.rados.rados.0.trial187.stdout:35: write initial oid 35 2026-02-13T18:05:57.013 INFO:tasks.rados.rados.0.trial187.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-13T18:05:57.017 INFO:tasks.rados.rados.0.trial187.stdout:35: writing trial18717860-35 from 571438 to 1195316 tid 1 2026-02-13T18:05:57.023 INFO:tasks.rados.rados.0.trial187.stdout:35: writing trial18717860-35 from 1806623 to 2436290 tid 2 2026-02-13T18:05:57.023 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.023 INFO:tasks.rados.rados.0.trial187.stdout:20: finishing write tid 4 to trial18717860-20 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:20: oid 20 updating version 0 to 5 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:20: oid 20 updating version 5 to 6 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:20: oid 20 version 6 is already newer than 4 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 6 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: finishing write tid 1 to trial18717860-21 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: finishing write tid 2 to trial18717860-21 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: finishing write tid 3 to trial18717860-21 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: finishing write tid 4 to trial18717860-21 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: oid 21 updating version 0 to 6 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: oid 21 version 6 is already newer than 4 2026-02-13T18:05:57.024 INFO:tasks.rados.rados.0.trial187.stdout:21: oid 21 version 6 is already newer than 5 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: finishing write tid 1 to trial18717860-22 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: finishing write tid 2 to trial18717860-22 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: finishing write tid 3 to trial18717860-22 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: finishing write tid 4 to trial18717860-22 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: oid 22 updating version 0 to 3 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: oid 22 version 3 is already newer than 1 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: oid 22 version 3 is already newer than 2 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 3 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:23: finishing write tid 1 to trial18717860-23 2026-02-13T18:05:57.025 INFO:tasks.rados.rados.0.trial187.stdout:23: finishing write tid 2 to trial18717860-23 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:23: finishing write tid 3 to trial18717860-23 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:23: finishing write tid 4 to trial18717860-23 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:23: oid 23 updating version 0 to 5 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:23: oid 23 version 5 is already newer than 4 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:23: oid 23 updating version 5 to 6 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:24: finishing write tid 1 to trial18717860-24 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:24: finishing write tid 2 to trial18717860-24 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:24: finishing write tid 3 to trial18717860-24 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:24: finishing write tid 4 to trial18717860-24 2026-02-13T18:05:57.026 INFO:tasks.rados.rados.0.trial187.stdout:24: oid 24 updating version 0 to 4 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:24: oid 24 updating version 4 to 5 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:24: oid 24 updating version 5 to 6 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 6 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: finishing write tid 1 to trial18717860-25 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: finishing write tid 2 to trial18717860-25 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: finishing write tid 3 to trial18717860-25 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: finishing write tid 4 to trial18717860-25 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: oid 25 updating version 0 to 1 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: oid 25 updating version 1 to 2 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: oid 25 updating version 2 to 3 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 3 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-13T18:05:57.027 INFO:tasks.rados.rados.0.trial187.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: finishing write tid 1 to trial18717860-26 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: finishing write tid 2 to trial18717860-26 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: finishing write tid 3 to trial18717860-26 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: finishing write tid 4 to trial18717860-26 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: oid 26 updating version 0 to 11 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: oid 26 version 11 is already newer than 10 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: oid 26 updating version 11 to 12 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 12 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:27: finishing write tid 1 to trial18717860-27 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:27: finishing write tid 2 to trial18717860-27 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:27: finishing write tid 3 to trial18717860-27 2026-02-13T18:05:57.028 INFO:tasks.rados.rados.0.trial187.stdout:27: finishing write tid 4 to trial18717860-27 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:27: oid 27 updating version 0 to 4 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:27: oid 27 updating version 4 to 6 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:27: oid 27 version 6 is already newer than 5 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 6 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: finishing write tid 1 to trial18717860-28 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: finishing write tid 2 to trial18717860-28 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:29: finishing write tid 1 to trial18717860-29 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: finishing write tid 3 to trial18717860-28 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: finishing write tid 4 to trial18717860-28 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: oid 28 updating version 0 to 8 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: oid 28 version 8 is already newer than 7 2026-02-13T18:05:57.029 INFO:tasks.rados.rados.0.trial187.stdout:28: oid 28 updating version 8 to 9 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 9 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: finishing write tid 2 to trial18717860-29 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: finishing write tid 3 to trial18717860-29 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: finishing write tid 4 to trial18717860-29 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: oid 29 updating version 0 to 10 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: oid 29 updating version 10 to 12 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: oid 29 version 12 is already newer than 11 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 12 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-13T18:05:57.030 INFO:tasks.rados.rados.0.trial187.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: finishing write tid 1 to trial18717860-30 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: finishing write tid 2 to trial18717860-30 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: finishing write tid 3 to trial18717860-30 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: finishing write tid 4 to trial18717860-30 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: oid 30 updating version 0 to 4 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: oid 30 updating version 4 to 6 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: oid 30 version 6 is already newer than 5 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:31: finishing write tid 1 to trial18717860-31 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:31: finishing write tid 2 to trial18717860-31 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:31: finishing write tid 3 to trial18717860-31 2026-02-13T18:05:57.031 INFO:tasks.rados.rados.0.trial187.stdout:20: done (15 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:21: done (14 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:22: done (13 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:23: done (12 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:24: done (11 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:25: done (10 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:26: done (9 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:27: done (8 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:28: done (7 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:29: done (6 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:30: done (5 left) 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:36: write initial oid 36 2026-02-13T18:05:57.032 INFO:tasks.rados.rados.0.trial187.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-13T18:05:57.033 INFO:tasks.rados.rados.0.trial187.stdout:36: writing trial18717860-36 from 588245 to 1287372 tid 1 2026-02-13T18:05:57.033 INFO:tasks.rados.rados.0.trial187.stdout:36: writing trial18717860-36 from 1865105 to 2354783 tid 2 2026-02-13T18:05:57.033 INFO:tasks.rados.rados.0.trial187.stdout:37: write initial oid 37 2026-02-13T18:05:57.033 INFO:tasks.rados.rados.0.trial187.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-13T18:05:57.035 INFO:tasks.rados.rados.0.trial187.stdout:37: writing trial18717860-37 from 605052 to 1379428 tid 1 2026-02-13T18:05:57.040 INFO:tasks.rados.rados.0.trial187.stdout:37: writing trial18717860-37 from 1923587 to 2556923 tid 2 2026-02-13T18:05:57.040 INFO:tasks.rados.rados.0.trial187.stdout:38: write initial oid 38 2026-02-13T18:05:57.040 INFO:tasks.rados.rados.0.trial187.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-13T18:05:57.044 INFO:tasks.rados.rados.0.trial187.stdout:38: writing trial18717860-38 from 621859 to 1071484 tid 1 2026-02-13T18:05:57.049 INFO:tasks.rados.rados.0.trial187.stdout:38: writing trial18717860-38 from 1865716 to 2621859 tid 2 2026-02-13T18:05:57.050 INFO:tasks.rados.rados.0.trial187.stdout:39: write initial oid 39 2026-02-13T18:05:57.050 INFO:tasks.rados.rados.0.trial187.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-13T18:05:57.054 INFO:tasks.rados.rados.0.trial187.stdout:39: writing trial18717860-39 from 638666 to 1163540 tid 1 2026-02-13T18:05:57.059 INFO:tasks.rados.rados.0.trial187.stdout:39: writing trial18717860-39 from 1924198 to 2561203 tid 2 2026-02-13T18:05:57.059 INFO:tasks.rados.rados.0.trial187.stdout:40: write initial oid 40 2026-02-13T18:05:57.059 INFO:tasks.rados.rados.0.trial187.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-13T18:05:57.064 INFO:tasks.rados.rados.0.trial187.stdout:40: writing trial18717860-40 from 655473 to 1371949 tid 1 2026-02-13T18:05:57.069 INFO:tasks.rados.rados.0.trial187.stdout:40: writing trial18717860-40 from 2099033 to 2655473 tid 2 2026-02-13T18:05:57.069 INFO:tasks.rados.rados.0.trial187.stdout:41: write initial oid 41 2026-02-13T18:05:57.069 INFO:tasks.rados.rados.0.trial187.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-13T18:05:57.074 INFO:tasks.rados.rados.0.trial187.stdout:41: writing trial18717860-41 from 672280 to 1464005 tid 1 2026-02-13T18:05:57.079 INFO:tasks.rados.rados.0.trial187.stdout:41: writing trial18717860-41 from 2157515 to 2672280 tid 2 2026-02-13T18:05:57.079 INFO:tasks.rados.rados.0.trial187.stdout:42: write initial oid 42 2026-02-13T18:05:57.079 INFO:tasks.rados.rados.0.trial187.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-13T18:05:57.083 INFO:tasks.rados.rados.0.trial187.stdout:42: writing trial18717860-42 from 689087 to 1156061 tid 1 2026-02-13T18:05:57.088 INFO:tasks.rados.rados.0.trial187.stdout:42: writing trial18717860-42 from 1699644 to 2483976 tid 2 2026-02-13T18:05:57.088 INFO:tasks.rados.rados.0.trial187.stdout:43: write initial oid 43 2026-02-13T18:05:57.088 INFO:tasks.rados.rados.0.trial187.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-13T18:05:57.092 INFO:tasks.rados.rados.0.trial187.stdout:43: writing trial18717860-43 from 705894 to 1248117 tid 1 2026-02-13T18:05:57.097 INFO:tasks.rados.rados.0.trial187.stdout:43: writing trial18717860-43 from 1758126 to 2402469 tid 2 2026-02-13T18:05:57.097 INFO:tasks.rados.rados.0.trial187.stdout:44: write initial oid 44 2026-02-13T18:05:57.097 INFO:tasks.rados.rados.0.trial187.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-13T18:05:57.102 INFO:tasks.rados.rados.0.trial187.stdout:44: writing trial18717860-44 from 722701 to 1340173 tid 1 2026-02-13T18:05:57.106 INFO:tasks.rados.rados.0.trial187.stdout:44: writing trial18717860-44 from 1816608 to 2604609 tid 2 2026-02-13T18:05:57.106 INFO:tasks.rados.rados.0.trial187.stdout:45: write initial oid 45 2026-02-13T18:05:57.107 INFO:tasks.rados.rados.0.trial187.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-13T18:05:57.112 INFO:tasks.rados.rados.0.trial187.stdout:45: writing trial18717860-45 from 739508 to 1432229 tid 1 2026-02-13T18:05:57.116 INFO:tasks.rados.rados.0.trial187.stdout:45: writing trial18717860-45 from 1875090 to 2523102 tid 2 2026-02-13T18:05:57.116 INFO:tasks.rados.rados.0.trial187.stdout:46: write initial oid 46 2026-02-13T18:05:57.116 INFO:tasks.rados.rados.0.trial187.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-13T18:05:57.121 INFO:tasks.rados.rados.0.trial187.stdout:46: writing trial18717860-46 from 756315 to 1524285 tid 1 2026-02-13T18:05:57.126 INFO:tasks.rados.rados.0.trial187.stdout:46: writing trial18717860-46 from 1933572 to 2725242 tid 2 2026-02-13T18:05:57.126 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:31: finishing write tid 4 to trial18717860-31 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:31: oid 31 updating version 0 to 4 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:31: oid 31 updating version 4 to 6 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:31: oid 31 version 6 is already newer than 5 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 6 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:32: finishing write tid 1 to trial18717860-32 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:31: done (15 left) 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:47: write initial oid 47 2026-02-13T18:05:57.127 INFO:tasks.rados.rados.0.trial187.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-13T18:05:57.131 INFO:tasks.rados.rados.0.trial187.stdout:47: writing trial18717860-47 from 773122 to 1332694 tid 1 2026-02-13T18:05:57.136 INFO:tasks.rados.rados.0.trial187.stdout:47: writing trial18717860-47 from 1992054 to 2643735 tid 2 2026-02-13T18:05:57.136 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: finishing write tid 2 to trial18717860-32 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: finishing write tid 3 to trial18717860-32 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: finishing write tid 4 to trial18717860-32 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: oid 32 updating version 0 to 9 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: oid 32 version 9 is already newer than 7 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: oid 32 version 9 is already newer than 8 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 9 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:33: finishing write tid 1 to trial18717860-33 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:33: finishing write tid 2 to trial18717860-33 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:33: finishing write tid 3 to trial18717860-33 2026-02-13T18:05:57.137 INFO:tasks.rados.rados.0.trial187.stdout:32: done (15 left) 2026-02-13T18:05:57.138 INFO:tasks.rados.rados.0.trial187.stdout:48: write initial oid 48 2026-02-13T18:05:57.138 INFO:tasks.rados.rados.0.trial187.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-13T18:05:57.141 INFO:tasks.rados.rados.0.trial187.stdout:48: writing trial18717860-48 from 789929 to 1424750 tid 1 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:48: writing trial18717860-48 from 2050536 to 2789929 tid 2 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:33: finishing write tid 4 to trial18717860-33 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:33: oid 33 updating version 0 to 4 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:33: oid 33 updating version 4 to 6 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:33: oid 33 version 6 is already newer than 5 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 6 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:34: finishing write tid 1 to trial18717860-34 2026-02-13T18:05:57.147 INFO:tasks.rados.rados.0.trial187.stdout:33: done (15 left) 2026-02-13T18:05:57.148 INFO:tasks.rados.rados.0.trial187.stdout:49: write initial oid 49 2026-02-13T18:05:57.148 INFO:tasks.rados.rados.0.trial187.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-13T18:05:57.150 INFO:tasks.rados.rados.0.trial187.stdout:49: writing trial18717860-49 from 406736 to 1116806 tid 1 2026-02-13T18:05:57.155 INFO:tasks.rados.rados.0.trial187.stdout:49: writing trial18717860-49 from 1709018 to 2364368 tid 2 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: finishing write tid 2 to trial18717860-34 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: finishing write tid 3 to trial18717860-34 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: finishing write tid 4 to trial18717860-34 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: oid 34 updating version 0 to 6 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: oid 34 version 6 is already newer than 4 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: oid 34 version 6 is already newer than 5 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:35: finishing write tid 1 to trial18717860-35 2026-02-13T18:05:57.156 INFO:tasks.rados.rados.0.trial187.stdout:34: done (15 left) 2026-02-13T18:05:57.157 INFO:tasks.rados.rados.0.trial187.stdout:50: write initial oid 50 2026-02-13T18:05:57.157 INFO:tasks.rados.rados.0.trial187.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-13T18:05:57.160 INFO:tasks.rados.rados.0.trial187.stdout:50: writing trial18717860-50 from 423543 to 1208862 tid 1 2026-02-13T18:05:57.167 INFO:tasks.rados.rados.0.trial187.stdout:50: writing trial18717860-50 from 1767500 to 2566508 tid 2 2026-02-13T18:05:57.167 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:05:57.167 INFO:tasks.rados.rados.0.trial187.stdout:35: finishing write tid 2 to trial18717860-35 2026-02-13T18:05:57.167 INFO:tasks.rados.rados.0.trial187.stdout:35: finishing write tid 3 to trial18717860-35 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:35: finishing write tid 4 to trial18717860-35 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:35: oid 35 updating version 0 to 3 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:35: oid 35 version 3 is already newer than 1 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:35: oid 35 version 3 is already newer than 2 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 3 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:36: finishing write tid 1 to trial18717860-36 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:36: finishing write tid 2 to trial18717860-36 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:36: finishing write tid 3 to trial18717860-36 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:35: done (15 left) 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:51: snap_create 2026-02-13T18:05:57.168 INFO:tasks.rados.rados.0.trial187.stdout:36: finishing write tid 4 to trial18717860-36 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:36: oid 36 updating version 0 to 8 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:36: oid 36 version 8 is already newer than 7 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:36: oid 36 updating version 8 to 9 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 9 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: finishing write tid 1 to trial18717860-37 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: finishing write tid 2 to trial18717860-37 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: finishing write tid 3 to trial18717860-37 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: finishing write tid 4 to trial18717860-37 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: oid 37 updating version 0 to 7 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: oid 37 updating version 7 to 8 2026-02-13T18:05:57.169 INFO:tasks.rados.rados.0.trial187.stdout:37: oid 37 updating version 8 to 9 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 9 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: finishing write tid 1 to trial18717860-38 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: finishing write tid 2 to trial18717860-38 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: finishing write tid 3 to trial18717860-38 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: finishing write tid 4 to trial18717860-38 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: oid 38 updating version 0 to 6 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: oid 38 version 6 is already newer than 5 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: oid 38 version 6 is already newer than 4 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-13T18:05:57.170 INFO:tasks.rados.rados.0.trial187.stdout:39: finishing write tid 1 to trial18717860-39 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: finishing write tid 2 to trial18717860-39 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: finishing write tid 3 to trial18717860-39 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: finishing write tid 4 to trial18717860-39 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: oid 39 updating version 0 to 14 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: oid 39 updating version 14 to 15 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: oid 39 version 15 is already newer than 13 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 15 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:40: finishing write tid 1 to trial18717860-40 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:40: finishing write tid 2 to trial18717860-40 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:40: finishing write tid 3 to trial18717860-40 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:40: finishing write tid 4 to trial18717860-40 2026-02-13T18:05:57.171 INFO:tasks.rados.rados.0.trial187.stdout:40: oid 40 updating version 0 to 6 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:40: oid 40 version 6 is already newer than 5 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:40: oid 40 version 6 is already newer than 4 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: finishing write tid 1 to trial18717860-41 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: finishing write tid 2 to trial18717860-41 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: finishing write tid 3 to trial18717860-41 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: finishing write tid 4 to trial18717860-41 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: oid 41 updating version 0 to 1 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: oid 41 updating version 1 to 2 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: oid 41 updating version 2 to 3 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 3 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-13T18:05:57.172 INFO:tasks.rados.rados.0.trial187.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: finishing write tid 1 to trial18717860-42 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: finishing write tid 2 to trial18717860-42 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: finishing write tid 3 to trial18717860-42 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: finishing write tid 4 to trial18717860-42 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: oid 42 updating version 0 to 4 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: oid 42 updating version 4 to 6 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: oid 42 version 6 is already newer than 5 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 6 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:43: finishing write tid 1 to trial18717860-43 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:43: finishing write tid 2 to trial18717860-43 2026-02-13T18:05:57.173 INFO:tasks.rados.rados.0.trial187.stdout:43: finishing write tid 3 to trial18717860-43 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:43: finishing write tid 4 to trial18717860-43 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:43: oid 43 updating version 0 to 10 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:43: oid 43 updating version 10 to 11 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:43: oid 43 updating version 11 to 12 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 12 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: finishing write tid 1 to trial18717860-44 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: finishing write tid 2 to trial18717860-44 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: finishing write tid 3 to trial18717860-44 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: finishing write tid 4 to trial18717860-44 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: oid 44 updating version 0 to 14 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: oid 44 updating version 14 to 15 2026-02-13T18:05:57.174 INFO:tasks.rados.rados.0.trial187.stdout:44: oid 44 version 15 is already newer than 13 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 15 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: finishing write tid 1 to trial18717860-45 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:46: finishing write tid 1 to trial18717860-46 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: finishing write tid 2 to trial18717860-45 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: finishing write tid 3 to trial18717860-45 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: finishing write tid 4 to trial18717860-45 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: oid 45 updating version 0 to 8 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: oid 45 updating version 8 to 9 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: oid 45 version 9 is already newer than 7 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 9 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-13T18:05:57.175 INFO:tasks.rados.rados.0.trial187.stdout:46: finishing write tid 2 to trial18717860-46 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:46: finishing write tid 3 to trial18717860-46 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:46: finishing write tid 4 to trial18717860-46 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:46: oid 46 updating version 0 to 8 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:46: oid 46 updating version 8 to 9 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:46: oid 46 version 9 is already newer than 7 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 9 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:47: finishing write tid 1 to trial18717860-47 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:47: finishing write tid 2 to trial18717860-47 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:47: finishing write tid 3 to trial18717860-47 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:47: finishing write tid 4 to trial18717860-47 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:47: oid 47 updating version 0 to 7 2026-02-13T18:05:57.176 INFO:tasks.rados.rados.0.trial187.stdout:47: oid 47 updating version 7 to 8 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:47: oid 47 updating version 8 to 9 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 9 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: finishing write tid 1 to trial18717860-48 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: finishing write tid 2 to trial18717860-48 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: finishing write tid 3 to trial18717860-48 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: finishing write tid 4 to trial18717860-48 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: oid 48 updating version 0 to 18 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: oid 48 version 18 is already newer than 16 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: oid 48 version 18 is already newer than 17 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 18 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-13T18:05:57.177 INFO:tasks.rados.rados.0.trial187.stdout:49: finishing write tid 1 to trial18717860-49 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: finishing write tid 2 to trial18717860-49 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: finishing write tid 3 to trial18717860-49 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: finishing write tid 4 to trial18717860-49 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: oid 49 updating version 0 to 9 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: oid 49 version 9 is already newer than 7 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: oid 49 version 9 is already newer than 8 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-13T18:05:57.178 INFO:tasks.rados.rados.0.trial187.stdout:50: finishing write tid 1 to trial18717860-50 2026-02-13T18:05:57.179 INFO:tasks.rados.rados.0.trial187.stdout:50: finishing write tid 2 to trial18717860-50 2026-02-13T18:05:57.179 INFO:tasks.rados.rados.0.trial187.stdout:50: finishing write tid 3 to trial18717860-50 2026-02-13T18:05:57.179 INFO:tasks.rados.rados.0.trial187.stdout:50: finishing write tid 4 to trial18717860-50 2026-02-13T18:05:57.179 INFO:tasks.rados.rados.0.trial187.stdout:50: oid 50 updating version 0 to 8 2026-02-13T18:05:57.179 INFO:tasks.rados.rados.0.trial187.stdout:50: oid 50 updating version 8 to 9 2026-02-13T18:05:57.180 INFO:tasks.rados.rados.0.trial187.stdout:50: oid 50 version 9 is already newer than 7 2026-02-13T18:05:57.180 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-13T18:05:57.180 INFO:tasks.rados.rados.0.trial187.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:36: done (15 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:37: done (14 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:38: done (13 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:39: done (12 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:40: done (11 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:41: done (10 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:42: done (9 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:43: done (8 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:44: done (7 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:45: done (6 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:46: done (5 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:47: done (4 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:48: done (3 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:49: done (2 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:50: done (1 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:51: done (0 left) 2026-02-13T18:05:58.075 INFO:tasks.rados.rados.0.trial187.stdout:52: snap_remove snap 0 2026-02-13T18:05:59.076 INFO:tasks.rados.rados.0.trial187.stdout:52: done (0 left) 2026-02-13T18:05:59.077 INFO:tasks.rados.rados.0.trial187.stdout:53: write (excl) oid 21 current snap is 1 2026-02-13T18:05:59.077 INFO:tasks.rados.rados.0.trial187.stdout:53: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2026-02-13T18:05:59.080 INFO:tasks.rados.rados.0.trial187.stdout:53: writing trial18717860-21 from 440350 to 900918 tid 1 2026-02-13T18:05:59.083 INFO:tasks.rados.rados.0.trial187.stdout:53: writing trial18717860-21 from 1309629 to 1852295 tid 2 2026-02-13T18:05:59.087 INFO:tasks.rados.rados.0.trial187.stdout:53: writing trial18717860-21 from 2323973 to 2840350 tid 3 2026-02-13T18:05:59.087 INFO:tasks.rados.rados.0.trial187.stdout:54: copy_from oid 35 from oid 4 current snap is 1 2026-02-13T18:05:59.088 INFO:tasks.rados.rados.0.trial187.stdout:53: finishing write tid 1 to trial18717860-21 2026-02-13T18:05:59.088 INFO:tasks.rados.rados.0.trial187.stdout:53: finishing write tid 2 to trial18717860-21 2026-02-13T18:05:59.088 INFO:tasks.rados.rados.0.trial187.stdout:55: delete oid 43 current snap is 1 2026-02-13T18:05:59.090 INFO:tasks.rados.rados.0.trial187.stdout:53: finishing write tid 3 to trial18717860-21 2026-02-13T18:05:59.090 INFO:tasks.rados.rados.0.trial187.stdout:53: finishing write tid 4 to trial18717860-21 2026-02-13T18:05:59.090 INFO:tasks.rados.rados.0.trial187.stdout:53: finishing write tid 5 to trial18717860-21 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:53: oid 21 updating version 0 to 13 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:53: oid 21 version 13 is already newer than 10 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:53: oid 21 version 13 is already newer than 11 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:53: oid 21 version 13 is already newer than 12 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 13 (ObjNum 50 snap 1 seq_num 50) dirty exists 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:53: left oid 21 (ObjNum 50 snap 1 seq_num 50) 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:53: done (2 left) 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:55: done (1 left) 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:56: rollback oid 36 current snap is 1 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:56: done (1 left) 2026-02-13T18:05:59.091 INFO:tasks.rados.rados.0.trial187.stdout:57: write oid 9 current snap is 1 2026-02-13T18:05:59.092 INFO:tasks.rados.rados.0.trial187.stdout:57: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-13T18:05:59.095 INFO:tasks.rados.rados.0.trial187.stdout:57: writing trial18717860-9 from 473964 to 1085030 tid 1 2026-02-13T18:05:59.100 INFO:tasks.rados.rados.0.trial187.stdout:57: writing trial18717860-9 from 1826593 to 2372928 tid 2 2026-02-13T18:05:59.102 INFO:tasks.rados.rados.0.trial187.stdout:57: writing trial18717860-9 from 2778819 to 2873964 tid 3 2026-02-13T18:05:59.102 INFO:tasks.rados.rados.0.trial187.stdout:58: delete oid 8 current snap is 1 2026-02-13T18:05:59.102 INFO:tasks.rados.rados.0.trial187.stdout:57: finishing write tid 1 to trial18717860-9 2026-02-13T18:05:59.102 INFO:tasks.rados.rados.0.trial187.stdout:54: finishing copy_from racing read to trial18717860-35 2026-02-13T18:05:59.103 INFO:tasks.rados.rados.0.trial187.stdout:54: finishing copy_from to trial18717860-35 2026-02-13T18:05:59.103 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-13T18:05:59.103 INFO:tasks.rados.rados.0.trial187.stdout:57: finishing write tid 2 to trial18717860-9 2026-02-13T18:05:59.103 INFO:tasks.rados.rados.0.trial187.stdout:57: finishing write tid 3 to trial18717860-9 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:54: done (2 left) 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:58: done (1 left) 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:59: read oid 22 snap -1 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:59: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:60: rollback oid 38 current snap is 1 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:60: done (2 left) 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:61: write oid 36 current snap is 1 2026-02-13T18:05:59.104 INFO:tasks.rados.rados.0.trial187.stdout:61: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-13T18:05:59.107 INFO:tasks.rados.rados.0.trial187.stdout:61: writing trial18717860-36 from 507578 to 985495 tid 1 2026-02-13T18:05:59.111 INFO:tasks.rados.rados.0.trial187.stdout:61: writing trial18717860-36 from 1543557 to 2093561 tid 2 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:61: writing trial18717860-36 from 2833665 to 2907578 tid 3 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:62: read oid 8 snap -1 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:62: expect deleted 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:63: delete oid 24 current snap is 1 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:57: finishing write tid 4 to trial18717860-9 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:57: finishing write tid 5 to trial18717860-9 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:57: oid 9 updating version 0 to 16 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:57: oid 9 updating version 16 to 19 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:57: oid 9 version 19 is already newer than 18 2026-02-13T18:05:59.115 INFO:tasks.rados.rados.0.trial187.stdout:57: oid 9 version 19 is already newer than 17 2026-02-13T18:05:59.116 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 19 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-13T18:05:59.116 INFO:tasks.rados.rados.0.trial187.stdout:57: left oid 9 (ObjNum 52 snap 1 seq_num 52) 2026-02-13T18:05:59.116 INFO:tasks.rados.rados.0.trial187.stdout:59: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T18:05:59.116 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 588816 2026-02-13T18:05:59.157 INFO:tasks.rados.rados.0.trial187.stdout:61: finishing write tid 1 to trial18717860-36 2026-02-13T18:05:59.157 INFO:tasks.rados.rados.0.trial187.stdout:61: finishing write tid 2 to trial18717860-36 2026-02-13T18:05:59.157 INFO:tasks.rados.rados.0.trial187.stdout:61: finishing write tid 3 to trial18717860-36 2026-02-13T18:05:59.157 INFO:tasks.rados.rados.0.trial187.stdout:61: finishing write tid 4 to trial18717860-36 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: finishing write tid 5 to trial18717860-36 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: oid 36 updating version 0 to 11 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: oid 36 version 11 is already newer than 10 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: oid 36 updating version 11 to 13 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: oid 36 version 13 is already newer than 12 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 13 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: left oid 36 (ObjNum 54 snap 1 seq_num 54) 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:57: done (4 left) 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:59: done (3 left) 2026-02-13T18:05:59.158 INFO:tasks.rados.rados.0.trial187.stdout:61: done (2 left) 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:62: done (1 left) 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:63: done (0 left) 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:64: copy_from oid 17 from oid 14 current snap is 1 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:65: copy_from oid 30 from oid 7 current snap is 1 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:66: rollback oid 45 current snap is 1 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:66: done (2 left) 2026-02-13T18:05:59.159 INFO:tasks.rados.rados.0.trial187.stdout:67: delete oid 16 current snap is 1 2026-02-13T18:05:59.162 INFO:tasks.rados.rados.0.trial187.stdout:67: done (2 left) 2026-02-13T18:05:59.162 INFO:tasks.rados.rados.0.trial187.stdout:68: snap_create 2026-02-13T18:05:59.167 INFO:tasks.rados.rados.0.trial187.stdout:64: finishing copy_from racing read to trial18717860-17 2026-02-13T18:05:59.168 INFO:tasks.rados.rados.0.trial187.stdout:64: finishing copy_from to trial18717860-17 2026-02-13T18:05:59.168 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 3 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-13T18:05:59.169 INFO:tasks.rados.rados.0.trial187.stdout:65: finishing copy_from racing read to trial18717860-30 2026-02-13T18:05:59.169 INFO:tasks.rados.rados.0.trial187.stdout:65: finishing copy_from to trial18717860-30 2026-02-13T18:05:59.170 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-13T18:06:00.082 INFO:tasks.rados.rados.0.trial187.stdout:64: done (2 left) 2026-02-13T18:06:00.082 INFO:tasks.rados.rados.0.trial187.stdout:65: done (1 left) 2026-02-13T18:06:00.082 INFO:tasks.rados.rados.0.trial187.stdout:68: done (0 left) 2026-02-13T18:06:00.083 INFO:tasks.rados.rados.0.trial187.stdout:69: write oid 48 current snap is 2 2026-02-13T18:06:00.083 INFO:tasks.rados.rados.0.trial187.stdout:69: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2026-02-13T18:06:00.090 INFO:tasks.rados.rados.0.trial187.stdout:69: writing trial18717860-48 from 557999 to 1261663 tid 1 2026-02-13T18:06:00.096 INFO:tasks.rados.rados.0.trial187.stdout:69: writing trial18717860-48 from 1719003 to 2132687 tid 2 2026-02-13T18:06:00.102 INFO:tasks.rados.rados.0.trial187.stdout:69: writing trial18717860-48 from 2632287 to 2957999 tid 3 2026-02-13T18:06:00.102 INFO:tasks.rados.rados.0.trial187.stdout:70: read oid 34 snap -1 2026-02-13T18:06:00.102 INFO:tasks.rados.rados.0.trial187.stdout:70: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:06:00.102 INFO:tasks.rados.rados.0.trial187.stdout:71: snap_remove snap 1 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:71: done (2 left) 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:72: rollback oid 15 current snap is 2 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:72: done (2 left) 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:73: read oid 38 snap -1 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:73: expect (ObjNum 37 snap 0 seq_num 37) 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:74: read oid 18 snap -1 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:74: expect (ObjNum 17 snap 0 seq_num 17) 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:75: read oid 41 snap -1 2026-02-13T18:06:01.084 INFO:tasks.rados.rados.0.trial187.stdout:75: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-13T18:06:01.085 INFO:tasks.rados.rados.0.trial187.stdout:76: write oid 9 current snap is 2 2026-02-13T18:06:01.085 INFO:tasks.rados.rados.0.trial187.stdout:69: finishing write tid 1 to trial18717860-48 2026-02-13T18:06:01.085 INFO:tasks.rados.rados.0.trial187.stdout:69: finishing write tid 2 to trial18717860-48 2026-02-13T18:06:01.085 INFO:tasks.rados.rados.0.trial187.stdout:76: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-13T18:06:01.092 INFO:tasks.rados.rados.0.trial187.stdout:76: writing trial18717860-9 from 574806 to 1353719 tid 1 2026-02-13T18:06:01.101 INFO:tasks.rados.rados.0.trial187.stdout:76: writing trial18717860-9 from 2061132 to 2618474 tid 2 2026-02-13T18:06:01.101 INFO:tasks.rados.rados.0.trial187.stdout:77: snap_create 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: finishing write tid 3 to trial18717860-48 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: finishing write tid 4 to trial18717860-48 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: finishing write tid 5 to trial18717860-48 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: oid 48 updating version 0 to 21 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: oid 48 updating version 21 to 23 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: oid 48 version 23 is already newer than 22 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: oid 48 updating version 23 to 24 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 24 (ObjNum 57 snap 2 seq_num 57) dirty exists 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:69: left oid 48 (ObjNum 57 snap 2 seq_num 57) 2026-02-13T18:06:01.102 INFO:tasks.rados.rados.0.trial187.stdout:70: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:06:01.103 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:01.170 INFO:tasks.rados.rados.0.trial187.stdout:75: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-13T18:06:01.192 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1677595 2026-02-13T18:06:01.202 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 131466 2026-02-13T18:06:01.222 INFO:tasks.rados.rados.0.trial187.stdout:73: expect (ObjNum 37 snap 0 seq_num 37) 2026-02-13T18:06:01.239 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:01.279 INFO:tasks.rados.rados.0.trial187.stdout:74: expect (ObjNum 17 snap 0 seq_num 17) 2026-02-13T18:06:01.304 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:01.321 INFO:tasks.rados.rados.0.trial187.stdout:76: finishing write tid 1 to trial18717860-9 2026-02-13T18:06:01.321 INFO:tasks.rados.rados.0.trial187.stdout:76: finishing write tid 2 to trial18717860-9 2026-02-13T18:06:01.321 INFO:tasks.rados.rados.0.trial187.stdout:76: finishing write tid 3 to trial18717860-9 2026-02-13T18:06:01.321 INFO:tasks.rados.rados.0.trial187.stdout:76: finishing write tid 4 to trial18717860-9 2026-02-13T18:06:01.321 INFO:tasks.rados.rados.0.trial187.stdout:76: oid 9 updating version 0 to 23 2026-02-13T18:06:01.322 INFO:tasks.rados.rados.0.trial187.stdout:76: oid 9 version 23 is already newer than 21 2026-02-13T18:06:01.322 INFO:tasks.rados.rados.0.trial187.stdout:76: oid 9 version 23 is already newer than 22 2026-02-13T18:06:01.322 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 23 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-13T18:06:01.322 INFO:tasks.rados.rados.0.trial187.stdout:76: left oid 9 (ObjNum 58 snap 2 seq_num 58) 2026-02-13T18:06:02.089 INFO:tasks.rados.rados.0.trial187.stdout:69: done (6 left) 2026-02-13T18:06:02.089 INFO:tasks.rados.rados.0.trial187.stdout:70: done (5 left) 2026-02-13T18:06:02.089 INFO:tasks.rados.rados.0.trial187.stdout:73: done (4 left) 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:74: done (3 left) 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:75: done (2 left) 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:76: done (1 left) 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:77: done (0 left) 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:78: read oid 6 snap -1 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:78: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:79: write oid 12 current snap is 3 2026-02-13T18:06:02.090 INFO:tasks.rados.rados.0.trial187.stdout:79: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2026-02-13T18:06:02.096 INFO:tasks.rados.rados.0.trial187.stdout:79: writing trial18717860-12 from 591613 to 1045775 tid 1 2026-02-13T18:06:02.103 INFO:tasks.rados.rados.0.trial187.stdout:79: writing trial18717860-12 from 1719614 to 2136967 tid 2 2026-02-13T18:06:02.109 INFO:tasks.rados.rados.0.trial187.stdout:79: writing trial18717860-12 from 2570780 to 2991613 tid 3 2026-02-13T18:06:02.109 INFO:tasks.rados.rados.0.trial187.stdout:80: snap_create 2026-02-13T18:06:02.110 INFO:tasks.rados.rados.0.trial187.stdout:78: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-13T18:06:02.125 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:02.142 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1887689 2026-02-13T18:06:02.149 INFO:tasks.rados.rados.0.trial187.stdout:79: finishing write tid 1 to trial18717860-12 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: finishing write tid 2 to trial18717860-12 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: finishing write tid 3 to trial18717860-12 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: finishing write tid 4 to trial18717860-12 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: finishing write tid 5 to trial18717860-12 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: oid 12 updating version 0 to 10 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: oid 12 updating version 10 to 11 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: oid 12 version 11 is already newer than 8 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: oid 12 version 11 is already newer than 9 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 11 (ObjNum 59 snap 3 seq_num 59) dirty exists 2026-02-13T18:06:02.150 INFO:tasks.rados.rados.0.trial187.stdout:79: left oid 12 (ObjNum 59 snap 3 seq_num 59) 2026-02-13T18:06:03.090 INFO:tasks.rados.rados.0.trial187.stdout:78: done (2 left) 2026-02-13T18:06:03.090 INFO:tasks.rados.rados.0.trial187.stdout:79: done (1 left) 2026-02-13T18:06:03.090 INFO:tasks.rados.rados.0.trial187.stdout:80: done (0 left) 2026-02-13T18:06:03.090 INFO:tasks.rados.rados.0.trial187.stdout:81: read oid 44 snap -1 2026-02-13T18:06:03.091 INFO:tasks.rados.rados.0.trial187.stdout:81: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-13T18:06:03.091 INFO:tasks.rados.rados.0.trial187.stdout:82: snap_remove snap 2 2026-02-13T18:06:03.673 INFO:tasks.rados.rados.0.trial187.stdout:82: done (1 left) 2026-02-13T18:06:03.674 INFO:tasks.rados.rados.0.trial187.stdout:83: delete oid 24 current snap is 4 2026-02-13T18:06:03.674 INFO:tasks.rados.rados.0.trial187.stdout:81: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-13T18:06:03.674 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 117151 2026-02-13T18:06:03.734 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1717641 2026-02-13T18:06:03.744 INFO:tasks.rados.rados.0.trial187.stdout:81: done (1 left) 2026-02-13T18:06:03.744 INFO:tasks.rados.rados.0.trial187.stdout:83: done (0 left) 2026-02-13T18:06:03.744 INFO:tasks.rados.rados.0.trial187.stdout:84: write oid 17 current snap is 4 2026-02-13T18:06:03.744 INFO:tasks.rados.rados.0.trial187.stdout:84: seq_num 61 ranges {625227=721013,1952931=704669} 2026-02-13T18:06:03.753 INFO:tasks.rados.rados.0.trial187.stdout:84: writing trial18717860-17 from 625227 to 1346240 tid 1 2026-02-13T18:06:03.763 INFO:tasks.rados.rados.0.trial187.stdout:84: writing trial18717860-17 from 1952931 to 2657600 tid 2 2026-02-13T18:06:03.763 INFO:tasks.rados.rados.0.trial187.stdout:85: write (excl) oid 31 current snap is 4 2026-02-13T18:06:03.763 INFO:tasks.rados.rados.0.trial187.stdout:84: finishing write tid 1 to trial18717860-17 2026-02-13T18:06:03.763 INFO:tasks.rados.rados.0.trial187.stdout:85: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-13T18:06:03.772 INFO:tasks.rados.rados.0.trial187.stdout:85: writing trial18717860-31 from 642034 to 1438296 tid 1 2026-02-13T18:06:03.779 INFO:tasks.rados.rados.0.trial187.stdout:85: writing trial18717860-31 from 1895060 to 2459740 tid 2 2026-02-13T18:06:03.780 INFO:tasks.rados.rados.0.trial187.stdout:86: write oid 33 current snap is 4 2026-02-13T18:06:03.780 INFO:tasks.rados.rados.0.trial187.stdout:86: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2026-02-13T18:06:03.787 INFO:tasks.rados.rados.0.trial187.stdout:86: writing trial18717860-33 from 658841 to 1130352 tid 1 2026-02-13T18:06:03.794 INFO:tasks.rados.rados.0.trial187.stdout:86: writing trial18717860-33 from 1553542 to 2261880 tid 2 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:86: writing trial18717860-33 from 2964119 to 3058841 tid 3 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:87: copy_from oid 30 from oid 37 current snap is 4 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: finishing write tid 2 to trial18717860-17 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: finishing write tid 3 to trial18717860-17 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: finishing write tid 4 to trial18717860-17 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: oid 17 updating version 0 to 26 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: oid 17 version 26 is already newer than 25 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: oid 17 updating version 26 to 27 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 27 (ObjNum 61 snap 4 seq_num 61) dirty exists 2026-02-13T18:06:03.799 INFO:tasks.rados.rados.0.trial187.stdout:84: left oid 17 (ObjNum 61 snap 4 seq_num 61) 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: finishing write tid 1 to trial18717860-31 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: finishing write tid 2 to trial18717860-31 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: finishing write tid 3 to trial18717860-31 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: finishing write tid 4 to trial18717860-31 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: oid 31 updating version 0 to 8 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: oid 31 updating version 8 to 10 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: oid 31 version 10 is already newer than 9 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 10 (ObjNum 62 snap 4 seq_num 62) dirty exists 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: left oid 31 (ObjNum 62 snap 4 seq_num 62) 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:86: finishing write tid 1 to trial18717860-33 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:84: done (3 left) 2026-02-13T18:06:03.800 INFO:tasks.rados.rados.0.trial187.stdout:85: done (2 left) 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:88: rollback oid 24 current snap is 4 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 3 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:86: finishing write tid 2 to trial18717860-33 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:89: read oid 39 snap 3 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:89: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:90: read oid 40 snap 3 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:90: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:91: read oid 20 snap -1 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:91: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:92: snap_create 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:88: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:06:03.801 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 0 (ObjNum 33 snap 0 seq_num 3015302704) dirty dne 2026-02-13T18:06:03.802 INFO:tasks.rados.rados.0.trial187.stdout:89: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-13T18:06:03.872 INFO:tasks.rados.rados.0.trial187.stdout:86: finishing write tid 3 to trial18717860-33 2026-02-13T18:06:03.872 INFO:tasks.rados.rados.0.trial187.stdout:91: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-13T18:06:03.872 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:03.897 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2128678 2026-02-13T18:06:03.898 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:03.916 INFO:tasks.rados.rados.0.trial187.stdout:90: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T18:06:03.943 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:86: finishing write tid 4 to trial18717860-33 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:86: finishing write tid 5 to trial18717860-33 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:86: oid 33 updating version 0 to 29 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:86: oid 33 updating version 29 to 30 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:86: oid 33 updating version 30 to 31 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:86: oid 33 version 31 is already newer than 28 2026-02-13T18:06:03.963 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 31 (ObjNum 63 snap 4 seq_num 63) dirty exists 2026-02-13T18:06:03.964 INFO:tasks.rados.rados.0.trial187.stdout:86: left oid 33 (ObjNum 63 snap 4 seq_num 63) 2026-02-13T18:06:03.964 INFO:tasks.rados.rados.0.trial187.stdout:87: finishing copy_from racing read to trial18717860-30 2026-02-13T18:06:03.964 INFO:tasks.rados.rados.0.trial187.stdout:87: finishing copy_from to trial18717860-30 2026-02-13T18:06:03.964 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 9 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-13T18:06:05.178 INFO:tasks.rados.rados.0.trial187.stdout:86: done (6 left) 2026-02-13T18:06:05.178 INFO:tasks.rados.rados.0.trial187.stdout:87: done (5 left) 2026-02-13T18:06:05.178 INFO:tasks.rados.rados.0.trial187.stdout:88: done (4 left) 2026-02-13T18:06:05.178 INFO:tasks.rados.rados.0.trial187.stdout:89: done (3 left) 2026-02-13T18:06:05.178 INFO:tasks.rados.rados.0.trial187.stdout:90: done (2 left) 2026-02-13T18:06:05.179 INFO:tasks.rados.rados.0.trial187.stdout:91: done (1 left) 2026-02-13T18:06:05.179 INFO:tasks.rados.rados.0.trial187.stdout:92: done (0 left) 2026-02-13T18:06:05.179 INFO:tasks.rados.rados.0.trial187.stdout:93: write (excl) oid 18 current snap is 5 2026-02-13T18:06:05.179 INFO:tasks.rados.rados.0.trial187.stdout:93: seq_num 64 ranges {675648=546760,2012024=568349} 2026-02-13T18:06:05.183 INFO:tasks.rados.rados.0.trial187.stdout:93: writing trial18717860-18 from 675648 to 1222408 tid 1 2026-02-13T18:06:05.189 INFO:tasks.rados.rados.0.trial187.stdout:93: writing trial18717860-18 from 2012024 to 2580373 tid 2 2026-02-13T18:06:05.189 INFO:tasks.rados.rados.0.trial187.stdout:94: rollback oid 22 current snap is 5 2026-02-13T18:06:05.189 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 4 2026-02-13T18:06:05.189 INFO:tasks.rados.rados.0.trial187.stdout:93: finishing write tid 1 to trial18717860-18 2026-02-13T18:06:05.189 INFO:tasks.rados.rados.0.trial187.stdout:95: write (excl) oid 12 current snap is 5 2026-02-13T18:06:05.189 INFO:tasks.rados.rados.0.trial187.stdout:95: seq_num 65 ranges {692455=622009,2070506=712007} 2026-02-13T18:06:05.193 INFO:tasks.rados.rados.0.trial187.stdout:95: writing trial18717860-12 from 692455 to 1314464 tid 1 2026-02-13T18:06:05.199 INFO:tasks.rados.rados.0.trial187.stdout:95: writing trial18717860-12 from 2070506 to 2782513 tid 2 2026-02-13T18:06:05.199 INFO:tasks.rados.rados.0.trial187.stdout:96: copy_from oid 1 from oid 36 current snap is 5 2026-02-13T18:06:05.199 INFO:tasks.rados.rados.0.trial187.stdout:94: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:06:05.199 INFO:tasks.rados.rados.0.trial187.stdout:94: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:06:05.200 INFO:tasks.rados.rados.0.trial187.stdout:94: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:06:05.200 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 35 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T18:06:05.200 INFO:tasks.rados.rados.0.trial187.stdout:95: finishing write tid 1 to trial18717860-12 2026-02-13T18:06:05.200 INFO:tasks.rados.rados.0.trial187.stdout:94: done (3 left) 2026-02-13T18:06:05.200 INFO:tasks.rados.rados.0.trial187.stdout:97: snap_remove snap 3 2026-02-13T18:06:06.183 INFO:tasks.rados.rados.0.trial187.stdout:97: done (3 left) 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:98: read oid 50 snap -1 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:98: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:99: read oid 20 snap -1 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:99: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:100: snap_create 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:95: finishing write tid 2 to trial18717860-12 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:95: finishing write tid 3 to trial18717860-12 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:95: finishing write tid 4 to trial18717860-12 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:95: oid 12 updating version 0 to 16 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:95: oid 12 version 16 is already newer than 15 2026-02-13T18:06:06.184 INFO:tasks.rados.rados.0.trial187.stdout:95: oid 12 updating version 16 to 17 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 17 (ObjNum 65 snap 5 seq_num 65) dirty exists 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:95: left oid 12 (ObjNum 65 snap 5 seq_num 65) 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: finishing write tid 2 to trial18717860-18 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: finishing write tid 3 to trial18717860-18 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: finishing write tid 4 to trial18717860-18 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: oid 18 updating version 0 to 13 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: oid 18 version 13 is already newer than 12 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: oid 18 version 13 is already newer than 11 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 13 (ObjNum 64 snap 5 seq_num 64) dirty exists 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:93: left oid 18 (ObjNum 64 snap 5 seq_num 64) 2026-02-13T18:06:06.185 INFO:tasks.rados.rados.0.trial187.stdout:96: finishing copy_from racing read to trial18717860-1 2026-02-13T18:06:06.186 INFO:tasks.rados.rados.0.trial187.stdout:96: finishing copy_from to trial18717860-1 2026-02-13T18:06:06.186 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 13 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-13T18:06:06.186 INFO:tasks.rados.rados.0.trial187.stdout:99: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-13T18:06:06.186 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:06.223 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1689999 2026-02-13T18:06:06.253 INFO:tasks.rados.rados.0.trial187.stdout:98: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T18:06:06.255 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 428657 2026-02-13T18:06:06.271 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 364069 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:93: done (5 left) 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:95: done (4 left) 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:96: done (3 left) 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:98: done (2 left) 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:99: done (1 left) 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:100: done (0 left) 2026-02-13T18:06:07.185 INFO:tasks.rados.rados.0.trial187.stdout:101: delete oid 33 current snap is 6 2026-02-13T18:06:07.188 INFO:tasks.rados.rados.0.trial187.stdout:101: done (0 left) 2026-02-13T18:06:07.188 INFO:tasks.rados.rados.0.trial187.stdout:102: rollback oid 2 current snap is 6 2026-02-13T18:06:07.189 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 4 2026-02-13T18:06:07.189 INFO:tasks.rados.rados.0.trial187.stdout:103: write oid 21 current snap is 6 2026-02-13T18:06:07.189 INFO:tasks.rados.rados.0.trial187.stdout:103: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-13T18:06:07.198 INFO:tasks.rados.rados.0.trial187.stdout:103: writing trial18717860-21 from 726069 to 1498576 tid 1 2026-02-13T18:06:07.208 INFO:tasks.rados.rados.0.trial187.stdout:103: writing trial18717860-21 from 2071117 to 2786793 tid 2 2026-02-13T18:06:07.208 INFO:tasks.rados.rados.0.trial187.stdout:104: read oid 46 snap -1 2026-02-13T18:06:07.208 INFO:tasks.rados.rados.0.trial187.stdout:104: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T18:06:07.208 INFO:tasks.rados.rados.0.trial187.stdout:105: read oid 29 snap -1 2026-02-13T18:06:07.208 INFO:tasks.rados.rados.0.trial187.stdout:105: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-13T18:06:07.208 INFO:tasks.rados.rados.0.trial187.stdout:106: rollback oid 38 current snap is 6 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 5 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:102: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:102: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:102: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 19 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:103: finishing write tid 1 to trial18717860-21 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:102: done (4 left) 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:107: write (excl) oid 48 current snap is 6 2026-02-13T18:06:07.209 INFO:tasks.rados.rados.0.trial187.stdout:107: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2026-02-13T18:06:07.215 INFO:tasks.rados.rados.0.trial187.stdout:107: writing trial18717860-48 from 742876 to 1190632 tid 1 2026-02-13T18:06:07.223 INFO:tasks.rados.rados.0.trial187.stdout:107: writing trial18717860-48 from 1729599 to 2305286 tid 2 2026-02-13T18:06:07.229 INFO:tasks.rados.rados.0.trial187.stdout:107: writing trial18717860-48 from 3101234 to 3142876 tid 3 2026-02-13T18:06:07.229 INFO:tasks.rados.rados.0.trial187.stdout:108: read oid 2 snap -1 2026-02-13T18:06:07.229 INFO:tasks.rados.rados.0.trial187.stdout:108: expect (ObjNum 1 snap 0 seq_num 1) 2026-02-13T18:06:07.230 INFO:tasks.rados.rados.0.trial187.stdout:109: write oid 22 current snap is 6 2026-02-13T18:06:07.230 INFO:tasks.rados.rados.0.trial187.stdout:109: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2026-02-13T18:06:07.238 INFO:tasks.rados.rados.0.trial187.stdout:109: writing trial18717860-22 from 759683 to 1399041 tid 1 2026-02-13T18:06:07.242 INFO:tasks.rados.rados.0.trial187.stdout:109: writing trial18717860-22 from 1904434 to 2623779 tid 2 2026-02-13T18:06:07.244 INFO:tasks.rados.rados.0.trial187.stdout:109: writing trial18717860-22 from 3128657 to 3159683 tid 3 2026-02-13T18:06:07.244 INFO:tasks.rados.rados.0.trial187.stdout:110: write oid 7 current snap is 6 2026-02-13T18:06:07.245 INFO:tasks.rados.rados.0.trial187.stdout:110: seq_num 70 ranges {776490=714607,2246563=579356} 2026-02-13T18:06:07.250 INFO:tasks.rados.rados.0.trial187.stdout:110: writing trial18717860-7 from 776490 to 1491097 tid 1 2026-02-13T18:06:07.256 INFO:tasks.rados.rados.0.trial187.stdout:110: writing trial18717860-7 from 2246563 to 2825919 tid 2 2026-02-13T18:06:07.256 INFO:tasks.rados.rados.0.trial187.stdout:111: read oid 44 snap 4 2026-02-13T18:06:07.256 INFO:tasks.rados.rados.0.trial187.stdout:111: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-13T18:06:07.257 INFO:tasks.rados.rados.0.trial187.stdout:112: copy_from oid 11 from oid 30 current snap is 6 2026-02-13T18:06:07.257 INFO:tasks.rados.rados.0.trial187.stdout:105: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-13T18:06:07.310 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:07.328 INFO:tasks.rados.rados.0.trial187.stdout:106: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:06:07.328 INFO:tasks.rados.rados.0.trial187.stdout:106: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:06:07.329 INFO:tasks.rados.rados.0.trial187.stdout:106: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:06:07.329 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 11 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T18:06:07.329 INFO:tasks.rados.rados.0.trial187.stdout:104: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T18:06:07.378 INFO:tasks.rados.rados.0.trial187.stdout:103: finishing write tid 2 to trial18717860-21 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:103: finishing write tid 3 to trial18717860-21 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:107: finishing write tid 1 to trial18717860-48 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:103: finishing write tid 4 to trial18717860-21 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:103: oid 21 updating version 0 to 16 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:103: oid 21 version 16 is already newer than 15 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:103: oid 21 updating version 16 to 17 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 17 (ObjNum 67 snap 6 seq_num 67) dirty exists 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:103: left oid 21 (ObjNum 67 snap 6 seq_num 67) 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:107: finishing write tid 2 to trial18717860-48 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:107: finishing write tid 3 to trial18717860-48 2026-02-13T18:06:07.379 INFO:tasks.rados.rados.0.trial187.stdout:107: finishing write tid 4 to trial18717860-48 2026-02-13T18:06:07.380 INFO:tasks.rados.rados.0.trial187.stdout:103: done (9 left) 2026-02-13T18:06:07.380 INFO:tasks.rados.rados.0.trial187.stdout:104: done (8 left) 2026-02-13T18:06:07.380 INFO:tasks.rados.rados.0.trial187.stdout:105: done (7 left) 2026-02-13T18:06:07.380 INFO:tasks.rados.rados.0.trial187.stdout:106: done (6 left) 2026-02-13T18:06:07.380 INFO:tasks.rados.rados.0.trial187.stdout:113: write oid 35 current snap is 6 2026-02-13T18:06:07.380 INFO:tasks.rados.rados.0.trial187.stdout:113: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-13T18:06:07.387 INFO:tasks.rados.rados.0.trial187.stdout:113: writing trial18717860-35 from 793297 to 1583153 tid 1 2026-02-13T18:06:07.397 INFO:tasks.rados.rados.0.trial187.stdout:113: writing trial18717860-35 from 2305045 to 3028059 tid 2 2026-02-13T18:06:07.397 INFO:tasks.rados.rados.0.trial187.stdout:114: delete oid 21 current snap is 6 2026-02-13T18:06:07.397 INFO:tasks.rados.rados.0.trial187.stdout:107: finishing write tid 5 to trial18717860-48 2026-02-13T18:06:07.397 INFO:tasks.rados.rados.0.trial187.stdout:107: oid 48 updating version 0 to 45 2026-02-13T18:06:07.397 INFO:tasks.rados.rados.0.trial187.stdout:107: oid 48 version 45 is already newer than 43 2026-02-13T18:06:07.398 INFO:tasks.rados.rados.0.trial187.stdout:107: oid 48 version 45 is already newer than 44 2026-02-13T18:06:07.398 INFO:tasks.rados.rados.0.trial187.stdout:107: oid 48 updating version 45 to 46 2026-02-13T18:06:07.398 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 46 (ObjNum 68 snap 6 seq_num 68) dirty exists 2026-02-13T18:06:07.398 INFO:tasks.rados.rados.0.trial187.stdout:107: left oid 48 (ObjNum 68 snap 6 seq_num 68) 2026-02-13T18:06:07.398 INFO:tasks.rados.rados.0.trial187.stdout:108: expect (ObjNum 1 snap 0 seq_num 1) 2026-02-13T18:06:07.413 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 474458 2026-02-13T18:06:07.436 INFO:tasks.rados.rados.0.trial187.stdout:109: finishing write tid 1 to trial18717860-22 2026-02-13T18:06:07.436 INFO:tasks.rados.rados.0.trial187.stdout:109: finishing write tid 2 to trial18717860-22 2026-02-13T18:06:07.436 INFO:tasks.rados.rados.0.trial187.stdout:109: finishing write tid 3 to trial18717860-22 2026-02-13T18:06:07.436 INFO:tasks.rados.rados.0.trial187.stdout:109: finishing write tid 4 to trial18717860-22 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:109: finishing write tid 5 to trial18717860-22 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:109: oid 22 updating version 0 to 49 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:109: oid 22 updating version 49 to 51 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:109: oid 22 version 51 is already newer than 48 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:109: oid 22 version 51 is already newer than 50 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 51 (ObjNum 69 snap 6 seq_num 69) dirty exists 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:109: left oid 22 (ObjNum 69 snap 6 seq_num 69) 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:110: finishing write tid 1 to trial18717860-7 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:110: finishing write tid 2 to trial18717860-7 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:110: finishing write tid 3 to trial18717860-7 2026-02-13T18:06:07.437 INFO:tasks.rados.rados.0.trial187.stdout:110: finishing write tid 4 to trial18717860-7 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:110: oid 7 updating version 0 to 19 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:110: oid 7 updating version 19 to 20 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:110: oid 7 updating version 20 to 21 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 21 (ObjNum 70 snap 6 seq_num 70) dirty exists 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:110: left oid 7 (ObjNum 70 snap 6 seq_num 70) 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:111: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-13T18:06:07.438 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:07.462 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1993976 2026-02-13T18:06:07.467 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:07.487 INFO:tasks.rados.rados.0.trial187.stdout:112: finishing copy_from racing read to trial18717860-11 2026-02-13T18:06:07.487 INFO:tasks.rados.rados.0.trial187.stdout:112: finishing copy_from to trial18717860-11 2026-02-13T18:06:07.487 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 9 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-13T18:06:07.487 INFO:tasks.rados.rados.0.trial187.stdout:113: finishing write tid 1 to trial18717860-35 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:113: finishing write tid 2 to trial18717860-35 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:107: done (7 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:108: done (6 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:109: done (5 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:110: done (4 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:111: done (3 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:112: done (2 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:114: done (1 left) 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:115: rollback oid 32 current snap is 6 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 4 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:113: finishing write tid 3 to trial18717860-35 2026-02-13T18:06:07.488 INFO:tasks.rados.rados.0.trial187.stdout:113: finishing write tid 4 to trial18717860-35 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:113: oid 35 updating version 0 to 15 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:113: oid 35 version 15 is already newer than 13 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:113: oid 35 version 15 is already newer than 14 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 15 (ObjNum 71 snap 6 seq_num 71) dirty exists 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:113: left oid 35 (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:113: done (1 left) 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:116: write (excl) oid 28 current snap is 6 2026-02-13T18:06:07.489 INFO:tasks.rados.rados.0.trial187.stdout:116: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2026-02-13T18:06:07.493 INFO:tasks.rados.rados.0.trial187.stdout:116: writing trial18717860-28 from 426911 to 967265 tid 1 2026-02-13T18:06:07.503 INFO:tasks.rados.rados.0.trial187.stdout:116: writing trial18717860-28 from 1622009 to 2348692 tid 2 2026-02-13T18:06:07.509 INFO:tasks.rados.rados.0.trial187.stdout:116: writing trial18717860-28 from 3121996 to 3226911 tid 3 2026-02-13T18:06:07.509 INFO:tasks.rados.rados.0.trial187.stdout:117: rollback oid 47 current snap is 6 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 5 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:115: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:115: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:115: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 19 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:116: finishing write tid 1 to trial18717860-28 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:116: finishing write tid 2 to trial18717860-28 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:115: done (2 left) 2026-02-13T18:06:07.510 INFO:tasks.rados.rados.0.trial187.stdout:118: snap_create 2026-02-13T18:06:07.511 INFO:tasks.rados.rados.0.trial187.stdout:116: finishing write tid 3 to trial18717860-28 2026-02-13T18:06:07.511 INFO:tasks.rados.rados.0.trial187.stdout:116: finishing write tid 4 to trial18717860-28 2026-02-13T18:06:07.511 INFO:tasks.rados.rados.0.trial187.stdout:116: finishing write tid 5 to trial18717860-28 2026-02-13T18:06:07.512 INFO:tasks.rados.rados.0.trial187.stdout:116: oid 28 updating version 0 to 14 2026-02-13T18:06:07.512 INFO:tasks.rados.rados.0.trial187.stdout:116: oid 28 updating version 14 to 15 2026-02-13T18:06:07.512 INFO:tasks.rados.rados.0.trial187.stdout:116: oid 28 updating version 15 to 17 2026-02-13T18:06:07.512 INFO:tasks.rados.rados.0.trial187.stdout:116: oid 28 version 17 is already newer than 16 2026-02-13T18:06:07.512 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 17 (ObjNum 73 snap 6 seq_num 73) dirty exists 2026-02-13T18:06:07.512 INFO:tasks.rados.rados.0.trial187.stdout:116: left oid 28 (ObjNum 73 snap 6 seq_num 73) 2026-02-13T18:06:07.513 INFO:tasks.rados.rados.0.trial187.stdout:117: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:06:07.513 INFO:tasks.rados.rados.0.trial187.stdout:117: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:06:07.513 INFO:tasks.rados.rados.0.trial187.stdout:117: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:06:07.513 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 14 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-13T18:06:08.192 INFO:tasks.rados.rados.0.trial187.stdout:116: done (2 left) 2026-02-13T18:06:08.192 INFO:tasks.rados.rados.0.trial187.stdout:117: done (1 left) 2026-02-13T18:06:08.192 INFO:tasks.rados.rados.0.trial187.stdout:118: done (0 left) 2026-02-13T18:06:08.192 INFO:tasks.rados.rados.0.trial187.stdout:119: write oid 46 current snap is 7 2026-02-13T18:06:08.192 INFO:tasks.rados.rados.0.trial187.stdout:119: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-13T18:06:08.199 INFO:tasks.rados.rados.0.trial187.stdout:119: writing trial18717860-46 from 443718 to 1059321 tid 1 2026-02-13T18:06:08.206 INFO:tasks.rados.rados.0.trial187.stdout:119: writing trial18717860-46 from 1564138 to 2034479 tid 2 2026-02-13T18:06:08.214 INFO:tasks.rados.rados.0.trial187.stdout:119: writing trial18717860-46 from 2633066 to 3243718 tid 3 2026-02-13T18:06:08.214 INFO:tasks.rados.rados.0.trial187.stdout:120: snap_create 2026-02-13T18:06:08.214 INFO:tasks.rados.rados.0.trial187.stdout:119: finishing write tid 1 to trial18717860-46 2026-02-13T18:06:08.214 INFO:tasks.rados.rados.0.trial187.stdout:119: finishing write tid 2 to trial18717860-46 2026-02-13T18:06:08.216 INFO:tasks.rados.rados.0.trial187.stdout:119: finishing write tid 3 to trial18717860-46 2026-02-13T18:06:08.216 INFO:tasks.rados.rados.0.trial187.stdout:119: finishing write tid 4 to trial18717860-46 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:119: finishing write tid 5 to trial18717860-46 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:119: oid 46 updating version 0 to 26 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:119: oid 46 updating version 26 to 27 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:119: oid 46 version 27 is already newer than 24 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:119: oid 46 version 27 is already newer than 25 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 27 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T18:06:08.217 INFO:tasks.rados.rados.0.trial187.stdout:119: left oid 46 (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:08.675 INFO:tasks.rados.rados.0.trial187.stdout:119: done (1 left) 2026-02-13T18:06:08.675 INFO:tasks.rados.rados.0.trial187.stdout:120: done (0 left) 2026-02-13T18:06:08.675 INFO:tasks.rados.rados.0.trial187.stdout:121: write (excl) oid 3 current snap is 8 2026-02-13T18:06:08.675 INFO:tasks.rados.rados.0.trial187.stdout:121: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2026-02-13T18:06:08.682 INFO:tasks.rados.rados.0.trial187.stdout:121: writing trial18717860-3 from 460525 to 1151377 tid 1 2026-02-13T18:06:08.691 INFO:tasks.rados.rados.0.trial187.stdout:121: writing trial18717860-3 from 1622620 to 2352972 tid 2 2026-02-13T18:06:08.697 INFO:tasks.rados.rados.0.trial187.stdout:121: writing trial18717860-3 from 3060489 to 3260525 tid 3 2026-02-13T18:06:08.697 INFO:tasks.rados.rados.0.trial187.stdout:122: read oid 23 snap -1 2026-02-13T18:06:08.697 INFO:tasks.rados.rados.0.trial187.stdout:122: expect (ObjNum 22 snap 0 seq_num 22) 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:123: rollback oid 34 current snap is 8 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 34 to 4 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:121: finishing write tid 1 to trial18717860-3 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:121: finishing write tid 2 to trial18717860-3 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:124: rollback oid 27 current snap is 8 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 5 2026-02-13T18:06:08.698 INFO:tasks.rados.rados.0.trial187.stdout:125: delete oid 49 current snap is 8 2026-02-13T18:06:08.699 INFO:tasks.rados.rados.0.trial187.stdout:123: finishing rollback tid 0 to trial18717860-34 2026-02-13T18:06:08.699 INFO:tasks.rados.rados.0.trial187.stdout:121: finishing write tid 3 to trial18717860-3 2026-02-13T18:06:08.700 INFO:tasks.rados.rados.0.trial187.stdout:123: finishing rollback tid 1 to trial18717860-34 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:123: finishing rollback tid 2 to trial18717860-34 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 15 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: finishing write tid 4 to trial18717860-3 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: finishing write tid 5 to trial18717860-3 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: oid 3 updating version 0 to 33 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: oid 3 updating version 33 to 34 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: oid 3 version 34 is already newer than 32 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: oid 3 version 34 is already newer than 31 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 34 (ObjNum 75 snap 8 seq_num 75) dirty exists 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: left oid 3 (ObjNum 75 snap 8 seq_num 75) 2026-02-13T18:06:08.701 INFO:tasks.rados.rados.0.trial187.stdout:121: done (4 left) 2026-02-13T18:06:08.702 INFO:tasks.rados.rados.0.trial187.stdout:123: done (3 left) 2026-02-13T18:06:08.702 INFO:tasks.rados.rados.0.trial187.stdout:125: done (2 left) 2026-02-13T18:06:08.702 INFO:tasks.rados.rados.0.trial187.stdout:126: snap_remove snap 6 2026-02-13T18:06:09.678 INFO:tasks.rados.rados.0.trial187.stdout:126: done (2 left) 2026-02-13T18:06:09.678 INFO:tasks.rados.rados.0.trial187.stdout:127: snap_create 2026-02-13T18:06:09.678 INFO:tasks.rados.rados.0.trial187.stdout:124: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:06:09.679 INFO:tasks.rados.rados.0.trial187.stdout:124: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:06:09.679 INFO:tasks.rados.rados.0.trial187.stdout:124: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:06:09.679 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 10 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-13T18:06:09.679 INFO:tasks.rados.rados.0.trial187.stdout:122: expect (ObjNum 22 snap 0 seq_num 22) 2026-02-13T18:06:09.711 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:09.735 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:10.681 INFO:tasks.rados.rados.0.trial187.stdout:122: done (2 left) 2026-02-13T18:06:10.682 INFO:tasks.rados.rados.0.trial187.stdout:124: done (1 left) 2026-02-13T18:06:10.682 INFO:tasks.rados.rados.0.trial187.stdout:127: done (0 left) 2026-02-13T18:06:10.682 INFO:tasks.rados.rados.0.trial187.stdout:128: copy_from oid 19 from oid 46 current snap is 9 2026-02-13T18:06:10.682 INFO:tasks.rados.rados.0.trial187.stdout:129: delete oid 48 current snap is 9 2026-02-13T18:06:10.684 INFO:tasks.rados.rados.0.trial187.stdout:129: done (1 left) 2026-02-13T18:06:10.684 INFO:tasks.rados.rados.0.trial187.stdout:130: delete oid 7 current snap is 9 2026-02-13T18:06:10.688 INFO:tasks.rados.rados.0.trial187.stdout:130: done (1 left) 2026-02-13T18:06:10.688 INFO:tasks.rados.rados.0.trial187.stdout:131: write (excl) oid 3 current snap is 9 2026-02-13T18:06:10.688 INFO:tasks.rados.rados.0.trial187.stdout:131: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2026-02-13T18:06:10.696 INFO:tasks.rados.rados.0.trial187.stdout:131: writing trial18717860-3 from 527753 to 1235954 tid 1 2026-02-13T18:06:10.706 INFO:tasks.rados.rados.0.trial187.stdout:131: writing trial18717860-3 from 1856548 to 2594238 tid 2 2026-02-13T18:06:10.711 INFO:tasks.rados.rados.0.trial187.stdout:131: writing trial18717860-3 from 3286534 to 3327753 tid 3 2026-02-13T18:06:10.711 INFO:tasks.rados.rados.0.trial187.stdout:132: snap_remove snap 8 2026-02-13T18:06:11.685 INFO:tasks.rados.rados.0.trial187.stdout:132: done (2 left) 2026-02-13T18:06:11.685 INFO:tasks.rados.rados.0.trial187.stdout:133: delete oid 15 current snap is 9 2026-02-13T18:06:11.685 INFO:tasks.rados.rados.0.trial187.stdout:128: finishing copy_from racing read to trial18717860-19 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:128: finishing copy_from to trial18717860-19 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 27 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: finishing write tid 1 to trial18717860-3 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: finishing write tid 2 to trial18717860-3 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: finishing write tid 3 to trial18717860-3 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: finishing write tid 4 to trial18717860-3 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: finishing write tid 5 to trial18717860-3 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: oid 3 updating version 0 to 40 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: oid 3 updating version 40 to 41 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: oid 3 version 41 is already newer than 39 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: oid 3 version 41 is already newer than 38 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 41 (ObjNum 79 snap 9 seq_num 79) dirty exists 2026-02-13T18:06:11.686 INFO:tasks.rados.rados.0.trial187.stdout:131: left oid 3 (ObjNum 79 snap 9 seq_num 79) 2026-02-13T18:06:11.688 INFO:tasks.rados.rados.0.trial187.stdout:128: done (2 left) 2026-02-13T18:06:11.688 INFO:tasks.rados.rados.0.trial187.stdout:131: done (1 left) 2026-02-13T18:06:11.688 INFO:tasks.rados.rados.0.trial187.stdout:133: done (0 left) 2026-02-13T18:06:11.688 INFO:tasks.rados.rados.0.trial187.stdout:134: read oid 9 snap 7 2026-02-13T18:06:11.688 INFO:tasks.rados.rados.0.trial187.stdout:134: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-13T18:06:11.688 INFO:tasks.rados.rados.0.trial187.stdout:135: delete oid 24 current snap is 9 2026-02-13T18:06:11.689 INFO:tasks.rados.rados.0.trial187.stdout:135: done (1 left) 2026-02-13T18:06:11.689 INFO:tasks.rados.rados.0.trial187.stdout:136: write (excl) oid 23 current snap is 9 2026-02-13T18:06:11.689 INFO:tasks.rados.rados.0.trial187.stdout:136: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-13T18:06:11.696 INFO:tasks.rados.rados.0.trial187.stdout:136: writing trial18717860-23 from 578174 to 1112122 tid 1 2026-02-13T18:06:11.702 INFO:tasks.rados.rados.0.trial187.stdout:136: writing trial18717860-23 from 1515641 to 2000658 tid 2 2026-02-13T18:06:11.711 INFO:tasks.rados.rados.0.trial187.stdout:136: writing trial18717860-23 from 2736097 to 3238402 tid 3 2026-02-13T18:06:11.711 INFO:tasks.rados.rados.0.trial187.stdout:137: rollback oid 34 current snap is 9 2026-02-13T18:06:11.711 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 34 to 7 2026-02-13T18:06:11.711 INFO:tasks.rados.rados.0.trial187.stdout:134: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-13T18:06:11.835 INFO:tasks.rados.rados.0.trial187.stdout:136: finishing write tid 1 to trial18717860-23 2026-02-13T18:06:11.835 INFO:tasks.rados.rados.0.trial187.stdout:136: finishing write tid 2 to trial18717860-23 2026-02-13T18:06:11.835 INFO:tasks.rados.rados.0.trial187.stdout:134: done (2 left) 2026-02-13T18:06:11.835 INFO:tasks.rados.rados.0.trial187.stdout:138: snap_remove snap 5 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:138: done (2 left) 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:139: snap_create 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:137: finishing rollback tid 0 to trial18717860-34 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:137: finishing rollback tid 1 to trial18717860-34 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:137: finishing rollback tid 2 to trial18717860-34 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 24 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T18:06:12.688 INFO:tasks.rados.rados.0.trial187.stdout:136: finishing write tid 3 to trial18717860-23 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: finishing write tid 4 to trial18717860-23 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: finishing write tid 5 to trial18717860-23 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: oid 23 updating version 0 to 16 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: oid 23 version 16 is already newer than 15 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: oid 23 updating version 16 to 18 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: oid 23 version 18 is already newer than 17 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 18 (ObjNum 82 snap 9 seq_num 82) dirty exists 2026-02-13T18:06:12.689 INFO:tasks.rados.rados.0.trial187.stdout:136: left oid 23 (ObjNum 82 snap 9 seq_num 82) 2026-02-13T18:06:13.675 INFO:tasks.rados.rados.0.trial187.stdout:136: done (2 left) 2026-02-13T18:06:13.676 INFO:tasks.rados.rados.0.trial187.stdout:137: done (1 left) 2026-02-13T18:06:13.676 INFO:tasks.rados.rados.0.trial187.stdout:139: done (0 left) 2026-02-13T18:06:13.676 INFO:tasks.rados.rados.0.trial187.stdout:140: read oid 39 snap -1 2026-02-13T18:06:13.676 INFO:tasks.rados.rados.0.trial187.stdout:140: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-13T18:06:13.676 INFO:tasks.rados.rados.0.trial187.stdout:141: write (excl) oid 37 current snap is 10 2026-02-13T18:06:13.676 INFO:tasks.rados.rados.0.trial187.stdout:141: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2026-02-13T18:06:13.683 INFO:tasks.rados.rados.0.trial187.stdout:141: writing trial18717860-37 from 594981 to 1204178 tid 1 2026-02-13T18:06:13.693 INFO:tasks.rados.rados.0.trial187.stdout:141: writing trial18717860-37 from 1974123 to 2719151 tid 2 2026-02-13T18:06:13.698 INFO:tasks.rados.rados.0.trial187.stdout:141: writing trial18717860-37 from 3279873 to 3394981 tid 3 2026-02-13T18:06:13.698 INFO:tasks.rados.rados.0.trial187.stdout:142: read oid 41 snap -1 2026-02-13T18:06:13.698 INFO:tasks.rados.rados.0.trial187.stdout:142: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-13T18:06:13.699 INFO:tasks.rados.rados.0.trial187.stdout:143: write oid 49 current snap is 10 2026-02-13T18:06:13.699 INFO:tasks.rados.rados.0.trial187.stdout:143: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2026-02-13T18:06:13.705 INFO:tasks.rados.rados.0.trial187.stdout:143: writing trial18717860-49 from 611788 to 1012587 tid 1 2026-02-13T18:06:13.713 INFO:tasks.rados.rados.0.trial187.stdout:143: writing trial18717860-49 from 1748958 to 2237644 tid 2 2026-02-13T18:06:13.722 INFO:tasks.rados.rados.0.trial187.stdout:143: writing trial18717860-49 from 2907296 to 3411788 tid 3 2026-02-13T18:06:13.722 INFO:tasks.rados.rados.0.trial187.stdout:144: snap_create 2026-02-13T18:06:13.722 INFO:tasks.rados.rados.0.trial187.stdout:140: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-13T18:06:13.722 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 527449 2026-02-13T18:06:13.751 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:13.777 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 545008 2026-02-13T18:06:13.794 INFO:tasks.rados.rados.0.trial187.stdout:141: finishing write tid 1 to trial18717860-37 2026-02-13T18:06:13.794 INFO:tasks.rados.rados.0.trial187.stdout:141: finishing write tid 2 to trial18717860-37 2026-02-13T18:06:13.794 INFO:tasks.rados.rados.0.trial187.stdout:141: finishing write tid 3 to trial18717860-37 2026-02-13T18:06:13.794 INFO:tasks.rados.rados.0.trial187.stdout:141: finishing write tid 4 to trial18717860-37 2026-02-13T18:06:13.794 INFO:tasks.rados.rados.0.trial187.stdout:141: finishing write tid 5 to trial18717860-37 2026-02-13T18:06:13.794 INFO:tasks.rados.rados.0.trial187.stdout:141: oid 37 updating version 0 to 65 2026-02-13T18:06:13.795 INFO:tasks.rados.rados.0.trial187.stdout:141: oid 37 version 65 is already newer than 63 2026-02-13T18:06:13.795 INFO:tasks.rados.rados.0.trial187.stdout:141: oid 37 updating version 65 to 66 2026-02-13T18:06:13.795 INFO:tasks.rados.rados.0.trial187.stdout:141: oid 37 version 66 is already newer than 64 2026-02-13T18:06:13.795 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 66 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:06:13.795 INFO:tasks.rados.rados.0.trial187.stdout:141: left oid 37 (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:06:13.795 INFO:tasks.rados.rados.0.trial187.stdout:142: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-13T18:06:13.796 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1950687 2026-02-13T18:06:13.844 INFO:tasks.rados.rados.0.trial187.stdout:143: finishing write tid 1 to trial18717860-49 2026-02-13T18:06:13.844 INFO:tasks.rados.rados.0.trial187.stdout:143: finishing write tid 2 to trial18717860-49 2026-02-13T18:06:13.844 INFO:tasks.rados.rados.0.trial187.stdout:143: finishing write tid 3 to trial18717860-49 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: finishing write tid 4 to trial18717860-49 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: finishing write tid 5 to trial18717860-49 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: oid 49 updating version 0 to 32 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: oid 49 version 32 is already newer than 31 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: oid 49 updating version 32 to 34 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: oid 49 version 34 is already newer than 33 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 34 (ObjNum 84 snap 10 seq_num 84) dirty exists 2026-02-13T18:06:13.845 INFO:tasks.rados.rados.0.trial187.stdout:143: left oid 49 (ObjNum 84 snap 10 seq_num 84) 2026-02-13T18:06:14.692 INFO:tasks.rados.rados.0.trial187.stdout:140: done (4 left) 2026-02-13T18:06:14.692 INFO:tasks.rados.rados.0.trial187.stdout:141: done (3 left) 2026-02-13T18:06:14.692 INFO:tasks.rados.rados.0.trial187.stdout:142: done (2 left) 2026-02-13T18:06:14.692 INFO:tasks.rados.rados.0.trial187.stdout:143: done (1 left) 2026-02-13T18:06:14.692 INFO:tasks.rados.rados.0.trial187.stdout:144: done (0 left) 2026-02-13T18:06:14.692 INFO:tasks.rados.rados.0.trial187.stdout:145: delete oid 28 current snap is 11 2026-02-13T18:06:14.694 INFO:tasks.rados.rados.0.trial187.stdout:145: done (0 left) 2026-02-13T18:06:14.694 INFO:tasks.rados.rados.0.trial187.stdout:146: read oid 12 snap -1 2026-02-13T18:06:14.694 INFO:tasks.rados.rados.0.trial187.stdout:146: expect (ObjNum 65 snap 5 seq_num 65) 2026-02-13T18:06:14.694 INFO:tasks.rados.rados.0.trial187.stdout:147: read oid 13 snap 7 2026-02-13T18:06:14.694 INFO:tasks.rados.rados.0.trial187.stdout:147: expect (ObjNum 12 snap 0 seq_num 12) 2026-02-13T18:06:14.695 INFO:tasks.rados.rados.0.trial187.stdout:148: write (excl) oid 4 current snap is 11 2026-02-13T18:06:14.695 INFO:tasks.rados.rados.0.trial187.stdout:148: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2026-02-13T18:06:14.702 INFO:tasks.rados.rados.0.trial187.stdout:148: writing trial18717860-4 from 645402 to 1196699 tid 1 2026-02-13T18:06:14.709 INFO:tasks.rados.rados.0.trial187.stdout:148: writing trial18717860-4 from 1749569 to 2241924 tid 2 2026-02-13T18:06:14.717 INFO:tasks.rados.rados.0.trial187.stdout:148: writing trial18717860-4 from 2845789 to 3445402 tid 3 2026-02-13T18:06:14.717 INFO:tasks.rados.rados.0.trial187.stdout:149: write (excl) oid 22 current snap is 11 2026-02-13T18:06:14.717 INFO:tasks.rados.rados.0.trial187.stdout:149: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2026-02-13T18:06:14.725 INFO:tasks.rados.rados.0.trial187.stdout:149: writing trial18717860-22 from 662209 to 1288755 tid 1 2026-02-13T18:06:14.733 INFO:tasks.rados.rados.0.trial187.stdout:149: writing trial18717860-22 from 1808051 to 2444064 tid 2 2026-02-13T18:06:14.739 INFO:tasks.rados.rados.0.trial187.stdout:149: writing trial18717860-22 from 2873212 to 3462209 tid 3 2026-02-13T18:06:14.739 INFO:tasks.rados.rados.0.trial187.stdout:150: snap_create 2026-02-13T18:06:14.739 INFO:tasks.rados.rados.0.trial187.stdout:146: expect (ObjNum 65 snap 5 seq_num 65) 2026-02-13T18:06:14.777 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:14.815 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:14.853 INFO:tasks.rados.rados.0.trial187.stdout:147: expect (ObjNum 12 snap 0 seq_num 12) 2026-02-13T18:06:14.889 INFO:tasks.rados.rados.0.trial187.stdout:148: finishing write tid 1 to trial18717860-4 2026-02-13T18:06:14.889 INFO:tasks.rados.rados.0.trial187.stdout:148: finishing write tid 2 to trial18717860-4 2026-02-13T18:06:14.889 INFO:tasks.rados.rados.0.trial187.stdout:148: finishing write tid 3 to trial18717860-4 2026-02-13T18:06:14.889 INFO:tasks.rados.rados.0.trial187.stdout:148: finishing write tid 4 to trial18717860-4 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:148: finishing write tid 5 to trial18717860-4 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:148: oid 4 updating version 0 to 17 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:148: oid 4 version 17 is already newer than 16 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:148: oid 4 version 17 is already newer than 15 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:148: oid 4 version 17 is already newer than 14 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 17 (ObjNum 86 snap 11 seq_num 86) dirty exists 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:148: left oid 4 (ObjNum 86 snap 11 seq_num 86) 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:149: finishing write tid 1 to trial18717860-22 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:149: finishing write tid 2 to trial18717860-22 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:149: finishing write tid 3 to trial18717860-22 2026-02-13T18:06:14.890 INFO:tasks.rados.rados.0.trial187.stdout:149: finishing write tid 4 to trial18717860-22 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:149: finishing write tid 5 to trial18717860-22 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:149: oid 22 updating version 0 to 71 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:149: oid 22 version 71 is already newer than 68 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:149: oid 22 version 71 is already newer than 69 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:149: oid 22 version 71 is already newer than 70 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 71 (ObjNum 87 snap 11 seq_num 87) dirty exists 2026-02-13T18:06:14.891 INFO:tasks.rados.rados.0.trial187.stdout:149: left oid 22 (ObjNum 87 snap 11 seq_num 87) 2026-02-13T18:06:15.693 INFO:tasks.rados.rados.0.trial187.stdout:146: done (4 left) 2026-02-13T18:06:15.693 INFO:tasks.rados.rados.0.trial187.stdout:147: done (3 left) 2026-02-13T18:06:15.693 INFO:tasks.rados.rados.0.trial187.stdout:148: done (2 left) 2026-02-13T18:06:15.693 INFO:tasks.rados.rados.0.trial187.stdout:149: done (1 left) 2026-02-13T18:06:15.693 INFO:tasks.rados.rados.0.trial187.stdout:150: done (0 left) 2026-02-13T18:06:15.693 INFO:tasks.rados.rados.0.trial187.stdout:151: write (excl) oid 31 current snap is 12 2026-02-13T18:06:15.694 INFO:tasks.rados.rados.0.trial187.stdout:151: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2026-02-13T18:06:15.698 INFO:tasks.rados.rados.0.trial187.stdout:151: writing trial18717860-31 from 679016 to 1380811 tid 1 2026-02-13T18:06:15.702 INFO:tasks.rados.rados.0.trial187.stdout:151: writing trial18717860-31 from 1866533 to 2362557 tid 2 2026-02-13T18:06:15.706 INFO:tasks.rados.rados.0.trial187.stdout:151: writing trial18717860-31 from 2900635 to 3303278 tid 3 2026-02-13T18:06:15.706 INFO:tasks.rados.rados.0.trial187.stdout:152: write oid 18 current snap is 12 2026-02-13T18:06:15.706 INFO:tasks.rados.rados.0.trial187.stdout:152: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2026-02-13T18:06:15.711 INFO:tasks.rados.rados.0.trial187.stdout:152: writing trial18717860-18 from 695823 to 1472867 tid 1 2026-02-13T18:06:15.715 INFO:tasks.rados.rados.0.trial187.stdout:152: writing trial18717860-18 from 1925015 to 2564697 tid 2 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:152: writing trial18717860-18 from 3328058 to 3495823 tid 3 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:153: snap_create 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:151: finishing write tid 1 to trial18717860-31 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:151: finishing write tid 2 to trial18717860-31 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:151: finishing write tid 3 to trial18717860-31 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:151: finishing write tid 4 to trial18717860-31 2026-02-13T18:06:15.719 INFO:tasks.rados.rados.0.trial187.stdout:151: finishing write tid 5 to trial18717860-31 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:151: oid 31 updating version 0 to 20 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:151: oid 31 updating version 20 to 21 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:151: oid 31 updating version 21 to 22 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:151: oid 31 version 22 is already newer than 19 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 22 (ObjNum 88 snap 12 seq_num 88) dirty exists 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:151: left oid 31 (ObjNum 88 snap 12 seq_num 88) 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:152: finishing write tid 1 to trial18717860-18 2026-02-13T18:06:15.720 INFO:tasks.rados.rados.0.trial187.stdout:152: finishing write tid 2 to trial18717860-18 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: finishing write tid 3 to trial18717860-18 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: finishing write tid 4 to trial18717860-18 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: finishing write tid 5 to trial18717860-18 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: oid 18 updating version 0 to 24 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: oid 18 updating version 24 to 26 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: oid 18 version 26 is already newer than 25 2026-02-13T18:06:15.721 INFO:tasks.rados.rados.0.trial187.stdout:152: oid 18 version 26 is already newer than 23 2026-02-13T18:06:15.722 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 26 (ObjNum 89 snap 12 seq_num 89) dirty exists 2026-02-13T18:06:15.722 INFO:tasks.rados.rados.0.trial187.stdout:152: left oid 18 (ObjNum 89 snap 12 seq_num 89) 2026-02-13T18:06:16.697 INFO:tasks.rados.rados.0.trial187.stdout:151: done (2 left) 2026-02-13T18:06:16.698 INFO:tasks.rados.rados.0.trial187.stdout:152: done (1 left) 2026-02-13T18:06:16.698 INFO:tasks.rados.rados.0.trial187.stdout:153: done (0 left) 2026-02-13T18:06:16.698 INFO:tasks.rados.rados.0.trial187.stdout:154: copy_from oid 50 from oid 2 current snap is 13 2026-02-13T18:06:16.698 INFO:tasks.rados.rados.0.trial187.stdout:155: snap_remove snap 9 2026-02-13T18:06:17.699 INFO:tasks.rados.rados.0.trial187.stdout:155: done (1 left) 2026-02-13T18:06:17.699 INFO:tasks.rados.rados.0.trial187.stdout:156: snap_create 2026-02-13T18:06:17.699 INFO:tasks.rados.rados.0.trial187.stdout:154: finishing copy_from racing read to trial18717860-50 2026-02-13T18:06:17.699 INFO:tasks.rados.rados.0.trial187.stdout:154: finishing copy_from to trial18717860-50 2026-02-13T18:06:17.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 19 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-13T18:06:18.676 INFO:tasks.rados.rados.0.trial187.stdout:154: done (1 left) 2026-02-13T18:06:18.676 INFO:tasks.rados.rados.0.trial187.stdout:156: done (0 left) 2026-02-13T18:06:18.676 INFO:tasks.rados.rados.0.trial187.stdout:157: snap_remove snap 11 2026-02-13T18:06:19.677 INFO:tasks.rados.rados.0.trial187.stdout:157: done (0 left) 2026-02-13T18:06:19.677 INFO:tasks.rados.rados.0.trial187.stdout:158: read oid 19 snap -1 2026-02-13T18:06:19.677 INFO:tasks.rados.rados.0.trial187.stdout:158: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:19.678 INFO:tasks.rados.rados.0.trial187.stdout:159: delete oid 1 current snap is 14 2026-02-13T18:06:19.682 INFO:tasks.rados.rados.0.trial187.stdout:158: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:19.744 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1904134 2026-02-13T18:06:19.787 INFO:tasks.rados.rados.0.trial187.stdout:158: done (1 left) 2026-02-13T18:06:19.787 INFO:tasks.rados.rados.0.trial187.stdout:159: done (0 left) 2026-02-13T18:06:19.787 INFO:tasks.rados.rados.0.trial187.stdout:160: copy_from oid 4 from oid 38 current snap is 14 2026-02-13T18:06:19.787 INFO:tasks.rados.rados.0.trial187.stdout:161: write (excl) oid 49 current snap is 14 2026-02-13T18:06:19.788 INFO:tasks.rados.rados.0.trial187.stdout:161: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-13T18:06:19.796 INFO:tasks.rados.rados.0.trial187.stdout:161: writing trial18717860-49 from 729437 to 1256979 tid 1 2026-02-13T18:06:19.805 INFO:tasks.rados.rados.0.trial187.stdout:161: writing trial18717860-49 from 1925626 to 2568977 tid 2 2026-02-13T18:06:19.811 INFO:tasks.rados.rados.0.trial187.stdout:161: writing trial18717860-49 from 3266551 to 3529437 tid 3 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:162: write oid 21 current snap is 14 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:161: finishing write tid 1 to trial18717860-49 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:160: finishing copy_from racing read to trial18717860-4 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:160: finishing copy_from to trial18717860-4 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 11 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:161: finishing write tid 2 to trial18717860-49 2026-02-13T18:06:19.812 INFO:tasks.rados.rados.0.trial187.stdout:162: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2026-02-13T18:06:19.821 INFO:tasks.rados.rados.0.trial187.stdout:162: writing trial18717860-21 from 746244 to 1465388 tid 1 2026-02-13T18:06:19.829 INFO:tasks.rados.rados.0.trial187.stdout:162: writing trial18717860-21 from 2100461 to 2603823 tid 2 2026-02-13T18:06:19.835 INFO:tasks.rados.rados.0.trial187.stdout:162: writing trial18717860-21 from 3126680 to 3546244 tid 3 2026-02-13T18:06:19.835 INFO:tasks.rados.rados.0.trial187.stdout:160: done (2 left) 2026-02-13T18:06:19.835 INFO:tasks.rados.rados.0.trial187.stdout:163: write oid 10 current snap is 14 2026-02-13T18:06:19.836 INFO:tasks.rados.rados.0.trial187.stdout:163: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2026-02-13T18:06:19.842 INFO:tasks.rados.rados.0.trial187.stdout:163: writing trial18717860-10 from 763051 to 1557444 tid 1 2026-02-13T18:06:19.846 INFO:tasks.rados.rados.0.trial187.stdout:163: writing trial18717860-10 from 2158943 to 2805963 tid 2 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:163: writing trial18717860-10 from 3437750 to 3563051 tid 3 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:164: delete oid 31 current snap is 14 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:161: finishing write tid 3 to trial18717860-49 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:161: finishing write tid 4 to trial18717860-49 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:161: finishing write tid 5 to trial18717860-49 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:161: oid 49 updating version 0 to 38 2026-02-13T18:06:19.850 INFO:tasks.rados.rados.0.trial187.stdout:161: oid 49 updating version 38 to 39 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:161: oid 49 version 39 is already newer than 36 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:161: oid 49 version 39 is already newer than 37 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 39 (ObjNum 91 snap 14 seq_num 91) dirty exists 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:161: left oid 49 (ObjNum 91 snap 14 seq_num 91) 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: finishing write tid 1 to trial18717860-21 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: finishing write tid 2 to trial18717860-21 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: finishing write tid 3 to trial18717860-21 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: finishing write tid 4 to trial18717860-21 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: finishing write tid 5 to trial18717860-21 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: oid 21 updating version 0 to 43 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: oid 21 version 43 is already newer than 41 2026-02-13T18:06:19.851 INFO:tasks.rados.rados.0.trial187.stdout:162: oid 21 version 43 is already newer than 40 2026-02-13T18:06:19.852 INFO:tasks.rados.rados.0.trial187.stdout:162: oid 21 version 43 is already newer than 42 2026-02-13T18:06:19.852 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 43 (ObjNum 92 snap 14 seq_num 92) dirty exists 2026-02-13T18:06:19.852 INFO:tasks.rados.rados.0.trial187.stdout:162: left oid 21 (ObjNum 92 snap 14 seq_num 92) 2026-02-13T18:06:19.852 INFO:tasks.rados.rados.0.trial187.stdout:163: finishing write tid 1 to trial18717860-10 2026-02-13T18:06:19.852 INFO:tasks.rados.rados.0.trial187.stdout:163: finishing write tid 2 to trial18717860-10 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: finishing write tid 3 to trial18717860-10 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: finishing write tid 4 to trial18717860-10 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: finishing write tid 5 to trial18717860-10 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: oid 10 updating version 0 to 24 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: oid 10 version 24 is already newer than 21 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: oid 10 version 24 is already newer than 22 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: oid 10 version 24 is already newer than 23 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 24 (ObjNum 93 snap 14 seq_num 93) dirty exists 2026-02-13T18:06:19.853 INFO:tasks.rados.rados.0.trial187.stdout:163: left oid 10 (ObjNum 93 snap 14 seq_num 93) 2026-02-13T18:06:19.854 INFO:tasks.rados.rados.0.trial187.stdout:161: done (3 left) 2026-02-13T18:06:19.854 INFO:tasks.rados.rados.0.trial187.stdout:162: done (2 left) 2026-02-13T18:06:19.854 INFO:tasks.rados.rados.0.trial187.stdout:163: done (1 left) 2026-02-13T18:06:19.854 INFO:tasks.rados.rados.0.trial187.stdout:164: done (0 left) 2026-02-13T18:06:19.854 INFO:tasks.rados.rados.0.trial187.stdout:165: delete oid 6 current snap is 14 2026-02-13T18:06:19.854 INFO:tasks.rados.rados.0.trial187.stdout:165: done (0 left) 2026-02-13T18:06:19.855 INFO:tasks.rados.rados.0.trial187.stdout:166: rollback oid 5 current snap is 14 2026-02-13T18:06:19.855 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 7 2026-02-13T18:06:19.855 INFO:tasks.rados.rados.0.trial187.stdout:167: write (excl) oid 2 current snap is 14 2026-02-13T18:06:19.855 INFO:tasks.rados.rados.0.trial187.stdout:167: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2026-02-13T18:06:19.858 INFO:tasks.rados.rados.0.trial187.stdout:167: writing trial18717860-2 from 413472 to 1033612 tid 1 2026-02-13T18:06:19.862 INFO:tasks.rados.rados.0.trial187.stdout:167: writing trial18717860-2 from 1818036 to 2328736 tid 2 2026-02-13T18:06:19.867 INFO:tasks.rados.rados.0.trial187.stdout:167: writing trial18717860-2 from 3120019 to 3613472 tid 3 2026-02-13T18:06:19.867 INFO:tasks.rados.rados.0.trial187.stdout:168: write oid 26 current snap is 14 2026-02-13T18:06:19.868 INFO:tasks.rados.rados.0.trial187.stdout:168: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2026-02-13T18:06:19.871 INFO:tasks.rados.rados.0.trial187.stdout:168: writing trial18717860-26 from 430279 to 1125668 tid 1 2026-02-13T18:06:19.877 INFO:tasks.rados.rados.0.trial187.stdout:168: writing trial18717860-26 from 1876518 to 2530876 tid 2 2026-02-13T18:06:19.881 INFO:tasks.rados.rados.0.trial187.stdout:168: writing trial18717860-26 from 3031089 to 3567886 tid 3 2026-02-13T18:06:19.881 INFO:tasks.rados.rados.0.trial187.stdout:169: delete oid 45 current snap is 14 2026-02-13T18:06:19.881 INFO:tasks.rados.rados.0.trial187.stdout:166: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:06:19.881 INFO:tasks.rados.rados.0.trial187.stdout:166: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:06:19.881 INFO:tasks.rados.rados.0.trial187.stdout:166: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:06:19.881 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 13 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: finishing write tid 1 to trial18717860-2 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: finishing write tid 2 to trial18717860-2 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: finishing write tid 3 to trial18717860-2 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: finishing write tid 4 to trial18717860-2 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: finishing write tid 5 to trial18717860-2 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: oid 2 updating version 0 to 33 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: oid 2 updating version 33 to 34 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: oid 2 version 34 is already newer than 32 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: oid 2 updating version 34 to 35 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 35 (ObjNum 96 snap 14 seq_num 96) dirty exists 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:167: left oid 2 (ObjNum 96 snap 14 seq_num 96) 2026-02-13T18:06:19.882 INFO:tasks.rados.rados.0.trial187.stdout:168: finishing write tid 1 to trial18717860-26 2026-02-13T18:06:19.883 INFO:tasks.rados.rados.0.trial187.stdout:168: finishing write tid 2 to trial18717860-26 2026-02-13T18:06:19.883 INFO:tasks.rados.rados.0.trial187.stdout:168: finishing write tid 3 to trial18717860-26 2026-02-13T18:06:19.883 INFO:tasks.rados.rados.0.trial187.stdout:168: finishing write tid 4 to trial18717860-26 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: finishing write tid 5 to trial18717860-26 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: oid 26 updating version 0 to 49 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: oid 26 version 49 is already newer than 47 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: oid 26 updating version 49 to 50 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: oid 26 version 50 is already newer than 48 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 50 (ObjNum 97 snap 14 seq_num 97) dirty exists 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: left oid 26 (ObjNum 97 snap 14 seq_num 97) 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:166: done (3 left) 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:167: done (2 left) 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:168: done (1 left) 2026-02-13T18:06:19.884 INFO:tasks.rados.rados.0.trial187.stdout:169: done (0 left) 2026-02-13T18:06:19.885 INFO:tasks.rados.rados.0.trial187.stdout:170: snap_create 2026-02-13T18:06:20.683 INFO:tasks.rados.rados.0.trial187.stdout:170: done (0 left) 2026-02-13T18:06:20.683 INFO:tasks.rados.rados.0.trial187.stdout:171: write (excl) oid 48 current snap is 15 2026-02-13T18:06:20.683 INFO:tasks.rados.rados.0.trial187.stdout:171: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2026-02-13T18:06:20.688 INFO:tasks.rados.rados.0.trial187.stdout:171: writing trial18717860-48 from 463893 to 1026133 tid 1 2026-02-13T18:06:20.693 INFO:tasks.rados.rados.0.trial187.stdout:171: writing trial18717860-48 from 1593482 to 2251509 tid 2 2026-02-13T18:06:20.697 INFO:tasks.rados.rados.0.trial187.stdout:171: writing trial18717860-48 from 2685935 to 3245276 tid 3 2026-02-13T18:06:20.697 INFO:tasks.rados.rados.0.trial187.stdout:172: snap_create 2026-02-13T18:06:20.697 INFO:tasks.rados.rados.0.trial187.stdout:171: finishing write tid 1 to trial18717860-48 2026-02-13T18:06:20.697 INFO:tasks.rados.rados.0.trial187.stdout:171: finishing write tid 2 to trial18717860-48 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: finishing write tid 3 to trial18717860-48 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: finishing write tid 4 to trial18717860-48 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: finishing write tid 5 to trial18717860-48 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: oid 48 updating version 0 to 79 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: oid 48 version 79 is already newer than 77 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: oid 48 version 79 is already newer than 78 2026-02-13T18:06:20.699 INFO:tasks.rados.rados.0.trial187.stdout:171: oid 48 version 79 is already newer than 76 2026-02-13T18:06:20.700 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 79 (ObjNum 99 snap 15 seq_num 99) dirty exists 2026-02-13T18:06:20.700 INFO:tasks.rados.rados.0.trial187.stdout:171: left oid 48 (ObjNum 99 snap 15 seq_num 99) 2026-02-13T18:06:21.684 INFO:tasks.rados.rados.0.trial187.stdout:171: done (1 left) 2026-02-13T18:06:21.684 INFO:tasks.rados.rados.0.trial187.stdout:172: done (0 left) 2026-02-13T18:06:21.684 INFO:tasks.rados.rados.0.trial187.stdout:173: write (excl) oid 9 current snap is 16 2026-02-13T18:06:21.684 INFO:tasks.rados.rados.0.trial187.stdout:173: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2026-02-13T18:06:21.688 INFO:tasks.rados.rados.0.trial187.stdout:173: writing trial18717860-9 from 480700 to 1118189 tid 1 2026-02-13T18:06:21.692 INFO:tasks.rados.rados.0.trial187.stdout:173: writing trial18717860-9 from 1651964 to 2053649 tid 2 2026-02-13T18:06:21.697 INFO:tasks.rados.rados.0.trial187.stdout:173: writing trial18717860-9 from 2713358 to 3483971 tid 3 2026-02-13T18:06:21.698 INFO:tasks.rados.rados.0.trial187.stdout:174: write oid 33 current snap is 16 2026-02-13T18:06:21.698 INFO:tasks.rados.rados.0.trial187.stdout:174: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2026-02-13T18:06:21.702 INFO:tasks.rados.rados.0.trial187.stdout:174: writing trial18717860-33 from 497507 to 1210245 tid 1 2026-02-13T18:06:21.707 INFO:tasks.rados.rados.0.trial187.stdout:174: writing trial18717860-33 from 1710446 to 2372142 tid 2 2026-02-13T18:06:21.712 INFO:tasks.rados.rados.0.trial187.stdout:174: writing trial18717860-33 from 3140781 to 3697507 tid 3 2026-02-13T18:06:21.712 INFO:tasks.rados.rados.0.trial187.stdout:175: delete oid 11 current snap is 16 2026-02-13T18:06:21.712 INFO:tasks.rados.rados.0.trial187.stdout:173: finishing write tid 1 to trial18717860-9 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: finishing write tid 2 to trial18717860-9 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: finishing write tid 3 to trial18717860-9 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: finishing write tid 4 to trial18717860-9 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: finishing write tid 5 to trial18717860-9 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: oid 9 updating version 0 to 53 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: oid 9 updating version 53 to 55 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: oid 9 version 55 is already newer than 54 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: oid 9 version 55 is already newer than 52 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 55 (ObjNum 100 snap 16 seq_num 100) dirty exists 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:173: left oid 9 (ObjNum 100 snap 16 seq_num 100) 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:174: finishing write tid 1 to trial18717860-33 2026-02-13T18:06:21.713 INFO:tasks.rados.rados.0.trial187.stdout:174: finishing write tid 2 to trial18717860-33 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: finishing write tid 3 to trial18717860-33 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: finishing write tid 4 to trial18717860-33 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: finishing write tid 5 to trial18717860-33 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: oid 33 updating version 0 to 81 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: oid 33 updating version 81 to 82 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: oid 33 version 82 is already newer than 80 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:174: oid 33 updating version 82 to 83 2026-02-13T18:06:21.715 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 83 (ObjNum 101 snap 16 seq_num 101) dirty exists 2026-02-13T18:06:21.716 INFO:tasks.rados.rados.0.trial187.stdout:174: left oid 33 (ObjNum 101 snap 16 seq_num 101) 2026-02-13T18:06:21.716 INFO:tasks.rados.rados.0.trial187.stdout:173: done (2 left) 2026-02-13T18:06:21.716 INFO:tasks.rados.rados.0.trial187.stdout:174: done (1 left) 2026-02-13T18:06:21.716 INFO:tasks.rados.rados.0.trial187.stdout:175: done (0 left) 2026-02-13T18:06:21.716 INFO:tasks.rados.rados.0.trial187.stdout:176: snap_remove snap 10 2026-02-13T18:06:22.690 INFO:tasks.rados.rados.0.trial187.stdout:176: done (0 left) 2026-02-13T18:06:22.690 INFO:tasks.rados.rados.0.trial187.stdout:177: read oid 31 snap -1 2026-02-13T18:06:22.691 INFO:tasks.rados.rados.0.trial187.stdout:177: expect deleted 2026-02-13T18:06:22.691 INFO:tasks.rados.rados.0.trial187.stdout:178: write oid 44 current snap is 16 2026-02-13T18:06:22.691 INFO:tasks.rados.rados.0.trial187.stdout:178: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2026-02-13T18:06:22.694 INFO:tasks.rados.rados.0.trial187.stdout:178: writing trial18717860-44 from 531121 to 994357 tid 1 2026-02-13T18:06:22.699 INFO:tasks.rados.rados.0.trial187.stdout:178: writing trial18717860-44 from 1711057 to 2376422 tid 2 2026-02-13T18:06:22.704 INFO:tasks.rados.rados.0.trial187.stdout:178: writing trial18717860-44 from 3079274 to 3731121 tid 3 2026-02-13T18:06:22.704 INFO:tasks.rados.rados.0.trial187.stdout:179: rollback oid 23 current snap is 16 2026-02-13T18:06:22.704 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 23 to 13 2026-02-13T18:06:22.705 INFO:tasks.rados.rados.0.trial187.stdout:178: finishing write tid 1 to trial18717860-44 2026-02-13T18:06:22.705 INFO:tasks.rados.rados.0.trial187.stdout:178: finishing write tid 2 to trial18717860-44 2026-02-13T18:06:22.705 INFO:tasks.rados.rados.0.trial187.stdout:177: done (2 left) 2026-02-13T18:06:22.705 INFO:tasks.rados.rados.0.trial187.stdout:180: snap_remove snap 4 2026-02-13T18:06:23.686 INFO:tasks.rados.rados.0.trial187.stdout:180: done (2 left) 2026-02-13T18:06:23.686 INFO:tasks.rados.rados.0.trial187.stdout:181: read oid 46 snap -1 2026-02-13T18:06:23.686 INFO:tasks.rados.rados.0.trial187.stdout:181: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:23.686 INFO:tasks.rados.rados.0.trial187.stdout:182: copy_from oid 41 from oid 19 current snap is 16 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: finishing write tid 3 to trial18717860-44 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: finishing write tid 4 to trial18717860-44 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: finishing write tid 5 to trial18717860-44 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: oid 44 updating version 0 to 89 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: oid 44 version 89 is already newer than 88 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: oid 44 version 89 is already newer than 87 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: oid 44 updating version 89 to 90 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 90 (ObjNum 103 snap 16 seq_num 103) dirty exists 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: left oid 44 (ObjNum 103 snap 16 seq_num 103) 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:179: finishing rollback tid 0 to trial18717860-23 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:179: finishing rollback tid 1 to trial18717860-23 2026-02-13T18:06:23.687 INFO:tasks.rados.rados.0.trial187.stdout:178: done (3 left) 2026-02-13T18:06:23.688 INFO:tasks.rados.rados.0.trial187.stdout:183: write (excl) oid 13 current snap is 16 2026-02-13T18:06:23.688 INFO:tasks.rados.rados.0.trial187.stdout:183: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2026-02-13T18:06:23.690 INFO:tasks.rados.rados.0.trial187.stdout:183: writing trial18717860-13 from 547928 to 1086413 tid 1 2026-02-13T18:06:23.698 INFO:tasks.rados.rados.0.trial187.stdout:183: writing trial18717860-13 from 1769539 to 2178562 tid 2 2026-02-13T18:06:23.705 INFO:tasks.rados.rados.0.trial187.stdout:183: writing trial18717860-13 from 2706697 to 3238751 tid 3 2026-02-13T18:06:23.705 INFO:tasks.rados.rados.0.trial187.stdout:184: write (excl) oid 25 current snap is 16 2026-02-13T18:06:23.705 INFO:tasks.rados.rados.0.trial187.stdout:179: finishing rollback tid 2 to trial18717860-23 2026-02-13T18:06:23.705 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 24 (ObjNum 82 snap 9 seq_num 82) dirty exists 2026-02-13T18:06:23.705 INFO:tasks.rados.rados.0.trial187.stdout:181: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:23.716 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1269053 2026-02-13T18:06:23.804 INFO:tasks.rados.rados.0.trial187.stdout:183: finishing write tid 1 to trial18717860-13 2026-02-13T18:06:23.804 INFO:tasks.rados.rados.0.trial187.stdout:183: finishing write tid 2 to trial18717860-13 2026-02-13T18:06:23.804 INFO:tasks.rados.rados.0.trial187.stdout:182: finishing copy_from racing read to trial18717860-41 2026-02-13T18:06:23.804 INFO:tasks.rados.rados.0.trial187.stdout:183: finishing write tid 3 to trial18717860-13 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: finishing write tid 4 to trial18717860-13 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: finishing write tid 5 to trial18717860-13 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: oid 13 updating version 0 to 46 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: oid 13 updating version 46 to 47 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: oid 13 version 47 is already newer than 41 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: oid 13 updating version 47 to 48 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 48 (ObjNum 104 snap 16 seq_num 104) dirty exists 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:183: left oid 13 (ObjNum 104 snap 16 seq_num 104) 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:182: finishing copy_from to trial18717860-41 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 27 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T18:06:23.805 INFO:tasks.rados.rados.0.trial187.stdout:184: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2026-02-13T18:06:23.812 INFO:tasks.rados.rados.0.trial187.stdout:184: writing trial18717860-25 from 564735 to 1178469 tid 1 2026-02-13T18:06:23.821 INFO:tasks.rados.rados.0.trial187.stdout:184: writing trial18717860-25 from 1828021 to 2497055 tid 2 2026-02-13T18:06:23.831 INFO:tasks.rados.rados.0.trial187.stdout:184: writing trial18717860-25 from 3134120 to 3764735 tid 3 2026-02-13T18:06:23.831 INFO:tasks.rados.rados.0.trial187.stdout:179: done (4 left) 2026-02-13T18:06:23.831 INFO:tasks.rados.rados.0.trial187.stdout:181: done (3 left) 2026-02-13T18:06:23.831 INFO:tasks.rados.rados.0.trial187.stdout:182: done (2 left) 2026-02-13T18:06:23.831 INFO:tasks.rados.rados.0.trial187.stdout:183: done (1 left) 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:185: read oid 27 snap -1 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:185: expect (ObjNum 26 snap 0 seq_num 26) 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:186: copy_from oid 8 from oid 7 current snap is 16 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:184: finishing write tid 1 to trial18717860-25 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:184: finishing write tid 2 to trial18717860-25 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:187: read oid 30 snap -1 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:187: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:188: read oid 2 snap -1 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:188: expect (ObjNum 96 snap 14 seq_num 96) 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:189: read oid 18 snap -1 2026-02-13T18:06:23.832 INFO:tasks.rados.rados.0.trial187.stdout:189: expect (ObjNum 89 snap 12 seq_num 89) 2026-02-13T18:06:23.833 INFO:tasks.rados.rados.0.trial187.stdout:190: delete oid 3 current snap is 16 2026-02-13T18:06:23.834 INFO:tasks.rados.rados.0.trial187.stdout:187: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:06:23.834 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:23.852 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 293872 2026-02-13T18:06:23.869 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:23.887 INFO:tasks.rados.rados.0.trial187.stdout:185: expect (ObjNum 26 snap 0 seq_num 26) 2026-02-13T18:06:23.894 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1868965 2026-02-13T18:06:23.909 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1478351 2026-02-13T18:06:23.919 INFO:tasks.rados.rados.0.trial187.stdout:186: finishing copy_from to trial18717860-8 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:186: got expected ENOENT (src dne) 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:186: finishing copy_from racing read to trial18717860-8 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: finishing write tid 3 to trial18717860-25 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: finishing write tid 4 to trial18717860-25 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: finishing write tid 5 to trial18717860-25 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: oid 25 updating version 0 to 18 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: oid 25 updating version 18 to 21 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: oid 25 version 21 is already newer than 20 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: oid 25 version 21 is already newer than 19 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 21 (ObjNum 105 snap 16 seq_num 105) dirty exists 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:184: left oid 25 (ObjNum 105 snap 16 seq_num 105) 2026-02-13T18:06:23.920 INFO:tasks.rados.rados.0.trial187.stdout:188: expect (ObjNum 96 snap 14 seq_num 96) 2026-02-13T18:06:23.921 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:23.976 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:24.010 INFO:tasks.rados.rados.0.trial187.stdout:189: expect (ObjNum 89 snap 12 seq_num 89) 2026-02-13T18:06:24.144 INFO:tasks.rados.rados.0.trial187.stdout:184: done (6 left) 2026-02-13T18:06:24.144 INFO:tasks.rados.rados.0.trial187.stdout:185: done (5 left) 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:186: done (4 left) 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:187: done (3 left) 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:188: done (2 left) 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:189: done (1 left) 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:190: done (0 left) 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:191: write oid 5 current snap is 16 2026-02-13T18:06:24.145 INFO:tasks.rados.rados.0.trial187.stdout:191: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2026-02-13T18:06:24.152 INFO:tasks.rados.rados.0.trial187.stdout:191: writing trial18717860-5 from 598349 to 1078934 tid 1 2026-02-13T18:06:24.160 INFO:tasks.rados.rados.0.trial187.stdout:191: writing trial18717860-5 from 1544985 to 2217688 tid 2 2026-02-13T18:06:24.168 INFO:tasks.rados.rados.0.trial187.stdout:191: writing trial18717860-5 from 2905319 to 3387542 tid 3 2026-02-13T18:06:24.168 INFO:tasks.rados.rados.0.trial187.stdout:192: copy_from oid 31 from oid 34 current snap is 16 2026-02-13T18:06:24.168 INFO:tasks.rados.rados.0.trial187.stdout:191: finishing write tid 1 to trial18717860-5 2026-02-13T18:06:24.168 INFO:tasks.rados.rados.0.trial187.stdout:191: finishing write tid 2 to trial18717860-5 2026-02-13T18:06:24.169 INFO:tasks.rados.rados.0.trial187.stdout:193: write oid 21 current snap is 16 2026-02-13T18:06:24.169 INFO:tasks.rados.rados.0.trial187.stdout:193: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2026-02-13T18:06:24.176 INFO:tasks.rados.rados.0.trial187.stdout:193: writing trial18717860-21 from 615156 to 1170990 tid 1 2026-02-13T18:06:24.182 INFO:tasks.rados.rados.0.trial187.stdout:193: writing trial18717860-21 from 1603467 to 2019828 tid 2 2026-02-13T18:06:24.192 INFO:tasks.rados.rados.0.trial187.stdout:193: writing trial18717860-21 from 2816389 to 3509884 tid 3 2026-02-13T18:06:24.192 INFO:tasks.rados.rados.0.trial187.stdout:194: delete oid 50 current snap is 16 2026-02-13T18:06:24.192 INFO:tasks.rados.rados.0.trial187.stdout:191: finishing write tid 3 to trial18717860-5 2026-02-13T18:06:24.192 INFO:tasks.rados.rados.0.trial187.stdout:191: finishing write tid 4 to trial18717860-5 2026-02-13T18:06:24.192 INFO:tasks.rados.rados.0.trial187.stdout:191: finishing write tid 5 to trial18717860-5 2026-02-13T18:06:24.192 INFO:tasks.rados.rados.0.trial187.stdout:191: oid 5 updating version 0 to 27 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:191: oid 5 updating version 27 to 28 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:191: oid 5 version 28 is already newer than 25 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:191: oid 5 version 28 is already newer than 26 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 28 (ObjNum 107 snap 16 seq_num 107) dirty exists 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:191: left oid 5 (ObjNum 107 snap 16 seq_num 107) 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:193: finishing write tid 1 to trial18717860-21 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:193: finishing write tid 2 to trial18717860-21 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:192: finishing copy_from racing read to trial18717860-31 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:192: finishing copy_from to trial18717860-31 2026-02-13T18:06:24.193 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 24 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T18:06:24.194 INFO:tasks.rados.rados.0.trial187.stdout:191: done (3 left) 2026-02-13T18:06:24.194 INFO:tasks.rados.rados.0.trial187.stdout:192: done (2 left) 2026-02-13T18:06:24.194 INFO:tasks.rados.rados.0.trial187.stdout:194: done (1 left) 2026-02-13T18:06:24.194 INFO:tasks.rados.rados.0.trial187.stdout:195: snap_create 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: finishing write tid 3 to trial18717860-21 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: finishing write tid 4 to trial18717860-21 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: finishing write tid 5 to trial18717860-21 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: oid 21 updating version 0 to 52 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: oid 21 updating version 52 to 54 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: oid 21 version 54 is already newer than 53 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:193: oid 21 version 54 is already newer than 51 2026-02-13T18:06:24.195 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 54 (ObjNum 108 snap 16 seq_num 108) dirty exists 2026-02-13T18:06:24.196 INFO:tasks.rados.rados.0.trial187.stdout:193: left oid 21 (ObjNum 108 snap 16 seq_num 108) 2026-02-13T18:06:24.695 INFO:tasks.rados.rados.0.trial187.stdout:193: done (1 left) 2026-02-13T18:06:24.695 INFO:tasks.rados.rados.0.trial187.stdout:195: done (0 left) 2026-02-13T18:06:24.695 INFO:tasks.rados.rados.0.trial187.stdout:196: write oid 25 current snap is 17 2026-02-13T18:06:24.695 INFO:tasks.rados.rados.0.trial187.stdout:196: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2026-02-13T18:06:24.704 INFO:tasks.rados.rados.0.trial187.stdout:196: writing trial18717860-25 from 648770 to 1355102 tid 1 2026-02-13T18:06:24.712 INFO:tasks.rados.rados.0.trial187.stdout:196: writing trial18717860-25 from 2120431 to 2540461 tid 2 2026-02-13T18:06:24.720 INFO:tasks.rados.rados.0.trial187.stdout:196: writing trial18717860-25 from 3271235 to 3703627 tid 3 2026-02-13T18:06:24.720 INFO:tasks.rados.rados.0.trial187.stdout:197: snap_remove snap 7 2026-02-13T18:06:24.720 INFO:tasks.rados.rados.0.trial187.stdout:196: finishing write tid 1 to trial18717860-25 2026-02-13T18:06:24.720 INFO:tasks.rados.rados.0.trial187.stdout:196: finishing write tid 2 to trial18717860-25 2026-02-13T18:06:25.696 INFO:tasks.rados.rados.0.trial187.stdout:197: done (1 left) 2026-02-13T18:06:25.696 INFO:tasks.rados.rados.0.trial187.stdout:198: write (excl) oid 10 current snap is 17 2026-02-13T18:06:25.696 INFO:tasks.rados.rados.0.trial187.stdout:198: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-13T18:06:25.705 INFO:tasks.rados.rados.0.trial187.stdout:198: writing trial18717860-10 from 665577 to 1447158 tid 1 2026-02-13T18:06:25.713 INFO:tasks.rados.rados.0.trial187.stdout:198: writing trial18717860-10 from 2062560 to 2626248 tid 2 2026-02-13T18:06:25.721 INFO:tasks.rados.rados.0.trial187.stdout:198: writing trial18717860-10 from 3182305 to 3825969 tid 3 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:199: copy_from oid 13 from oid 3 current snap is 17 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: finishing write tid 3 to trial18717860-25 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: finishing write tid 4 to trial18717860-25 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: finishing write tid 5 to trial18717860-25 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: oid 25 updating version 0 to 25 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: oid 25 updating version 25 to 26 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: oid 25 version 26 is already newer than 24 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: oid 25 version 26 is already newer than 23 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 26 (ObjNum 110 snap 17 seq_num 110) dirty exists 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:196: left oid 25 (ObjNum 110 snap 17 seq_num 110) 2026-02-13T18:06:25.722 INFO:tasks.rados.rados.0.trial187.stdout:198: finishing write tid 1 to trial18717860-10 2026-02-13T18:06:25.723 INFO:tasks.rados.rados.0.trial187.stdout:198: finishing write tid 2 to trial18717860-10 2026-02-13T18:06:25.723 INFO:tasks.rados.rados.0.trial187.stdout:196: done (2 left) 2026-02-13T18:06:25.723 INFO:tasks.rados.rados.0.trial187.stdout:200: delete oid 33 current snap is 17 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:198: finishing write tid 3 to trial18717860-10 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:199: finishing copy_from to trial18717860-13 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:199: got expected ENOENT (src dne) 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:198: finishing write tid 4 to trial18717860-10 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:199: finishing copy_from racing read to trial18717860-13 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:198: finishing write tid 5 to trial18717860-10 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:198: oid 10 updating version 0 to 36 2026-02-13T18:06:25.724 INFO:tasks.rados.rados.0.trial187.stdout:198: oid 10 version 36 is already newer than 35 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:198: oid 10 updating version 36 to 37 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:198: oid 10 version 37 is already newer than 34 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 37 (ObjNum 111 snap 17 seq_num 111) dirty exists 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:198: left oid 10 (ObjNum 111 snap 17 seq_num 111) 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:198: done (2 left) 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:199: done (1 left) 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:200: done (0 left) 2026-02-13T18:06:25.725 INFO:tasks.rados.rados.0.trial187.stdout:201: snap_remove snap 14 2026-02-13T18:06:26.701 INFO:tasks.rados.rados.0.trial187.stdout:201: done (0 left) 2026-02-13T18:06:26.702 INFO:tasks.rados.rados.0.trial187.stdout:202: read oid 26 snap 16 2026-02-13T18:06:26.702 INFO:tasks.rados.rados.0.trial187.stdout:202: expect (ObjNum 97 snap 14 seq_num 97) 2026-02-13T18:06:26.702 INFO:tasks.rados.rados.0.trial187.stdout:203: rollback oid 23 current snap is 17 2026-02-13T18:06:26.702 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 23 to 15 2026-02-13T18:06:26.702 INFO:tasks.rados.rados.0.trial187.stdout:204: snap_create 2026-02-13T18:06:26.704 INFO:tasks.rados.rados.0.trial187.stdout:203: finishing rollback tid 0 to trial18717860-23 2026-02-13T18:06:26.704 INFO:tasks.rados.rados.0.trial187.stdout:203: finishing rollback tid 1 to trial18717860-23 2026-02-13T18:06:26.704 INFO:tasks.rados.rados.0.trial187.stdout:203: finishing rollback tid 2 to trial18717860-23 2026-02-13T18:06:26.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 34 (ObjNum 82 snap 9 seq_num 82) dirty exists 2026-02-13T18:06:26.709 INFO:tasks.rados.rados.0.trial187.stdout:202: expect (ObjNum 97 snap 14 seq_num 97) 2026-02-13T18:06:26.734 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1973689 2026-02-13T18:06:26.789 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:27.703 INFO:tasks.rados.rados.0.trial187.stdout:202: done (2 left) 2026-02-13T18:06:27.703 INFO:tasks.rados.rados.0.trial187.stdout:203: done (1 left) 2026-02-13T18:06:27.703 INFO:tasks.rados.rados.0.trial187.stdout:204: done (0 left) 2026-02-13T18:06:27.703 INFO:tasks.rados.rados.0.trial187.stdout:205: write (excl) oid 6 current snap is 18 2026-02-13T18:06:27.703 INFO:tasks.rados.rados.0.trial187.stdout:205: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2026-02-13T18:06:27.711 INFO:tasks.rados.rados.0.trial187.stdout:205: writing trial18717860-6 from 699191 to 1231270 tid 1 2026-02-13T18:06:27.718 INFO:tasks.rados.rados.0.trial187.stdout:205: writing trial18717860-6 from 1779524 to 2346881 tid 2 2026-02-13T18:06:27.726 INFO:tasks.rados.rados.0.trial187.stdout:205: writing trial18717860-6 from 2837151 to 3503359 tid 3 2026-02-13T18:06:27.726 INFO:tasks.rados.rados.0.trial187.stdout:206: write oid 20 current snap is 18 2026-02-13T18:06:27.726 INFO:tasks.rados.rados.0.trial187.stdout:206: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2026-02-13T18:06:27.735 INFO:tasks.rados.rados.0.trial187.stdout:206: writing trial18717860-20 from 715998 to 1323326 tid 1 2026-02-13T18:06:27.741 INFO:tasks.rados.rados.0.trial187.stdout:206: writing trial18717860-20 from 1838006 to 2265374 tid 2 2026-02-13T18:06:27.749 INFO:tasks.rados.rados.0.trial187.stdout:206: writing trial18717860-20 from 2864574 to 3342054 tid 3 2026-02-13T18:06:27.752 INFO:tasks.rados.rados.0.trial187.stdout:206: writing trial18717860-20 from 3863835 to 3915998 tid 4 2026-02-13T18:06:27.752 INFO:tasks.rados.rados.0.trial187.stdout:207: read oid 16 snap 15 2026-02-13T18:06:27.752 INFO:tasks.rados.rados.0.trial187.stdout:207: expect deleted 2026-02-13T18:06:27.752 INFO:tasks.rados.rados.0.trial187.stdout:208: delete oid 8 current snap is 18 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: finishing write tid 1 to trial18717860-6 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: finishing write tid 2 to trial18717860-6 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: finishing write tid 3 to trial18717860-6 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: finishing write tid 4 to trial18717860-6 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: finishing write tid 5 to trial18717860-6 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: oid 6 updating version 0 to 41 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: oid 6 updating version 41 to 42 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: oid 6 version 42 is already newer than 40 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:205: oid 6 version 42 is already newer than 39 2026-02-13T18:06:27.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 42 (ObjNum 113 snap 18 seq_num 113) dirty exists 2026-02-13T18:06:27.754 INFO:tasks.rados.rados.0.trial187.stdout:205: left oid 6 (ObjNum 113 snap 18 seq_num 113) 2026-02-13T18:06:27.754 INFO:tasks.rados.rados.0.trial187.stdout:206: finishing write tid 1 to trial18717860-20 2026-02-13T18:06:27.754 INFO:tasks.rados.rados.0.trial187.stdout:206: finishing write tid 2 to trial18717860-20 2026-02-13T18:06:27.754 INFO:tasks.rados.rados.0.trial187.stdout:206: finishing write tid 3 to trial18717860-20 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: finishing write tid 4 to trial18717860-20 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: finishing write tid 5 to trial18717860-20 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: finishing write tid 6 to trial18717860-20 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: oid 20 updating version 0 to 20 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: oid 20 updating version 20 to 21 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: oid 20 updating version 21 to 23 2026-02-13T18:06:27.755 INFO:tasks.rados.rados.0.trial187.stdout:206: oid 20 version 23 is already newer than 22 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:206: oid 20 updating version 23 to 24 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 24 (ObjNum 114 snap 18 seq_num 114) dirty exists 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:206: left oid 20 (ObjNum 114 snap 18 seq_num 114) 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:205: done (3 left) 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:206: done (2 left) 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:207: done (1 left) 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:208: done (0 left) 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:209: rollback oid 38 current snap is 18 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 17 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:210: read oid 1 snap -1 2026-02-13T18:06:27.756 INFO:tasks.rados.rados.0.trial187.stdout:210: expect deleted 2026-02-13T18:06:27.757 INFO:tasks.rados.rados.0.trial187.stdout:211: write oid 44 current snap is 18 2026-02-13T18:06:27.757 INFO:tasks.rados.rados.0.trial187.stdout:211: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-13T18:06:27.758 INFO:tasks.rados.rados.0.trial187.stdout:211: writing trial18717860-44 from 749612 to 1223791 tid 1 2026-02-13T18:06:27.763 INFO:tasks.rados.rados.0.trial187.stdout:211: writing trial18717860-44 from 1954970 to 2386007 tid 2 2026-02-13T18:06:27.767 INFO:tasks.rados.rados.0.trial187.stdout:211: writing trial18717860-44 from 2919420 to 3535797 tid 3 2026-02-13T18:06:27.767 INFO:tasks.rados.rados.0.trial187.stdout:212: write oid 45 current snap is 18 2026-02-13T18:06:27.767 INFO:tasks.rados.rados.0.trial187.stdout:212: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2026-02-13T18:06:27.772 INFO:tasks.rados.rados.0.trial187.stdout:212: writing trial18717860-45 from 766419 to 1315847 tid 1 2026-02-13T18:06:27.777 INFO:tasks.rados.rados.0.trial187.stdout:212: writing trial18717860-45 from 2013452 to 2588147 tid 2 2026-02-13T18:06:27.782 INFO:tasks.rados.rados.0.trial187.stdout:212: writing trial18717860-45 from 3346843 to 3774492 tid 3 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:213: read oid 21 snap -1 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:213: expect (ObjNum 108 snap 16 seq_num 108) 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:214: delete oid 16 current snap is 18 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:209: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:209: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:209: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 27 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:211: finishing write tid 1 to trial18717860-44 2026-02-13T18:06:27.783 INFO:tasks.rados.rados.0.trial187.stdout:211: finishing write tid 2 to trial18717860-44 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: finishing write tid 3 to trial18717860-44 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: finishing write tid 4 to trial18717860-44 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: finishing write tid 5 to trial18717860-44 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: oid 44 updating version 0 to 116 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: oid 44 version 116 is already newer than 114 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: oid 44 version 116 is already newer than 115 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: oid 44 updating version 116 to 117 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 117 (ObjNum 116 snap 18 seq_num 116) dirty exists 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:211: left oid 44 (ObjNum 116 snap 18 seq_num 116) 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:212: finishing write tid 1 to trial18717860-45 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:212: finishing write tid 2 to trial18717860-45 2026-02-13T18:06:27.784 INFO:tasks.rados.rados.0.trial187.stdout:209: done (5 left) 2026-02-13T18:06:27.785 INFO:tasks.rados.rados.0.trial187.stdout:210: done (4 left) 2026-02-13T18:06:27.785 INFO:tasks.rados.rados.0.trial187.stdout:211: done (3 left) 2026-02-13T18:06:27.785 INFO:tasks.rados.rados.0.trial187.stdout:214: done (2 left) 2026-02-13T18:06:27.785 INFO:tasks.rados.rados.0.trial187.stdout:215: rollback oid 36 current snap is 18 2026-02-13T18:06:27.785 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 36 to 13 2026-02-13T18:06:27.785 INFO:tasks.rados.rados.0.trial187.stdout:216: snap_create 2026-02-13T18:06:27.786 INFO:tasks.rados.rados.0.trial187.stdout:212: finishing write tid 3 to trial18717860-45 2026-02-13T18:06:27.786 INFO:tasks.rados.rados.0.trial187.stdout:212: finishing write tid 4 to trial18717860-45 2026-02-13T18:06:27.786 INFO:tasks.rados.rados.0.trial187.stdout:212: finishing write tid 5 to trial18717860-45 2026-02-13T18:06:27.786 INFO:tasks.rados.rados.0.trial187.stdout:212: oid 45 updating version 0 to 36 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:212: oid 45 version 36 is already newer than 35 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:212: oid 45 updating version 36 to 38 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:212: oid 45 version 38 is already newer than 37 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 38 (ObjNum 117 snap 18 seq_num 117) dirty exists 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:212: left oid 45 (ObjNum 117 snap 18 seq_num 117) 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:215: finishing rollback tid 0 to trial18717860-36 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:215: finishing rollback tid 1 to trial18717860-36 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:215: finishing rollback tid 2 to trial18717860-36 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 38 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-13T18:06:27.787 INFO:tasks.rados.rados.0.trial187.stdout:213: expect (ObjNum 108 snap 16 seq_num 108) 2026-02-13T18:06:27.857 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3252340 2026-02-13T18:06:28.680 INFO:tasks.rados.rados.0.trial187.stdout:212: done (3 left) 2026-02-13T18:06:28.680 INFO:tasks.rados.rados.0.trial187.stdout:213: done (2 left) 2026-02-13T18:06:28.680 INFO:tasks.rados.rados.0.trial187.stdout:215: done (1 left) 2026-02-13T18:06:28.680 INFO:tasks.rados.rados.0.trial187.stdout:216: done (0 left) 2026-02-13T18:06:28.681 INFO:tasks.rados.rados.0.trial187.stdout:217: snap_remove snap 16 2026-02-13T18:06:29.679 INFO:tasks.rados.rados.0.trial187.stdout:217: done (0 left) 2026-02-13T18:06:29.680 INFO:tasks.rados.rados.0.trial187.stdout:218: snap_remove snap 17 2026-02-13T18:06:30.682 INFO:tasks.rados.rados.0.trial187.stdout:218: done (0 left) 2026-02-13T18:06:30.683 INFO:tasks.rados.rados.0.trial187.stdout:219: snap_remove snap 15 2026-02-13T18:06:31.683 INFO:tasks.rados.rados.0.trial187.stdout:219: done (0 left) 2026-02-13T18:06:31.684 INFO:tasks.rados.rados.0.trial187.stdout:220: rollback oid 18 current snap is 19 2026-02-13T18:06:31.684 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 18 2026-02-13T18:06:31.684 INFO:tasks.rados.rados.0.trial187.stdout:221: write oid 29 current snap is 19 2026-02-13T18:06:31.684 INFO:tasks.rados.rados.0.trial187.stdout:221: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-13T18:06:31.690 INFO:tasks.rados.rados.0.trial187.stdout:221: writing trial18717860-29 from 400033 to 1099959 tid 1 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:221: writing trial18717860-29 from 1614063 to 2000033 tid 2 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:222: copy_from oid 44 from oid 5 current snap is 19 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:220: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:220: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:220: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 60 (ObjNum 89 snap 12 seq_num 89) dirty exists 2026-02-13T18:06:31.694 INFO:tasks.rados.rados.0.trial187.stdout:221: finishing write tid 1 to trial18717860-29 2026-02-13T18:06:31.695 INFO:tasks.rados.rados.0.trial187.stdout:220: done (2 left) 2026-02-13T18:06:31.695 INFO:tasks.rados.rados.0.trial187.stdout:223: snap_remove snap 18 2026-02-13T18:06:32.685 INFO:tasks.rados.rados.0.trial187.stdout:223: done (2 left) 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:224: snap_create 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: finishing write tid 2 to trial18717860-29 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: finishing write tid 3 to trial18717860-29 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: finishing write tid 4 to trial18717860-29 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: oid 29 updating version 0 to 45 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: oid 29 updating version 45 to 46 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: oid 29 version 46 is already newer than 44 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 46 (ObjNum 119 snap 19 seq_num 119) dirty exists 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:221: left oid 29 (ObjNum 119 snap 19 seq_num 119) 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:222: finishing copy_from racing read to trial18717860-44 2026-02-13T18:06:32.686 INFO:tasks.rados.rados.0.trial187.stdout:222: finishing copy_from to trial18717860-44 2026-02-13T18:06:32.687 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 28 (ObjNum 107 snap 16 seq_num 107) dirty exists 2026-02-13T18:06:33.680 INFO:tasks.rados.rados.0.trial187.stdout:221: done (2 left) 2026-02-13T18:06:33.681 INFO:tasks.rados.rados.0.trial187.stdout:222: done (1 left) 2026-02-13T18:06:33.681 INFO:tasks.rados.rados.0.trial187.stdout:224: done (0 left) 2026-02-13T18:06:33.681 INFO:tasks.rados.rados.0.trial187.stdout:225: rollback oid 21 current snap is 20 2026-02-13T18:06:33.681 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 13 2026-02-13T18:06:33.681 INFO:tasks.rados.rados.0.trial187.stdout:226: copy_from oid 7 from oid 6 current snap is 20 2026-02-13T18:06:33.681 INFO:tasks.rados.rados.0.trial187.stdout:227: delete oid 44 current snap is 20 2026-02-13T18:06:33.685 INFO:tasks.rados.rados.0.trial187.stdout:227: done (2 left) 2026-02-13T18:06:33.685 INFO:tasks.rados.rados.0.trial187.stdout:228: snap_remove snap 19 2026-02-13T18:06:34.686 INFO:tasks.rados.rados.0.trial187.stdout:228: done (2 left) 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:229: rollback oid 27 current snap is 20 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 13 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:225: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:225: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 63 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:226: finishing copy_from racing read to trial18717860-7 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:226: finishing copy_from to trial18717860-7 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 42 (ObjNum 113 snap 18 seq_num 113) dirty exists 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:225: done (2 left) 2026-02-13T18:06:34.687 INFO:tasks.rados.rados.0.trial187.stdout:226: done (1 left) 2026-02-13T18:06:34.688 INFO:tasks.rados.rados.0.trial187.stdout:230: read oid 46 snap -1 2026-02-13T18:06:34.688 INFO:tasks.rados.rados.0.trial187.stdout:230: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:34.688 INFO:tasks.rados.rados.0.trial187.stdout:231: read oid 21 snap 12 2026-02-13T18:06:34.688 INFO:tasks.rados.rados.0.trial187.stdout:231: expect deleted 2026-02-13T18:06:34.688 INFO:tasks.rados.rados.0.trial187.stdout:232: write (excl) oid 24 current snap is 20 2026-02-13T18:06:34.688 INFO:tasks.rados.rados.0.trial187.stdout:232: seq_num 121 ranges {433647=450424,1331027=582033} 2026-02-13T18:06:34.691 INFO:tasks.rados.rados.0.trial187.stdout:232: writing trial18717860-24 from 433647 to 884071 tid 1 2026-02-13T18:06:34.698 INFO:tasks.rados.rados.0.trial187.stdout:232: writing trial18717860-24 from 1331027 to 1913060 tid 2 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:233: rollback oid 5 current snap is 20 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 12 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:229: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:229: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:229: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 40 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-13T18:06:34.699 INFO:tasks.rados.rados.0.trial187.stdout:230: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:34.747 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:34.796 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3106802 2026-02-13T18:06:34.797 INFO:tasks.rados.rados.0.trial187.stdout:232: finishing write tid 1 to trial18717860-24 2026-02-13T18:06:34.797 INFO:tasks.rados.rados.0.trial187.stdout:232: finishing write tid 2 to trial18717860-24 2026-02-13T18:06:34.797 INFO:tasks.rados.rados.0.trial187.stdout:229: done (4 left) 2026-02-13T18:06:34.797 INFO:tasks.rados.rados.0.trial187.stdout:230: done (3 left) 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:231: done (2 left) 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:234: snap_create 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:232: finishing write tid 3 to trial18717860-24 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:232: finishing write tid 4 to trial18717860-24 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:232: oid 24 updating version 0 to 43 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:232: oid 24 updating version 43 to 44 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:232: oid 24 updating version 44 to 45 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 45 (ObjNum 121 snap 20 seq_num 121) dirty exists 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:232: left oid 24 (ObjNum 121 snap 20 seq_num 121) 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:233: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:06:34.798 INFO:tasks.rados.rados.0.trial187.stdout:233: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:06:34.799 INFO:tasks.rados.rados.0.trial187.stdout:233: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:06:34.799 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 43 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-13T18:06:35.689 INFO:tasks.rados.rados.0.trial187.stdout:232: done (2 left) 2026-02-13T18:06:35.689 INFO:tasks.rados.rados.0.trial187.stdout:233: done (1 left) 2026-02-13T18:06:35.689 INFO:tasks.rados.rados.0.trial187.stdout:234: done (0 left) 2026-02-13T18:06:35.689 INFO:tasks.rados.rados.0.trial187.stdout:235: delete oid 42 current snap is 21 2026-02-13T18:06:35.692 INFO:tasks.rados.rados.0.trial187.stdout:235: done (0 left) 2026-02-13T18:06:35.692 INFO:tasks.rados.rados.0.trial187.stdout:236: read oid 35 snap -1 2026-02-13T18:06:35.692 INFO:tasks.rados.rados.0.trial187.stdout:236: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:06:35.692 INFO:tasks.rados.rados.0.trial187.stdout:237: rollback oid 27 current snap is 21 2026-02-13T18:06:35.692 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 20 2026-02-13T18:06:35.692 INFO:tasks.rados.rados.0.trial187.stdout:238: snap_remove snap 12 2026-02-13T18:06:36.690 INFO:tasks.rados.rados.0.trial187.stdout:238: done (2 left) 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:239: read oid 32 snap -1 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:239: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:240: snap_create 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:237: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:237: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:237: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 44 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-13T18:06:36.691 INFO:tasks.rados.rados.0.trial187.stdout:236: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:06:36.743 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 549527 2026-02-13T18:06:36.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 973944 2026-02-13T18:06:36.799 INFO:tasks.rados.rados.0.trial187.stdout:239: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-13T18:06:36.802 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 959202 2026-02-13T18:06:37.691 INFO:tasks.rados.rados.0.trial187.stdout:236: done (3 left) 2026-02-13T18:06:37.691 INFO:tasks.rados.rados.0.trial187.stdout:237: done (2 left) 2026-02-13T18:06:37.691 INFO:tasks.rados.rados.0.trial187.stdout:239: done (1 left) 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:240: done (0 left) 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:241: rollback oid 22 current snap is 22 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 13 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:242: read oid 48 snap -1 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:242: expect (ObjNum 99 snap 15 seq_num 99) 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:243: write oid 16 current snap is 22 2026-02-13T18:06:37.692 INFO:tasks.rados.rados.0.trial187.stdout:243: seq_num 123 ranges {467261=717275,1847991=219270} 2026-02-13T18:06:37.698 INFO:tasks.rados.rados.0.trial187.stdout:243: writing trial18717860-16 from 467261 to 1184536 tid 1 2026-02-13T18:06:37.705 INFO:tasks.rados.rados.0.trial187.stdout:243: writing trial18717860-16 from 1847991 to 2067261 tid 2 2026-02-13T18:06:37.705 INFO:tasks.rados.rados.0.trial187.stdout:244: snap_remove snap 21 2026-02-13T18:06:38.681 INFO:tasks.rados.rados.0.trial187.stdout:244: done (3 left) 2026-02-13T18:06:38.681 INFO:tasks.rados.rados.0.trial187.stdout:245: snap_remove snap 20 2026-02-13T18:06:39.682 INFO:tasks.rados.rados.0.trial187.stdout:245: done (3 left) 2026-02-13T18:06:39.682 INFO:tasks.rados.rados.0.trial187.stdout:246: delete oid 2 current snap is 22 2026-02-13T18:06:39.682 INFO:tasks.rados.rados.0.trial187.stdout:241: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:06:39.682 INFO:tasks.rados.rados.0.trial187.stdout:241: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:06:39.682 INFO:tasks.rados.rados.0.trial187.stdout:241: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:06:39.682 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 139 (ObjNum 87 snap 11 seq_num 87) dirty exists 2026-02-13T18:06:39.683 INFO:tasks.rados.rados.0.trial187.stdout:242: expect (ObjNum 99 snap 15 seq_num 99) 2026-02-13T18:06:39.692 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3335391 2026-02-13T18:06:39.707 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2691639 2026-02-13T18:06:39.715 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1209142 2026-02-13T18:06:39.736 INFO:tasks.rados.rados.0.trial187.stdout:243: finishing write tid 1 to trial18717860-16 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: finishing write tid 2 to trial18717860-16 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: finishing write tid 3 to trial18717860-16 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: finishing write tid 4 to trial18717860-16 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: oid 16 updating version 0 to 34 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: oid 16 updating version 34 to 36 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: oid 16 version 36 is already newer than 35 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 36 (ObjNum 123 snap 22 seq_num 123) dirty exists 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:243: left oid 16 (ObjNum 123 snap 22 seq_num 123) 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:241: done (3 left) 2026-02-13T18:06:39.737 INFO:tasks.rados.rados.0.trial187.stdout:242: done (2 left) 2026-02-13T18:06:39.738 INFO:tasks.rados.rados.0.trial187.stdout:243: done (1 left) 2026-02-13T18:06:39.738 INFO:tasks.rados.rados.0.trial187.stdout:246: done (0 left) 2026-02-13T18:06:39.738 INFO:tasks.rados.rados.0.trial187.stdout:247: read oid 26 snap 13 2026-02-13T18:06:39.738 INFO:tasks.rados.rados.0.trial187.stdout:247: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-13T18:06:39.738 INFO:tasks.rados.rados.0.trial187.stdout:248: delete oid 5 current snap is 22 2026-02-13T18:06:39.740 INFO:tasks.rados.rados.0.trial187.stdout:247: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-13T18:06:39.790 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:39.808 INFO:tasks.rados.rados.0.trial187.stdout:247: done (1 left) 2026-02-13T18:06:39.808 INFO:tasks.rados.rados.0.trial187.stdout:248: done (0 left) 2026-02-13T18:06:39.808 INFO:tasks.rados.rados.0.trial187.stdout:249: copy_from oid 14 from oid 5 current snap is 22 2026-02-13T18:06:39.808 INFO:tasks.rados.rados.0.trial187.stdout:250: snap_remove snap 13 2026-02-13T18:06:40.685 INFO:tasks.rados.rados.0.trial187.stdout:250: done (1 left) 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:251: read oid 2 snap -1 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:251: expect deleted 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:252: copy_from oid 9 from oid 16 current snap is 22 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:249: finishing copy_from to trial18717860-14 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:249: got expected ENOENT (src dne) 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:249: finishing copy_from racing read to trial18717860-14 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:249: done (2 left) 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:253: copy_from oid 49 from oid 21 current snap is 22 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:254: copy_from oid 10 from oid 45 current snap is 22 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:255: write oid 13 current snap is 22 2026-02-13T18:06:40.686 INFO:tasks.rados.rados.0.trial187.stdout:255: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-13T18:06:40.692 INFO:tasks.rados.rados.0.trial187.stdout:255: writing trial18717860-13 from 517682 to 1060704 tid 1 2026-02-13T18:06:40.699 INFO:tasks.rados.rados.0.trial187.stdout:255: writing trial18717860-13 from 1623437 to 2117682 tid 2 2026-02-13T18:06:40.699 INFO:tasks.rados.rados.0.trial187.stdout:256: write (excl) oid 7 current snap is 22 2026-02-13T18:06:40.699 INFO:tasks.rados.rados.0.trial187.stdout:256: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-13T18:06:40.707 INFO:tasks.rados.rados.0.trial187.stdout:256: writing trial18717860-7 from 534489 to 1152760 tid 1 2026-02-13T18:06:40.713 INFO:tasks.rados.rados.0.trial187.stdout:256: writing trial18717860-7 from 1565566 to 2134489 tid 2 2026-02-13T18:06:40.714 INFO:tasks.rados.rados.0.trial187.stdout:257: write oid 11 current snap is 22 2026-02-13T18:06:40.714 INFO:tasks.rados.rados.0.trial187.stdout:257: seq_num 128 ranges {551296=693520,2024048=127248} 2026-02-13T18:06:40.722 INFO:tasks.rados.rados.0.trial187.stdout:257: writing trial18717860-11 from 551296 to 1244816 tid 1 2026-02-13T18:06:40.729 INFO:tasks.rados.rados.0.trial187.stdout:257: writing trial18717860-11 from 2024048 to 2151296 tid 2 2026-02-13T18:06:40.729 INFO:tasks.rados.rados.0.trial187.stdout:258: read oid 6 snap -1 2026-02-13T18:06:40.729 INFO:tasks.rados.rados.0.trial187.stdout:258: expect (ObjNum 113 snap 18 seq_num 113) 2026-02-13T18:06:40.729 INFO:tasks.rados.rados.0.trial187.stdout:259: read oid 37 snap -1 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:259: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:260: snap_create 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:253: finishing copy_from to trial18717860-49 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:253: got expected ENOENT (src dne) 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:253: finishing copy_from racing read to trial18717860-49 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:252: finishing copy_from racing read to trial18717860-9 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:252: finishing copy_from to trial18717860-9 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 36 (ObjNum 123 snap 22 seq_num 123) dirty exists 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:255: finishing write tid 1 to trial18717860-13 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:254: finishing copy_from racing read to trial18717860-10 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:254: finishing copy_from to trial18717860-10 2026-02-13T18:06:40.730 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 38 (ObjNum 117 snap 18 seq_num 117) dirty exists 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: finishing write tid 2 to trial18717860-13 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: finishing write tid 3 to trial18717860-13 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: finishing write tid 4 to trial18717860-13 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: oid 13 updating version 0 to 78 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: oid 13 updating version 78 to 80 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: oid 13 version 80 is already newer than 79 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 80 (ObjNum 126 snap 22 seq_num 126) dirty exists 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:255: left oid 13 (ObjNum 126 snap 22 seq_num 126) 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:256: finishing write tid 1 to trial18717860-7 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:256: finishing write tid 2 to trial18717860-7 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:256: finishing write tid 3 to trial18717860-7 2026-02-13T18:06:40.731 INFO:tasks.rados.rados.0.trial187.stdout:256: finishing write tid 4 to trial18717860-7 2026-02-13T18:06:40.732 INFO:tasks.rados.rados.0.trial187.stdout:256: oid 7 updating version 0 to 68 2026-02-13T18:06:40.732 INFO:tasks.rados.rados.0.trial187.stdout:256: oid 7 version 68 is already newer than 67 2026-02-13T18:06:40.732 INFO:tasks.rados.rados.0.trial187.stdout:256: oid 7 updating version 68 to 69 2026-02-13T18:06:40.732 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 69 (ObjNum 127 snap 22 seq_num 127) dirty exists 2026-02-13T18:06:40.732 INFO:tasks.rados.rados.0.trial187.stdout:256: left oid 7 (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:06:40.732 INFO:tasks.rados.rados.0.trial187.stdout:257: finishing write tid 1 to trial18717860-11 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: finishing write tid 2 to trial18717860-11 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: finishing write tid 3 to trial18717860-11 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: finishing write tid 4 to trial18717860-11 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: oid 11 updating version 0 to 71 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: oid 11 updating version 71 to 72 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: oid 11 version 72 is already newer than 70 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 72 (ObjNum 128 snap 22 seq_num 128) dirty exists 2026-02-13T18:06:40.734 INFO:tasks.rados.rados.0.trial187.stdout:257: left oid 11 (ObjNum 128 snap 22 seq_num 128) 2026-02-13T18:06:40.735 INFO:tasks.rados.rados.0.trial187.stdout:258: expect (ObjNum 113 snap 18 seq_num 113) 2026-02-13T18:06:40.735 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:40.799 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 720736 2026-02-13T18:06:40.822 INFO:tasks.rados.rados.0.trial187.stdout:259: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:06:40.839 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2726015 2026-02-13T18:06:40.847 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:40.882 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:41.687 INFO:tasks.rados.rados.0.trial187.stdout:251: done (9 left) 2026-02-13T18:06:41.687 INFO:tasks.rados.rados.0.trial187.stdout:252: done (8 left) 2026-02-13T18:06:41.687 INFO:tasks.rados.rados.0.trial187.stdout:253: done (7 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:254: done (6 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:255: done (5 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:256: done (4 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:257: done (3 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:258: done (2 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:259: done (1 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:260: done (0 left) 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:261: rollback oid 31 current snap is 23 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 22 2026-02-13T18:06:41.688 INFO:tasks.rados.rados.0.trial187.stdout:262: read oid 30 snap -1 2026-02-13T18:06:41.689 INFO:tasks.rados.rados.0.trial187.stdout:262: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:06:41.689 INFO:tasks.rados.rados.0.trial187.stdout:263: write oid 33 current snap is 23 2026-02-13T18:06:41.689 INFO:tasks.rados.rados.0.trial187.stdout:263: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-13T18:06:41.693 INFO:tasks.rados.rados.0.trial187.stdout:263: writing trial18717860-33 from 568103 to 1336872 tid 1 2026-02-13T18:06:41.696 INFO:tasks.rados.rados.0.trial187.stdout:263: writing trial18717860-33 from 2082530 to 2168103 tid 2 2026-02-13T18:06:41.697 INFO:tasks.rados.rados.0.trial187.stdout:264: write (excl) oid 44 current snap is 23 2026-02-13T18:06:41.697 INFO:tasks.rados.rados.0.trial187.stdout:264: seq_num 130 ranges {584910=560371,1857365=327545} 2026-02-13T18:06:41.700 INFO:tasks.rados.rados.0.trial187.stdout:264: writing trial18717860-44 from 584910 to 1145281 tid 1 2026-02-13T18:06:41.704 INFO:tasks.rados.rados.0.trial187.stdout:264: writing trial18717860-44 from 1857365 to 2184910 tid 2 2026-02-13T18:06:41.705 INFO:tasks.rados.rados.0.trial187.stdout:265: write (excl) oid 12 current snap is 23 2026-02-13T18:06:41.705 INFO:tasks.rados.rados.0.trial187.stdout:265: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-13T18:06:41.709 INFO:tasks.rados.rados.0.trial187.stdout:265: writing trial18717860-12 from 601717 to 1237337 tid 1 2026-02-13T18:06:41.713 INFO:tasks.rados.rados.0.trial187.stdout:265: writing trial18717860-12 from 1799494 to 2201717 tid 2 2026-02-13T18:06:41.713 INFO:tasks.rados.rados.0.trial187.stdout:266: write (excl) oid 16 current snap is 23 2026-02-13T18:06:41.713 INFO:tasks.rados.rados.0.trial187.stdout:266: seq_num 132 ranges {618524=710869,1857976=360548} 2026-02-13T18:06:41.717 INFO:tasks.rados.rados.0.trial187.stdout:266: writing trial18717860-16 from 618524 to 1329393 tid 1 2026-02-13T18:06:41.721 INFO:tasks.rados.rados.0.trial187.stdout:266: writing trial18717860-16 from 1857976 to 2218524 tid 2 2026-02-13T18:06:41.721 INFO:tasks.rados.rados.0.trial187.stdout:267: write oid 36 current snap is 23 2026-02-13T18:06:41.721 INFO:tasks.rados.rados.0.trial187.stdout:267: seq_num 133 ranges {635331=786118,1916458=318873} 2026-02-13T18:06:41.726 INFO:tasks.rados.rados.0.trial187.stdout:267: writing trial18717860-36 from 635331 to 1421449 tid 1 2026-02-13T18:06:41.729 INFO:tasks.rados.rados.0.trial187.stdout:267: writing trial18717860-36 from 1916458 to 2235331 tid 2 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:268: rollback oid 8 current snap is 23 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 22 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:261: finishing rollback tid 0 to trial18717860-31 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:261: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:261: finishing rollback tid 2 to trial18717860-31 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 57 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:263: finishing write tid 1 to trial18717860-33 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:261: done (7 left) 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:269: delete oid 32 current snap is 23 2026-02-13T18:06:41.730 INFO:tasks.rados.rados.0.trial187.stdout:262: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:06:41.762 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:41.803 INFO:tasks.rados.rados.0.trial187.stdout:263: finishing write tid 2 to trial18717860-33 2026-02-13T18:06:41.803 INFO:tasks.rados.rados.0.trial187.stdout:263: finishing write tid 3 to trial18717860-33 2026-02-13T18:06:41.803 INFO:tasks.rados.rados.0.trial187.stdout:263: finishing write tid 4 to trial18717860-33 2026-02-13T18:06:41.803 INFO:tasks.rados.rados.0.trial187.stdout:263: oid 33 updating version 0 to 148 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:263: oid 33 updating version 148 to 149 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:263: oid 33 updating version 149 to 150 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 150 (ObjNum 129 snap 23 seq_num 129) dirty exists 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:263: left oid 33 (ObjNum 129 snap 23 seq_num 129) 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:264: finishing write tid 1 to trial18717860-44 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:264: finishing write tid 2 to trial18717860-44 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:264: finishing write tid 3 to trial18717860-44 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:264: finishing write tid 4 to trial18717860-44 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:264: oid 44 updating version 0 to 152 2026-02-13T18:06:41.804 INFO:tasks.rados.rados.0.trial187.stdout:264: oid 44 updating version 152 to 153 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:264: oid 44 version 153 is already newer than 151 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 153 (ObjNum 130 snap 23 seq_num 130) dirty exists 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:264: left oid 44 (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: finishing write tid 1 to trial18717860-12 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: finishing write tid 2 to trial18717860-12 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: finishing write tid 3 to trial18717860-12 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: finishing write tid 4 to trial18717860-12 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: oid 12 updating version 0 to 50 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: oid 12 updating version 50 to 52 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:265: oid 12 version 52 is already newer than 51 2026-02-13T18:06:41.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 52 (ObjNum 131 snap 23 seq_num 131) dirty exists 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:265: left oid 12 (ObjNum 131 snap 23 seq_num 131) 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: finishing write tid 1 to trial18717860-16 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: finishing write tid 2 to trial18717860-16 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: finishing write tid 3 to trial18717860-16 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: finishing write tid 4 to trial18717860-16 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: oid 16 updating version 0 to 41 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: oid 16 version 41 is already newer than 40 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: oid 16 updating version 41 to 42 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 42 (ObjNum 132 snap 23 seq_num 132) dirty exists 2026-02-13T18:06:41.806 INFO:tasks.rados.rados.0.trial187.stdout:266: left oid 16 (ObjNum 132 snap 23 seq_num 132) 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: finishing write tid 1 to trial18717860-36 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:268: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 0 (ObjNum 289 snap 0 seq_num 4014611515) dirty dne 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: finishing write tid 2 to trial18717860-36 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: finishing write tid 3 to trial18717860-36 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: finishing write tid 4 to trial18717860-36 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: oid 36 updating version 0 to 60 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: oid 36 version 60 is already newer than 58 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: oid 36 version 60 is already newer than 59 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 60 (ObjNum 133 snap 23 seq_num 133) dirty exists 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:267: left oid 36 (ObjNum 133 snap 23 seq_num 133) 2026-02-13T18:06:41.807 INFO:tasks.rados.rados.0.trial187.stdout:262: done (7 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:263: done (6 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:264: done (5 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:265: done (4 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:266: done (3 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:267: done (2 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:268: done (1 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:269: done (0 left) 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:270: read oid 22 snap 22 2026-02-13T18:06:41.808 INFO:tasks.rados.rados.0.trial187.stdout:270: expect (ObjNum 87 snap 11 seq_num 87) 2026-02-13T18:06:41.809 INFO:tasks.rados.rados.0.trial187.stdout:271: write oid 28 current snap is 23 2026-02-13T18:06:41.809 INFO:tasks.rados.rados.0.trial187.stdout:271: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-13T18:06:41.809 INFO:tasks.rados.rados.0.trial187.stdout:271: writing trial18717860-28 from 668945 to 1205561 tid 1 2026-02-13T18:06:41.811 INFO:tasks.rados.rados.0.trial187.stdout:271: writing trial18717860-28 from 1633422 to 2124785 tid 2 2026-02-13T18:06:41.811 INFO:tasks.rados.rados.0.trial187.stdout:272: read oid 40 snap -1 2026-02-13T18:06:41.811 INFO:tasks.rados.rados.0.trial187.stdout:272: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T18:06:41.811 INFO:tasks.rados.rados.0.trial187.stdout:273: write oid 17 current snap is 23 2026-02-13T18:06:41.811 INFO:tasks.rados.rados.0.trial187.stdout:273: seq_num 136 ranges {685752=611865,1975551=310201} 2026-02-13T18:06:41.815 INFO:tasks.rados.rados.0.trial187.stdout:273: writing trial18717860-17 from 685752 to 1297617 tid 1 2026-02-13T18:06:41.819 INFO:tasks.rados.rados.0.trial187.stdout:273: writing trial18717860-17 from 1975551 to 2285752 tid 2 2026-02-13T18:06:41.819 INFO:tasks.rados.rados.0.trial187.stdout:274: write oid 8 current snap is 23 2026-02-13T18:06:41.819 INFO:tasks.rados.rados.0.trial187.stdout:274: seq_num 137 ranges {702559=403467,1750386=495032} 2026-02-13T18:06:41.823 INFO:tasks.rados.rados.0.trial187.stdout:274: writing trial18717860-8 from 702559 to 1106026 tid 1 2026-02-13T18:06:41.828 INFO:tasks.rados.rados.0.trial187.stdout:274: writing trial18717860-8 from 1750386 to 2245418 tid 2 2026-02-13T18:06:41.828 INFO:tasks.rados.rados.0.trial187.stdout:275: copy_from oid 1 from oid 50 current snap is 23 2026-02-13T18:06:41.828 INFO:tasks.rados.rados.0.trial187.stdout:270: expect (ObjNum 87 snap 11 seq_num 87) 2026-02-13T18:06:41.965 INFO:tasks.rados.rados.0.trial187.stdout:271: finishing write tid 1 to trial18717860-28 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: finishing write tid 2 to trial18717860-28 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:270: done (5 left) 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:276: copy_from oid 4 from oid 2 current snap is 23 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: finishing write tid 3 to trial18717860-28 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: finishing write tid 4 to trial18717860-28 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: oid 28 updating version 0 to 50 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: oid 28 updating version 50 to 52 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: oid 28 version 52 is already newer than 51 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 52 (ObjNum 135 snap 23 seq_num 135) dirty exists 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:271: left oid 28 (ObjNum 135 snap 23 seq_num 135) 2026-02-13T18:06:41.966 INFO:tasks.rados.rados.0.trial187.stdout:272: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T18:06:42.014 INFO:tasks.rados.rados.0.trial187.stdout:273: finishing write tid 1 to trial18717860-17 2026-02-13T18:06:42.014 INFO:tasks.rados.rados.0.trial187.stdout:273: finishing write tid 2 to trial18717860-17 2026-02-13T18:06:42.014 INFO:tasks.rados.rados.0.trial187.stdout:273: finishing write tid 3 to trial18717860-17 2026-02-13T18:06:42.014 INFO:tasks.rados.rados.0.trial187.stdout:273: finishing write tid 4 to trial18717860-17 2026-02-13T18:06:42.014 INFO:tasks.rados.rados.0.trial187.stdout:273: oid 17 updating version 0 to 98 2026-02-13T18:06:42.014 INFO:tasks.rados.rados.0.trial187.stdout:273: oid 17 version 98 is already newer than 97 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:273: oid 17 version 98 is already newer than 96 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 98 (ObjNum 136 snap 23 seq_num 136) dirty exists 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:273: left oid 17 (ObjNum 136 snap 23 seq_num 136) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: finishing write tid 1 to trial18717860-8 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: finishing write tid 2 to trial18717860-8 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: finishing write tid 3 to trial18717860-8 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: finishing write tid 4 to trial18717860-8 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: oid 8 updating version 0 to 29 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: oid 8 version 29 is already newer than 28 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: oid 8 updating version 29 to 30 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 30 (ObjNum 137 snap 23 seq_num 137) dirty exists 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: left oid 8 (ObjNum 137 snap 23 seq_num 137) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:275: finishing copy_from to trial18717860-1 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:275: got expected ENOENT (src dne) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:275: finishing copy_from racing read to trial18717860-1 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:276: finishing copy_from to trial18717860-4 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:276: got expected ENOENT (src dne) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:276: finishing copy_from racing read to trial18717860-4 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:271: done (5 left) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:272: done (4 left) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:273: done (3 left) 2026-02-13T18:06:42.015 INFO:tasks.rados.rados.0.trial187.stdout:274: done (2 left) 2026-02-13T18:06:42.016 INFO:tasks.rados.rados.0.trial187.stdout:275: done (1 left) 2026-02-13T18:06:42.016 INFO:tasks.rados.rados.0.trial187.stdout:276: done (0 left) 2026-02-13T18:06:42.016 INFO:tasks.rados.rados.0.trial187.stdout:277: delete oid 22 current snap is 23 2026-02-13T18:06:42.016 INFO:tasks.rados.rados.0.trial187.stdout:277: done (0 left) 2026-02-13T18:06:42.016 INFO:tasks.rados.rados.0.trial187.stdout:278: copy_from oid 18 from oid 34 current snap is 23 2026-02-13T18:06:42.016 INFO:tasks.rados.rados.0.trial187.stdout:279: rollback oid 28 current snap is 23 2026-02-13T18:06:42.017 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 28 to 22 2026-02-13T18:06:42.017 INFO:tasks.rados.rados.0.trial187.stdout:280: read oid 7 snap -1 2026-02-13T18:06:42.017 INFO:tasks.rados.rados.0.trial187.stdout:280: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:06:42.017 INFO:tasks.rados.rados.0.trial187.stdout:281: snap_create 2026-02-13T18:06:42.020 INFO:tasks.rados.rados.0.trial187.stdout:279: finishing rollback tid 0 to trial18717860-28 2026-02-13T18:06:42.020 INFO:tasks.rados.rados.0.trial187.stdout:279: finishing rollback tid 1 to trial18717860-28 2026-02-13T18:06:42.020 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 54 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-13T18:06:42.022 INFO:tasks.rados.rados.0.trial187.stdout:280: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:06:42.022 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:42.064 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 921545 2026-02-13T18:06:42.076 INFO:tasks.rados.rados.0.trial187.stdout:278: finishing copy_from racing read to trial18717860-18 2026-02-13T18:06:42.076 INFO:tasks.rados.rados.0.trial187.stdout:278: finishing copy_from to trial18717860-18 2026-02-13T18:06:42.076 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 24 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T18:06:42.694 INFO:tasks.rados.rados.0.trial187.stdout:278: done (3 left) 2026-02-13T18:06:42.694 INFO:tasks.rados.rados.0.trial187.stdout:279: done (2 left) 2026-02-13T18:06:42.694 INFO:tasks.rados.rados.0.trial187.stdout:280: done (1 left) 2026-02-13T18:06:42.694 INFO:tasks.rados.rados.0.trial187.stdout:281: done (0 left) 2026-02-13T18:06:42.694 INFO:tasks.rados.rados.0.trial187.stdout:282: copy_from oid 18 from oid 5 current snap is 24 2026-02-13T18:06:42.695 INFO:tasks.rados.rados.0.trial187.stdout:283: snap_remove snap 23 2026-02-13T18:06:43.683 INFO:tasks.rados.rados.0.trial187.stdout:283: done (1 left) 2026-02-13T18:06:43.683 INFO:tasks.rados.rados.0.trial187.stdout:284: snap_create 2026-02-13T18:06:43.683 INFO:tasks.rados.rados.0.trial187.stdout:282: finishing copy_from to trial18717860-18 2026-02-13T18:06:43.683 INFO:tasks.rados.rados.0.trial187.stdout:282: got expected ENOENT (src dne) 2026-02-13T18:06:43.683 INFO:tasks.rados.rados.0.trial187.stdout:282: finishing copy_from racing read to trial18717860-18 2026-02-13T18:06:44.683 INFO:tasks.rados.rados.0.trial187.stdout:282: done (1 left) 2026-02-13T18:06:44.684 INFO:tasks.rados.rados.0.trial187.stdout:284: done (0 left) 2026-02-13T18:06:44.684 INFO:tasks.rados.rados.0.trial187.stdout:285: write (excl) oid 40 current snap is 25 2026-02-13T18:06:44.684 INFO:tasks.rados.rados.0.trial187.stdout:285: seq_num 139 ranges {736173=553965,1867350=468823} 2026-02-13T18:06:44.692 INFO:tasks.rados.rados.0.trial187.stdout:285: writing trial18717860-40 from 736173 to 1290138 tid 1 2026-02-13T18:06:44.699 INFO:tasks.rados.rados.0.trial187.stdout:285: writing trial18717860-40 from 1867350 to 2336173 tid 2 2026-02-13T18:06:44.699 INFO:tasks.rados.rados.0.trial187.stdout:286: read oid 9 snap -1 2026-02-13T18:06:44.699 INFO:tasks.rados.rados.0.trial187.stdout:286: expect (ObjNum 123 snap 22 seq_num 123) 2026-02-13T18:06:44.699 INFO:tasks.rados.rados.0.trial187.stdout:287: write (excl) oid 43 current snap is 25 2026-02-13T18:06:44.699 INFO:tasks.rados.rados.0.trial187.stdout:285: finishing write tid 1 to trial18717860-40 2026-02-13T18:06:44.700 INFO:tasks.rados.rados.0.trial187.stdout:287: seq_num 140 ranges {752980=629214,1809479=543501} 2026-02-13T18:06:44.708 INFO:tasks.rados.rados.0.trial187.stdout:287: writing trial18717860-43 from 752980 to 1382194 tid 1 2026-02-13T18:06:44.715 INFO:tasks.rados.rados.0.trial187.stdout:287: writing trial18717860-43 from 1809479 to 2352980 tid 2 2026-02-13T18:06:44.715 INFO:tasks.rados.rados.0.trial187.stdout:288: rollback oid 3 current snap is 25 2026-02-13T18:06:44.715 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 24 2026-02-13T18:06:44.715 INFO:tasks.rados.rados.0.trial187.stdout:285: finishing write tid 2 to trial18717860-40 2026-02-13T18:06:44.715 INFO:tasks.rados.rados.0.trial187.stdout:285: finishing write tid 3 to trial18717860-40 2026-02-13T18:06:44.715 INFO:tasks.rados.rados.0.trial187.stdout:285: finishing write tid 4 to trial18717860-40 2026-02-13T18:06:44.716 INFO:tasks.rados.rados.0.trial187.stdout:285: oid 40 updating version 0 to 54 2026-02-13T18:06:44.716 INFO:tasks.rados.rados.0.trial187.stdout:285: oid 40 updating version 54 to 56 2026-02-13T18:06:44.716 INFO:tasks.rados.rados.0.trial187.stdout:285: oid 40 version 56 is already newer than 55 2026-02-13T18:06:44.716 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 56 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:06:44.716 INFO:tasks.rados.rados.0.trial187.stdout:285: left oid 40 (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:06:44.716 INFO:tasks.rados.rados.0.trial187.stdout:286: expect (ObjNum 123 snap 22 seq_num 123) 2026-02-13T18:06:44.718 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1725190 2026-02-13T18:06:44.735 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 633971 2026-02-13T18:06:44.753 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 55738 2026-02-13T18:06:44.771 INFO:tasks.rados.rados.0.trial187.stdout:287: finishing write tid 1 to trial18717860-43 2026-02-13T18:06:44.771 INFO:tasks.rados.rados.0.trial187.stdout:288: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:06:44.771 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 0 (ObjNum 33 snap 0 seq_num 1702765960) dirty dne 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: finishing write tid 2 to trial18717860-43 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: finishing write tid 3 to trial18717860-43 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: finishing write tid 4 to trial18717860-43 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: oid 43 updating version 0 to 157 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: oid 43 version 157 is already newer than 156 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: oid 43 updating version 157 to 158 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 158 (ObjNum 140 snap 25 seq_num 140) dirty exists 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: left oid 43 (ObjNum 140 snap 25 seq_num 140) 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:285: done (3 left) 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:286: done (2 left) 2026-02-13T18:06:44.772 INFO:tasks.rados.rados.0.trial187.stdout:287: done (1 left) 2026-02-13T18:06:44.773 INFO:tasks.rados.rados.0.trial187.stdout:288: done (0 left) 2026-02-13T18:06:44.773 INFO:tasks.rados.rados.0.trial187.stdout:289: snap_create 2026-02-13T18:06:45.698 INFO:tasks.rados.rados.0.trial187.stdout:289: done (0 left) 2026-02-13T18:06:45.698 INFO:tasks.rados.rados.0.trial187.stdout:290: copy_from oid 31 from oid 9 current snap is 26 2026-02-13T18:06:45.698 INFO:tasks.rados.rados.0.trial187.stdout:291: read oid 12 snap -1 2026-02-13T18:06:45.699 INFO:tasks.rados.rados.0.trial187.stdout:291: expect (ObjNum 131 snap 23 seq_num 131) 2026-02-13T18:06:45.699 INFO:tasks.rados.rados.0.trial187.stdout:292: write oid 8 current snap is 26 2026-02-13T18:06:45.699 INFO:tasks.rados.rados.0.trial187.stdout:292: seq_num 141 ranges {769787=704463,2267961=101826} 2026-02-13T18:06:45.708 INFO:tasks.rados.rados.0.trial187.stdout:292: writing trial18717860-8 from 769787 to 1474250 tid 1 2026-02-13T18:06:45.714 INFO:tasks.rados.rados.0.trial187.stdout:292: writing trial18717860-8 from 2267961 to 2369787 tid 2 2026-02-13T18:06:45.714 INFO:tasks.rados.rados.0.trial187.stdout:293: write oid 29 current snap is 26 2026-02-13T18:06:45.714 INFO:tasks.rados.rados.0.trial187.stdout:293: seq_num 142 ranges {786594=779712,2326443=60151} 2026-02-13T18:06:45.724 INFO:tasks.rados.rados.0.trial187.stdout:293: writing trial18717860-29 from 786594 to 1566306 tid 1 2026-02-13T18:06:45.730 INFO:tasks.rados.rados.0.trial187.stdout:293: writing trial18717860-29 from 2326443 to 2386594 tid 2 2026-02-13T18:06:45.730 INFO:tasks.rados.rados.0.trial187.stdout:294: delete oid 1 current snap is 26 2026-02-13T18:06:45.730 INFO:tasks.rados.rados.0.trial187.stdout:291: expect (ObjNum 131 snap 23 seq_num 131) 2026-02-13T18:06:45.795 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1300869 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:290: finishing copy_from racing read to trial18717860-31 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:290: finishing copy_from to trial18717860-31 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 36 (ObjNum 123 snap 22 seq_num 123) dirty exists 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:292: finishing write tid 1 to trial18717860-8 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:292: finishing write tid 2 to trial18717860-8 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:292: finishing write tid 3 to trial18717860-8 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:290: done (4 left) 2026-02-13T18:06:45.843 INFO:tasks.rados.rados.0.trial187.stdout:291: done (3 left) 2026-02-13T18:06:45.844 INFO:tasks.rados.rados.0.trial187.stdout:294: done (2 left) 2026-02-13T18:06:45.844 INFO:tasks.rados.rados.0.trial187.stdout:295: write oid 39 current snap is 26 2026-02-13T18:06:45.844 INFO:tasks.rados.rados.0.trial187.stdout:295: seq_num 144 ranges {420208=530210,1527054=766050} 2026-02-13T18:06:45.849 INFO:tasks.rados.rados.0.trial187.stdout:295: writing trial18717860-39 from 420208 to 950418 tid 1 2026-02-13T18:06:45.858 INFO:tasks.rados.rados.0.trial187.stdout:295: writing trial18717860-39 from 1527054 to 2293104 tid 2 2026-02-13T18:06:45.858 INFO:tasks.rados.rados.0.trial187.stdout:296: write oid 26 current snap is 26 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:292: finishing write tid 4 to trial18717860-8 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:292: oid 8 updating version 0 to 32 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:292: oid 8 updating version 32 to 33 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:292: oid 8 updating version 33 to 34 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 34 (ObjNum 141 snap 26 seq_num 141) dirty exists 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:292: left oid 8 (ObjNum 141 snap 26 seq_num 141) 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:293: finishing write tid 1 to trial18717860-29 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:293: finishing write tid 2 to trial18717860-29 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:293: finishing write tid 3 to trial18717860-29 2026-02-13T18:06:45.859 INFO:tasks.rados.rados.0.trial187.stdout:296: seq_num 145 ranges {437015=721812,1701889=509708} 2026-02-13T18:06:45.866 INFO:tasks.rados.rados.0.trial187.stdout:296: writing trial18717860-26 from 437015 to 1158827 tid 1 2026-02-13T18:06:45.873 INFO:tasks.rados.rados.0.trial187.stdout:296: writing trial18717860-26 from 1701889 to 2211597 tid 2 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:292: done (3 left) 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:297: copy_from oid 14 from oid 37 current snap is 26 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:293: finishing write tid 4 to trial18717860-29 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:293: oid 29 updating version 0 to 59 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:293: oid 29 version 59 is already newer than 58 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:293: oid 29 updating version 59 to 60 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 60 (ObjNum 142 snap 26 seq_num 142) dirty exists 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:293: left oid 29 (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:295: finishing write tid 1 to trial18717860-39 2026-02-13T18:06:45.874 INFO:tasks.rados.rados.0.trial187.stdout:295: finishing write tid 2 to trial18717860-39 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:293: done (3 left) 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:298: read oid 34 snap 22 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:298: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:299: write oid 10 current snap is 26 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:295: finishing write tid 3 to trial18717860-39 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:295: finishing write tid 4 to trial18717860-39 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:295: oid 39 updating version 0 to 101 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:295: oid 39 version 101 is already newer than 100 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:295: oid 39 updating version 101 to 102 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 102 (ObjNum 144 snap 26 seq_num 144) dirty exists 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:295: left oid 39 (ObjNum 144 snap 26 seq_num 144) 2026-02-13T18:06:45.875 INFO:tasks.rados.rados.0.trial187.stdout:296: finishing write tid 1 to trial18717860-26 2026-02-13T18:06:45.876 INFO:tasks.rados.rados.0.trial187.stdout:299: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-13T18:06:45.881 INFO:tasks.rados.rados.0.trial187.stdout:299: writing trial18717860-10 from 453822 to 1250883 tid 1 2026-02-13T18:06:45.889 INFO:tasks.rados.rados.0.trial187.stdout:299: writing trial18717860-10 from 1760371 to 2413737 tid 2 2026-02-13T18:06:45.889 INFO:tasks.rados.rados.0.trial187.stdout:295: done (4 left) 2026-02-13T18:06:45.889 INFO:tasks.rados.rados.0.trial187.stdout:300: snap_remove snap 24 2026-02-13T18:06:46.702 INFO:tasks.rados.rados.0.trial187.stdout:300: done (4 left) 2026-02-13T18:06:46.702 INFO:tasks.rados.rados.0.trial187.stdout:301: rollback oid 3 current snap is 26 2026-02-13T18:06:46.702 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 22 2026-02-13T18:06:46.703 INFO:tasks.rados.rados.0.trial187.stdout:298: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:06:46.726 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1392550 2026-02-13T18:06:46.747 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 208286 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: finishing write tid 2 to trial18717860-26 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: finishing write tid 3 to trial18717860-26 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: finishing write tid 4 to trial18717860-26 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: oid 26 updating version 0 to 104 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: oid 26 updating version 104 to 105 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: oid 26 updating version 105 to 106 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 106 (ObjNum 145 snap 26 seq_num 145) dirty exists 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:296: left oid 26 (ObjNum 145 snap 26 seq_num 145) 2026-02-13T18:06:46.766 INFO:tasks.rados.rados.0.trial187.stdout:299: finishing write tid 1 to trial18717860-10 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: finishing write tid 2 to trial18717860-10 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: finishing write tid 3 to trial18717860-10 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: finishing write tid 4 to trial18717860-10 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: oid 10 updating version 0 to 56 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: oid 10 version 56 is already newer than 55 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: oid 10 version 56 is already newer than 54 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 56 (ObjNum 146 snap 26 seq_num 146) dirty exists 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:299: left oid 10 (ObjNum 146 snap 26 seq_num 146) 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:297: finishing copy_from racing read to trial18717860-14 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:297: finishing copy_from to trial18717860-14 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 66 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:06:46.767 INFO:tasks.rados.rados.0.trial187.stdout:296: done (4 left) 2026-02-13T18:06:46.768 INFO:tasks.rados.rados.0.trial187.stdout:297: done (3 left) 2026-02-13T18:06:46.768 INFO:tasks.rados.rados.0.trial187.stdout:298: done (2 left) 2026-02-13T18:06:46.768 INFO:tasks.rados.rados.0.trial187.stdout:299: done (1 left) 2026-02-13T18:06:46.768 INFO:tasks.rados.rados.0.trial187.stdout:302: delete oid 11 current snap is 26 2026-02-13T18:06:46.768 INFO:tasks.rados.rados.0.trial187.stdout:301: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:06:46.768 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 0 (ObjNum 177 snap 0 seq_num 3012785280) dirty dne 2026-02-13T18:06:46.769 INFO:tasks.rados.rados.0.trial187.stdout:301: done (1 left) 2026-02-13T18:06:46.769 INFO:tasks.rados.rados.0.trial187.stdout:302: done (0 left) 2026-02-13T18:06:46.769 INFO:tasks.rados.rados.0.trial187.stdout:303: rollback oid 44 current snap is 26 2026-02-13T18:06:46.769 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 25 2026-02-13T18:06:46.769 INFO:tasks.rados.rados.0.trial187.stdout:304: snap_remove snap 22 2026-02-13T18:06:47.703 INFO:tasks.rados.rados.0.trial187.stdout:304: done (1 left) 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:305: read oid 15 snap 25 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:305: expect deleted 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:306: delete oid 16 current snap is 26 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:303: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:303: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:303: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:06:47.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 162 (ObjNum 130 snap 23 seq_num 130) dirty exists 2026-02-13T18:06:47.706 INFO:tasks.rados.rados.0.trial187.stdout:303: done (2 left) 2026-02-13T18:06:47.706 INFO:tasks.rados.rados.0.trial187.stdout:305: done (1 left) 2026-02-13T18:06:47.706 INFO:tasks.rados.rados.0.trial187.stdout:306: done (0 left) 2026-02-13T18:06:47.706 INFO:tasks.rados.rados.0.trial187.stdout:307: snap_remove snap 25 2026-02-13T18:06:48.683 INFO:tasks.rados.rados.0.trial187.stdout:307: done (0 left) 2026-02-13T18:06:48.684 INFO:tasks.rados.rados.0.trial187.stdout:308: write (excl) oid 27 current snap is 26 2026-02-13T18:06:48.684 INFO:tasks.rados.rados.0.trial187.stdout:308: seq_num 149 ranges {504243=622808,1819464=517046} 2026-02-13T18:06:48.691 INFO:tasks.rados.rados.0.trial187.stdout:308: writing trial18717860-27 from 504243 to 1127051 tid 1 2026-02-13T18:06:48.699 INFO:tasks.rados.rados.0.trial187.stdout:308: writing trial18717860-27 from 1819464 to 2336510 tid 2 2026-02-13T18:06:48.699 INFO:tasks.rados.rados.0.trial187.stdout:309: write (excl) oid 12 current snap is 26 2026-02-13T18:06:48.699 INFO:tasks.rados.rados.0.trial187.stdout:309: seq_num 150 ranges {521050=698057,1877946=643104} 2026-02-13T18:06:48.707 INFO:tasks.rados.rados.0.trial187.stdout:309: writing trial18717860-12 from 521050 to 1219107 tid 1 2026-02-13T18:06:48.716 INFO:tasks.rados.rados.0.trial187.stdout:309: writing trial18717860-12 from 1877946 to 2521050 tid 2 2026-02-13T18:06:48.716 INFO:tasks.rados.rados.0.trial187.stdout:310: rollback oid 35 current snap is 26 2026-02-13T18:06:48.716 INFO:tasks.rados.rados.0.trial187.stdout:310: done (2 left) 2026-02-13T18:06:48.716 INFO:tasks.rados.rados.0.trial187.stdout:311: write oid 18 current snap is 26 2026-02-13T18:06:48.717 INFO:tasks.rados.rados.0.trial187.stdout:311: seq_num 151 ranges {537857=773306,1936428=520715} 2026-02-13T18:06:48.725 INFO:tasks.rados.rados.0.trial187.stdout:311: writing trial18717860-18 from 537857 to 1311163 tid 1 2026-02-13T18:06:48.730 INFO:tasks.rados.rados.0.trial187.stdout:311: writing trial18717860-18 from 1936428 to 2457143 tid 2 2026-02-13T18:06:48.730 INFO:tasks.rados.rados.0.trial187.stdout:312: write (excl) oid 21 current snap is 26 2026-02-13T18:06:48.730 INFO:tasks.rados.rados.0.trial187.stdout:312: seq_num 152 ranges {554664=448555,1478557=664373} 2026-02-13T18:06:48.734 INFO:tasks.rados.rados.0.trial187.stdout:312: writing trial18717860-21 from 554664 to 1003219 tid 1 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:312: writing trial18717860-21 from 1478557 to 2142930 tid 2 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:313: read oid 11 snap -1 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:313: expect deleted 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:314: rollback oid 45 current snap is 26 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:314: done (5 left) 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:315: copy_from oid 4 from oid 25 current snap is 26 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:308: finishing write tid 1 to trial18717860-27 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:316: rollback oid 1 current snap is 26 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:316: done (6 left) 2026-02-13T18:06:48.739 INFO:tasks.rados.rados.0.trial187.stdout:317: read oid 15 snap -1 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:317: expect deleted 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:318: delete oid 17 current snap is 26 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: finishing write tid 2 to trial18717860-27 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: finishing write tid 3 to trial18717860-27 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: finishing write tid 4 to trial18717860-27 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: oid 27 updating version 0 to 55 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: oid 27 updating version 55 to 56 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: oid 27 updating version 56 to 57 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 57 (ObjNum 149 snap 26 seq_num 149) dirty exists 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:308: left oid 27 (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:309: finishing write tid 1 to trial18717860-12 2026-02-13T18:06:48.740 INFO:tasks.rados.rados.0.trial187.stdout:309: finishing write tid 2 to trial18717860-12 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:309: finishing write tid 3 to trial18717860-12 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:309: finishing write tid 4 to trial18717860-12 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:309: oid 12 updating version 0 to 66 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:309: oid 12 version 66 is already newer than 65 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:309: oid 12 updating version 66 to 67 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 67 (ObjNum 150 snap 26 seq_num 150) dirty exists 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:309: left oid 12 (ObjNum 150 snap 26 seq_num 150) 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:311: finishing write tid 1 to trial18717860-18 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:311: finishing write tid 2 to trial18717860-18 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:311: finishing write tid 3 to trial18717860-18 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:311: finishing write tid 4 to trial18717860-18 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:311: oid 18 updating version 0 to 85 2026-02-13T18:06:48.741 INFO:tasks.rados.rados.0.trial187.stdout:311: oid 18 updating version 85 to 87 2026-02-13T18:06:48.742 INFO:tasks.rados.rados.0.trial187.stdout:311: oid 18 version 87 is already newer than 86 2026-02-13T18:06:48.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 87 (ObjNum 151 snap 26 seq_num 151) dirty exists 2026-02-13T18:06:48.742 INFO:tasks.rados.rados.0.trial187.stdout:311: left oid 18 (ObjNum 151 snap 26 seq_num 151) 2026-02-13T18:06:48.742 INFO:tasks.rados.rados.0.trial187.stdout:312: finishing write tid 1 to trial18717860-21 2026-02-13T18:06:48.742 INFO:tasks.rados.rados.0.trial187.stdout:308: done (7 left) 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:309: done (6 left) 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:311: done (5 left) 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:313: done (4 left) 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:317: done (3 left) 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:318: done (2 left) 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:319: write oid 5 current snap is 26 2026-02-13T18:06:48.743 INFO:tasks.rados.rados.0.trial187.stdout:319: seq_num 154 ranges {588278=715406,1711874=668042} 2026-02-13T18:06:48.744 INFO:tasks.rados.rados.0.trial187.stdout:319: writing trial18717860-5 from 588278 to 1303684 tid 1 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:319: writing trial18717860-5 from 1711874 to 2379916 tid 2 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:320: read oid 20 snap -1 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:320: expect (ObjNum 114 snap 18 seq_num 114) 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:321: read oid 29 snap -1 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:321: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:322: write (excl) oid 50 current snap is 26 2026-02-13T18:06:48.749 INFO:tasks.rados.rados.0.trial187.stdout:322: seq_num 155 ranges {605085=790655,2170356=434729} 2026-02-13T18:06:48.753 INFO:tasks.rados.rados.0.trial187.stdout:322: writing trial18717860-50 from 605085 to 1395740 tid 1 2026-02-13T18:06:48.759 INFO:tasks.rados.rados.0.trial187.stdout:322: writing trial18717860-50 from 2170356 to 2605085 tid 2 2026-02-13T18:06:48.759 INFO:tasks.rados.rados.0.trial187.stdout:323: delete oid 23 current snap is 26 2026-02-13T18:06:48.759 INFO:tasks.rados.rados.0.trial187.stdout:312: finishing write tid 2 to trial18717860-21 2026-02-13T18:06:48.759 INFO:tasks.rados.rados.0.trial187.stdout:312: finishing write tid 3 to trial18717860-21 2026-02-13T18:06:48.759 INFO:tasks.rados.rados.0.trial187.stdout:312: finishing write tid 4 to trial18717860-21 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:312: oid 21 updating version 0 to 71 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:312: oid 21 updating version 71 to 72 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:312: oid 21 version 72 is already newer than 70 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 72 (ObjNum 152 snap 26 seq_num 152) dirty exists 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:312: left oid 21 (ObjNum 152 snap 26 seq_num 152) 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: finishing write tid 1 to trial18717860-5 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:315: finishing copy_from racing read to trial18717860-4 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: finishing write tid 2 to trial18717860-5 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: finishing write tid 3 to trial18717860-5 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: finishing write tid 4 to trial18717860-5 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: oid 5 updating version 0 to 62 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: oid 5 version 62 is already newer than 61 2026-02-13T18:06:48.760 INFO:tasks.rados.rados.0.trial187.stdout:319: oid 5 updating version 62 to 63 2026-02-13T18:06:48.761 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 63 (ObjNum 154 snap 26 seq_num 154) dirty exists 2026-02-13T18:06:48.761 INFO:tasks.rados.rados.0.trial187.stdout:319: left oid 5 (ObjNum 154 snap 26 seq_num 154) 2026-02-13T18:06:48.761 INFO:tasks.rados.rados.0.trial187.stdout:315: finishing copy_from to trial18717860-4 2026-02-13T18:06:48.761 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 26 (ObjNum 110 snap 17 seq_num 110) dirty exists 2026-02-13T18:06:48.761 INFO:tasks.rados.rados.0.trial187.stdout:321: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:06:48.824 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2119736 2026-02-13T18:06:48.834 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 777301 2026-02-13T18:06:48.857 INFO:tasks.rados.rados.0.trial187.stdout:320: expect (ObjNum 114 snap 18 seq_num 114) 2026-02-13T18:06:48.891 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:48.940 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2079076 2026-02-13T18:06:48.966 INFO:tasks.rados.rados.0.trial187.stdout:322: finishing write tid 1 to trial18717860-50 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: finishing write tid 2 to trial18717860-50 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: finishing write tid 3 to trial18717860-50 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: finishing write tid 4 to trial18717860-50 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: oid 50 updating version 0 to 53 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: oid 50 updating version 53 to 54 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: oid 50 version 54 is already newer than 52 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 54 (ObjNum 155 snap 26 seq_num 155) dirty exists 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:322: left oid 50 (ObjNum 155 snap 26 seq_num 155) 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:312: done (6 left) 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:315: done (5 left) 2026-02-13T18:06:48.967 INFO:tasks.rados.rados.0.trial187.stdout:319: done (4 left) 2026-02-13T18:06:48.968 INFO:tasks.rados.rados.0.trial187.stdout:320: done (3 left) 2026-02-13T18:06:48.968 INFO:tasks.rados.rados.0.trial187.stdout:321: done (2 left) 2026-02-13T18:06:48.968 INFO:tasks.rados.rados.0.trial187.stdout:322: done (1 left) 2026-02-13T18:06:48.968 INFO:tasks.rados.rados.0.trial187.stdout:323: done (0 left) 2026-02-13T18:06:48.968 INFO:tasks.rados.rados.0.trial187.stdout:324: snap_create 2026-02-13T18:06:49.709 INFO:tasks.rados.rados.0.trial187.stdout:324: done (0 left) 2026-02-13T18:06:49.710 INFO:tasks.rados.rados.0.trial187.stdout:325: snap_remove snap 26 2026-02-13T18:06:50.713 INFO:tasks.rados.rados.0.trial187.stdout:325: done (0 left) 2026-02-13T18:06:50.713 INFO:tasks.rados.rados.0.trial187.stdout:326: write oid 43 current snap is 27 2026-02-13T18:06:50.714 INFO:tasks.rados.rados.0.trial187.stdout:326: seq_num 157 ranges {638699=541153,1770967=531722} 2026-02-13T18:06:50.721 INFO:tasks.rados.rados.0.trial187.stdout:326: writing trial18717860-43 from 638699 to 1179852 tid 1 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:326: writing trial18717860-43 from 1770967 to 2302689 tid 2 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:327: rollback oid 18 current snap is 27 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:327: done (1 left) 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:328: rollback oid 50 current snap is 27 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:328: done (1 left) 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:329: write (excl) oid 17 current snap is 27 2026-02-13T18:06:50.729 INFO:tasks.rados.rados.0.trial187.stdout:329: seq_num 158 ranges {655506=616402,1829449=675380} 2026-02-13T18:06:50.737 INFO:tasks.rados.rados.0.trial187.stdout:329: writing trial18717860-17 from 655506 to 1271908 tid 1 2026-02-13T18:06:50.746 INFO:tasks.rados.rados.0.trial187.stdout:329: writing trial18717860-17 from 1829449 to 2504829 tid 2 2026-02-13T18:06:50.746 INFO:tasks.rados.rados.0.trial187.stdout:330: snap_create 2026-02-13T18:06:50.746 INFO:tasks.rados.rados.0.trial187.stdout:326: finishing write tid 1 to trial18717860-43 2026-02-13T18:06:50.746 INFO:tasks.rados.rados.0.trial187.stdout:326: finishing write tid 2 to trial18717860-43 2026-02-13T18:06:50.746 INFO:tasks.rados.rados.0.trial187.stdout:326: finishing write tid 3 to trial18717860-43 2026-02-13T18:06:50.746 INFO:tasks.rados.rados.0.trial187.stdout:326: finishing write tid 4 to trial18717860-43 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:326: oid 43 updating version 0 to 169 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:326: oid 43 version 169 is already newer than 167 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:326: oid 43 version 169 is already newer than 168 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 169 (ObjNum 157 snap 27 seq_num 157) dirty exists 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:326: left oid 43 (ObjNum 157 snap 27 seq_num 157) 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:329: finishing write tid 1 to trial18717860-17 2026-02-13T18:06:50.747 INFO:tasks.rados.rados.0.trial187.stdout:329: finishing write tid 2 to trial18717860-17 2026-02-13T18:06:50.748 INFO:tasks.rados.rados.0.trial187.stdout:329: finishing write tid 3 to trial18717860-17 2026-02-13T18:06:50.748 INFO:tasks.rados.rados.0.trial187.stdout:329: finishing write tid 4 to trial18717860-17 2026-02-13T18:06:50.748 INFO:tasks.rados.rados.0.trial187.stdout:329: oid 17 updating version 0 to 123 2026-02-13T18:06:50.748 INFO:tasks.rados.rados.0.trial187.stdout:329: oid 17 updating version 123 to 124 2026-02-13T18:06:50.748 INFO:tasks.rados.rados.0.trial187.stdout:329: oid 17 updating version 124 to 125 2026-02-13T18:06:50.749 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 125 (ObjNum 158 snap 27 seq_num 158) dirty exists 2026-02-13T18:06:50.749 INFO:tasks.rados.rados.0.trial187.stdout:329: left oid 17 (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:06:51.714 INFO:tasks.rados.rados.0.trial187.stdout:326: done (2 left) 2026-02-13T18:06:51.714 INFO:tasks.rados.rados.0.trial187.stdout:329: done (1 left) 2026-02-13T18:06:51.714 INFO:tasks.rados.rados.0.trial187.stdout:330: done (0 left) 2026-02-13T18:06:51.714 INFO:tasks.rados.rados.0.trial187.stdout:331: write oid 9 current snap is 28 2026-02-13T18:06:51.714 INFO:tasks.rados.rados.0.trial187.stdout:331: seq_num 159 ranges {672313=691651,1887931=419038} 2026-02-13T18:06:51.723 INFO:tasks.rados.rados.0.trial187.stdout:331: writing trial18717860-9 from 672313 to 1363964 tid 1 2026-02-13T18:06:51.729 INFO:tasks.rados.rados.0.trial187.stdout:331: writing trial18717860-9 from 1887931 to 2306969 tid 2 2026-02-13T18:06:51.729 INFO:tasks.rados.rados.0.trial187.stdout:332: snap_create 2026-02-13T18:06:51.729 INFO:tasks.rados.rados.0.trial187.stdout:331: finishing write tid 1 to trial18717860-9 2026-02-13T18:06:51.734 INFO:tasks.rados.rados.0.trial187.stdout:331: finishing write tid 2 to trial18717860-9 2026-02-13T18:06:51.735 INFO:tasks.rados.rados.0.trial187.stdout:331: finishing write tid 3 to trial18717860-9 2026-02-13T18:06:51.735 INFO:tasks.rados.rados.0.trial187.stdout:331: finishing write tid 4 to trial18717860-9 2026-02-13T18:06:51.735 INFO:tasks.rados.rados.0.trial187.stdout:331: oid 9 updating version 0 to 129 2026-02-13T18:06:51.735 INFO:tasks.rados.rados.0.trial187.stdout:331: oid 9 version 129 is already newer than 127 2026-02-13T18:06:51.735 INFO:tasks.rados.rados.0.trial187.stdout:331: oid 9 version 129 is already newer than 128 2026-02-13T18:06:51.735 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 129 (ObjNum 159 snap 28 seq_num 159) dirty exists 2026-02-13T18:06:51.736 INFO:tasks.rados.rados.0.trial187.stdout:331: left oid 9 (ObjNum 159 snap 28 seq_num 159) 2026-02-13T18:06:52.719 INFO:tasks.rados.rados.0.trial187.stdout:331: done (1 left) 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:332: done (0 left) 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:333: read oid 13 snap 27 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:333: expect (ObjNum 126 snap 22 seq_num 126) 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:334: rollback oid 45 current snap is 29 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 28 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:335: read oid 39 snap 27 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:335: expect (ObjNum 144 snap 26 seq_num 144) 2026-02-13T18:06:52.720 INFO:tasks.rados.rados.0.trial187.stdout:336: snap_create 2026-02-13T18:06:52.725 INFO:tasks.rados.rados.0.trial187.stdout:333: expect (ObjNum 126 snap 22 seq_num 126) 2026-02-13T18:06:52.743 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1096992 2026-02-13T18:06:52.781 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2074461 2026-02-13T18:06:52.805 INFO:tasks.rados.rados.0.trial187.stdout:335: expect (ObjNum 144 snap 26 seq_num 144) 2026-02-13T18:06:52.827 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:52.879 INFO:tasks.rados.rados.0.trial187.stdout:334: finishing rollback tid 0 to trial18717860-45 2026-02-13T18:06:52.879 INFO:tasks.rados.rados.0.trial187.stdout:334: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:06:52.879 INFO:tasks.rados.rados.0.trial187.stdout:334: finishing rollback tid 2 to trial18717860-45 2026-02-13T18:06:52.879 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 67 (ObjNum 117 snap 18 seq_num 117) dirty exists 2026-02-13T18:06:53.684 INFO:tasks.rados.rados.0.trial187.stdout:333: done (3 left) 2026-02-13T18:06:53.685 INFO:tasks.rados.rados.0.trial187.stdout:334: done (2 left) 2026-02-13T18:06:53.685 INFO:tasks.rados.rados.0.trial187.stdout:335: done (1 left) 2026-02-13T18:06:53.685 INFO:tasks.rados.rados.0.trial187.stdout:336: done (0 left) 2026-02-13T18:06:53.685 INFO:tasks.rados.rados.0.trial187.stdout:337: snap_remove snap 29 2026-02-13T18:06:54.685 INFO:tasks.rados.rados.0.trial187.stdout:337: done (0 left) 2026-02-13T18:06:54.685 INFO:tasks.rados.rados.0.trial187.stdout:338: rollback oid 36 current snap is 30 2026-02-13T18:06:54.685 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 36 to 28 2026-02-13T18:06:54.686 INFO:tasks.rados.rados.0.trial187.stdout:339: rollback oid 2 current snap is 30 2026-02-13T18:06:54.686 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 28 2026-02-13T18:06:54.686 INFO:tasks.rados.rados.0.trial187.stdout:340: rollback oid 42 current snap is 30 2026-02-13T18:06:54.686 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 42 to 28 2026-02-13T18:06:54.686 INFO:tasks.rados.rados.0.trial187.stdout:341: write oid 24 current snap is 30 2026-02-13T18:06:54.686 INFO:tasks.rados.rados.0.trial187.stdout:341: seq_num 160 ranges {689120=483253,1946413=679049} 2026-02-13T18:06:54.692 INFO:tasks.rados.rados.0.trial187.stdout:341: writing trial18717860-24 from 689120 to 1172373 tid 1 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:341: writing trial18717860-24 from 1946413 to 2625462 tid 2 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:342: copy_from oid 43 from oid 44 current snap is 30 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:340: finishing rollback tid 1 to trial18717860-42 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 0 (ObjNum 801 snap 0 seq_num 4015649372) dirty dne 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:338: finishing rollback tid 0 to trial18717860-36 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:338: finishing rollback tid 1 to trial18717860-36 2026-02-13T18:06:54.703 INFO:tasks.rados.rados.0.trial187.stdout:340: done (4 left) 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:343: rollback oid 1 current snap is 30 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 1 to 27 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:338: finishing rollback tid 2 to trial18717860-36 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 75 (ObjNum 133 snap 23 seq_num 133) dirty exists 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:339: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 0 (ObjNum 129 snap 0 seq_num 3013881736) dirty dne 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:341: finishing write tid 1 to trial18717860-24 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:338: done (4 left) 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:339: done (3 left) 2026-02-13T18:06:54.704 INFO:tasks.rados.rados.0.trial187.stdout:344: snap_create 2026-02-13T18:06:54.705 INFO:tasks.rados.rados.0.trial187.stdout:343: finishing rollback tid 1 to trial18717860-1 2026-02-13T18:06:54.705 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:06:54.705 INFO:tasks.rados.rados.0.trial187.stdout:341: finishing write tid 2 to trial18717860-24 2026-02-13T18:06:54.705 INFO:tasks.rados.rados.0.trial187.stdout:341: finishing write tid 3 to trial18717860-24 2026-02-13T18:06:54.705 INFO:tasks.rados.rados.0.trial187.stdout:341: finishing write tid 4 to trial18717860-24 2026-02-13T18:06:54.706 INFO:tasks.rados.rados.0.trial187.stdout:341: oid 24 updating version 0 to 57 2026-02-13T18:06:54.706 INFO:tasks.rados.rados.0.trial187.stdout:341: oid 24 updating version 57 to 58 2026-02-13T18:06:54.706 INFO:tasks.rados.rados.0.trial187.stdout:341: oid 24 version 58 is already newer than 56 2026-02-13T18:06:54.706 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 58 (ObjNum 160 snap 30 seq_num 160) dirty exists 2026-02-13T18:06:54.706 INFO:tasks.rados.rados.0.trial187.stdout:341: left oid 24 (ObjNum 160 snap 30 seq_num 160) 2026-02-13T18:06:54.715 INFO:tasks.rados.rados.0.trial187.stdout:342: finishing copy_from racing read to trial18717860-43 2026-02-13T18:06:54.715 INFO:tasks.rados.rados.0.trial187.stdout:342: finishing copy_from to trial18717860-43 2026-02-13T18:06:54.715 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 162 (ObjNum 130 snap 23 seq_num 130) dirty exists 2026-02-13T18:06:55.686 INFO:tasks.rados.rados.0.trial187.stdout:341: done (3 left) 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:342: done (2 left) 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:343: done (1 left) 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:344: done (0 left) 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:345: read oid 32 snap -1 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:345: expect deleted 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:346: read oid 44 snap -1 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:346: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:347: read oid 14 snap -1 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:347: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:348: copy_from oid 16 from oid 12 current snap is 31 2026-02-13T18:06:55.687 INFO:tasks.rados.rados.0.trial187.stdout:349: rollback oid 31 current snap is 31 2026-02-13T18:06:55.688 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 27 2026-02-13T18:06:55.688 INFO:tasks.rados.rados.0.trial187.stdout:350: read oid 3 snap -1 2026-02-13T18:06:55.688 INFO:tasks.rados.rados.0.trial187.stdout:350: expect deleted 2026-02-13T18:06:55.688 INFO:tasks.rados.rados.0.trial187.stdout:351: snap_create 2026-02-13T18:06:55.691 INFO:tasks.rados.rados.0.trial187.stdout:346: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:06:55.721 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:55.743 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:55.760 INFO:tasks.rados.rados.0.trial187.stdout:347: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:06:55.833 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:55.868 INFO:tasks.rados.rados.0.trial187.stdout:349: finishing rollback tid 0 to trial18717860-31 2026-02-13T18:06:55.868 INFO:tasks.rados.rados.0.trial187.stdout:349: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:06:55.868 INFO:tasks.rados.rados.0.trial187.stdout:349: finishing rollback tid 2 to trial18717860-31 2026-02-13T18:06:55.869 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 70 (ObjNum 123 snap 22 seq_num 123) dirty exists 2026-02-13T18:06:55.869 INFO:tasks.rados.rados.0.trial187.stdout:348: finishing copy_from racing read to trial18717860-16 2026-02-13T18:06:55.869 INFO:tasks.rados.rados.0.trial187.stdout:348: finishing copy_from to trial18717860-16 2026-02-13T18:06:55.869 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 67 (ObjNum 150 snap 26 seq_num 150) dirty exists 2026-02-13T18:06:56.690 INFO:tasks.rados.rados.0.trial187.stdout:345: done (6 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:346: done (5 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:347: done (4 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:348: done (3 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:349: done (2 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:350: done (1 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:351: done (0 left) 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:352: copy_from oid 4 from oid 40 current snap is 32 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:353: rollback oid 25 current snap is 32 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 30 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:354: write (excl) oid 22 current snap is 32 2026-02-13T18:06:56.691 INFO:tasks.rados.rados.0.trial187.stdout:354: seq_num 161 ranges {705927=558502,2004895=422707} 2026-02-13T18:06:56.698 INFO:tasks.rados.rados.0.trial187.stdout:354: writing trial18717860-22 from 705927 to 1264429 tid 1 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:354: writing trial18717860-22 from 2004895 to 2427602 tid 2 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:355: snap_remove snap 28 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:353: finishing rollback tid 0 to trial18717860-25 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:353: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:353: finishing rollback tid 2 to trial18717860-25 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 61 (ObjNum 110 snap 17 seq_num 110) dirty exists 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:354: finishing write tid 1 to trial18717860-22 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:352: finishing copy_from racing read to trial18717860-4 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:352: finishing copy_from to trial18717860-4 2026-02-13T18:06:56.707 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 56 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:06:57.690 INFO:tasks.rados.rados.0.trial187.stdout:352: done (3 left) 2026-02-13T18:06:57.690 INFO:tasks.rados.rados.0.trial187.stdout:353: done (2 left) 2026-02-13T18:06:57.690 INFO:tasks.rados.rados.0.trial187.stdout:355: done (1 left) 2026-02-13T18:06:57.690 INFO:tasks.rados.rados.0.trial187.stdout:356: read oid 41 snap -1 2026-02-13T18:06:57.690 INFO:tasks.rados.rados.0.trial187.stdout:356: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:357: snap_create 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: finishing write tid 2 to trial18717860-22 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: finishing write tid 3 to trial18717860-22 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: finishing write tid 4 to trial18717860-22 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: oid 22 updating version 0 to 174 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: oid 22 version 174 is already newer than 173 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: oid 22 version 174 is already newer than 172 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 174 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T18:06:57.691 INFO:tasks.rados.rados.0.trial187.stdout:354: left oid 22 (ObjNum 161 snap 32 seq_num 161) 2026-02-13T18:06:57.699 INFO:tasks.rados.rados.0.trial187.stdout:356: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:06:57.699 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:06:58.686 INFO:tasks.rados.rados.0.trial187.stdout:354: done (2 left) 2026-02-13T18:06:58.686 INFO:tasks.rados.rados.0.trial187.stdout:356: done (1 left) 2026-02-13T18:06:58.686 INFO:tasks.rados.rados.0.trial187.stdout:357: done (0 left) 2026-02-13T18:06:58.686 INFO:tasks.rados.rados.0.trial187.stdout:358: copy_from oid 31 from oid 6 current snap is 33 2026-02-13T18:06:58.686 INFO:tasks.rados.rados.0.trial187.stdout:359: snap_create 2026-02-13T18:06:58.699 INFO:tasks.rados.rados.0.trial187.stdout:358: finishing copy_from racing read to trial18717860-31 2026-02-13T18:06:58.699 INFO:tasks.rados.rados.0.trial187.stdout:358: finishing copy_from to trial18717860-31 2026-02-13T18:06:58.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 42 (ObjNum 113 snap 18 seq_num 113) dirty exists 2026-02-13T18:06:59.915 INFO:tasks.rados.rados.0.trial187.stdout:358: done (1 left) 2026-02-13T18:06:59.915 INFO:tasks.rados.rados.0.trial187.stdout:359: done (0 left) 2026-02-13T18:06:59.915 INFO:tasks.rados.rados.0.trial187.stdout:360: snap_remove snap 33 2026-02-13T18:07:00.917 INFO:tasks.rados.rados.0.trial187.stdout:360: done (0 left) 2026-02-13T18:07:00.917 INFO:tasks.rados.rados.0.trial187.stdout:361: read oid 27 snap -1 2026-02-13T18:07:00.917 INFO:tasks.rados.rados.0.trial187.stdout:361: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:00.917 INFO:tasks.rados.rados.0.trial187.stdout:362: rollback oid 44 current snap is 34 2026-02-13T18:07:00.917 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 32 2026-02-13T18:07:00.917 INFO:tasks.rados.rados.0.trial187.stdout:363: snap_create 2026-02-13T18:07:00.921 INFO:tasks.rados.rados.0.trial187.stdout:362: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:07:00.922 INFO:tasks.rados.rados.0.trial187.stdout:362: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:07:00.922 INFO:tasks.rados.rados.0.trial187.stdout:362: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:07:00.922 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 180 (ObjNum 130 snap 23 seq_num 130) dirty exists 2026-02-13T18:07:00.924 INFO:tasks.rados.rados.0.trial187.stdout:361: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:00.973 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 467494 2026-02-13T18:07:00.996 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:01.917 INFO:tasks.rados.rados.0.trial187.stdout:361: done (2 left) 2026-02-13T18:07:01.917 INFO:tasks.rados.rados.0.trial187.stdout:362: done (1 left) 2026-02-13T18:07:01.917 INFO:tasks.rados.rados.0.trial187.stdout:363: done (0 left) 2026-02-13T18:07:01.917 INFO:tasks.rados.rados.0.trial187.stdout:364: snap_remove snap 34 2026-02-13T18:07:03.422 INFO:tasks.rados.rados.0.trial187.stdout:364: done (0 left) 2026-02-13T18:07:03.423 INFO:tasks.rados.rados.0.trial187.stdout:365: write oid 15 current snap is 35 2026-02-13T18:07:03.423 INFO:tasks.rados.rados.0.trial187.stdout:365: seq_num 162 ranges {722734=633751,2063377=659357} 2026-02-13T18:07:03.431 INFO:tasks.rados.rados.0.trial187.stdout:365: writing trial18717860-15 from 722734 to 1356485 tid 1 2026-02-13T18:07:03.441 INFO:tasks.rados.rados.0.trial187.stdout:365: writing trial18717860-15 from 2063377 to 2722734 tid 2 2026-02-13T18:07:03.441 INFO:tasks.rados.rados.0.trial187.stdout:366: write (excl) oid 39 current snap is 35 2026-02-13T18:07:03.441 INFO:tasks.rados.rados.0.trial187.stdout:365: finishing write tid 1 to trial18717860-15 2026-02-13T18:07:03.441 INFO:tasks.rados.rados.0.trial187.stdout:366: seq_num 163 ranges {739541=709000,2121859=426376} 2026-02-13T18:07:03.450 INFO:tasks.rados.rados.0.trial187.stdout:366: writing trial18717860-39 from 739541 to 1448541 tid 1 2026-02-13T18:07:03.458 INFO:tasks.rados.rados.0.trial187.stdout:366: writing trial18717860-39 from 2121859 to 2548235 tid 2 2026-02-13T18:07:03.458 INFO:tasks.rados.rados.0.trial187.stdout:367: snap_remove snap 31 2026-02-13T18:07:03.686 INFO:tasks.rados.rados.0.trial187.stdout:367: done (2 left) 2026-02-13T18:07:03.686 INFO:tasks.rados.rados.0.trial187.stdout:368: write oid 47 current snap is 35 2026-02-13T18:07:03.687 INFO:tasks.rados.rados.0.trial187.stdout:368: seq_num 164 ranges {756348=784249,2063988=686387} 2026-02-13T18:07:03.696 INFO:tasks.rados.rados.0.trial187.stdout:368: writing trial18717860-47 from 756348 to 1540597 tid 1 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:368: writing trial18717860-47 from 2063988 to 2750375 tid 2 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:369: snap_create 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: finishing write tid 2 to trial18717860-15 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: finishing write tid 3 to trial18717860-15 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: finishing write tid 4 to trial18717860-15 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: oid 15 updating version 0 to 69 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: oid 15 version 69 is already newer than 68 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: oid 15 updating version 69 to 70 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 70 (ObjNum 162 snap 35 seq_num 162) dirty exists 2026-02-13T18:07:03.706 INFO:tasks.rados.rados.0.trial187.stdout:365: left oid 15 (ObjNum 162 snap 35 seq_num 162) 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: finishing write tid 1 to trial18717860-39 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: finishing write tid 2 to trial18717860-39 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: finishing write tid 3 to trial18717860-39 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: finishing write tid 4 to trial18717860-39 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: oid 39 updating version 0 to 133 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: oid 39 version 133 is already newer than 131 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: oid 39 version 133 is already newer than 132 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 133 (ObjNum 163 snap 35 seq_num 163) dirty exists 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:366: left oid 39 (ObjNum 163 snap 35 seq_num 163) 2026-02-13T18:07:03.707 INFO:tasks.rados.rados.0.trial187.stdout:368: finishing write tid 1 to trial18717860-47 2026-02-13T18:07:03.708 INFO:tasks.rados.rados.0.trial187.stdout:368: finishing write tid 2 to trial18717860-47 2026-02-13T18:07:03.708 INFO:tasks.rados.rados.0.trial187.stdout:368: finishing write tid 3 to trial18717860-47 2026-02-13T18:07:03.708 INFO:tasks.rados.rados.0.trial187.stdout:368: finishing write tid 4 to trial18717860-47 2026-02-13T18:07:03.708 INFO:tasks.rados.rados.0.trial187.stdout:368: oid 47 updating version 0 to 69 2026-02-13T18:07:03.709 INFO:tasks.rados.rados.0.trial187.stdout:368: oid 47 updating version 69 to 70 2026-02-13T18:07:03.709 INFO:tasks.rados.rados.0.trial187.stdout:368: oid 47 version 70 is already newer than 68 2026-02-13T18:07:03.709 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 70 (ObjNum 164 snap 35 seq_num 164) dirty exists 2026-02-13T18:07:03.709 INFO:tasks.rados.rados.0.trial187.stdout:368: left oid 47 (ObjNum 164 snap 35 seq_num 164) 2026-02-13T18:07:04.702 INFO:tasks.rados.rados.0.trial187.stdout:365: done (3 left) 2026-02-13T18:07:04.703 INFO:tasks.rados.rados.0.trial187.stdout:366: done (2 left) 2026-02-13T18:07:04.703 INFO:tasks.rados.rados.0.trial187.stdout:368: done (1 left) 2026-02-13T18:07:04.703 INFO:tasks.rados.rados.0.trial187.stdout:369: done (0 left) 2026-02-13T18:07:04.703 INFO:tasks.rados.rados.0.trial187.stdout:370: read oid 43 snap -1 2026-02-13T18:07:04.703 INFO:tasks.rados.rados.0.trial187.stdout:370: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:07:04.703 INFO:tasks.rados.rados.0.trial187.stdout:371: snap_create 2026-02-13T18:07:04.707 INFO:tasks.rados.rados.0.trial187.stdout:370: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:07:04.736 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:04.759 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:06.712 INFO:tasks.rados.rados.0.trial187.stdout:370: done (1 left) 2026-02-13T18:07:06.712 INFO:tasks.rados.rados.0.trial187.stdout:371: done (0 left) 2026-02-13T18:07:06.713 INFO:tasks.rados.rados.0.trial187.stdout:372: read oid 15 snap -1 2026-02-13T18:07:06.713 INFO:tasks.rados.rados.0.trial187.stdout:372: expect (ObjNum 162 snap 35 seq_num 162) 2026-02-13T18:07:06.713 INFO:tasks.rados.rados.0.trial187.stdout:373: read oid 40 snap -1 2026-02-13T18:07:06.713 INFO:tasks.rados.rados.0.trial187.stdout:373: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:06.713 INFO:tasks.rados.rados.0.trial187.stdout:374: snap_create 2026-02-13T18:07:06.716 INFO:tasks.rados.rados.0.trial187.stdout:373: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:06.742 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:06.793 INFO:tasks.rados.rados.0.trial187.stdout:372: expect (ObjNum 162 snap 35 seq_num 162) 2026-02-13T18:07:06.813 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:07.713 INFO:tasks.rados.rados.0.trial187.stdout:372: done (2 left) 2026-02-13T18:07:07.713 INFO:tasks.rados.rados.0.trial187.stdout:373: done (1 left) 2026-02-13T18:07:07.714 INFO:tasks.rados.rados.0.trial187.stdout:374: done (0 left) 2026-02-13T18:07:07.714 INFO:tasks.rados.rados.0.trial187.stdout:375: copy_from oid 33 from oid 41 current snap is 38 2026-02-13T18:07:07.714 INFO:tasks.rados.rados.0.trial187.stdout:376: snap_remove snap 30 2026-02-13T18:07:08.687 INFO:tasks.rados.rados.0.trial187.stdout:376: done (1 left) 2026-02-13T18:07:08.688 INFO:tasks.rados.rados.0.trial187.stdout:377: snap_create 2026-02-13T18:07:08.688 INFO:tasks.rados.rados.0.trial187.stdout:375: finishing copy_from racing read to trial18717860-33 2026-02-13T18:07:08.688 INFO:tasks.rados.rados.0.trial187.stdout:375: finishing copy_from to trial18717860-33 2026-02-13T18:07:08.688 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 27 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T18:07:09.688 INFO:tasks.rados.rados.0.trial187.stdout:375: done (1 left) 2026-02-13T18:07:09.689 INFO:tasks.rados.rados.0.trial187.stdout:377: done (0 left) 2026-02-13T18:07:09.689 INFO:tasks.rados.rados.0.trial187.stdout:378: write oid 28 current snap is 39 2026-02-13T18:07:09.689 INFO:tasks.rados.rados.0.trial187.stdout:378: seq_num 165 ranges {773155=459498,1722470=430045,2648676=124479} 2026-02-13T18:07:09.696 INFO:tasks.rados.rados.0.trial187.stdout:378: writing trial18717860-28 from 773155 to 1232653 tid 1 2026-02-13T18:07:09.703 INFO:tasks.rados.rados.0.trial187.stdout:378: writing trial18717860-28 from 1722470 to 2152515 tid 2 2026-02-13T18:07:09.707 INFO:tasks.rados.rados.0.trial187.stdout:378: writing trial18717860-28 from 2648676 to 2773155 tid 3 2026-02-13T18:07:09.707 INFO:tasks.rados.rados.0.trial187.stdout:379: read oid 19 snap -1 2026-02-13T18:07:09.707 INFO:tasks.rados.rados.0.trial187.stdout:379: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:09.708 INFO:tasks.rados.rados.0.trial187.stdout:380: write (excl) oid 36 current snap is 39 2026-02-13T18:07:09.708 INFO:tasks.rados.rados.0.trial187.stdout:380: seq_num 166 ranges {789962=534747,1780952=690056} 2026-02-13T18:07:09.716 INFO:tasks.rados.rados.0.trial187.stdout:380: writing trial18717860-36 from 789962 to 1324709 tid 1 2026-02-13T18:07:09.724 INFO:tasks.rados.rados.0.trial187.stdout:380: writing trial18717860-36 from 1780952 to 2471008 tid 2 2026-02-13T18:07:09.724 INFO:tasks.rados.rados.0.trial187.stdout:381: snap_remove snap 27 2026-02-13T18:07:10.693 INFO:tasks.rados.rados.0.trial187.stdout:381: done (3 left) 2026-02-13T18:07:10.693 INFO:tasks.rados.rados.0.trial187.stdout:382: read oid 50 snap -1 2026-02-13T18:07:10.693 INFO:tasks.rados.rados.0.trial187.stdout:382: expect (ObjNum 155 snap 26 seq_num 155) 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:383: read oid 42 snap -1 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:383: expect deleted 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:384: copy_from oid 16 from oid 4 current snap is 39 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: finishing write tid 1 to trial18717860-28 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: finishing write tid 2 to trial18717860-28 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: finishing write tid 3 to trial18717860-28 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: finishing write tid 4 to trial18717860-28 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: finishing write tid 5 to trial18717860-28 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: oid 28 updating version 0 to 63 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: oid 28 version 63 is already newer than 61 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: oid 28 updating version 63 to 64 2026-02-13T18:07:10.694 INFO:tasks.rados.rados.0.trial187.stdout:378: oid 28 version 64 is already newer than 62 2026-02-13T18:07:10.695 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 64 (ObjNum 165 snap 39 seq_num 165) dirty exists 2026-02-13T18:07:10.695 INFO:tasks.rados.rados.0.trial187.stdout:378: left oid 28 (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:07:10.695 INFO:tasks.rados.rados.0.trial187.stdout:379: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:10.695 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:10.780 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2339624 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: finishing write tid 1 to trial18717860-36 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: finishing write tid 2 to trial18717860-36 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: finishing write tid 3 to trial18717860-36 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: finishing write tid 4 to trial18717860-36 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: oid 36 updating version 0 to 81 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: oid 36 version 81 is already newer than 80 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:380: oid 36 version 81 is already newer than 79 2026-02-13T18:07:10.790 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 81 (ObjNum 166 snap 39 seq_num 166) dirty exists 2026-02-13T18:07:10.791 INFO:tasks.rados.rados.0.trial187.stdout:380: left oid 36 (ObjNum 166 snap 39 seq_num 166) 2026-02-13T18:07:10.791 INFO:tasks.rados.rados.0.trial187.stdout:382: expect (ObjNum 155 snap 26 seq_num 155) 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:384: finishing copy_from racing read to trial18717860-16 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:384: finishing copy_from to trial18717860-16 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 56 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:378: done (5 left) 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:379: done (4 left) 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:380: done (3 left) 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:382: done (2 left) 2026-02-13T18:07:10.839 INFO:tasks.rados.rados.0.trial187.stdout:383: done (1 left) 2026-02-13T18:07:10.840 INFO:tasks.rados.rados.0.trial187.stdout:384: done (0 left) 2026-02-13T18:07:10.840 INFO:tasks.rados.rados.0.trial187.stdout:385: snap_remove snap 38 2026-02-13T18:07:11.693 INFO:tasks.rados.rados.0.trial187.stdout:385: done (0 left) 2026-02-13T18:07:11.693 INFO:tasks.rados.rados.0.trial187.stdout:386: read oid 35 snap -1 2026-02-13T18:07:11.694 INFO:tasks.rados.rados.0.trial187.stdout:386: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:07:11.694 INFO:tasks.rados.rados.0.trial187.stdout:387: write (excl) oid 39 current snap is 39 2026-02-13T18:07:11.694 INFO:tasks.rados.rados.0.trial187.stdout:387: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2026-02-13T18:07:11.700 INFO:tasks.rados.rados.0.trial187.stdout:387: writing trial18717860-39 from 406769 to 1016765 tid 1 2026-02-13T18:07:11.706 INFO:tasks.rados.rados.0.trial187.stdout:387: writing trial18717860-39 from 1439434 to 1873148 tid 2 2026-02-13T18:07:11.712 INFO:tasks.rados.rados.0.trial187.stdout:387: writing trial18717860-39 from 2303522 to 2806769 tid 3 2026-02-13T18:07:11.712 INFO:tasks.rados.rados.0.trial187.stdout:388: read oid 44 snap -1 2026-02-13T18:07:11.712 INFO:tasks.rados.rados.0.trial187.stdout:388: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:07:11.713 INFO:tasks.rados.rados.0.trial187.stdout:389: rollback oid 38 current snap is 39 2026-02-13T18:07:11.713 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 32 2026-02-13T18:07:11.713 INFO:tasks.rados.rados.0.trial187.stdout:386: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:07:11.713 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 440910 2026-02-13T18:07:11.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1729359 2026-02-13T18:07:11.793 INFO:tasks.rados.rados.0.trial187.stdout:387: finishing write tid 1 to trial18717860-39 2026-02-13T18:07:11.793 INFO:tasks.rados.rados.0.trial187.stdout:387: finishing write tid 2 to trial18717860-39 2026-02-13T18:07:11.793 INFO:tasks.rados.rados.0.trial187.stdout:387: finishing write tid 3 to trial18717860-39 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: finishing write tid 4 to trial18717860-39 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: finishing write tid 5 to trial18717860-39 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: oid 39 updating version 0 to 143 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: oid 39 updating version 143 to 144 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: oid 39 updating version 144 to 146 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: oid 39 version 146 is already newer than 145 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 146 (ObjNum 167 snap 39 seq_num 167) dirty exists 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:387: left oid 39 (ObjNum 167 snap 39 seq_num 167) 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:389: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:389: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:07:11.794 INFO:tasks.rados.rados.0.trial187.stdout:389: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:07:11.795 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 41 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T18:07:11.795 INFO:tasks.rados.rados.0.trial187.stdout:388: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:07:11.795 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:11.837 INFO:tasks.rados.rados.0.trial187.stdout:386: done (3 left) 2026-02-13T18:07:11.837 INFO:tasks.rados.rados.0.trial187.stdout:387: done (2 left) 2026-02-13T18:07:11.837 INFO:tasks.rados.rados.0.trial187.stdout:388: done (1 left) 2026-02-13T18:07:11.837 INFO:tasks.rados.rados.0.trial187.stdout:389: done (0 left) 2026-02-13T18:07:11.837 INFO:tasks.rados.rados.0.trial187.stdout:390: copy_from oid 35 from oid 47 current snap is 39 2026-02-13T18:07:11.837 INFO:tasks.rados.rados.0.trial187.stdout:391: write oid 50 current snap is 39 2026-02-13T18:07:11.838 INFO:tasks.rados.rados.0.trial187.stdout:391: seq_num 168 ranges {423576=401598,1497916=693725} 2026-02-13T18:07:11.842 INFO:tasks.rados.rados.0.trial187.stdout:391: writing trial18717860-50 from 423576 to 825174 tid 1 2026-02-13T18:07:11.852 INFO:tasks.rados.rados.0.trial187.stdout:391: writing trial18717860-50 from 1497916 to 2191641 tid 2 2026-02-13T18:07:11.852 INFO:tasks.rados.rados.0.trial187.stdout:392: snap_create 2026-02-13T18:07:11.852 INFO:tasks.rados.rados.0.trial187.stdout:391: finishing write tid 1 to trial18717860-50 2026-02-13T18:07:11.852 INFO:tasks.rados.rados.0.trial187.stdout:390: finishing copy_from racing read to trial18717860-35 2026-02-13T18:07:11.852 INFO:tasks.rados.rados.0.trial187.stdout:390: finishing copy_from to trial18717860-35 2026-02-13T18:07:11.852 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 70 (ObjNum 164 snap 35 seq_num 164) dirty exists 2026-02-13T18:07:11.854 INFO:tasks.rados.rados.0.trial187.stdout:391: finishing write tid 2 to trial18717860-50 2026-02-13T18:07:11.854 INFO:tasks.rados.rados.0.trial187.stdout:391: finishing write tid 3 to trial18717860-50 2026-02-13T18:07:11.854 INFO:tasks.rados.rados.0.trial187.stdout:391: finishing write tid 4 to trial18717860-50 2026-02-13T18:07:11.855 INFO:tasks.rados.rados.0.trial187.stdout:391: oid 50 updating version 0 to 57 2026-02-13T18:07:11.855 INFO:tasks.rados.rados.0.trial187.stdout:391: oid 50 updating version 57 to 58 2026-02-13T18:07:11.855 INFO:tasks.rados.rados.0.trial187.stdout:391: oid 50 version 58 is already newer than 56 2026-02-13T18:07:11.855 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 58 (ObjNum 168 snap 39 seq_num 168) dirty exists 2026-02-13T18:07:11.855 INFO:tasks.rados.rados.0.trial187.stdout:391: left oid 50 (ObjNum 168 snap 39 seq_num 168) 2026-02-13T18:07:12.701 INFO:tasks.rados.rados.0.trial187.stdout:390: done (2 left) 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:391: done (1 left) 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:392: done (0 left) 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:393: read oid 1 snap -1 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:393: expect deleted 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:394: copy_from oid 3 from oid 16 current snap is 40 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:395: rollback oid 25 current snap is 40 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 32 2026-02-13T18:07:12.702 INFO:tasks.rados.rados.0.trial187.stdout:396: rollback oid 47 current snap is 40 2026-02-13T18:07:12.703 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 32 2026-02-13T18:07:12.703 INFO:tasks.rados.rados.0.trial187.stdout:397: snap_create 2026-02-13T18:07:12.704 INFO:tasks.rados.rados.0.trial187.stdout:395: finishing rollback tid 0 to trial18717860-25 2026-02-13T18:07:12.705 INFO:tasks.rados.rados.0.trial187.stdout:395: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:07:12.705 INFO:tasks.rados.rados.0.trial187.stdout:395: finishing rollback tid 2 to trial18717860-25 2026-02-13T18:07:12.705 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 73 (ObjNum 110 snap 17 seq_num 110) dirty exists 2026-02-13T18:07:12.705 INFO:tasks.rados.rados.0.trial187.stdout:396: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:07:12.706 INFO:tasks.rados.rados.0.trial187.stdout:396: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:07:12.706 INFO:tasks.rados.rados.0.trial187.stdout:396: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:07:12.706 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 73 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-13T18:07:12.710 INFO:tasks.rados.rados.0.trial187.stdout:394: finishing copy_from racing read to trial18717860-3 2026-02-13T18:07:12.710 INFO:tasks.rados.rados.0.trial187.stdout:394: finishing copy_from to trial18717860-3 2026-02-13T18:07:12.710 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 56 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:07:13.688 INFO:tasks.rados.rados.0.trial187.stdout:393: done (4 left) 2026-02-13T18:07:13.688 INFO:tasks.rados.rados.0.trial187.stdout:394: done (3 left) 2026-02-13T18:07:13.689 INFO:tasks.rados.rados.0.trial187.stdout:395: done (2 left) 2026-02-13T18:07:13.689 INFO:tasks.rados.rados.0.trial187.stdout:396: done (1 left) 2026-02-13T18:07:13.689 INFO:tasks.rados.rados.0.trial187.stdout:397: done (0 left) 2026-02-13T18:07:13.689 INFO:tasks.rados.rados.0.trial187.stdout:398: delete oid 15 current snap is 41 2026-02-13T18:07:13.692 INFO:tasks.rados.rados.0.trial187.stdout:398: done (0 left) 2026-02-13T18:07:13.692 INFO:tasks.rados.rados.0.trial187.stdout:399: read oid 11 snap -1 2026-02-13T18:07:13.692 INFO:tasks.rados.rados.0.trial187.stdout:399: expect deleted 2026-02-13T18:07:13.693 INFO:tasks.rados.rados.0.trial187.stdout:400: read oid 35 snap 35 2026-02-13T18:07:13.693 INFO:tasks.rados.rados.0.trial187.stdout:400: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:07:13.693 INFO:tasks.rados.rados.0.trial187.stdout:401: snap_remove snap 39 2026-02-13T18:07:14.691 INFO:tasks.rados.rados.0.trial187.stdout:401: done (2 left) 2026-02-13T18:07:14.691 INFO:tasks.rados.rados.0.trial187.stdout:402: snap_create 2026-02-13T18:07:14.691 INFO:tasks.rados.rados.0.trial187.stdout:400: expect (ObjNum 71 snap 6 seq_num 71) 2026-02-13T18:07:14.722 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2506429 2026-02-13T18:07:14.756 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3129486 2026-02-13T18:07:15.693 INFO:tasks.rados.rados.0.trial187.stdout:399: done (2 left) 2026-02-13T18:07:15.693 INFO:tasks.rados.rados.0.trial187.stdout:400: done (1 left) 2026-02-13T18:07:15.693 INFO:tasks.rados.rados.0.trial187.stdout:402: done (0 left) 2026-02-13T18:07:15.693 INFO:tasks.rados.rados.0.trial187.stdout:403: write (excl) oid 1 current snap is 42 2026-02-13T18:07:15.693 INFO:tasks.rados.rados.0.trial187.stdout:403: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2026-02-13T18:07:15.699 INFO:tasks.rados.rados.0.trial187.stdout:403: writing trial18717860-1 from 457190 to 1009286 tid 1 2026-02-13T18:07:15.707 INFO:tasks.rados.rados.0.trial187.stdout:403: writing trial18717860-1 from 1614880 to 2195921 tid 2 2026-02-13T18:07:15.712 INFO:tasks.rados.rados.0.trial187.stdout:403: writing trial18717860-1 from 2785791 to 2857190 tid 3 2026-02-13T18:07:15.712 INFO:tasks.rados.rados.0.trial187.stdout:404: copy_from oid 15 from oid 27 current snap is 42 2026-02-13T18:07:15.712 INFO:tasks.rados.rados.0.trial187.stdout:403: finishing write tid 1 to trial18717860-1 2026-02-13T18:07:15.712 INFO:tasks.rados.rados.0.trial187.stdout:403: finishing write tid 2 to trial18717860-1 2026-02-13T18:07:15.712 INFO:tasks.rados.rados.0.trial187.stdout:405: write (excl) oid 5 current snap is 42 2026-02-13T18:07:15.712 INFO:tasks.rados.rados.0.trial187.stdout:405: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2026-02-13T18:07:15.719 INFO:tasks.rados.rados.0.trial187.stdout:405: writing trial18717860-5 from 473997 to 1101342 tid 1 2026-02-13T18:07:15.726 INFO:tasks.rados.rados.0.trial187.stdout:405: writing trial18717860-5 from 1673362 to 2114414 tid 2 2026-02-13T18:07:15.731 INFO:tasks.rados.rados.0.trial187.stdout:405: writing trial18717860-5 from 2529567 to 2873997 tid 3 2026-02-13T18:07:15.731 INFO:tasks.rados.rados.0.trial187.stdout:406: write (excl) oid 25 current snap is 42 2026-02-13T18:07:15.731 INFO:tasks.rados.rados.0.trial187.stdout:406: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2026-02-13T18:07:15.739 INFO:tasks.rados.rados.0.trial187.stdout:406: writing trial18717860-25 from 490804 to 1193398 tid 1 2026-02-13T18:07:15.743 INFO:tasks.rados.rados.0.trial187.stdout:406: writing trial18717860-25 from 1615491 to 2200201 tid 2 2026-02-13T18:07:15.746 INFO:tasks.rados.rados.0.trial187.stdout:406: writing trial18717860-25 from 2724284 to 2890804 tid 3 2026-02-13T18:07:15.746 INFO:tasks.rados.rados.0.trial187.stdout:407: write oid 50 current snap is 42 2026-02-13T18:07:15.747 INFO:tasks.rados.rados.0.trial187.stdout:407: seq_num 173 ranges {507611=777843,2073973=444721} 2026-02-13T18:07:15.751 INFO:tasks.rados.rados.0.trial187.stdout:407: writing trial18717860-50 from 507611 to 1285454 tid 1 2026-02-13T18:07:15.759 INFO:tasks.rados.rados.0.trial187.stdout:407: writing trial18717860-50 from 2073973 to 2518694 tid 2 2026-02-13T18:07:15.759 INFO:tasks.rados.rados.0.trial187.stdout:408: copy_from oid 41 from oid 13 current snap is 42 2026-02-13T18:07:15.759 INFO:tasks.rados.rados.0.trial187.stdout:403: finishing write tid 3 to trial18717860-1 2026-02-13T18:07:15.759 INFO:tasks.rados.rados.0.trial187.stdout:409: snap_create 2026-02-13T18:07:15.759 INFO:tasks.rados.rados.0.trial187.stdout:403: finishing write tid 4 to trial18717860-1 2026-02-13T18:07:15.759 INFO:tasks.rados.rados.0.trial187.stdout:403: finishing write tid 5 to trial18717860-1 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:403: oid 1 updating version 0 to 76 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:403: oid 1 updating version 76 to 77 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:403: oid 1 updating version 77 to 78 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:403: oid 1 version 78 is already newer than 75 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 78 (ObjNum 170 snap 42 seq_num 170) dirty exists 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:403: left oid 1 (ObjNum 170 snap 42 seq_num 170) 2026-02-13T18:07:15.760 INFO:tasks.rados.rados.0.trial187.stdout:405: finishing write tid 1 to trial18717860-5 2026-02-13T18:07:15.761 INFO:tasks.rados.rados.0.trial187.stdout:404: finishing copy_from racing read to trial18717860-15 2026-02-13T18:07:15.761 INFO:tasks.rados.rados.0.trial187.stdout:404: finishing copy_from to trial18717860-15 2026-02-13T18:07:15.761 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 57 (ObjNum 149 snap 26 seq_num 149) dirty exists 2026-02-13T18:07:15.761 INFO:tasks.rados.rados.0.trial187.stdout:405: finishing write tid 2 to trial18717860-5 2026-02-13T18:07:15.761 INFO:tasks.rados.rados.0.trial187.stdout:405: finishing write tid 3 to trial18717860-5 2026-02-13T18:07:15.761 INFO:tasks.rados.rados.0.trial187.stdout:405: finishing write tid 4 to trial18717860-5 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:405: finishing write tid 5 to trial18717860-5 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:405: oid 5 updating version 0 to 76 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:405: oid 5 version 76 is already newer than 75 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:405: oid 5 version 76 is already newer than 74 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:405: oid 5 version 76 is already newer than 73 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 76 (ObjNum 171 snap 42 seq_num 171) dirty exists 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:405: left oid 5 (ObjNum 171 snap 42 seq_num 171) 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:406: finishing write tid 1 to trial18717860-25 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:406: finishing write tid 2 to trial18717860-25 2026-02-13T18:07:15.762 INFO:tasks.rados.rados.0.trial187.stdout:406: finishing write tid 3 to trial18717860-25 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:406: finishing write tid 4 to trial18717860-25 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:406: finishing write tid 5 to trial18717860-25 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:406: oid 25 updating version 0 to 78 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:406: oid 25 version 78 is already newer than 77 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:406: oid 25 updating version 78 to 80 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:406: oid 25 version 80 is already newer than 79 2026-02-13T18:07:15.763 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 80 (ObjNum 172 snap 42 seq_num 172) dirty exists 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:406: left oid 25 (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: finishing write tid 1 to trial18717860-50 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: finishing write tid 2 to trial18717860-50 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: finishing write tid 3 to trial18717860-50 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: finishing write tid 4 to trial18717860-50 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: oid 50 updating version 0 to 60 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: oid 50 updating version 60 to 62 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: oid 50 version 62 is already newer than 61 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 62 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:07:15.764 INFO:tasks.rados.rados.0.trial187.stdout:407: left oid 50 (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:15.765 INFO:tasks.rados.rados.0.trial187.stdout:408: finishing copy_from racing read to trial18717860-41 2026-02-13T18:07:15.765 INFO:tasks.rados.rados.0.trial187.stdout:408: finishing copy_from to trial18717860-41 2026-02-13T18:07:15.765 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 80 (ObjNum 126 snap 22 seq_num 126) dirty exists 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:403: done (6 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:404: done (5 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:405: done (4 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:406: done (3 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:407: done (2 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:408: done (1 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:409: done (0 left) 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:410: write oid 3 current snap is 43 2026-02-13T18:07:16.697 INFO:tasks.rados.rados.0.trial187.stdout:410: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2026-02-13T18:07:16.700 INFO:tasks.rados.rados.0.trial187.stdout:410: writing trial18717860-3 from 524418 to 977510 tid 1 2026-02-13T18:07:16.705 INFO:tasks.rados.rados.0.trial187.stdout:410: writing trial18717860-3 from 1732455 to 2320834 tid 2 2026-02-13T18:07:16.708 INFO:tasks.rados.rados.0.trial187.stdout:410: writing trial18717860-3 from 2779130 to 2924418 tid 3 2026-02-13T18:07:16.708 INFO:tasks.rados.rados.0.trial187.stdout:411: read oid 38 snap -1 2026-02-13T18:07:16.708 INFO:tasks.rados.rados.0.trial187.stdout:411: expect (ObjNum 37 snap 0 seq_num 37) 2026-02-13T18:07:16.708 INFO:tasks.rados.rados.0.trial187.stdout:412: write oid 10 current snap is 43 2026-02-13T18:07:16.708 INFO:tasks.rados.rados.0.trial187.stdout:412: seq_num 175 ranges {541225=644694,1907290=448390} 2026-02-13T18:07:16.712 INFO:tasks.rados.rados.0.trial187.stdout:412: writing trial18717860-10 from 541225 to 1185919 tid 1 2026-02-13T18:07:16.717 INFO:tasks.rados.rados.0.trial187.stdout:412: writing trial18717860-10 from 1907290 to 2355680 tid 2 2026-02-13T18:07:16.717 INFO:tasks.rados.rados.0.trial187.stdout:413: write oid 31 current snap is 43 2026-02-13T18:07:16.717 INFO:tasks.rados.rados.0.trial187.stdout:413: seq_num 176 ranges {558032=719943,1849419=592048} 2026-02-13T18:07:16.722 INFO:tasks.rados.rados.0.trial187.stdout:413: writing trial18717860-31 from 558032 to 1277975 tid 1 2026-02-13T18:07:16.726 INFO:tasks.rados.rados.0.trial187.stdout:413: writing trial18717860-31 from 1849419 to 2441467 tid 2 2026-02-13T18:07:16.726 INFO:tasks.rados.rados.0.trial187.stdout:414: snap_remove snap 37 2026-02-13T18:07:17.699 INFO:tasks.rados.rados.0.trial187.stdout:414: done (4 left) 2026-02-13T18:07:17.700 INFO:tasks.rados.rados.0.trial187.stdout:415: snap_remove snap 40 2026-02-13T18:07:18.690 INFO:tasks.rados.rados.0.trial187.stdout:415: done (4 left) 2026-02-13T18:07:18.690 INFO:tasks.rados.rados.0.trial187.stdout:416: read oid 29 snap -1 2026-02-13T18:07:18.690 INFO:tasks.rados.rados.0.trial187.stdout:416: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:18.690 INFO:tasks.rados.rados.0.trial187.stdout:417: snap_remove snap 36 2026-02-13T18:07:19.691 INFO:tasks.rados.rados.0.trial187.stdout:417: done (5 left) 2026-02-13T18:07:19.691 INFO:tasks.rados.rados.0.trial187.stdout:418: read oid 22 snap -1 2026-02-13T18:07:19.691 INFO:tasks.rados.rados.0.trial187.stdout:418: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T18:07:19.691 INFO:tasks.rados.rados.0.trial187.stdout:419: copy_from oid 50 from oid 2 current snap is 43 2026-02-13T18:07:19.691 INFO:tasks.rados.rados.0.trial187.stdout:410: finishing write tid 1 to trial18717860-3 2026-02-13T18:07:19.691 INFO:tasks.rados.rados.0.trial187.stdout:410: finishing write tid 2 to trial18717860-3 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: finishing write tid 3 to trial18717860-3 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: finishing write tid 4 to trial18717860-3 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: finishing write tid 5 to trial18717860-3 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: oid 3 updating version 0 to 151 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: oid 3 version 151 is already newer than 150 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: oid 3 updating version 151 to 152 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: oid 3 version 152 is already newer than 149 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 152 (ObjNum 174 snap 43 seq_num 174) dirty exists 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:410: left oid 3 (ObjNum 174 snap 43 seq_num 174) 2026-02-13T18:07:19.692 INFO:tasks.rados.rados.0.trial187.stdout:411: expect (ObjNum 37 snap 0 seq_num 37) 2026-02-13T18:07:19.738 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2090246 2026-02-13T18:07:19.761 INFO:tasks.rados.rados.0.trial187.stdout:412: finishing write tid 1 to trial18717860-10 2026-02-13T18:07:19.761 INFO:tasks.rados.rados.0.trial187.stdout:412: finishing write tid 2 to trial18717860-10 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:412: finishing write tid 3 to trial18717860-10 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:412: finishing write tid 4 to trial18717860-10 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:412: oid 10 updating version 0 to 69 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:412: oid 10 updating version 69 to 71 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:412: oid 10 version 71 is already newer than 70 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 71 (ObjNum 175 snap 43 seq_num 175) dirty exists 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:412: left oid 10 (ObjNum 175 snap 43 seq_num 175) 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:413: finishing write tid 1 to trial18717860-31 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:413: finishing write tid 2 to trial18717860-31 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:413: finishing write tid 3 to trial18717860-31 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:413: finishing write tid 4 to trial18717860-31 2026-02-13T18:07:19.762 INFO:tasks.rados.rados.0.trial187.stdout:413: oid 31 updating version 0 to 93 2026-02-13T18:07:19.763 INFO:tasks.rados.rados.0.trial187.stdout:413: oid 31 updating version 93 to 94 2026-02-13T18:07:19.763 INFO:tasks.rados.rados.0.trial187.stdout:413: oid 31 version 94 is already newer than 92 2026-02-13T18:07:19.763 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 94 (ObjNum 176 snap 43 seq_num 176) dirty exists 2026-02-13T18:07:19.763 INFO:tasks.rados.rados.0.trial187.stdout:413: left oid 31 (ObjNum 176 snap 43 seq_num 176) 2026-02-13T18:07:19.763 INFO:tasks.rados.rados.0.trial187.stdout:416: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:19.763 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 184175 2026-02-13T18:07:19.825 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 793189 2026-02-13T18:07:19.847 INFO:tasks.rados.rados.0.trial187.stdout:419: finishing copy_from to trial18717860-50 2026-02-13T18:07:19.848 INFO:tasks.rados.rados.0.trial187.stdout:419: got expected ENOENT (src dne) 2026-02-13T18:07:19.848 INFO:tasks.rados.rados.0.trial187.stdout:419: finishing copy_from racing read to trial18717860-50 2026-02-13T18:07:19.848 INFO:tasks.rados.rados.0.trial187.stdout:418: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T18:07:19.862 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:19.906 INFO:tasks.rados.rados.0.trial187.stdout:410: done (6 left) 2026-02-13T18:07:19.906 INFO:tasks.rados.rados.0.trial187.stdout:411: done (5 left) 2026-02-13T18:07:19.906 INFO:tasks.rados.rados.0.trial187.stdout:412: done (4 left) 2026-02-13T18:07:19.906 INFO:tasks.rados.rados.0.trial187.stdout:413: done (3 left) 2026-02-13T18:07:19.906 INFO:tasks.rados.rados.0.trial187.stdout:416: done (2 left) 2026-02-13T18:07:19.907 INFO:tasks.rados.rados.0.trial187.stdout:418: done (1 left) 2026-02-13T18:07:19.907 INFO:tasks.rados.rados.0.trial187.stdout:419: done (0 left) 2026-02-13T18:07:19.907 INFO:tasks.rados.rados.0.trial187.stdout:420: read oid 22 snap 42 2026-02-13T18:07:19.907 INFO:tasks.rados.rados.0.trial187.stdout:420: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T18:07:19.907 INFO:tasks.rados.rados.0.trial187.stdout:421: copy_from oid 6 from oid 50 current snap is 43 2026-02-13T18:07:19.907 INFO:tasks.rados.rados.0.trial187.stdout:422: snap_create 2026-02-13T18:07:19.908 INFO:tasks.rados.rados.0.trial187.stdout:420: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T18:07:19.979 INFO:tasks.rados.rados.0.trial187.stdout:421: finishing copy_from racing read to trial18717860-6 2026-02-13T18:07:19.979 INFO:tasks.rados.rados.0.trial187.stdout:421: finishing copy_from to trial18717860-6 2026-02-13T18:07:19.980 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 62 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:07:20.695 INFO:tasks.rados.rados.0.trial187.stdout:420: done (2 left) 2026-02-13T18:07:20.695 INFO:tasks.rados.rados.0.trial187.stdout:421: done (1 left) 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:422: done (0 left) 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:423: read oid 32 snap -1 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:423: expect deleted 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:424: copy_from oid 48 from oid 16 current snap is 44 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:425: copy_from oid 39 from oid 17 current snap is 44 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:426: read oid 12 snap -1 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:426: expect (ObjNum 150 snap 26 seq_num 150) 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:427: rollback oid 45 current snap is 44 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 32 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:428: read oid 27 snap -1 2026-02-13T18:07:20.696 INFO:tasks.rados.rados.0.trial187.stdout:428: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:20.697 INFO:tasks.rados.rados.0.trial187.stdout:429: write oid 24 current snap is 44 2026-02-13T18:07:20.697 INFO:tasks.rados.rados.0.trial187.stdout:429: seq_num 177 ranges {574839=795192,1907901=452059} 2026-02-13T18:07:20.703 INFO:tasks.rados.rados.0.trial187.stdout:429: writing trial18717860-24 from 574839 to 1370031 tid 1 2026-02-13T18:07:20.710 INFO:tasks.rados.rados.0.trial187.stdout:429: writing trial18717860-24 from 1907901 to 2359960 tid 2 2026-02-13T18:07:20.710 INFO:tasks.rados.rados.0.trial187.stdout:430: copy_from oid 22 from oid 29 current snap is 44 2026-02-13T18:07:20.711 INFO:tasks.rados.rados.0.trial187.stdout:428: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:20.721 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1598526 2026-02-13T18:07:20.748 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:20.779 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:20.806 INFO:tasks.rados.rados.0.trial187.stdout:426: expect (ObjNum 150 snap 26 seq_num 150) 2026-02-13T18:07:20.806 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 336966 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:427: finishing rollback tid 0 to trial18717860-45 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:427: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:427: finishing rollback tid 2 to trial18717860-45 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 86 (ObjNum 117 snap 18 seq_num 117) dirty exists 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:429: finishing write tid 1 to trial18717860-24 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:424: finishing copy_from racing read to trial18717860-48 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:425: finishing copy_from racing read to trial18717860-39 2026-02-13T18:07:20.924 INFO:tasks.rados.rados.0.trial187.stdout:424: finishing copy_from to trial18717860-48 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 56 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:425: finishing copy_from to trial18717860-39 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 125 (ObjNum 158 snap 27 seq_num 158) dirty exists 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:429: finishing write tid 2 to trial18717860-24 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:423: done (7 left) 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:424: done (6 left) 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:425: done (5 left) 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:426: done (4 left) 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:427: done (3 left) 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:428: done (2 left) 2026-02-13T18:07:20.925 INFO:tasks.rados.rados.0.trial187.stdout:431: snap_remove snap 42 2026-02-13T18:07:21.697 INFO:tasks.rados.rados.0.trial187.stdout:431: done (2 left) 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:432: copy_from oid 9 from oid 14 current snap is 44 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:429: finishing write tid 3 to trial18717860-24 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:429: finishing write tid 4 to trial18717860-24 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:429: oid 24 updating version 0 to 70 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:429: oid 24 updating version 70 to 71 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:429: oid 24 updating version 71 to 72 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 72 (ObjNum 177 snap 44 seq_num 177) dirty exists 2026-02-13T18:07:21.698 INFO:tasks.rados.rados.0.trial187.stdout:429: left oid 24 (ObjNum 177 snap 44 seq_num 177) 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:430: finishing copy_from racing read to trial18717860-22 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:430: finishing copy_from to trial18717860-22 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 60 (ObjNum 142 snap 26 seq_num 142) dirty exists 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:429: done (2 left) 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:430: done (1 left) 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:433: copy_from oid 40 from oid 50 current snap is 44 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:434: read oid 33 snap -1 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:434: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:435: read oid 41 snap 35 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:435: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:21.699 INFO:tasks.rados.rados.0.trial187.stdout:436: write (excl) oid 35 current snap is 44 2026-02-13T18:07:21.700 INFO:tasks.rados.rados.0.trial187.stdout:436: seq_num 178 ranges {591646=470441,1566383=595717,2888822=102824} 2026-02-13T18:07:21.704 INFO:tasks.rados.rados.0.trial187.stdout:436: writing trial18717860-35 from 591646 to 1062087 tid 1 2026-02-13T18:07:21.711 INFO:tasks.rados.rados.0.trial187.stdout:436: writing trial18717860-35 from 1566383 to 2162100 tid 2 2026-02-13T18:07:21.717 INFO:tasks.rados.rados.0.trial187.stdout:436: writing trial18717860-35 from 2888822 to 2991646 tid 3 2026-02-13T18:07:21.718 INFO:tasks.rados.rados.0.trial187.stdout:437: delete oid 1 current snap is 44 2026-02-13T18:07:21.718 INFO:tasks.rados.rados.0.trial187.stdout:435: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:21.718 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:21.820 INFO:tasks.rados.rados.0.trial187.stdout:432: finishing copy_from racing read to trial18717860-9 2026-02-13T18:07:21.820 INFO:tasks.rados.rados.0.trial187.stdout:432: finishing copy_from to trial18717860-9 2026-02-13T18:07:21.820 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 66 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:07:21.820 INFO:tasks.rados.rados.0.trial187.stdout:436: finishing write tid 1 to trial18717860-35 2026-02-13T18:07:21.821 INFO:tasks.rados.rados.0.trial187.stdout:434: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:21.909 INFO:tasks.rados.rados.0.trial187.stdout:436: finishing write tid 2 to trial18717860-35 2026-02-13T18:07:21.909 INFO:tasks.rados.rados.0.trial187.stdout:433: finishing copy_from racing read to trial18717860-40 2026-02-13T18:07:21.909 INFO:tasks.rados.rados.0.trial187.stdout:432: done (5 left) 2026-02-13T18:07:21.909 INFO:tasks.rados.rados.0.trial187.stdout:434: done (4 left) 2026-02-13T18:07:21.909 INFO:tasks.rados.rados.0.trial187.stdout:435: done (3 left) 2026-02-13T18:07:21.910 INFO:tasks.rados.rados.0.trial187.stdout:437: done (2 left) 2026-02-13T18:07:21.910 INFO:tasks.rados.rados.0.trial187.stdout:438: write oid 20 current snap is 44 2026-02-13T18:07:21.910 INFO:tasks.rados.rados.0.trial187.stdout:438: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2026-02-13T18:07:21.917 INFO:tasks.rados.rados.0.trial187.stdout:438: writing trial18717860-20 from 625260 to 1246199 tid 1 2026-02-13T18:07:21.924 INFO:tasks.rados.rados.0.trial187.stdout:438: writing trial18717860-20 from 1683347 to 2282733 tid 2 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:438: writing trial18717860-20 from 2943668 to 3025260 tid 3 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:439: read oid 29 snap -1 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:439: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:440: copy_from oid 27 from oid 42 current snap is 44 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:433: finishing copy_from to trial18717860-40 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 62 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:436: finishing write tid 3 to trial18717860-35 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:436: finishing write tid 4 to trial18717860-35 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:436: finishing write tid 5 to trial18717860-35 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:436: oid 35 updating version 0 to 71 2026-02-13T18:07:21.931 INFO:tasks.rados.rados.0.trial187.stdout:436: oid 35 updating version 71 to 73 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:436: oid 35 version 73 is already newer than 72 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:436: oid 35 updating version 73 to 74 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 74 (ObjNum 178 snap 44 seq_num 178) dirty exists 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:436: left oid 35 (ObjNum 178 snap 44 seq_num 178) 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:438: finishing write tid 1 to trial18717860-20 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:433: done (4 left) 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:436: done (3 left) 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:441: read oid 36 snap -1 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:441: expect (ObjNum 166 snap 39 seq_num 166) 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:442: write (excl) oid 19 current snap is 44 2026-02-13T18:07:21.932 INFO:tasks.rados.rados.0.trial187.stdout:442: seq_num 181 ranges {642067=696188,2025476=459397,2971091=70976} 2026-02-13T18:07:21.939 INFO:tasks.rados.rados.0.trial187.stdout:442: writing trial18717860-19 from 642067 to 1338255 tid 1 2026-02-13T18:07:21.947 INFO:tasks.rados.rados.0.trial187.stdout:442: writing trial18717860-19 from 2025476 to 2484873 tid 2 2026-02-13T18:07:21.951 INFO:tasks.rados.rados.0.trial187.stdout:442: writing trial18717860-19 from 2971091 to 3042067 tid 3 2026-02-13T18:07:21.951 INFO:tasks.rados.rados.0.trial187.stdout:443: write (excl) oid 1 current snap is 44 2026-02-13T18:07:21.951 INFO:tasks.rados.rados.0.trial187.stdout:440: finishing copy_from to trial18717860-27 2026-02-13T18:07:21.951 INFO:tasks.rados.rados.0.trial187.stdout:440: got expected ENOENT (src dne) 2026-02-13T18:07:21.951 INFO:tasks.rados.rados.0.trial187.stdout:440: finishing copy_from racing read to trial18717860-27 2026-02-13T18:07:21.951 INFO:tasks.rados.rados.0.trial187.stdout:443: seq_num 182 ranges {658874=771437,2083958=603055} 2026-02-13T18:07:21.961 INFO:tasks.rados.rados.0.trial187.stdout:443: writing trial18717860-1 from 658874 to 1430311 tid 1 2026-02-13T18:07:21.969 INFO:tasks.rados.rados.0.trial187.stdout:443: writing trial18717860-1 from 2083958 to 2687013 tid 2 2026-02-13T18:07:21.969 INFO:tasks.rados.rados.0.trial187.stdout:440: done (5 left) 2026-02-13T18:07:21.969 INFO:tasks.rados.rados.0.trial187.stdout:444: snap_create 2026-02-13T18:07:21.969 INFO:tasks.rados.rados.0.trial187.stdout:439: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:21.969 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:22.069 INFO:tasks.rados.rados.0.trial187.stdout:438: finishing write tid 2 to trial18717860-20 2026-02-13T18:07:22.069 INFO:tasks.rados.rados.0.trial187.stdout:438: finishing write tid 3 to trial18717860-20 2026-02-13T18:07:22.069 INFO:tasks.rados.rados.0.trial187.stdout:438: finishing write tid 4 to trial18717860-20 2026-02-13T18:07:22.069 INFO:tasks.rados.rados.0.trial187.stdout:438: finishing write tid 5 to trial18717860-20 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:438: oid 20 updating version 0 to 78 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:438: oid 20 updating version 78 to 80 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:438: oid 20 version 80 is already newer than 77 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:438: oid 20 version 80 is already newer than 79 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 80 (ObjNum 180 snap 44 seq_num 180) dirty exists 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:438: left oid 20 (ObjNum 180 snap 44 seq_num 180) 2026-02-13T18:07:22.070 INFO:tasks.rados.rados.0.trial187.stdout:441: expect (ObjNum 166 snap 39 seq_num 166) 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: finishing write tid 1 to trial18717860-19 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: finishing write tid 2 to trial18717860-19 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: finishing write tid 3 to trial18717860-19 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: finishing write tid 4 to trial18717860-19 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: finishing write tid 5 to trial18717860-19 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: oid 19 updating version 0 to 90 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: oid 19 version 90 is already newer than 89 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: oid 19 updating version 90 to 92 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: oid 19 version 92 is already newer than 91 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 92 (ObjNum 181 snap 44 seq_num 181) dirty exists 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:442: left oid 19 (ObjNum 181 snap 44 seq_num 181) 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:443: finishing write tid 1 to trial18717860-1 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:443: finishing write tid 2 to trial18717860-1 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:443: finishing write tid 3 to trial18717860-1 2026-02-13T18:07:22.170 INFO:tasks.rados.rados.0.trial187.stdout:443: finishing write tid 4 to trial18717860-1 2026-02-13T18:07:22.171 INFO:tasks.rados.rados.0.trial187.stdout:443: oid 1 updating version 0 to 93 2026-02-13T18:07:22.171 INFO:tasks.rados.rados.0.trial187.stdout:443: oid 1 updating version 93 to 94 2026-02-13T18:07:22.171 INFO:tasks.rados.rados.0.trial187.stdout:443: oid 1 updating version 94 to 95 2026-02-13T18:07:22.171 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 95 (ObjNum 182 snap 44 seq_num 182) dirty exists 2026-02-13T18:07:22.171 INFO:tasks.rados.rados.0.trial187.stdout:443: left oid 1 (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:07:22.713 INFO:tasks.rados.rados.0.trial187.stdout:438: done (5 left) 2026-02-13T18:07:22.713 INFO:tasks.rados.rados.0.trial187.stdout:439: done (4 left) 2026-02-13T18:07:22.713 INFO:tasks.rados.rados.0.trial187.stdout:441: done (3 left) 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:442: done (2 left) 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:443: done (1 left) 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:444: done (0 left) 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:445: copy_from oid 43 from oid 1 current snap is 45 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:446: rollback oid 26 current snap is 45 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 35 2026-02-13T18:07:22.714 INFO:tasks.rados.rados.0.trial187.stdout:447: snap_remove snap 44 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:447: done (2 left) 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:448: rollback oid 4 current snap is 45 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 32 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:446: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:446: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:446: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 170 (ObjNum 145 snap 26 seq_num 145) dirty exists 2026-02-13T18:07:23.692 INFO:tasks.rados.rados.0.trial187.stdout:445: finishing copy_from racing read to trial18717860-43 2026-02-13T18:07:23.693 INFO:tasks.rados.rados.0.trial187.stdout:445: finishing copy_from to trial18717860-43 2026-02-13T18:07:23.693 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 95 (ObjNum 182 snap 44 seq_num 182) dirty exists 2026-02-13T18:07:23.693 INFO:tasks.rados.rados.0.trial187.stdout:445: done (2 left) 2026-02-13T18:07:23.693 INFO:tasks.rados.rados.0.trial187.stdout:446: done (1 left) 2026-02-13T18:07:23.693 INFO:tasks.rados.rados.0.trial187.stdout:449: write (excl) oid 21 current snap is 45 2026-02-13T18:07:23.693 INFO:tasks.rados.rados.0.trial187.stdout:449: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2026-02-13T18:07:23.699 INFO:tasks.rados.rados.0.trial187.stdout:449: writing trial18717860-21 from 675681 to 1238720 tid 1 2026-02-13T18:07:23.709 INFO:tasks.rados.rados.0.trial187.stdout:449: writing trial18717860-21 from 1858793 to 2605506 tid 2 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:449: writing trial18717860-21 from 3025937 to 3075681 tid 3 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:450: read oid 27 snap -1 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:450: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:448: finishing rollback tid 0 to trial18717860-4 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:448: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:448: finishing rollback tid 2 to trial18717860-4 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 106 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:449: finishing write tid 1 to trial18717860-21 2026-02-13T18:07:23.713 INFO:tasks.rados.rados.0.trial187.stdout:449: finishing write tid 2 to trial18717860-21 2026-02-13T18:07:23.714 INFO:tasks.rados.rados.0.trial187.stdout:448: done (2 left) 2026-02-13T18:07:23.714 INFO:tasks.rados.rados.0.trial187.stdout:451: write oid 8 current snap is 45 2026-02-13T18:07:23.714 INFO:tasks.rados.rados.0.trial187.stdout:451: seq_num 184 ranges {692488=638288,1917275=606724} 2026-02-13T18:07:23.721 INFO:tasks.rados.rados.0.trial187.stdout:451: writing trial18717860-8 from 692488 to 1330776 tid 1 2026-02-13T18:07:23.730 INFO:tasks.rados.rados.0.trial187.stdout:451: writing trial18717860-8 from 1917275 to 2523999 tid 2 2026-02-13T18:07:23.730 INFO:tasks.rados.rados.0.trial187.stdout:452: copy_from oid 18 from oid 11 current snap is 45 2026-02-13T18:07:23.730 INFO:tasks.rados.rados.0.trial187.stdout:449: finishing write tid 3 to trial18717860-21 2026-02-13T18:07:23.730 INFO:tasks.rados.rados.0.trial187.stdout:449: finishing write tid 4 to trial18717860-21 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:449: finishing write tid 5 to trial18717860-21 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:449: oid 21 updating version 0 to 75 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:449: oid 21 updating version 75 to 76 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:449: oid 21 updating version 76 to 77 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:449: oid 21 version 77 is already newer than 74 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 77 (ObjNum 183 snap 45 seq_num 183) dirty exists 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:449: left oid 21 (ObjNum 183 snap 45 seq_num 183) 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:450: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:23.731 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 231802 2026-02-13T18:07:23.755 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:23.782 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:23.809 INFO:tasks.rados.rados.0.trial187.stdout:451: finishing write tid 1 to trial18717860-8 2026-02-13T18:07:23.809 INFO:tasks.rados.rados.0.trial187.stdout:452: finishing copy_from to trial18717860-18 2026-02-13T18:07:23.809 INFO:tasks.rados.rados.0.trial187.stdout:452: got expected ENOENT (src dne) 2026-02-13T18:07:23.809 INFO:tasks.rados.rados.0.trial187.stdout:452: finishing copy_from racing read to trial18717860-18 2026-02-13T18:07:23.809 INFO:tasks.rados.rados.0.trial187.stdout:449: done (3 left) 2026-02-13T18:07:23.809 INFO:tasks.rados.rados.0.trial187.stdout:450: done (2 left) 2026-02-13T18:07:23.810 INFO:tasks.rados.rados.0.trial187.stdout:452: done (1 left) 2026-02-13T18:07:23.810 INFO:tasks.rados.rados.0.trial187.stdout:453: read oid 27 snap -1 2026-02-13T18:07:23.810 INFO:tasks.rados.rados.0.trial187.stdout:453: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:23.810 INFO:tasks.rados.rados.0.trial187.stdout:454: write oid 26 current snap is 45 2026-02-13T18:07:23.810 INFO:tasks.rados.rados.0.trial187.stdout:454: seq_num 185 ranges {709295=713537,1859404=750382} 2026-02-13T18:07:23.818 INFO:tasks.rados.rados.0.trial187.stdout:454: writing trial18717860-26 from 709295 to 1422832 tid 1 2026-02-13T18:07:23.827 INFO:tasks.rados.rados.0.trial187.stdout:454: writing trial18717860-26 from 1859404 to 2609786 tid 2 2026-02-13T18:07:23.827 INFO:tasks.rados.rados.0.trial187.stdout:455: read oid 6 snap -1 2026-02-13T18:07:23.827 INFO:tasks.rados.rados.0.trial187.stdout:455: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:23.827 INFO:tasks.rados.rados.0.trial187.stdout:456: snap_create 2026-02-13T18:07:23.827 INFO:tasks.rados.rados.0.trial187.stdout:451: finishing write tid 2 to trial18717860-8 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:451: finishing write tid 3 to trial18717860-8 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:451: finishing write tid 4 to trial18717860-8 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:451: oid 8 updating version 0 to 43 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:451: oid 8 version 43 is already newer than 42 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:451: oid 8 updating version 43 to 44 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 44 (ObjNum 184 snap 45 seq_num 184) dirty exists 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:451: left oid 8 (ObjNum 184 snap 45 seq_num 184) 2026-02-13T18:07:23.828 INFO:tasks.rados.rados.0.trial187.stdout:453: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:23.831 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 524587 2026-02-13T18:07:23.886 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1995134 2026-02-13T18:07:23.894 INFO:tasks.rados.rados.0.trial187.stdout:454: finishing write tid 1 to trial18717860-26 2026-02-13T18:07:23.894 INFO:tasks.rados.rados.0.trial187.stdout:454: finishing write tid 2 to trial18717860-26 2026-02-13T18:07:23.894 INFO:tasks.rados.rados.0.trial187.stdout:454: finishing write tid 3 to trial18717860-26 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:454: finishing write tid 4 to trial18717860-26 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:454: oid 26 updating version 0 to 174 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:454: oid 26 updating version 174 to 175 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:454: oid 26 version 175 is already newer than 171 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 175 (ObjNum 185 snap 45 seq_num 185) dirty exists 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:454: left oid 26 (ObjNum 185 snap 45 seq_num 185) 2026-02-13T18:07:23.895 INFO:tasks.rados.rados.0.trial187.stdout:455: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:23.941 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1295720 2026-02-13T18:07:24.040 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:07:24.040 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:07:24.040 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T18:07:24.040 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T18:07:24.042 INFO:tasks.ceph.mon.a:Started 2026-02-13T18:07:24.042 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:07:24.043 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:07:24.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient: get_monmap_and_config 2026-02-13T18:07:24.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient: monmap: 2026-02-13T18:07:24.102 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.102 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.102 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:24.095001+0000 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:24.095001+0000 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:24.103 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 1 Processor -- start 2026-02-13T18:07:24.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 1 -- start start 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient: init 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient(hunting): picked mon.noname-c con 0x7f9b5808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient(hunting): picked mon.noname-a con 0x7f9b5808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient(hunting): picked mon.noname-b con 0x7f9b5808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58089e80 con 0x7f9b5808dc80 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58088c20 con 0x7f9b5808c2f0 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58089ba0 con 0x7f9b5808cdd0 2026-02-13T18:07:24.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b5d92a640 10 monclient(hunting): authenticate will time out at 675.150144s 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b567fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9b5808dc80 0x7f9b58181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35020/0 (socket says 10.20.193.78:35020) 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b567fc640 1 -- 10.20.193.78:0/834774451 learned_addr learned my addr 10.20.193.78:0/834774451 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.092+0000 7f9b577fe640 1 --1- 10.20.193.78:0/834774451 >> v1:10.20.193.78:6790/0 conn(0x7f9b5808cdd0 0x7f9b581a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38654/0 (socket says 10.20.193.78:38654) 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b577fe640 1 -- 10.20.193.78:0/834774451 >> v1:10.20.193.78:6790/0 conn(0x7f9b5808cdd0 legacy=0x7f9b581a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b567fc640 1 -- 10.20.193.78:0/834774451 >> v1:10.20.193.78:6789/0 conn(0x7f9b5808dc80 legacy=0x7f9b58181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284453670 0 0) 0x7f9b58089ba0 con 0x7f9b5808cdd0 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient(hunting): my global_id is 4487 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b44003620 con 0x7f9b5808cdd0 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b56ffd640 1 -- 10.20.193.78:0/834774451 >> v1:10.20.193.187:6789/0 conn(0x7f9b5808c2f0 legacy=0x7f9b5808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 194125588 0 0) 0x7f9b44003620 con 0x7f9b5808cdd0 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 >> v1:10.20.193.187:6789/0 conn(0x7f9b5808c2f0 legacy=0x7f9b5808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 >> v1:10.20.193.78:6789/0 conn(0x7f9b5808dc80 legacy=0x7f9b58181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 monclient: found mon.noname-b 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5808d370 con 0x7f9b5808cdd0 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b48004620 con 0x7f9b5808cdd0 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: dump: 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.111 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 5 monclient: authenticate success, global_id 4487 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b480048f0 con 0x7f9b5808cdd0 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 1 -- 10.20.193.78:0/834774451 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b48005fa0 con 0x7f9b5808cdd0 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b55ffb640 10 monclient: dump: 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.112 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 4 set_mon_vals no callback set 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: shutdown 2026-02-13T18:07:24.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- 10.20.193.78:0/834774451 >> v1:10.20.193.78:6790/0 conn(0x7f9b5808cdd0 legacy=0x7f9b581a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- 10.20.193.78:0/834774451 shutdown_connections 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- 10.20.193.78:0/834774451 >> 10.20.193.78:0/834774451 conn(0x7f9b58091720 msgr2=0x7f9b58091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- 10.20.193.78:0/834774451 shutdown_connections 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- 10.20.193.78:0/834774451 wait complete. 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: monmap: 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.114 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 Processor -- start 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- start start 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: init 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient(hunting): picked mon.noname-c con 0x7f9b5808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient(hunting): picked mon.noname-b con 0x7f9b5808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient(hunting): picked mon.noname-a con 0x7f9b5808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58085af0 con 0x7f9b5808dc80 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58088910 con 0x7f9b5808cdd0 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b581537b0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b5d92a640 10 monclient(hunting): authenticate will time out at 675.154046s 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b577fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9b5808dc80 0x7f9b58195b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35032/0 (socket says 10.20.193.78:35032) 2026-02-13T18:07:24.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.096+0000 7f9b577fe640 1 -- 10.20.193.78:0/445794155 learned_addr learned my addr 10.20.193.78:0/445794155 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b577fe640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.78:6789/0 conn(0x7f9b5808dc80 legacy=0x7f9b58195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b56ffd640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.78:6790/0 conn(0x7f9b5808c2f0 legacy=0x7f9b58083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b567fc640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.187:6789/0 conn(0x7f9b5808cdd0 legacy=0x7f9b58194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858559818 0 0) 0x7f9b581537b0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): my global_id is 4490 2026-02-13T18:07:24.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28003620 con 0x7f9b5808c2f0 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1464409742 0 0) 0x7f9b28003620 con 0x7f9b5808c2f0 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b581537b0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b4c003380 con 0x7f9b5808c2f0 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): dump: 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.120 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1080474795 0 0) 0x7f9b581537b0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.187:6789/0 conn(0x7f9b5808cdd0 legacy=0x7f9b58194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.78:6789/0 conn(0x7f9b5808dc80 legacy=0x7f9b58195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 monclient: found mon.c 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580800d0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 5 monclient: authenticate success, global_id 4490 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 monclient: _renew_subs 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b58081b90 con 0x7f9b5808c2f0 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 monclient: _renew_subs 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b58084070 con 0x7f9b5808c2f0 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.100+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b5808f5e0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b4c0039c0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b4c003d60 con 0x7f9b5808c2f0 2026-02-13T18:07:24.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 10 monclient: dump: 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b557fa640 4 set_mon_vals no callback set 2026-02-13T18:07:24.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9b4c004000 con 0x7f9b5808c2f0 2026-02-13T18:07:24.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(110..110 src has 1..110) ==== 3987+0+0 (unknown 1583590671 0 0) 0x7f9b4c04c6c0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.124+0000 7f9b567fc640 10 monclient: get_auth_request con 0x7f9b2803d450 auth_method 0 2026-02-13T18:07:24.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.128+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f9b4c017620 con 0x7f9b5808c2f0 2026-02-13T18:07:24.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.128+0000 7f9b2ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.128+0000 7f9b2ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:24.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:07:24.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:24.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b58081fe0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b2ffff640 1 -- 10.20.193.78:0/445794155 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1603 (unknown 254746657 0 2557369025) 0x7f9b58081fe0 con 0x7f9b5808c2f0 2026-02-13T18:07:24.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b2ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:24.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b2ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:24.252 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:07:24.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9b2803d450 legacy=0x7f9b2805d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 10 monclient: shutdown 2026-02-13T18:07:24.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 >> v1:10.20.193.78:6790/0 conn(0x7f9b5808c2f0 legacy=0x7f9b58083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 shutdown_connections 2026-02-13T18:07:24.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 >> 10.20.193.78:0/445794155 conn(0x7f9b58091720 msgr2=0x7f9b5805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 shutdown_connections 2026-02-13T18:07:24.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.240+0000 7f9b5d92a640 1 -- 10.20.193.78:0/445794155 wait complete. 2026-02-13T18:07:24.262 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:07:24.262 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:07:24.262 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.320+0000 7f8883d00640 10 monclient: get_monmap_and_config 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.320+0000 7f8883d00640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.320+0000 7f8883d00640 10 monclient: monmap: 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:24.324889+0000 2026-02-13T18:07:24.332 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:24.324889+0000 2026-02-13T18:07:24.333 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.333 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.333 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.333 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:24.333 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.320+0000 7f8883d00640 1 Processor -- start 2026-02-13T18:07:24.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.320+0000 7f8883d00640 1 -- start start 2026-02-13T18:07:24.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.320+0000 7f8883d00640 10 monclient: init 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient(hunting): picked mon.noname-b con 0x7f887c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient(hunting): picked mon.noname-a con 0x7f887c05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient(hunting): picked mon.noname-c con 0x7f887c1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c095530 con 0x7f887c05e4b0 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c140390 con 0x7f887c1853c0 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c05d230 con 0x7f887c13f8b0 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient(hunting): authenticate will time out at 675.380340s 2026-02-13T18:07:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8881274640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f887c05e4b0 0x7f887c183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35034/0 (socket says 10.20.193.78:35034) 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8881274640 1 -- 10.20.193.78:0/2122878659 learned_addr learned my addr 10.20.193.78:0/2122878659 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8881a75640 1 --1- 10.20.193.78:0/2122878659 >> v1:10.20.193.78:6790/0 conn(0x7f887c13f8b0 0x7f887c13fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38670/0 (socket says 10.20.193.78:38670) 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8881274640 1 -- 10.20.193.78:0/2122878659 >> v1:10.20.193.78:6789/0 conn(0x7f887c05e4b0 legacy=0x7f887c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8881a75640 1 -- 10.20.193.78:0/2122878659 >> v1:10.20.193.78:6790/0 conn(0x7f887c13f8b0 legacy=0x7f887c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832041399 0 0) 0x7f887c05d230 con 0x7f887c13f8b0 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient(hunting): my global_id is 4493 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8864003620 con 0x7f887c13f8b0 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8882276640 1 -- 10.20.193.78:0/2122878659 >> v1:10.20.193.187:6789/0 conn(0x7f887c1853c0 legacy=0x7f887c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3528628350 0 0) 0x7f8864003620 con 0x7f887c13f8b0 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 >> v1:10.20.193.187:6789/0 conn(0x7f887c1853c0 legacy=0x7f887c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 >> v1:10.20.193.78:6789/0 conn(0x7f887c05e4b0 legacy=0x7f887c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 monclient: found mon.noname-b 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c05d510 con 0x7f887c13f8b0 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f886c003110 con 0x7f887c13f8b0 2026-02-13T18:07:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: dump: 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.342 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 5 monclient: authenticate success, global_id 4493 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f886c0033e0 con 0x7f887c13f8b0 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 1 -- 10.20.193.78:0/2122878659 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f886c004a90 con 0x7f887c13f8b0 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8880a73640 10 monclient: dump: 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.343 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 4 set_mon_vals no callback set 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient: shutdown 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- 10.20.193.78:0/2122878659 >> v1:10.20.193.78:6790/0 conn(0x7f887c13f8b0 legacy=0x7f887c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- 10.20.193.78:0/2122878659 shutdown_connections 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- 10.20.193.78:0/2122878659 >> 10.20.193.78:0/2122878659 conn(0x7f887c0545d0 msgr2=0x7f887c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- 10.20.193.78:0/2122878659 shutdown_connections 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 1 -- 10.20.193.78:0/2122878659 wait complete. 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.324+0000 7f8883d00640 10 monclient: monmap: 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:24.345 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 Processor -- start 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 -- start start 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: init 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient(hunting): picked mon.noname-c con 0x7f887c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient(hunting): picked mon.noname-a con 0x7f887c13f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient(hunting): picked mon.noname-b con 0x7f887c1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c10f790 con 0x7f887c13f8b0 2026-02-13T18:07:24.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c111250 con 0x7f887c1853c0 2026-02-13T18:07:24.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c10fd60 con 0x7f887c05e4b0 2026-02-13T18:07:24.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient(hunting): authenticate will time out at 675.384454s 2026-02-13T18:07:24.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8881274640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f887c13f8b0 0x7f887c180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35046/0 (socket says 10.20.193.78:35046) 2026-02-13T18:07:24.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8881274640 1 -- 10.20.193.78:0/1247737696 learned_addr learned my addr 10.20.193.78:0/1247737696 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8881274640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c13f8b0 legacy=0x7f887c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8881a75640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6790/0 conn(0x7f887c05e4b0 legacy=0x7f887c13ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8882276640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.187:6789/0 conn(0x7f887c1853c0 legacy=0x7f887c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996375677 0 0) 0x7f887c10f790 con 0x7f887c13f8b0 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): my global_id is 54099 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f884c003620 con 0x7f887c13f8b0 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254183421 0 0) 0x7f887c10fd60 con 0x7f887c05e4b0 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): my global_id is 4496 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f887c10f790 con 0x7f887c05e4b0 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646977336 0 0) 0x7f887c111250 con 0x7f887c1853c0 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): my global_id is 4507 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f887c10fd60 con 0x7f887c1853c0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3838892962 0 0) 0x7f884c003620 con 0x7f887c13f8b0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f887c111250 con 0x7f887c13f8b0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3775330810 0 0) 0x7f887c10f790 con 0x7f887c05e4b0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884c003620 con 0x7f887c05e4b0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8870003290 con 0x7f887c13f8b0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): dump: 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.356 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f886c002b70 con 0x7f887c05e4b0 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): dump: 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 625769973 0 0) 0x7f887c10fd60 con 0x7f887c1853c0 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f887c10f790 con 0x7f887c1853c0 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8878004850 con 0x7f887c1853c0 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient(hunting): dump: 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.359 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2147417395 0 0) 0x7f887c111250 con 0x7f887c13f8b0 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6790/0 conn(0x7f887c05e4b0 legacy=0x7f887c13ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.187:6789/0 conn(0x7f887c1853c0 legacy=0x7f887c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 monclient: found mon.a 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c1120c0 con 0x7f887c13f8b0 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 5 monclient: authenticate success, global_id 54099 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: _renew_subs 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f887c13f2e0 con 0x7f887c13f8b0 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: _renew_subs 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f887c110a90 con 0x7f887c13f8b0 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8870003560 con 0x7f887c13f8b0 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8870004d40 con 0x7f887c13f8b0 2026-02-13T18:07:24.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886bfff640 4 set_mon_vals no callback set 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f886a7fc640 10 monclient: dump: 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.362 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.328+0000 7f8883d00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f887c1a6e40 con 0x7f887c12d690 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f8870004fd0 con 0x7f887c13f8b0 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3987+0+0 (unknown 1583590671 0 0) 0x7f887004c670 con 0x7f887c13f8b0 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f8882276640 10 monclient: get_auth_request con 0x7f884c03d910 auth_method 0 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f8881a75640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c12d690 legacy=0x7f887c08d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 562772350 0 0) 0x7f887c1a6e40 con 0x7f887c12d690 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient(hunting): my global_id is 54102 2026-02-13T18:07:24.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f887c111250 con 0x7f887c12d690 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 363696092 0 0) 0x7f887c111250 con 0x7f887c12d690 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f887c1a6e40 con 0x7f887c12d690 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f886c003560 con 0x7f887c12d690 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient: dump: 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.364 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2042656311 0 0) 0x7f887c1a6e40 con 0x7f887c12d690 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f887c12da60 con 0x7f887c12d690 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f886c007290 con 0x7f887c12d690 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c12d690 legacy=0x7f887c08d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.332+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c12d690 legacy=0x7f887c08d040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.336+0000 7f8883d00640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:24.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.336+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f887c051150 con 0x7f887c184ba0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8881a75640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c184ba0 legacy=0x7f887c08bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179765717 0 0) 0x7f887c051150 con 0x7f887c184ba0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient(hunting): my global_id is 54105 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f887c1a6e40 con 0x7f887c184ba0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 576717786 0 0) 0x7f887c1a6e40 con 0x7f887c184ba0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f887c051150 con 0x7f887c184ba0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f886c005790 con 0x7f887c184ba0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient: dump: 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1182493267 0 0) 0x7f887c051150 con 0x7f887c184ba0 2026-02-13T18:07:24.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f887c093020 con 0x7f887c184ba0 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4337 (unknown 0 0 1881295462) 0x7f886c006ad0 con 0x7f887c184ba0 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c184ba0 legacy=0x7f887c08bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f886a7fc640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c184ba0 legacy=0x7f887c08bec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:24.368 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 8, 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 267, 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:24.369 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.370 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.371 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:24.372 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.373 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:24.374 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:24.375 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.376 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.377 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.378 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:07:24.379 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.379 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.379 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.379 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:24.379 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.187:6812/2668687789 conn(0x7f884c03d910 legacy=0x7f884c05ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 10 monclient: shutdown 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 >> v1:10.20.193.78:6789/0 conn(0x7f887c13f8b0 legacy=0x7f887c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8882276640 1 -- 10.20.193.78:0/1247737696 reap_dead start 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8882276640 1 -- 10.20.193.78:0/1247737696 reap_dead start 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 shutdown_connections 2026-02-13T18:07:24.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 >> 10.20.193.78:0/1247737696 conn(0x7f887c0545d0 msgr2=0x7f887c0965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 shutdown_connections 2026-02-13T18:07:24.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.340+0000 7f8883d00640 1 -- 10.20.193.78:0/1247737696 wait complete. 2026-02-13T18:07:24.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:07:24.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:07:24.381 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:07:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient: get_monmap_and_config 2026-02-13T18:07:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient: monmap: 2026-02-13T18:07:24.452 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.452 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:24.443764+0000 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:24.443764+0000 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 1 Processor -- start 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 1 -- start start 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient: init 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient(hunting): picked mon.noname-c con 0x7f36d408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient(hunting): picked mon.noname-b con 0x7f36d408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient(hunting): picked mon.noname-a con 0x7f36d408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d4089e80 con 0x7f36d408cdd0 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d4088c20 con 0x7f36d408c2f0 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d4089ba0 con 0x7f36d408dc80 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d8fb3640 10 monclient(hunting): authenticate will time out at 675.499043s 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d1d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f36d408dc80 0x7f36d4181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38690/0 (socket says 10.20.193.78:38690) 2026-02-13T18:07:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.440+0000 7f36d1d74640 1 -- 10.20.193.78:0/2826010206 learned_addr learned my addr 10.20.193.78:0/2826010206 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1d74640 1 -- 10.20.193.78:0/2826010206 >> v1:10.20.193.78:6790/0 conn(0x7f36d408dc80 legacy=0x7f36d4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d2d76640 1 -- 10.20.193.78:0/2826010206 >> v1:10.20.193.78:6789/0 conn(0x7f36d408cdd0 legacy=0x7f36d41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d2575640 1 -- 10.20.193.78:0/2826010206 >> v1:10.20.193.187:6789/0 conn(0x7f36d408c2f0 legacy=0x7f36d408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907613598 0 0) 0x7f36d4089ba0 con 0x7f36d408dc80 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): my global_id is 4499 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c0003620 con 0x7f36d408dc80 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661394520 0 0) 0x7f36d4089e80 con 0x7f36d408cdd0 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): my global_id is 54108 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36d4089ba0 con 0x7f36d408cdd0 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762746827 0 0) 0x7f36d4088c20 con 0x7f36d408c2f0 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient(hunting): my global_id is 4510 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36d4089e80 con 0x7f36d408c2f0 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1466270818 0 0) 0x7f36d4089ba0 con 0x7f36d408cdd0 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 >> v1:10.20.193.78:6790/0 conn(0x7f36d408dc80 legacy=0x7f36d4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 >> v1:10.20.193.187:6789/0 conn(0x7f36d408c2f0 legacy=0x7f36d408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 monclient: found mon.noname-a 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d408d370 con 0x7f36d408cdd0 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 5 monclient: authenticate success, global_id 54108 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36c4004670 con 0x7f36d408cdd0 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: dump: 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.463 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d2d76640 1 --1- 10.20.193.78:0/2826010206 >> v1:10.20.193.78:6789/0 conn(0x7f36d408cdd0 0x7f36d41a3410 :-1 s=OPENED pgs=112 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f36c4004dd0 mon_map magic: 0 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36c4004940 con 0x7f36d408cdd0 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 4 set_mon_vals no callback set 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: shutdown 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2826010206 >> v1:10.20.193.78:6789/0 conn(0x7f36d408cdd0 legacy=0x7f36d41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 1 -- 10.20.193.78:0/2826010206 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36c4004dd0 con 0x7f36d408cdd0 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1573640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2826010206 shutdown_connections 2026-02-13T18:07:24.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2826010206 >> 10.20.193.78:0/2826010206 conn(0x7f36d4091720 msgr2=0x7f36d4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2826010206 shutdown_connections 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2826010206 wait complete. 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: monmap: 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:24.465 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 Processor -- start 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- start start 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: init 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient(hunting): picked mon.noname-b con 0x7f36d408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient(hunting): picked mon.noname-c con 0x7f36d408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient(hunting): picked mon.noname-a con 0x7f36d408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d408ea00 con 0x7f36d408dc80 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d40578e0 con 0x7f36d408c2f0 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d4088910 con 0x7f36d408cdd0 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d8fb3640 10 monclient(hunting): authenticate will time out at 675.502934s 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f36d408cdd0 0x7f36d4192440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38706/0 (socket says 10.20.193.78:38706) 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.444+0000 7f36d1d74640 1 -- 10.20.193.78:0/2193746619 learned_addr learned my addr 10.20.193.78:0/2193746619 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d1d74640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d408cdd0 legacy=0x7f36d4192440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d2d76640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6789/0 conn(0x7f36d408dc80 legacy=0x7f36d4193b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250674512 0 0) 0x7f36d4088910 con 0x7f36d408cdd0 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): my global_id is 4502 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a0003620 con 0x7f36d408cdd0 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125641688 0 0) 0x7f36d408ea00 con 0x7f36d408dc80 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): my global_id is 54111 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36d4088910 con 0x7f36d408dc80 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d2575640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.187:6789/0 conn(0x7f36d408c2f0 legacy=0x7f36d4083990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 435018425 0 0) 0x7f36a0003620 con 0x7f36d408cdd0 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36d408ea00 con 0x7f36d408cdd0 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36bc0033a0 con 0x7f36d408cdd0 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): dump: 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.468 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2320750381 0 0) 0x7f36d4088910 con 0x7f36d408dc80 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36a0003620 con 0x7f36d408dc80 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36c4004dd0 con 0x7f36d408dc80 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient(hunting): dump: 2026-02-13T18:07:24.469 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 360134369 0 0) 0x7f36d408ea00 con 0x7f36d408cdd0 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.187:6789/0 conn(0x7f36d408c2f0 legacy=0x7f36d4083990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6789/0 conn(0x7f36d408dc80 legacy=0x7f36d4193b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 monclient: found mon.c 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d4151790 con 0x7f36d408cdd0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 5 monclient: authenticate success, global_id 4502 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 10 monclient: _renew_subs 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36d4080440 con 0x7f36d408cdd0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 10 monclient: _renew_subs 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f36d407ec40 con 0x7f36d408cdd0 2026-02-13T18:07:24.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36bc004b90 con 0x7f36d408cdd0 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36bc004f20 con 0x7f36d408cdd0 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 10 monclient: dump: 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.472 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d0d72640 4 set_mon_vals no callback set 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f36d408f620 con 0x7f36d41510e0 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f36bc005100 con 0x7f36d408cdd0 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(110..110 src has 1..110) ==== 3987+0+0 (unknown 1583590671 0 0) 0x7f36bc04c750 con 0x7f36d408cdd0 2026-02-13T18:07:24.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.448+0000 7f36d2d76640 10 monclient: get_auth_request con 0x7f36a003d640 auth_method 0 2026-02-13T18:07:24.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36d2575640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d41510e0 legacy=0x7f36d4059a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030221200 0 0) 0x7f36d40578e0 con 0x7f36d41510e0 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient(hunting): my global_id is 4505 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36d408ea00 con 0x7f36d41510e0 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2158322825 0 0) 0x7f36d408ea00 con 0x7f36d41510e0 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36d40578e0 con 0x7f36d41510e0 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36c8003260 con 0x7f36d41510e0 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient: dump: 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.476 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1633837112 0 0) 0x7f36d40578e0 con 0x7f36d41510e0 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36d41514b0 con 0x7f36d41510e0 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f36c80058c0 con 0x7f36d41510e0 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:24.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d41510e0 legacy=0x7f36d4059a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.452+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d41510e0 legacy=0x7f36d4059a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f36d4090810 con 0x7f36d405a190 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d2575640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d405a190 legacy=0x7f36d4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2505892628 0 0) 0x7f36d4090810 con 0x7f36d405a190 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient(hunting): my global_id is 4508 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36d40578e0 con 0x7f36d405a190 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3276485908 0 0) 0x7f36d40578e0 con 0x7f36d405a190 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36d4090810 con 0x7f36d405a190 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f36c8003ab0 con 0x7f36d405a190 2026-02-13T18:07:24.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient: dump: 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3644269110 0 0) 0x7f36d4090810 con 0x7f36d405a190 2026-02-13T18:07:24.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f36d40510e0 con 0x7f36d405a190 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 1990336726) 0x7f36c8005b10 con 0x7f36d405a190 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d405a190 legacy=0x7f36d4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36baffd640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d405a190 legacy=0x7f36d4196290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:07:24.480 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 8, 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 125847, 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.481 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.482 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:24.483 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.484 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:24.485 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:24.486 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.487 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.488 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:24.489 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:24.490 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.187:6812/2668687789 conn(0x7f36a003d640 legacy=0x7f36a005daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 10 monclient: shutdown 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 >> v1:10.20.193.78:6790/0 conn(0x7f36d408cdd0 legacy=0x7f36d4192440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d2d76640 1 -- 10.20.193.78:0/2193746619 reap_dead start 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d2d76640 1 -- 10.20.193.78:0/2193746619 reap_dead start 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 shutdown_connections 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 >> 10.20.193.78:0/2193746619 conn(0x7f36d4091720 msgr2=0x7f36d405ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 shutdown_connections 2026-02-13T18:07:24.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.456+0000 7f36d8fb3640 1 -- 10.20.193.78:0/2193746619 wait complete. 2026-02-13T18:07:24.492 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:07:24.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:07:24.492 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:07:24.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient: get_monmap_and_config 2026-02-13T18:07:24.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient: monmap: 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:24.547840+0000 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:24.547840+0000 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 1 Processor -- start 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 1 -- start start 2026-02-13T18:07:24.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient: init 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient(hunting): picked mon.noname-c con 0x7fb50c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient(hunting): picked mon.noname-a con 0x7fb50c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient(hunting): picked mon.noname-b con 0x7fb50c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c089e80 con 0x7fb50c08dc80 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c088c20 con 0x7fb50c08c2f0 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c089ba0 con 0x7fb50c08cdd0 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb5120d7640 10 monclient(hunting): authenticate will time out at 675.603007s 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb50bfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb50c08cdd0 0x7fb50c1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38740/0 (socket says 10.20.193.78:38740) 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb50bfff640 1 -- 10.20.193.78:0/2666707943 learned_addr learned my addr 10.20.193.78:0/2666707943 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.544+0000 7fb50affd640 1 --1- 10.20.193.78:0/2666707943 >> v1:10.20.193.78:6789/0 conn(0x7fb50c08dc80 0x7fb50c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35100/0 (socket says 10.20.193.78:35100) 2026-02-13T18:07:24.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50affd640 1 -- 10.20.193.78:0/2666707943 >> v1:10.20.193.78:6789/0 conn(0x7fb50c08dc80 legacy=0x7fb50c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50bfff640 1 -- 10.20.193.78:0/2666707943 >> v1:10.20.193.78:6790/0 conn(0x7fb50c08cdd0 legacy=0x7fb50c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716804452 0 0) 0x7fb50c089e80 con 0x7fb50c08dc80 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): my global_id is 54114 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f0003620 con 0x7fb50c08dc80 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50b7fe640 1 -- 10.20.193.78:0/2666707943 >> v1:10.20.193.187:6789/0 conn(0x7fb50c08c2f0 legacy=0x7fb50c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776681007 0 0) 0x7fb50c089ba0 con 0x7fb50c08cdd0 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient(hunting): my global_id is 4511 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50c089e80 con 0x7fb50c08cdd0 2026-02-13T18:07:24.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2434756701 0 0) 0x7fb4f0003620 con 0x7fb50c08dc80 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 >> v1:10.20.193.78:6790/0 conn(0x7fb50c08cdd0 legacy=0x7fb50c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 >> v1:10.20.193.187:6789/0 conn(0x7fb50c08c2f0 legacy=0x7fb50c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 monclient: found mon.noname-a 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c08d370 con 0x7fb50c08dc80 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 5 monclient: authenticate success, global_id 54114 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4fc003110 con 0x7fb50c08dc80 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: dump: 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.567 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4fc0033e0 con 0x7fb50c08dc80 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 1 -- 10.20.193.78:0/2666707943 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4fc004a90 con 0x7fb50c08dc80 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50a7fc640 10 monclient: dump: 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.568 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 4 set_mon_vals no callback set 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: shutdown 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- 10.20.193.78:0/2666707943 >> v1:10.20.193.78:6789/0 conn(0x7fb50c08dc80 legacy=0x7fb50c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- 10.20.193.78:0/2666707943 shutdown_connections 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- 10.20.193.78:0/2666707943 >> 10.20.193.78:0/2666707943 conn(0x7fb50c091720 msgr2=0x7fb50c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- 10.20.193.78:0/2666707943 shutdown_connections 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- 10.20.193.78:0/2666707943 wait complete. 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: monmap: 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 Processor -- start 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- start start 2026-02-13T18:07:24.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: init 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient(hunting): picked mon.noname-a con 0x7fb50c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient(hunting): picked mon.noname-c con 0x7fb50c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient(hunting): picked mon.noname-b con 0x7fb50c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c0822b0 con 0x7fb50c08c2f0 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c082590 con 0x7fb50c08dc80 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50c05dc70 con 0x7fb50c08cdd0 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb5120d7640 10 monclient(hunting): authenticate will time out at 675.606828s 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb50c08cdd0 0x7fb50c083aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38756/0 (socket says 10.20.193.78:38756) 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.548+0000 7fb50affd640 1 -- 10.20.193.78:0/4207690679 learned_addr learned my addr 10.20.193.78:0/4207690679 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb50affd640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.78:6790/0 conn(0x7fb50c08cdd0 legacy=0x7fb50c083aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb50b7fe640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.78:6789/0 conn(0x7fb50c08c2f0 legacy=0x7fb50c153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb50bfff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c08dc80 legacy=0x7fb50c195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392885992 0 0) 0x7fb50c0822b0 con 0x7fb50c08c2f0 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): my global_id is 54117 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4dc003620 con 0x7fb50c08c2f0 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158827869 0 0) 0x7fb50c05dc70 con 0x7fb50c08cdd0 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): my global_id is 4514 2026-02-13T18:07:24.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50c0822b0 con 0x7fb50c08cdd0 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3252450427 0 0) 0x7fb4dc003620 con 0x7fb50c08c2f0 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50c05dc70 con 0x7fb50c08c2f0 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4f8003380 con 0x7fb50c08c2f0 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): dump: 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.573 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235299169 0 0) 0x7fb50c082590 con 0x7fb50c08dc80 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): my global_id is 4519 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4dc003620 con 0x7fb50c08dc80 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 68930591 0 0) 0x7fb50c0822b0 con 0x7fb50c08cdd0 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50c082590 con 0x7fb50c08cdd0 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4fc002b70 con 0x7fb50c08cdd0 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient(hunting): dump: 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1359209998 0 0) 0x7fb50c05dc70 con 0x7fb50c08c2f0 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.78:6790/0 conn(0x7fb50c08cdd0 legacy=0x7fb50c083aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c08dc80 legacy=0x7fb50c195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 monclient: found mon.a 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c088910 con 0x7fb50c08c2f0 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 5 monclient: authenticate success, global_id 54117 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 10 monclient: _renew_subs 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c081fd0 con 0x7fb50c08c2f0 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 10 monclient: _renew_subs 2026-02-13T18:07:24.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb50c196cb0 con 0x7fb50c08c2f0 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4f80039c0 con 0x7fb50c08c2f0 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4f8003d20 con 0x7fb50c08c2f0 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb509ffb640 4 set_mon_vals no callback set 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 10 monclient: dump: 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.577 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb50c08f600 con 0x7fb50c05b550 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb4f8003ff0 con 0x7fb50c08c2f0 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3987+0+0 (unknown 1583590671 0 0) 0x7fb4f804c690 con 0x7fb50c08c2f0 2026-02-13T18:07:24.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.552+0000 7fb50bfff640 10 monclient: get_auth_request con 0x7fb4dc03d880 auth_method 0 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb50affd640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c05b550 legacy=0x7fb50c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717691150 0 0) 0x7fb50c08f600 con 0x7fb50c05b550 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient(hunting): my global_id is 4522 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50c05dc70 con 0x7fb50c05b550 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3231751463 0 0) 0x7fb50c05dc70 con 0x7fb50c05b550 2026-02-13T18:07:24.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50c08f600 con 0x7fb50c05b550 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4fc004fb0 con 0x7fb50c05b550 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient: dump: 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.582 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1042979686 0 0) 0x7fb50c08f600 con 0x7fb50c05b550 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb50c0574a0 con 0x7fb50c05b550 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb4fc005040 con 0x7fb50c05b550 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c05b550 legacy=0x7fb50c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.556+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c05b550 legacy=0x7fb50c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb5120d7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb50c090810 con 0x7fb50c05b920 2026-02-13T18:07:24.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb50affd640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c05b920 legacy=0x7fb50c198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907314631 0 0) 0x7fb50c090810 con 0x7fb50c05b920 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient(hunting): my global_id is 4525 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50c08f600 con 0x7fb50c05b920 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 257281956 0 0) 0x7fb50c08f600 con 0x7fb50c05b920 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50c090810 con 0x7fb50c05b920 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4fc0056e0 con 0x7fb50c05b920 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.560+0000 7fb4e7fff640 10 monclient: dump: 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.584 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1469986769 0 0) 0x7fb50c090810 con 0x7fb50c05b920 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb50c0510e0 con 0x7fb50c05b920 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4676 (unknown 0 0 2210599118) 0x7fb4fc005a00 con 0x7fb50c05b920 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c05b920 legacy=0x7fb50c198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb4e7fff640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6789/0 conn(0x7fb50c05b920 legacy=0x7fb50c198000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 8, 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 125927, 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:07:24.586 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.587 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.588 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:24.589 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:24.590 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.591 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.592 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:24.593 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.594 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:24.595 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:24.596 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:24.596 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:24.596 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:24.596 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb4dc03d880 legacy=0x7fb4dc05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 10 monclient: shutdown 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 >> v1:10.20.193.78:6789/0 conn(0x7fb50c08c2f0 legacy=0x7fb50c153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb50bfff640 1 -- 10.20.193.78:0/4207690679 reap_dead start 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb50bfff640 1 -- 10.20.193.78:0/4207690679 reap_dead start 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 shutdown_connections 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 >> 10.20.193.78:0/4207690679 conn(0x7fb50c091720 msgr2=0x7fb50c058cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 shutdown_connections 2026-02-13T18:07:24.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.564+0000 7fb5120d7640 1 -- 10.20.193.78:0/4207690679 wait complete. 2026-02-13T18:07:24.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:07:24.598 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:07:24.598 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:07:24.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient: get_monmap_and_config 2026-02-13T18:07:24.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient: monmap: 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:24.659459+0000 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:24.659459+0000 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:24.667 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 1 Processor -- start 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 1 -- start start 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient: init 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient(hunting): picked mon.noname-c con 0x7fdee008e920 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient(hunting): picked mon.noname-a con 0x7fdee008d7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient(hunting): picked mon.noname-b con 0x7fdee0184cb0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee005d030 con 0x7fdee008d7b0 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee005d730 con 0x7fdee008e920 2026-02-13T18:07:24.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee005e0d0 con 0x7fdee0184cb0 2026-02-13T18:07:24.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee7d76640 10 monclient(hunting): authenticate will time out at 675.714866s 2026-02-13T18:07:24.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee52ea640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fdee008d7b0 0x7fdee008f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35112/0 (socket says 10.20.193.78:35112) 2026-02-13T18:07:24.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee52ea640 1 -- 10.20.193.78:0/1401589377 learned_addr learned my addr 10.20.193.78:0/1401589377 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.656+0000 7fdee62ec640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fdee0184cb0 0x7fdee01a5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38770/0 (socket says 10.20.193.78:38770) 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee52ea640 1 -- 10.20.193.78:0/1401589377 >> v1:10.20.193.78:6789/0 conn(0x7fdee008d7b0 legacy=0x7fdee008f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee62ec640 1 -- 10.20.193.78:0/1401589377 >> v1:10.20.193.78:6790/0 conn(0x7fdee0184cb0 legacy=0x7fdee01a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee5aeb640 1 -- 10.20.193.78:0/1401589377 >> v1:10.20.193.187:6789/0 conn(0x7fdee008e920 legacy=0x7fdee008ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158848044 0 0) 0x7fdee005d030 con 0x7fdee008d7b0 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): my global_id is 54120 2026-02-13T18:07:24.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec8003620 con 0x7fdee008d7b0 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703121800 0 0) 0x7fdee005e0d0 con 0x7fdee0184cb0 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient(hunting): my global_id is 4517 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee005d030 con 0x7fdee0184cb0 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1030678398 0 0) 0x7fdec8003620 con 0x7fdee008d7b0 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 >> v1:10.20.193.78:6790/0 conn(0x7fdee0184cb0 legacy=0x7fdee01a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 >> v1:10.20.193.187:6789/0 conn(0x7fdee008e920 legacy=0x7fdee008ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 monclient: found mon.noname-a 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee008cdd0 con 0x7fdee008d7b0 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 5 monclient: authenticate success, global_id 54120 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fded4003110 con 0x7fdee008d7b0 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: dump: 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.675 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fded40033e0 con 0x7fdee008d7b0 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 1 -- 10.20.193.78:0/1401589377 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fded4004b50 con 0x7fdee008d7b0 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee4ae9640 10 monclient: dump: 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 4 set_mon_vals no callback set 2026-02-13T18:07:24.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: shutdown 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- 10.20.193.78:0/1401589377 >> v1:10.20.193.78:6789/0 conn(0x7fdee008d7b0 legacy=0x7fdee008f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- 10.20.193.78:0/1401589377 shutdown_connections 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- 10.20.193.78:0/1401589377 >> 10.20.193.78:0/1401589377 conn(0x7fdee008ff50 msgr2=0x7fdee0090350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- 10.20.193.78:0/1401589377 shutdown_connections 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- 10.20.193.78:0/1401589377 wait complete. 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: build_initial_monmap 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: monmap: 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:24.678 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 Processor -- start 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- start start 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: init 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient(hunting): picked mon.noname-b con 0x7fdee008d7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient(hunting): picked mon.noname-c con 0x7fdee008e920 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient(hunting): picked mon.noname-a con 0x7fdee0184cb0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee0188a20 con 0x7fdee0184cb0 2026-02-13T18:07:24.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee0184ac0 con 0x7fdee008d7b0 2026-02-13T18:07:24.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee01875c0 con 0x7fdee008e920 2026-02-13T18:07:24.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:24.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee7d76640 10 monclient(hunting): authenticate will time out at 675.718874s 2026-02-13T18:07:24.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee62ec640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fdee0184cb0 0x7fdee01843b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35114/0 (socket says 10.20.193.78:35114) 2026-02-13T18:07:24.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.660+0000 7fdee62ec640 1 -- 10.20.193.78:0/3277929627 learned_addr learned my addr 10.20.193.78:0/3277929627 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee62ec640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.78:6789/0 conn(0x7fdee0184cb0 legacy=0x7fdee01843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee52ea640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.78:6790/0 conn(0x7fdee008e920 legacy=0x7fdee0183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee5aeb640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.187:6789/0 conn(0x7fdee008d7b0 legacy=0x7fdee0143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405598538 0 0) 0x7fdee0188a20 con 0x7fdee0184cb0 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): my global_id is 54123 2026-02-13T18:07:24.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb0003620 con 0x7fdee0184cb0 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538244981 0 0) 0x7fdee01875c0 con 0x7fdee008e920 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): my global_id is 4520 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee0188a20 con 0x7fdee008e920 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969244278 0 0) 0x7fdee0184ac0 con 0x7fdee008d7b0 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:24.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): my global_id is 4531 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee01875c0 con 0x7fdee008d7b0 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1815561808 0 0) 0x7fdeb0003620 con 0x7fdee0184cb0 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdee0184ac0 con 0x7fdee0184cb0 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdedc004860 con 0x7fdee0184cb0 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): dump: 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.685 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3025624862 0 0) 0x7fdee0184ac0 con 0x7fdee0184cb0 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.78:6790/0 conn(0x7fdee008e920 legacy=0x7fdee0183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.187:6789/0 conn(0x7fdee008d7b0 legacy=0x7fdee0143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 monclient: found mon.a 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0189920 con 0x7fdee0184cb0 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: _finish_auth 0 2026-02-13T18:07:24.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 5 monclient: authenticate success, global_id 54123 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 monclient: _renew_subs 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdee0189080 con 0x7fdee0184cb0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 monclient: _renew_subs 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdee01882f0 con 0x7fdee0184cb0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdedc004a40 con 0x7fdee0184cb0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdedc006250 con 0x7fdee0184cb0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 10 monclient: dump: 2026-02-13T18:07:24.687 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdecffff640 4 set_mon_vals no callback set 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fdedc006520 con 0x7fdee0184cb0 2026-02-13T18:07:24.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00008e0 con 0x7fdee0184cb0 2026-02-13T18:07:24.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3987+0+0 (unknown 1583590671 0 0) 0x7fdedc04db00 con 0x7fdee0184cb0 2026-02-13T18:07:24.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.664+0000 7fdee5aeb640 10 monclient: get_auth_request con 0x7fdeb003d6a0 auth_method 0 2026-02-13T18:07:24.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.668+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fdedc018a70 con 0x7fdee0184cb0 2026-02-13T18:07:24.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.668+0000 7fdece7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:24.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.668+0000 7fdece7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:24.718 INFO:tasks.rados.rados.0.trial187.stdout:451: done (4 left) 2026-02-13T18:07:24.718 INFO:tasks.rados.rados.0.trial187.stdout:453: done (3 left) 2026-02-13T18:07:24.719 INFO:tasks.rados.rados.0.trial187.stdout:454: done (2 left) 2026-02-13T18:07:24.719 INFO:tasks.rados.rados.0.trial187.stdout:455: done (1 left) 2026-02-13T18:07:24.719 INFO:tasks.rados.rados.0.trial187.stdout:456: done (0 left) 2026-02-13T18:07:24.719 INFO:tasks.rados.rados.0.trial187.stdout:457: write oid 47 current snap is 46 2026-02-13T18:07:24.719 INFO:tasks.rados.rados.0.trial187.stdout:457: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2026-02-13T18:07:24.728 INFO:tasks.rados.rados.0.trial187.stdout:457: writing trial18717860-47 from 726102 to 1514888 tid 1 2026-02-13T18:07:24.735 INFO:tasks.rados.rados.0.trial187.stdout:457: writing trial18717860-47 from 1917886 to 2528279 tid 2 2026-02-13T18:07:24.739 INFO:tasks.rados.rados.0.trial187.stdout:457: writing trial18717860-47 from 3108206 to 3126102 tid 3 2026-02-13T18:07:24.739 INFO:tasks.rados.rados.0.trial187.stdout:458: delete oid 31 current snap is 46 2026-02-13T18:07:24.740 INFO:tasks.rados.rados.0.trial187.stdout:457: finishing write tid 1 to trial18717860-47 2026-02-13T18:07:24.740 INFO:tasks.rados.rados.0.trial187.stdout:457: finishing write tid 2 to trial18717860-47 2026-02-13T18:07:24.740 INFO:tasks.rados.rados.0.trial187.stdout:457: finishing write tid 3 to trial18717860-47 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: finishing write tid 4 to trial18717860-47 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: finishing write tid 5 to trial18717860-47 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: oid 47 updating version 0 to 85 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: oid 47 version 85 is already newer than 83 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: oid 47 version 85 is already newer than 82 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: oid 47 version 85 is already newer than 84 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 85 (ObjNum 186 snap 46 seq_num 186) dirty exists 2026-02-13T18:07:24.741 INFO:tasks.rados.rados.0.trial187.stdout:457: left oid 47 (ObjNum 186 snap 46 seq_num 186) 2026-02-13T18:07:24.742 INFO:tasks.rados.rados.0.trial187.stdout:457: done (1 left) 2026-02-13T18:07:24.742 INFO:tasks.rados.rados.0.trial187.stdout:458: done (0 left) 2026-02-13T18:07:24.742 INFO:tasks.rados.rados.0.trial187.stdout:459: rollback oid 46 current snap is 46 2026-02-13T18:07:24.742 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 43 2026-02-13T18:07:24.742 INFO:tasks.rados.rados.0.trial187.stdout:460: write oid 15 current snap is 46 2026-02-13T18:07:24.742 INFO:tasks.rados.rados.0.trial187.stdout:460: seq_num 188 ranges {759716=539284,2034850=614062} 2026-02-13T18:07:24.750 INFO:tasks.rados.rados.0.trial187.stdout:460: writing trial18717860-15 from 759716 to 1299000 tid 1 2026-02-13T18:07:24.759 INFO:tasks.rados.rados.0.trial187.stdout:460: writing trial18717860-15 from 2034850 to 2648912 tid 2 2026-02-13T18:07:24.759 INFO:tasks.rados.rados.0.trial187.stdout:461: rollback oid 27 current snap is 46 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 45 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:459: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:459: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:459: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 81 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:460: finishing write tid 1 to trial18717860-15 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:459: done (2 left) 2026-02-13T18:07:24.760 INFO:tasks.rados.rados.0.trial187.stdout:462: snap_remove snap 35 2026-02-13T18:07:24.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.788+0000 7fdee7d76640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:07:24.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.788+0000 7fdee7d76640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:07:24.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.788+0000 7fdee7d76640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:24.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.788+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdee00626c0 con 0x7fdee0184cb0 2026-02-13T18:07:24.809 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.809 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=10,logm=63} crc {auth=1232810541,config=1618278320,health=2358046931,kv=1881317687,logm=3734521355}) 2026-02-13T18:07:24.809 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=11,kv=11,logm=65} crc {auth=4280584276,config=1618278320,health=3800237533,kv=4087868365,logm=1575607661}) 2026-02-13T18:07:24.809 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.809 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=10,logm=63} crc {auth=1232810541,config=1618278320,health=2358046931,kv=1881317687,logm=3734521355}) 2026-02-13T18:07:24.810 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=725133676,config=1618278321,health=1885236166,kv=2900068441,logm=3058293061}) 2026-02-13T18:07:24.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdece7fc640 1 -- 10.20.193.78:0/3277929627 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fdedc01dd20 con 0x7fdee0184cb0 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdece7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdece7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.187:6812/2668687789 conn(0x7fdeb003d6a0 legacy=0x7fdeb005db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 10 monclient: shutdown 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 >> v1:10.20.193.78:6789/0 conn(0x7fdee0184cb0 legacy=0x7fdee01843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 shutdown_connections 2026-02-13T18:07:24.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 >> 10.20.193.78:0/3277929627 conn(0x7fdee008ff50 msgr2=0x7fdee01a5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:24.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 shutdown_connections 2026-02-13T18:07:24.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:24.800+0000 7fdee7d76640 1 -- 10.20.193.78:0/3277929627 wait complete. 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=116795455}) 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=262917728}) 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=116795455}) 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2214204807}) 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3817109466}) 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1948455039}) 2026-02-13T18:07:24.816 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3817109466}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3219931146}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2502315368}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=246020310}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2502315368}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.799+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3097821923}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3123161834}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1852128231}) 2026-02-13T18:07:24.817 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3123161834}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=751176172}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=38,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=21} crc {logm=1907945262,mdsmap=685858242,mgr=174722761,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=3075781900,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3492138135,osd_pg_creating=829091629,osd_snap=2204709633}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=21,osdmap=2} crc {logm=1579294931,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=1078031112,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3831369246,osd_pg_creating=829091629,osd_snap=225743651,osdmap=4102600358}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=38,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=21} crc {logm=1907945262,mdsmap=685858242,mgr=174722761,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=3075781900,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3492138135,osd_pg_creating=829091629,osd_snap=2204709633}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=35,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=18,osdmap=7} crc {logm=1876452268,mdsmap=685858242,mgr=174722761,mgr_metadata=3546443502,mgrstat=602084704,mon_config_key=3256534467,monmap=1180532494,nvmeofgw=935146538,osd_metadata=1252444728,osd_pg_creating=829091629,osd_snap=2415077583,osdmap=461175149}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2890683166}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1181890590}) 2026-02-13T18:07:24.818 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2890683166}) 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1213142222}) 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=69} crc {osdmap=1093792928}) 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=68} crc {osdmap=2140355748}) 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=69} crc {osdmap=1093792928}) 2026-02-13T18:07:24.819 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:07:24.803+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=66} crc {osdmap=1169291423}) 2026-02-13T18:07:24.820 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:462: done (2 left) 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:463: read oid 34 snap 41 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:463: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:464: rollback oid 41 current snap is 46 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 45 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:460: finishing write tid 2 to trial18717860-15 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:460: finishing write tid 3 to trial18717860-15 2026-02-13T18:07:25.721 INFO:tasks.rados.rados.0.trial187.stdout:460: finishing write tid 4 to trial18717860-15 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:460: oid 15 updating version 0 to 97 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:460: oid 15 updating version 97 to 98 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:460: oid 15 updating version 98 to 99 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 99 (ObjNum 188 snap 46 seq_num 188) dirty exists 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:460: left oid 15 (ObjNum 188 snap 46 seq_num 188) 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:461: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:461: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:461: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 90 (ObjNum 149 snap 26 seq_num 149) dirty exists 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:460: done (3 left) 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:461: done (2 left) 2026-02-13T18:07:25.722 INFO:tasks.rados.rados.0.trial187.stdout:465: copy_from oid 19 from oid 2 current snap is 46 2026-02-13T18:07:25.723 INFO:tasks.rados.rados.0.trial187.stdout:466: snap_create 2026-02-13T18:07:25.723 INFO:tasks.rados.rados.0.trial187.stdout:465: finishing copy_from to trial18717860-19 2026-02-13T18:07:25.723 INFO:tasks.rados.rados.0.trial187.stdout:465: got expected ENOENT (src dne) 2026-02-13T18:07:25.723 INFO:tasks.rados.rados.0.trial187.stdout:465: finishing copy_from racing read to trial18717860-19 2026-02-13T18:07:25.724 INFO:tasks.rados.rados.0.trial187.stdout:463: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T18:07:25.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 915808 2026-02-13T18:07:25.787 INFO:tasks.rados.rados.0.trial187.stdout:464: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:07:25.787 INFO:tasks.rados.rados.0.trial187.stdout:464: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:07:25.787 INFO:tasks.rados.rados.0.trial187.stdout:464: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:07:25.787 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 83 (ObjNum 126 snap 22 seq_num 126) dirty exists 2026-02-13T18:07:25.822 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:07:25.822 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:07:25.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient: get_monmap_and_config 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient: build_initial_monmap 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient: monmap: 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:25.884542+0000 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:25.884542+0000 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:25.892 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:25.893 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:25.893 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:25.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 1 Processor -- start 2026-02-13T18:07:25.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 1 -- start start 2026-02-13T18:07:25.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient: init 2026-02-13T18:07:25.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:25.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient(hunting): picked mon.noname-c con 0x7f1c4808cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient(hunting): picked mon.noname-b con 0x7f1c4808d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient(hunting): picked mon.noname-a con 0x7f1c4808d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c48085ad0 con 0x7f1c4808d5d0 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c48085ee0 con 0x7f1c4808cdc0 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4808e000 con 0x7f1c4808d190 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4f382640 10 monclient(hunting): authenticate will time out at 676.939890s 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4c8f6640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1c4808d190 0x7f1c48183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38786/0 (socket says 10.20.193.78:38786) 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4c8f6640 1 -- 10.20.193.78:0/461602706 learned_addr learned my addr 10.20.193.78:0/461602706 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:25.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.880+0000 7f1c4d8f8640 1 --1- 10.20.193.78:0/461602706 >> v1:10.20.193.78:6789/0 conn(0x7f1c4808d5d0 0x7f1c481a53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35124/0 (socket says 10.20.193.78:35124) 2026-02-13T18:07:25.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4d8f8640 1 -- 10.20.193.78:0/461602706 >> v1:10.20.193.78:6789/0 conn(0x7f1c4808d5d0 legacy=0x7f1c481a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:25.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4c8f6640 1 -- 10.20.193.78:0/461602706 >> v1:10.20.193.78:6790/0 conn(0x7f1c4808d190 legacy=0x7f1c48183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:25.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4d0f7640 1 -- 10.20.193.78:0/461602706 >> v1:10.20.193.187:6789/0 conn(0x7f1c4808cdc0 legacy=0x7f1c4808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:25.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412613554 0 0) 0x7f1c48085ad0 con 0x7f1c4808d5d0 2026-02-13T18:07:25.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): my global_id is 54126 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c30003620 con 0x7f1c4808d5d0 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973490433 0 0) 0x7f1c4808e000 con 0x7f1c4808d190 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): my global_id is 4523 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c48085ad0 con 0x7f1c4808d190 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169760413 0 0) 0x7f1c38002cb0 con 0x7f1c4808cdc0 2026-02-13T18:07:25.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient(hunting): my global_id is 4534 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c4808e000 con 0x7f1c4808cdc0 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2979793893 0 0) 0x7f1c30003620 con 0x7f1c4808d5d0 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 >> v1:10.20.193.78:6790/0 conn(0x7f1c4808d190 legacy=0x7f1c48183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 >> v1:10.20.193.187:6789/0 conn(0x7f1c4808cdc0 legacy=0x7f1c4808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: _finish_hunting 0 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 monclient: found mon.noname-a 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:25.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c48086f80 con 0x7f1c4808d5d0 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: _finish_auth 0 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: _check_auth_tickets 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 5 monclient: authenticate success, global_id 54126 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c44004620 con 0x7f1c4808d5d0 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: dump: 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.905 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4d8f8640 1 --1- 10.20.193.78:0/461602706 >> v1:10.20.193.78:6789/0 conn(0x7f1c4808d5d0 0x7f1c481a53e0 :-1 s=OPENED pgs=121 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f1c44005fa0 mon_map magic: 0 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c440048f0 con 0x7f1c4808d5d0 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:25.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 4 set_mon_vals no callback set 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 10 monclient: shutdown 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 1 -- 10.20.193.78:0/461602706 >> v1:10.20.193.78:6789/0 conn(0x7f1c4808d5d0 legacy=0x7f1c481a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 1 -- 10.20.193.78:0/461602706 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c44005fa0 con 0x7f1c4808d5d0 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c37fff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 1 -- 10.20.193.78:0/461602706 shutdown_connections 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 1 -- 10.20.193.78:0/461602706 >> 10.20.193.78:0/461602706 conn(0x7f1c48091720 msgr2=0x7f1c48091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 1 -- 10.20.193.78:0/461602706 shutdown_connections 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 1 -- 10.20.193.78:0/461602706 wait complete. 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 10 monclient: build_initial_monmap 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 10 monclient: monmap: 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:25.907 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.884+0000 7f1c4f382640 1 Processor -- start 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- start start 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: init 2026-02-13T18:07:25.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient(hunting): picked mon.noname-c con 0x7f1c4808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient(hunting): picked mon.noname-a con 0x7f1c4808d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient(hunting): picked mon.noname-b con 0x7f1c4808d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c48083540 con 0x7f1c4808d190 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4808b710 con 0x7f1c4808d5d0 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c480811e0 con 0x7f1c4808cdc0 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient(hunting): authenticate will time out at 676.944487s 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4d0f7640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1c4808cdc0 0x7f1c48084a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38790/0 (socket says 10.20.193.78:38790) 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4d0f7640 1 -- 10.20.193.78:0/3468621144 learned_addr learned my addr 10.20.193.78:0/3468621144 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:25.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4d0f7640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.78:6790/0 conn(0x7f1c4808cdc0 legacy=0x7f1c48084a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4c8f6640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.78:6789/0 conn(0x7f1c4808d190 legacy=0x7f1c481941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736608033 0 0) 0x7f1c480811e0 con 0x7f1c4808cdc0 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): my global_id is 4526 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c18003620 con 0x7f1c4808cdc0 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370760985 0 0) 0x7f1c48083540 con 0x7f1c4808d190 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:25.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): my global_id is 54129 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c480811e0 con 0x7f1c4808d190 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4d8f8640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.187:6789/0 conn(0x7f1c4808d5d0 legacy=0x7f1c481958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3255605029 0 0) 0x7f1c480811e0 con 0x7f1c4808d190 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c48083540 con 0x7f1c4808d190 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c3c0032d0 con 0x7f1c4808d190 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): dump: 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.911 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1979220163 0 0) 0x7f1c18003620 con 0x7f1c4808cdc0 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c480811e0 con 0x7f1c4808cdc0 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c38003530 con 0x7f1c4808cdc0 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:25.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient(hunting): dump: 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3053306513 0 0) 0x7f1c48083540 con 0x7f1c4808d190 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.78:6790/0 conn(0x7f1c4808cdc0 legacy=0x7f1c48084a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:25.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.187:6789/0 conn(0x7f1c4808d5d0 legacy=0x7f1c481958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 monclient: found mon.a 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c48082ca0 con 0x7f1c4808d190 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: _finish_auth 0 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 5 monclient: authenticate success, global_id 54129 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _renew_subs 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:25.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c48081d40 con 0x7f1c4808d190 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _renew_subs 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c48085350 con 0x7f1c4808d190 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c3c004b90 con 0x7f1c4808d190 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1c3c004ef0 con 0x7f1c4808d190 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 10 monclient: dump: 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:25.915 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c377fe640 4 set_mon_vals no callback set 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:25.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4808f620 con 0x7f1c4808d190 2026-02-13T18:07:25.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.888+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1c3c0051c0 con 0x7f1c4808d190 2026-02-13T18:07:25.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.892+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(112..112 src has 1..112) ==== 3959+0+0 (unknown 187252841 0 0) 0x7f1c3c04c620 con 0x7f1c4808d190 2026-02-13T18:07:25.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.892+0000 7f1c4d0f7640 10 monclient: get_auth_request con 0x7f1c1803d690 auth_method 0 2026-02-13T18:07:25.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.892+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f1c4808f620 con 0x7f1c4808d190 2026-02-13T18:07:25.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.892+0000 7f1c35ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:25.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:25.892+0000 7f1c35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1c480510e0 con 0x7f1c4808d190 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c35ffb640 1 -- 10.20.193.78:0/3468621144 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1603 (unknown 254746657 0 4098653069) 0x7f1c3c0175a0 con 0x7f1c4808d190 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c35ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c35ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:26.028 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1c1803d690 legacy=0x7f1c1805db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 10 monclient: shutdown 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 >> v1:10.20.193.78:6789/0 conn(0x7f1c4808d190 legacy=0x7f1c481941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 shutdown_connections 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 >> 10.20.193.78:0/3468621144 conn(0x7f1c48091720 msgr2=0x7f1c4805ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 shutdown_connections 2026-02-13T18:07:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.016+0000 7f1c4f382640 1 -- 10.20.193.78:0/3468621144 wait complete. 2026-02-13T18:07:26.040 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:07:26.040 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:07:26.040 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:07:26.040 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:07:26.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.088+0000 7f23a2940640 10 monclient: get_monmap_and_config 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.088+0000 7f23a2940640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.088+0000 7f23a2940640 10 monclient: monmap: 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:26.093382+0000 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:26.093382+0000 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:26.101 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:26.102 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 Processor -- start 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- start start 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient: init 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient(hunting): picked mon.noname-b con 0x7f239c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient(hunting): picked mon.noname-a con 0x7f239c05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient(hunting): picked mon.noname-c con 0x7f239c1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c095530 con 0x7f239c05e4b0 2026-02-13T18:07:26.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c140390 con 0x7f239c1853c0 2026-02-13T18:07:26.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c05d230 con 0x7f239c13f8b0 2026-02-13T18:07:26.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient(hunting): authenticate will time out at 677.148582s 2026-02-13T18:07:26.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239bfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f239c13f8b0 0x7f239c13fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38802/0 (socket says 10.20.193.78:38802) 2026-02-13T18:07:26.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239bfff640 1 -- 10.20.193.78:0/2800180109 learned_addr learned my addr 10.20.193.78:0/2800180109 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239b7fe640 1 -- 10.20.193.78:0/2800180109 >> v1:10.20.193.78:6789/0 conn(0x7f239c05e4b0 legacy=0x7f239c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239bfff640 1 -- 10.20.193.78:0/2800180109 >> v1:10.20.193.78:6790/0 conn(0x7f239c13f8b0 legacy=0x7f239c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528980507 0 0) 0x7f239c05d230 con 0x7f239c13f8b0 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): my global_id is 4529 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2380003620 con 0x7f239c13f8b0 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825296718 0 0) 0x7f238c002cb0 con 0x7f239c05e4b0 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient(hunting): my global_id is 54132 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f239c05d230 con 0x7f239c05e4b0 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a0eb6640 1 -- 10.20.193.78:0/2800180109 >> v1:10.20.193.187:6789/0 conn(0x7f239c1853c0 legacy=0x7f239c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 819587005 0 0) 0x7f2380003620 con 0x7f239c13f8b0 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 >> v1:10.20.193.187:6789/0 conn(0x7f239c1853c0 legacy=0x7f239c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 >> v1:10.20.193.78:6789/0 conn(0x7f239c05e4b0 legacy=0x7f239c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 monclient: found mon.noname-b 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c05d510 con 0x7f239c13f8b0 2026-02-13T18:07:26.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2388003040 con 0x7f239c13f8b0 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: dump: 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.110 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 5 monclient: authenticate success, global_id 4529 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2388003310 con 0x7f239c13f8b0 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 1 -- 10.20.193.78:0/2800180109 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23880049a0 con 0x7f239c13f8b0 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f239affd640 10 monclient: dump: 2026-02-13T18:07:26.111 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 4 set_mon_vals no callback set 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 10 monclient: shutdown 2026-02-13T18:07:26.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- 10.20.193.78:0/2800180109 >> v1:10.20.193.78:6790/0 conn(0x7f239c13f8b0 legacy=0x7f239c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- 10.20.193.78:0/2800180109 shutdown_connections 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- 10.20.193.78:0/2800180109 >> 10.20.193.78:0/2800180109 conn(0x7f239c0545d0 msgr2=0x7f239c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- 10.20.193.78:0/2800180109 shutdown_connections 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.092+0000 7f23a2940640 1 -- 10.20.193.78:0/2800180109 wait complete. 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient: monmap: 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.113 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 1 Processor -- start 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 1 -- start start 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient: init 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient(hunting): picked mon.noname-b con 0x7f239c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient(hunting): picked mon.noname-c con 0x7f239c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient(hunting): picked mon.noname-a con 0x7f239c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c111310 con 0x7f239c1853c0 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c10fe20 con 0x7f239c05e4b0 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239c112180 con 0x7f239c13f8b0 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a2940640 10 monclient(hunting): authenticate will time out at 677.153267s 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a0eb6640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f239c1853c0 0x7f239c181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35164/0 (socket says 10.20.193.78:35164) 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f239b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f239c13f8b0 0x7f239c180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38810/0 (socket says 10.20.193.78:38810) 2026-02-13T18:07:26.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a0eb6640 1 -- 10.20.193.78:0/425743571 learned_addr learned my addr 10.20.193.78:0/425743571 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f23a0eb6640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c1853c0 legacy=0x7f239c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f239b7fe640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6790/0 conn(0x7f239c13f8b0 legacy=0x7f239c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f239bfff640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.187:6789/0 conn(0x7f239c05e4b0 legacy=0x7f239c13ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597592473 0 0) 0x7f239c111310 con 0x7f239c1853c0 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): my global_id is 54135 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f236c003620 con 0x7f239c1853c0 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704698271 0 0) 0x7f239c112180 con 0x7f239c13f8b0 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): my global_id is 4532 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f239c111310 con 0x7f239c13f8b0 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126662366 0 0) 0x7f239c10fe20 con 0x7f239c05e4b0 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 10 monclient(hunting): my global_id is 4543 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.096+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f239c112180 con 0x7f239c05e4b0 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2836809259 0 0) 0x7f236c003620 con 0x7f239c1853c0 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f239c10fe20 con 0x7f239c1853c0 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2390004930 con 0x7f239c1853c0 2026-02-13T18:07:26.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): dump: 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1063901397 0 0) 0x7f239c111310 con 0x7f239c13f8b0 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f236c003620 con 0x7f239c13f8b0 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f238c002b60 con 0x7f239c13f8b0 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): dump: 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.125 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1288795988 0 0) 0x7f239c10fe20 con 0x7f239c1853c0 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6790/0 conn(0x7f239c13f8b0 legacy=0x7f239c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.187:6789/0 conn(0x7f239c05e4b0 legacy=0x7f239c13ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 monclient: found mon.a 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c10f800 con 0x7f239c1853c0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 5 monclient: authenticate success, global_id 54135 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 10 monclient: _renew_subs 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f239c13f3a0 con 0x7f239c1853c0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 10 monclient: _renew_subs 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f239c110b50 con 0x7f239c1853c0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2390004ed0 con 0x7f239c1853c0 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2390005260 con 0x7f239c1853c0 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: dump: 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f239a7fc640 4 set_mon_vals no callback set 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f239c1a6e40 con 0x7f239c12d750 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f23900054b0 con 0x7f239c1853c0 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(112..112 src has 1..112) ==== 3959+0+0 (unknown 187252841 0 0) 0x7f239004dae0 con 0x7f239c1853c0 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f239b7fe640 10 monclient: get_auth_request con 0x7f236c03d640 auth_method 0 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f239bfff640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c12d750 legacy=0x7f239c08d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51512444 0 0) 0x7f239c1a6e40 con 0x7f239c12d750 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient(hunting): my global_id is 54138 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f239c10fe20 con 0x7f239c12d750 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1717706314 0 0) 0x7f239c10fe20 con 0x7f239c12d750 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f239c1a6e40 con 0x7f239c12d750 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2388004cd0 con 0x7f239c12d750 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: dump: 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.130 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1935658334 0 0) 0x7f239c1a6e40 con 0x7f239c12d750 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f239c12db20 con 0x7f239c12d750 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2388007010 con 0x7f239c12d750 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c12d750 legacy=0x7f239c08d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.100+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c12d750 legacy=0x7f239c08d0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.104+0000 7f23a2940640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.104+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f239c051150 con 0x7f239c184ba0 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f239bfff640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c184ba0 legacy=0x7f239c08bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655431113 0 0) 0x7f239c051150 con 0x7f239c184ba0 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient(hunting): my global_id is 54141 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f239c1a6e40 con 0x7f239c184ba0 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3978676940 0 0) 0x7f239c1a6e40 con 0x7f239c184ba0 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f239c051150 con 0x7f239c184ba0 2026-02-13T18:07:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2388005320 con 0x7f239c184ba0 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient: dump: 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.133 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3988740965 0 0) 0x7f239c051150 con 0x7f239c184ba0 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f239c093020 con 0x7f239c184ba0 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4338 (unknown 0 0 1418437398) 0x7f23880067c0 con 0x7f239c184ba0 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c184ba0 legacy=0x7f239c08bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f2398ff9640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c184ba0 legacy=0x7f239c08bf70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:26.134 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 8, 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 2035, 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:07:26.135 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.136 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.137 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:26.138 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.139 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.140 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.141 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:26.142 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.143 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:26.144 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:26.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.187:6812/2668687789 conn(0x7f236c03d640 legacy=0x7f236c05daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 10 monclient: shutdown 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 >> v1:10.20.193.78:6789/0 conn(0x7f239c1853c0 legacy=0x7f239c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a0eb6640 1 -- 10.20.193.78:0/425743571 reap_dead start 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a0eb6640 1 -- 10.20.193.78:0/425743571 reap_dead start 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 shutdown_connections 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 >> 10.20.193.78:0/425743571 conn(0x7f239c0545d0 msgr2=0x7f239c096590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 shutdown_connections 2026-02-13T18:07:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.108+0000 7f23a2940640 1 -- 10.20.193.78:0/425743571 wait complete. 2026-02-13T18:07:26.146 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:07:26.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:07:26.147 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:07:26.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.208+0000 7f11937c6640 10 monclient: get_monmap_and_config 2026-02-13T18:07:26.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.208+0000 7f11937c6640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.208+0000 7f11937c6640 10 monclient: monmap: 2026-02-13T18:07:26.220 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.220 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.220 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:26.212804+0000 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:26.212804+0000 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:26.221 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.208+0000 7f11937c6640 1 Processor -- start 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.208+0000 7f11937c6640 1 -- start start 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.208+0000 7f11937c6640 10 monclient: init 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient(hunting): picked mon.noname-c con 0x7f118c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient(hunting): picked mon.noname-b con 0x7f118c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient(hunting): picked mon.noname-a con 0x7f118c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c095530 con 0x7f118c1853c0 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c140390 con 0x7f118c13f8b0 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c05d230 con 0x7f118c05e4b0 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient(hunting): authenticate will time out at 677.268479s 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f1190d3a640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f118c05e4b0 0x7f118c183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38822/0 (socket says 10.20.193.78:38822) 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f1190d3a640 1 -- 10.20.193.78:0/2171243564 learned_addr learned my addr 10.20.193.78:0/2171243564 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f1191d3c640 1 --1- 10.20.193.78:0/2171243564 >> v1:10.20.193.78:6789/0 conn(0x7f118c1853c0 0x7f118c1a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35182/0 (socket says 10.20.193.78:35182) 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f1190d3a640 1 -- 10.20.193.78:0/2171243564 >> v1:10.20.193.78:6790/0 conn(0x7f118c05e4b0 legacy=0x7f118c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f1191d3c640 1 -- 10.20.193.78:0/2171243564 >> v1:10.20.193.78:6789/0 conn(0x7f118c1853c0 legacy=0x7f118c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124015627 0 0) 0x7f118c05d230 con 0x7f118c05e4b0 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): my global_id is 4535 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1174003620 con 0x7f118c05e4b0 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1912730963 0 0) 0x7f11880040a0 con 0x7f118c1853c0 2026-02-13T18:07:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient(hunting): my global_id is 54144 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f118c05d230 con 0x7f118c1853c0 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f119153b640 1 -- 10.20.193.78:0/2171243564 >> v1:10.20.193.187:6789/0 conn(0x7f118c13f8b0 legacy=0x7f118c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3123730616 0 0) 0x7f1174003620 con 0x7f118c05e4b0 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 >> v1:10.20.193.187:6789/0 conn(0x7f118c13f8b0 legacy=0x7f118c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 >> v1:10.20.193.78:6789/0 conn(0x7f118c1853c0 legacy=0x7f118c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 monclient: found mon.noname-b 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c05d510 con 0x7f118c05e4b0 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 5 monclient: authenticate success, global_id 4535 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1180003110 con 0x7f118c05e4b0 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: dump: 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.234 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11800033e0 con 0x7f118c05e4b0 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 1 -- 10.20.193.78:0/2171243564 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1180004b50 con 0x7f118c05e4b0 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f117bfff640 10 monclient: dump: 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.236 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 4 set_mon_vals no callback set 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient: shutdown 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- 10.20.193.78:0/2171243564 >> v1:10.20.193.78:6790/0 conn(0x7f118c05e4b0 legacy=0x7f118c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- 10.20.193.78:0/2171243564 shutdown_connections 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- 10.20.193.78:0/2171243564 >> 10.20.193.78:0/2171243564 conn(0x7f118c0545d0 msgr2=0x7f118c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- 10.20.193.78:0/2171243564 shutdown_connections 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 1 -- 10.20.193.78:0/2171243564 wait complete. 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.212+0000 7f11937c6640 10 monclient: monmap: 2026-02-13T18:07:26.237 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 Processor -- start 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- start start 2026-02-13T18:07:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: init 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient(hunting): picked mon.noname-b con 0x7f118c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient(hunting): picked mon.noname-a con 0x7f118c13f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient(hunting): picked mon.noname-c con 0x7f118c1853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c12d150 con 0x7f118c13f8b0 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c1a4d30 con 0x7f118c05e4b0 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c08ae20 con 0x7f118c1853c0 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient(hunting): authenticate will time out at 677.272308s 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1191d3c640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f118c1853c0 0x7f118c1815a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38830/0 (socket says 10.20.193.78:38830) 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1191d3c640 1 -- 10.20.193.78:0/2494598058 learned_addr learned my addr 10.20.193.78:0/2494598058 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1191d3c640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c1853c0 legacy=0x7f118c1815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1190d3a640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6789/0 conn(0x7f118c13f8b0 legacy=0x7f118c1a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088862434 0 0) 0x7f118c12d150 con 0x7f118c13f8b0 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): my global_id is 54147 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f115c003620 con 0x7f118c13f8b0 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f119153b640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.187:6789/0 conn(0x7f118c05e4b0 legacy=0x7f118c1a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3307970163 0 0) 0x7f115c003620 con 0x7f118c13f8b0 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f118c12d150 con 0x7f118c13f8b0 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1180002b70 con 0x7f118c13f8b0 2026-02-13T18:07:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): dump: 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680046813 0 0) 0x7f118c1a4d30 con 0x7f118c05e4b0 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient(hunting): my global_id is 4549 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f115c003620 con 0x7f118c05e4b0 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2558101229 0 0) 0x7f118c12d150 con 0x7f118c13f8b0 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c1853c0 legacy=0x7f118c1815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.187:6789/0 conn(0x7f118c05e4b0 legacy=0x7f118c1a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 monclient: found mon.a 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c12ce70 con 0x7f118c13f8b0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 5 monclient: authenticate success, global_id 54147 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: _renew_subs 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f118c182cc0 con 0x7f118c13f8b0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: _renew_subs 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f118c183270 con 0x7f118c13f8b0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11800033e0 con 0x7f118c13f8b0 2026-02-13T18:07:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1180005190 con 0x7f118c13f8b0 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 10 monclient: dump: 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f117b7fe640 4 set_mon_vals no callback set 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f118c057e50 con 0x7f118c08e9a0 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1180011820 con 0x7f118c13f8b0 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.216+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(112..112 src has 1..112) ==== 3959+0+0 (unknown 187252841 0 0) 0x7f118004c620 con 0x7f118c13f8b0 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1191d3c640 10 monclient: get_auth_request con 0x7f115c03d5b0 auth_method 0 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f119153b640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c08e9a0 legacy=0x7f118c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651314999 0 0) 0x7f118c057e50 con 0x7f118c08e9a0 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient(hunting): my global_id is 4538 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f118c12d150 con 0x7f118c08e9a0 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3399293229 0 0) 0x7f118c12d150 con 0x7f118c08e9a0 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f118c057e50 con 0x7f118c08e9a0 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f117c0032a0 con 0x7f118c08e9a0 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient: dump: 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.246 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1816126686 0 0) 0x7f118c057e50 con 0x7f118c08e9a0 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f118c12c8f0 con 0x7f118c08e9a0 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f117c0058c0 con 0x7f118c08e9a0 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c08e9a0 legacy=0x7f118c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.220+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c08e9a0 legacy=0x7f118c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.224+0000 7f11937c6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.224+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f118c08a8f0 con 0x7f118c08ed70 2026-02-13T18:07:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f119153b640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c08ed70 legacy=0x7f118c184570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463653084 0 0) 0x7f118c08a8f0 con 0x7f118c08ed70 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient(hunting): my global_id is 4541 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f118c057e50 con 0x7f118c08ed70 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3879135820 0 0) 0x7f118c057e50 con 0x7f118c08ed70 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f118c08a8f0 con 0x7f118c08ed70 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f117c003ab0 con 0x7f118c08ed70 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient: dump: 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.250 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3702011268 0 0) 0x7f118c08a8f0 con 0x7f118c08ed70 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f118c051150 con 0x7f118c08ed70 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 1694396847) 0x7f117c005b40 con 0x7f118c08ed70 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c08ed70 legacy=0x7f118c184570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1179ffb640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6790/0 conn(0x7f118c08ed70 legacy=0x7f118c184570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 8, 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 127619, 2026-02-13T18:07:26.252 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.253 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.254 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:26.255 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.256 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:26.257 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.258 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.259 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:26.260 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:07:26.261 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:26.262 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:26.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.187:6812/2668687789 conn(0x7f115c03d5b0 legacy=0x7f115c05da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 10 monclient: shutdown 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 >> v1:10.20.193.78:6789/0 conn(0x7f118c13f8b0 legacy=0x7f118c1a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1191d3c640 1 -- 10.20.193.78:0/2494598058 reap_dead start 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f1191d3c640 1 -- 10.20.193.78:0/2494598058 reap_dead start 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 shutdown_connections 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 >> 10.20.193.78:0/2494598058 conn(0x7f118c0545d0 msgr2=0x7f118c08c100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 shutdown_connections 2026-02-13T18:07:26.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.228+0000 7f11937c6640 1 -- 10.20.193.78:0/2494598058 wait complete. 2026-02-13T18:07:26.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:07:26.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:07:26.265 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:07:26.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.312+0000 7fa37e41b640 10 monclient: get_monmap_and_config 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.312+0000 7fa37e41b640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.312+0000 7fa37e41b640 10 monclient: monmap: 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:26.317431+0000 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:26.317431+0000 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:26.325 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 Processor -- start 2026-02-13T18:07:26.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- start start 2026-02-13T18:07:26.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient: init 2026-02-13T18:07:26.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:26.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient(hunting): picked mon.noname-b con 0x7fa378085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient(hunting): picked mon.noname-a con 0x7fa378085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient(hunting): picked mon.noname-c con 0x7fa378181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa378088400 con 0x7fa378085b60 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa378088120 con 0x7fa378181d50 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37808c550 con 0x7fa378085790 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient(hunting): authenticate will time out at 677.372797s 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa377fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa378085790 0x7fa378089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38858/0 (socket says 10.20.193.78:38858) 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa377fff640 1 -- 10.20.193.78:0/3985943850 learned_addr learned my addr 10.20.193.78:0/3985943850 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa3777fe640 1 --1- 10.20.193.78:0/3985943850 >> v1:10.20.193.78:6789/0 conn(0x7fa378085b60 0x7fa378085fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35190/0 (socket says 10.20.193.78:35190) 2026-02-13T18:07:26.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa3777fe640 1 -- 10.20.193.78:0/3985943850 >> v1:10.20.193.78:6789/0 conn(0x7fa378085b60 legacy=0x7fa378085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa377fff640 1 -- 10.20.193.78:0/3985943850 >> v1:10.20.193.78:6790/0 conn(0x7fa378085790 legacy=0x7fa378089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844642148 0 0) 0x7fa37808c550 con 0x7fa378085790 2026-02-13T18:07:26.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37c991640 1 -- 10.20.193.78:0/3985943850 >> v1:10.20.193.187:6789/0 conn(0x7fa378181d50 legacy=0x7fa3781a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): my global_id is 4544 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35c003620 con 0x7fa378085790 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702970908 0 0) 0x7fa368002c60 con 0x7fa378085b60 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient(hunting): my global_id is 54150 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa37808c550 con 0x7fa378085b60 2026-02-13T18:07:26.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3468713308 0 0) 0x7fa35c003620 con 0x7fa378085790 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 >> v1:10.20.193.187:6789/0 conn(0x7fa378181d50 legacy=0x7fa3781a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 >> v1:10.20.193.78:6789/0 conn(0x7fa378085b60 legacy=0x7fa378085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 monclient: found mon.noname-b 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378087540 con 0x7fa378085790 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa364003110 con 0x7fa378085790 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: dump: 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.337 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 5 monclient: authenticate success, global_id 4544 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3640033e0 con 0x7fa378085790 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 1 -- 10.20.193.78:0/3985943850 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa364004b50 con 0x7fa378085790 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa376ffd640 10 monclient: dump: 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.338 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 4 set_mon_vals no callback set 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 10 monclient: shutdown 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- 10.20.193.78:0/3985943850 >> v1:10.20.193.78:6790/0 conn(0x7fa378085790 legacy=0x7fa378089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- 10.20.193.78:0/3985943850 shutdown_connections 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.316+0000 7fa37e41b640 1 -- 10.20.193.78:0/3985943850 >> 10.20.193.78:0/3985943850 conn(0x7fa378091720 msgr2=0x7fa378091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- 10.20.193.78:0/3985943850 shutdown_connections 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- 10.20.193.78:0/3985943850 wait complete. 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: monmap: 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.340 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 Processor -- start 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- start start 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: init 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient(hunting): picked mon.noname-c con 0x7fa378085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient(hunting): picked mon.noname-a con 0x7fa378085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient(hunting): picked mon.noname-b con 0x7fa378181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37811be40 con 0x7fa378085b60 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37811c120 con 0x7fa378181d50 2026-02-13T18:07:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa378181b60 con 0x7fa378085790 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient(hunting): authenticate will time out at 677.376873s 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa3777fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa378085b60 0x7fa378181450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35200/0 (socket says 10.20.193.78:35200) 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa3777fe640 1 -- 10.20.193.78:0/1817252436 learned_addr learned my addr 10.20.193.78:0/1817252436 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa377fff640 1 --1- 10.20.193.78:0/1817252436 >> v1:10.20.193.78:6790/0 conn(0x7fa378085790 0x7fa378180d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38868/0 (socket says 10.20.193.78:38868) 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa3777fe640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.78:6789/0 conn(0x7fa378085b60 legacy=0x7fa378181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa377fff640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.78:6790/0 conn(0x7fa378085790 legacy=0x7fa378180d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168250083 0 0) 0x7fa378181b60 con 0x7fa378085790 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): my global_id is 4547 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa348003620 con 0x7fa378085790 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113519980 0 0) 0x7fa37811be40 con 0x7fa378085b60 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): my global_id is 54153 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa378181b60 con 0x7fa378085b60 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37c991640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa378181d50 legacy=0x7fa378127f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2230613009 0 0) 0x7fa348003620 con 0x7fa378085790 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa37811be40 con 0x7fa378085790 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa3640048e0 con 0x7fa378085790 2026-02-13T18:07:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): dump: 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1969272876 0 0) 0x7fa378181b60 con 0x7fa378085b60 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa348003620 con 0x7fa378085b60 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa3680048e0 con 0x7fa378085b60 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient(hunting): dump: 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.345 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 263936448 0 0) 0x7fa37811be40 con 0x7fa378085790 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa378181d50 legacy=0x7fa378127f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.78:6789/0 conn(0x7fa378085b60 legacy=0x7fa378181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 monclient: found mon.c 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378089dc0 con 0x7fa378085790 2026-02-13T18:07:26.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 5 monclient: authenticate success, global_id 4547 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: _renew_subs 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa37805d080 con 0x7fa378085790 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: _renew_subs 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa37805c740 con 0x7fa378085790 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3640033b0 con 0x7fa378085790 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa364005320 con 0x7fa378085790 2026-02-13T18:07:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa3767fc640 4 set_mon_vals no callback set 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.320+0000 7fa374ff9640 10 monclient: dump: 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.349 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa37e41b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa37808f620 con 0x7fa378140730 2026-02-13T18:07:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa3640119b0 con 0x7fa378085790 2026-02-13T18:07:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(112..112 src has 1..112) ==== 3959+0+0 (unknown 187252841 0 0) 0x7fa36404c650 con 0x7fa378085790 2026-02-13T18:07:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa37c991640 10 monclient: get_auth_request con 0x7fa34803d6e0 auth_method 0 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa3777fe640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa378140730 legacy=0x7fa378057000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155649575 0 0) 0x7fa348003620 con 0x7fa378140730 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient(hunting): my global_id is 4558 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa37811be40 con 0x7fa378140730 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2012667654 0 0) 0x7fa37811be40 con 0x7fa378140730 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa348003620 con 0x7fa378140730 2026-02-13T18:07:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa368004e20 con 0x7fa378140730 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient: dump: 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 22764116 0 0) 0x7fa348003620 con 0x7fa378140730 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa378090810 con 0x7fa378140730 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa368007a20 con 0x7fa378140730 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa378140730 legacy=0x7fa378057000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.324+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa378140730 legacy=0x7fa378057000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.328+0000 7fa37e41b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.328+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa3780510e0 con 0x7fa37808cba0 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa3777fe640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa37808cba0 legacy=0x7fa378057710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328130697 0 0) 0x7fa3780510e0 con 0x7fa37808cba0 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient(hunting): my global_id is 4561 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa348003620 con 0x7fa37808cba0 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3495332090 0 0) 0x7fa348003620 con 0x7fa37808cba0 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3780510e0 con 0x7fa37808cba0 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa3680053c0 con 0x7fa37808cba0 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient: dump: 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.355 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2999270384 0 0) 0x7fa3780510e0 con 0x7fa37808cba0 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa378057e20 con 0x7fa37808cba0 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4676 (unknown 0 0 3446958384) 0x7fa368005830 con 0x7fa37808cba0 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa37808cba0 legacy=0x7fa378057710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa374ff9640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6789/0 conn(0x7fa37808cba0 legacy=0x7fa378057710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 8, 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 127695, 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.357 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.358 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.359 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:26.360 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:26.361 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.362 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:26.363 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:26.364 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.365 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:26.366 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:26.367 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:26.367 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:26.367 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:26.367 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa34803d6e0 legacy=0x7fa34805db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 10 monclient: shutdown 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 >> v1:10.20.193.78:6790/0 conn(0x7fa378085790 legacy=0x7fa378180d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37c991640 1 -- 10.20.193.78:0/1817252436 reap_dead start 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37c991640 1 -- 10.20.193.78:0/1817252436 reap_dead start 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 shutdown_connections 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 >> 10.20.193.78:0/1817252436 conn(0x7fa378091720 msgr2=0x7fa378123bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 shutdown_connections 2026-02-13T18:07:26.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.332+0000 7fa37e41b640 1 -- 10.20.193.78:0/1817252436 wait complete. 2026-02-13T18:07:26.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:07:26.369 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T18:07:26.369 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:07:26.369 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T18:07:26.369 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T18:07:26.369 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T18:07:26.369 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:07:26.380 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T18:07:26.380 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:07:26.380 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:07:26.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient: get_monmap_and_config 2026-02-13T18:07:26.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient: monmap: 2026-02-13T18:07:26.495 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.495 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.495 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:26.486658+0000 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:26.486658+0000 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 1 Processor -- start 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 1 -- start start 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient: init 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient(hunting): picked mon.noname-c con 0x7fa96c13f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient(hunting): picked mon.noname-b con 0x7fa96c05e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient(hunting): picked mon.noname-a con 0x7fa96c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c095530 con 0x7fa96c1853c0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c140390 con 0x7fa96c13f8b0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c05d230 con 0x7fa96c05e4b0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa97087e640 10 monclient(hunting): authenticate will time out at 677.541809s 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa96ad76640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fa96c1853c0 legacy=0x7fa96c1a57a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa969d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa96c05e4b0 0x7fa96c183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38874/0 (socket says 10.20.193.78:38874) 2026-02-13T18:07:26.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.484+0000 7fa969d74640 1 -- 10.20.193.78:0/1479243822 learned_addr learned my addr 10.20.193.78:0/1479243822 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969d74640 1 -- 10.20.193.78:0/1479243822 >> v1:10.20.193.78:6790/0 conn(0x7fa96c05e4b0 legacy=0x7fa96c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241885998 0 0) 0x7fa96c05d230 con 0x7fa96c05e4b0 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient(hunting): my global_id is 4550 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa958003620 con 0x7fa96c05e4b0 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa96a575640 1 -- 10.20.193.78:0/1479243822 >> v1:10.20.193.187:6789/0 conn(0x7fa96c13f8b0 legacy=0x7fa96c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2337938110 0 0) 0x7fa958003620 con 0x7fa96c05e4b0 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 >> v1:10.20.193.187:6789/0 conn(0x7fa96c13f8b0 legacy=0x7fa96c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 >> v1:10.20.193.78:6789/0 conn(0x7fa96c1853c0 legacy=0x7fa96c1a57a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 monclient: found mon.noname-b 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c05d510 con 0x7fa96c05e4b0 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa954003110 con 0x7fa96c05e4b0 2026-02-13T18:07:26.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: dump: 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.503 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 5 monclient: authenticate success, global_id 4550 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9540033e0 con 0x7fa96c05e4b0 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 1 -- 10.20.193.78:0/1479243822 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa954004b50 con 0x7fa96c05e4b0 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969573640 10 monclient: dump: 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.504 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 4 set_mon_vals no callback set 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: shutdown 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:26.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- 10.20.193.78:0/1479243822 >> v1:10.20.193.78:6790/0 conn(0x7fa96c05e4b0 legacy=0x7fa96c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- 10.20.193.78:0/1479243822 shutdown_connections 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- 10.20.193.78:0/1479243822 >> 10.20.193.78:0/1479243822 conn(0x7fa96c0545d0 msgr2=0x7fa96c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- 10.20.193.78:0/1479243822 shutdown_connections 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- 10.20.193.78:0/1479243822 wait complete. 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: build_initial_monmap 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: monmap: 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:26.506 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 Processor -- start 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- start start 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: init 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient(hunting): picked mon.noname-a con 0x7fa96c05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient(hunting): picked mon.noname-c con 0x7fa96c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient(hunting): picked mon.noname-b con 0x7fa96c1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:26.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c057e50 con 0x7fa96c05e4b0 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c1110c0 con 0x7fa96c1853c0 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa96a575640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fa96c05e4b0 legacy=0x7fa96c13ea40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96c10fbd0 con 0x7fa96c13f8b0 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa97087e640 10 monclient(hunting): authenticate will time out at 677.546398s 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa96c13f8b0 0x7fa96c180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38880/0 (socket says 10.20.193.78:38880) 2026-02-13T18:07:26.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.488+0000 7fa969d74640 1 -- 10.20.193.78:0/4234230155 learned_addr learned my addr 10.20.193.78:0/4234230155 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa969d74640 1 -- 10.20.193.78:0/4234230155 >> v1:10.20.193.78:6790/0 conn(0x7fa96c13f8b0 legacy=0x7fa96c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790714177 0 0) 0x7fa96c10fbd0 con 0x7fa96c13f8b0 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): my global_id is 4553 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa938003620 con 0x7fa96c13f8b0 2026-02-13T18:07:26.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 283787390 0 0) 0x7fa938003620 con 0x7fa96c13f8b0 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa96c10fbd0 con 0x7fa96c13f8b0 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa9540048e0 con 0x7fa96c13f8b0 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): dump: 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.512 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa96ad76640 1 -- 10.20.193.78:0/4234230155 >> v1:10.20.193.187:6789/0 conn(0x7fa96c1853c0 legacy=0x7fa96c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2907447334 0 0) 0x7fa96c10fbd0 con 0x7fa96c13f8b0 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 >> v1:10.20.193.187:6789/0 conn(0x7fa96c1853c0 legacy=0x7fa96c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 >> v1:10.20.193.78:6789/0 conn(0x7fa96c05e4b0 legacy=0x7fa96c13ea40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 monclient: found mon.c 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:26.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c111f30 con 0x7fa96c13f8b0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: _finish_auth 0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 5 monclient: authenticate success, global_id 4553 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 monclient: _renew_subs 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c111690 con 0x7fa96c13f8b0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 monclient: _renew_subs 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa96c13f380 con 0x7fa96c13f8b0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa954003380 con 0x7fa96c13f8b0 2026-02-13T18:07:26.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa954005190 con 0x7fa96c13f8b0 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 10 monclient: dump: 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:26.515 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa968d72640 4 set_mon_vals no callback set 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c0008e0 con 0x7fa96c13f8b0 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa969d74640 1 --1- 10.20.193.78:0/4234230155 >> v1:10.20.193.78:6790/0 conn(0x7fa96c13f8b0 0x7fa96c180590 :-1 s=OPENED pgs=212 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fa95404c6f0 osd_map(112..112 src has 1..112) 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa954011820 con 0x7fa96c13f8b0 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.492+0000 7fa96a575640 10 monclient: get_auth_request con 0x7fa93803d340 auth_method 0 2026-02-13T18:07:26.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:26.496+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(112..112 src has 1..112) ==== 3959+0+0 (unknown 187252841 0 0) 0x7fa95404c6f0 con 0x7fa96c13f8b0 2026-02-13T18:07:27.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.320+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fa954017680 con 0x7fa96c13f8b0 2026-02-13T18:07:27.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.320+0000 7fa952ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:27.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.320+0000 7fa952ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa96c093020 con 0x7fa96c13f8b0 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa952ffd640 1 -- 10.20.193.78:0/4234230155 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1603 (unknown 254746657 0 738736405) 0x7fa95401c930 con 0x7fa96c13f8b0 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa952ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa952ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:27.451 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:07:27.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa93803d340 legacy=0x7fa93805d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:27.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 10 monclient: shutdown 2026-02-13T18:07:27.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:27.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 >> v1:10.20.193.78:6790/0 conn(0x7fa96c13f8b0 legacy=0x7fa96c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 shutdown_connections 2026-02-13T18:07:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 >> 10.20.193.78:0/4234230155 conn(0x7fa96c0545d0 msgr2=0x7fa96c0965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 shutdown_connections 2026-02-13T18:07:27.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:27.440+0000 7fa97087e640 1 -- 10.20.193.78:0/4234230155 wait complete. 2026-02-13T18:07:30.462 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:07:30.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient: get_monmap_and_config 2026-02-13T18:07:30.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient: build_initial_monmap 2026-02-13T18:07:30.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient: monmap: 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:30.516488+0000 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:30.516488+0000 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:30.525 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 1 Processor -- start 2026-02-13T18:07:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 1 -- start start 2026-02-13T18:07:30.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient: init 2026-02-13T18:07:30.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:30.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:30.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient(hunting): picked mon.noname-b con 0x7fdd1c085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:30.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient(hunting): picked mon.noname-a con 0x7fdd1c085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:30.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient(hunting): picked mon.noname-c con 0x7fdd1c181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:30.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c088400 con 0x7fdd1c085b60 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c088120 con 0x7fdd1c181d50 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c08c550 con 0x7fdd1c085790 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd2177f640 10 monclient(hunting): authenticate will time out at 681.571908s 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd1a7fc640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fdd1c085b60 legacy=0x7fdd1c085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd1affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fdd1c085790 0x7fdd1c089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38330/0 (socket says 10.20.193.78:38330) 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.512+0000 7fdd1affd640 1 -- 10.20.193.78:0/1381060692 learned_addr learned my addr 10.20.193.78:0/1381060692 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd1affd640 1 -- 10.20.193.78:0/1381060692 >> v1:10.20.193.78:6790/0 conn(0x7fdd1c085790 legacy=0x7fdd1c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd1b7fe640 1 -- 10.20.193.78:0/1381060692 >> v1:10.20.193.187:6789/0 conn(0x7fdd1c181d50 legacy=0x7fdd1c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543553388 0 0) 0x7fdd1c088120 con 0x7fdd1c181d50 2026-02-13T18:07:30.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient(hunting): my global_id is 4570 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd08003620 con 0x7fdd1c181d50 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2001358963 0 0) 0x7fdd08003620 con 0x7fdd1c181d50 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 >> v1:10.20.193.78:6790/0 conn(0x7fdd1c085790 legacy=0x7fdd1c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 >> v1:10.20.193.78:6789/0 conn(0x7fdd1c085b60 legacy=0x7fdd1c085fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 monclient: found mon.noname-c 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:30.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c087540 con 0x7fdd1c181d50 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: _finish_auth 0 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 5 monclient: authenticate success, global_id 4570 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdd0c004670 con 0x7fdd1c181d50 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: dump: 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:30.533 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd0c004940 con 0x7fdd1c181d50 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 1 -- 10.20.193.78:0/1381060692 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdd0c004dd0 con 0x7fdd1c181d50 2026-02-13T18:07:30.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd19ffb640 10 monclient: dump: 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:30.535 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 4 set_mon_vals no callback set 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 10 monclient: shutdown 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 1 -- 10.20.193.78:0/1381060692 >> v1:10.20.193.187:6789/0 conn(0x7fdd1c181d50 legacy=0x7fdd1c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 1 -- 10.20.193.78:0/1381060692 shutdown_connections 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 1 -- 10.20.193.78:0/1381060692 >> 10.20.193.78:0/1381060692 conn(0x7fdd1c091720 msgr2=0x7fdd1c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 1 -- 10.20.193.78:0/1381060692 shutdown_connections 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.516+0000 7fdd2177f640 1 -- 10.20.193.78:0/1381060692 wait complete. 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: build_initial_monmap 2026-02-13T18:07:30.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: monmap: 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 Processor -- start 2026-02-13T18:07:30.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 -- start start 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: init 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient(hunting): picked mon.noname-b con 0x7fdd1c085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient(hunting): picked mon.noname-a con 0x7fdd1c085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient(hunting): picked mon.noname-c con 0x7fdd1c181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c140930 con 0x7fdd1c085b60 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c13b550 con 0x7fdd1c085790 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c181b60 con 0x7fdd1c181d50 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd1a7fc640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fdd1c085b60 legacy=0x7fdd1c180d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:30.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient(hunting): authenticate will time out at 681.576863s 2026-02-13T18:07:30.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd1b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fdd1c181d50 0x7fdd1c181450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38334/0 (socket says 10.20.193.78:38334) 2026-02-13T18:07:30.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd1b7fe640 1 -- 10.20.193.78:0/1253851616 learned_addr learned my addr 10.20.193.78:0/1253851616 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:30.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd1b7fe640 1 -- 10.20.193.78:0/1253851616 >> v1:10.20.193.78:6790/0 conn(0x7fdd1c181d50 legacy=0x7fdd1c181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd1affd640 1 -- 10.20.193.78:0/1253851616 >> v1:10.20.193.187:6789/0 conn(0x7fdd1c085790 legacy=0x7fdd1c190af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975898105 0 0) 0x7fdd1c13b550 con 0x7fdd1c085790 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): my global_id is 4573 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce8003620 con 0x7fdd1c085790 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 49329220 0 0) 0x7fdce8003620 con 0x7fdd1c085790 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd1c13b550 con 0x7fdd1c085790 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdd10003330 con 0x7fdd1c085790 2026-02-13T18:07:30.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): dump: 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:30.543 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2013493616 0 0) 0x7fdd1c13b550 con 0x7fdd1c085790 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 >> v1:10.20.193.78:6790/0 conn(0x7fdd1c181d50 legacy=0x7fdd1c181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 >> v1:10.20.193.78:6789/0 conn(0x7fdd1c085b60 legacy=0x7fdd1c180d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 monclient: found mon.b 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c13b830 con 0x7fdd1c085790 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient: _finish_auth 0 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdcfb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:30.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 5 monclient: authenticate success, global_id 4573 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: _renew_subs 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c13b270 con 0x7fdd1c085790 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: _renew_subs 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.520+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd1c1947d0 con 0x7fdd1c085790 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd10004b90 con 0x7fdd1c085790 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdd10004f30 con 0x7fdd1c085790 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:30.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 10 monclient: dump: 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd197fa640 4 set_mon_vals no callback set 2026-02-13T18:07:30.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd2177f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd2177f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd2177f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c0389c0 con 0x7fdd1c085790 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd1affd640 1 --1- 10.20.193.78:0/1253851616 >> v1:10.20.193.187:6789/0 conn(0x7fdd1c085790 0x7fdd1c190af0 :-1 s=OPENED pgs=237 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fdd10005110 mgrmap(e 5) 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fdd10005110 con 0x7fdd1c085790 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.524+0000 7fdd1a7fc640 10 monclient: get_auth_request con 0x7fdce803d370 auth_method 0 2026-02-13T18:07:30.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:30.528+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(112..112 src has 1..112) ==== 3959+0+0 (unknown 187252841 0 0) 0x7fdd1004c6c0 con 0x7fdd1c085790 2026-02-13T18:07:31.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.352+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fdd100175e0 con 0x7fdd1c085790 2026-02-13T18:07:31.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.352+0000 7fdcfb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:31.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.352+0000 7fdcfb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:31.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdd1c139a10 con 0x7fdd1c085790 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdcfb7fe640 1 -- 10.20.193.78:0/1253851616 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1603 (unknown 254746657 0 2574043860) 0x7fdd1001c900 con 0x7fdd1c085790 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdcfb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdcfb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:31.480 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 >> v1:10.20.193.187:6812/2668687789 conn(0x7fdce803d370 legacy=0x7fdce805d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 10 monclient: shutdown 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.468+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 >> v1:10.20.193.187:6789/0 conn(0x7fdd1c085790 legacy=0x7fdd1c190af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.472+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 shutdown_connections 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.472+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 >> 10.20.193.78:0/1253851616 conn(0x7fdd1c091720 msgr2=0x7fdd1c191280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.472+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 shutdown_connections 2026-02-13T18:07:31.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:31.472+0000 7fdd2177f640 1 -- 10.20.193.78:0/1253851616 wait complete. 2026-02-13T18:07:34.491 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:07:34.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient: get_monmap_and_config 2026-02-13T18:07:34.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient: build_initial_monmap 2026-02-13T18:07:34.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient: monmap: 2026-02-13T18:07:34.569 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:34.569 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:34.569 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:34.555209+0000 2026-02-13T18:07:34.569 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:34.555209+0000 2026-02-13T18:07:34.570 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:34.570 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:34.570 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:34.570 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:34.570 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:34.570 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 1 Processor -- start 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 1 -- start start 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient: init 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient(hunting): picked mon.noname-c con 0x7fb2d8085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient(hunting): picked mon.noname-a con 0x7fb2d8085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d8181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d8088400 con 0x7fb2d8085b60 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d8088120 con 0x7fb2d8085790 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d808c550 con 0x7fb2d8181d50 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2d5d74640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2dcbd6640 10 monclient(hunting): authenticate will time out at 685.610689s 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2d6d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 0x7fb2d81a2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38346/0 (socket says 10.20.193.78:38346) 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.552+0000 7fb2d6d76640 1 -- 10.20.193.78:0/1732763606 learned_addr learned my addr 10.20.193.78:0/1732763606 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.556+0000 7fb2d6d76640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2d81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.556+0000 7fb2d6575640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.187:6789/0 conn(0x7fb2d8085790 legacy=0x7fb2d8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:34.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:34.756+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:35.160+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:35.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:35.964+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:37.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): tick 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 monclient(hunting): continuing hunt 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2d81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.187:6789/0 conn(0x7fb2d8085790 legacy=0x7fb2d8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8085fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d8181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): picked mon.noname-a con 0x7fb2d8085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:37.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): picked mon.noname-c con 0x7fb2d8085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d8087540 con 0x7fb2d8085b60 2026-02-13T18:07:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b4068ff0 con 0x7fb2d8085790 2026-02-13T18:07:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406a290 con 0x7fb2d8181d50 2026-02-13T18:07:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.552+0000 7fb2bffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.556+0000 7fb2d6575640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2b40238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.556+0000 7fb2d6d76640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.187:6789/0 conn(0x7fb2d8085790 legacy=0x7fb2b40668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:37.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:37.752+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:38.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:38.156+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:38.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:38.956+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:40.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): tick 2026-02-13T18:07:40.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:07:40.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 monclient(hunting): continuing hunt 2026-02-13T18:07:40.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:07:40.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2b40238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.187:6789/0 conn(0x7fb2d8085790 legacy=0x7fb2b40668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): picked mon.noname-c con 0x7fb2b40693c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): picked mon.noname-a con 0x7fb2d8085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d8181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406b530 con 0x7fb2d8085b60 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d8087540 con 0x7fb2b40693c0 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b4046810 con 0x7fb2d8181d50 2026-02-13T18:07:40.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2bffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:40.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.553+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:40.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.557+0000 7fb2d6d76640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2b40238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.557+0000 7fb2d6575640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.187:6789/0 conn(0x7fb2b40693c0 legacy=0x7fb2b4069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.753+0000 7fb2d5d74640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377457381 0 0) 0x7fb2b4046810 con 0x7fb2d8181d50 2026-02-13T18:07:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient(hunting): my global_id is 4556 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2c40058b0 con 0x7fb2d8181d50 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1770152344 0 0) 0x7fb2c40058b0 con 0x7fb2d8181d50 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.187:6789/0 conn(0x7fb2b40693c0 legacy=0x7fb2b4069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2b40450a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: _finish_hunting 0 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 monclient: found mon.noname-b 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b4047a90 con 0x7fb2d8181d50 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: _finish_auth 0 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: _check_auth_tickets 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 5 monclient: authenticate success, global_id 4556 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2c8004580 con 0x7fb2d8181d50 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: dump: 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.785 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2c8004760 con 0x7fb2d8181d50 2026-02-13T18:07:40.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 1 -- 10.20.193.78:0/1732763606 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2c8005eb0 con 0x7fb2d8181d50 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d5573640 10 monclient: dump: 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.787 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 4 set_mon_vals no callback set 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: shutdown 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/1732763606 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2b40238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/1732763606 shutdown_connections 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/1732763606 >> 10.20.193.78:0/1732763606 conn(0x7fb2d8091720 msgr2=0x7fb2d8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/1732763606 shutdown_connections 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/1732763606 wait complete. 2026-02-13T18:07:40.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: build_initial_monmap 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: monmap: 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 Processor -- start 2026-02-13T18:07:40.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- start start 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: init 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient(hunting): picked mon.noname-a con 0x7fb2b40693c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d8085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient(hunting): picked mon.noname-c con 0x7fb2d8181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d6575640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fb2b40693c0 legacy=0x7fb2d8180d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d805b620 con 0x7fb2b40693c0 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d805c8b0 con 0x7fb2d8085b60 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d8181b60 con 0x7fb2d8181d50 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:40.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2dcbd6640 10 monclient(hunting): authenticate will time out at 691.830980s 2026-02-13T18:07:40.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d6d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 0x7fb2d812fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52352/0 (socket says 10.20.193.78:52352) 2026-02-13T18:07:40.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.773+0000 7fb2d6d76640 1 -- 10.20.193.78:0/619005648 learned_addr learned my addr 10.20.193.78:0/619005648 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2d6d76640 1 -- 10.20.193.78:0/619005648 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2d812fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443489228 0 0) 0x7fb2d8181b60 con 0x7fb2d8181d50 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): my global_id is 4559 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a4003620 con 0x7fb2d8181d50 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2114351421 0 0) 0x7fb2a4003620 con 0x7fb2d8181d50 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2d8181b60 con 0x7fb2d8181d50 2026-02-13T18:07:40.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2c8004910 con 0x7fb2d8181d50 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): dump: 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.795 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2d5d74640 1 -- 10.20.193.78:0/619005648 >> v1:10.20.193.187:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1103606941 0 0) 0x7fb2d8181b60 con 0x7fb2d8181d50 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 >> v1:10.20.193.187:6789/0 conn(0x7fb2d8085b60 legacy=0x7fb2d8181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 >> v1:10.20.193.78:6789/0 conn(0x7fb2b40693c0 legacy=0x7fb2d8180d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: _finish_hunting 0 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 monclient: found mon.c 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d805a130 con 0x7fb2d8181d50 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: _finish_auth 0 2026-02-13T18:07:40.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: _check_auth_tickets 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 5 monclient: authenticate success, global_id 4559 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 monclient: _renew_subs 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d805c490 con 0x7fb2d8181d50 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 monclient: _renew_subs 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2d805dcf0 con 0x7fb2d8181d50 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2c8006340 con 0x7fb2d8181d50 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb2c80066a0 con 0x7fb2d8181d50 2026-02-13T18:07:40.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 10 monclient: dump: 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2d4d72640 4 set_mon_vals no callback set 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb2c8012d30 con 0x7fb2d8181d50 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d80389c0 con 0x7fb2d8181d50 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(113..113 src has 1..113) ==== 3931+0+0 (unknown 1393594319 0 0) 0x7fb2c804d990 con 0x7fb2d8181d50 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.777+0000 7fb2d6575640 10 monclient: get_auth_request con 0x7fb2a403d2a0 auth_method 0 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.781+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fb2c80189f0 con 0x7fb2d8181d50 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.781+0000 7fb2beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:40.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.781+0000 7fb2beffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:40.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2dcbd6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:07:40.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2dcbd6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:40.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2dcbd6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb2d808f620 con 0x7fb2d8181d50 2026-02-13T18:07:40.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2beffd640 1 -- 10.20.193.78:0/619005648 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 2346561208) 0x7fb2d808f620 con 0x7fb2d8181d50 2026-02-13T18:07:40.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:07:40.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.901+0000 7fb2beffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:40.912 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":12,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:07:40.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb2a403d2a0 legacy=0x7fb2a405d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 10 monclient: shutdown 2026-02-13T18:07:40.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:40.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 >> v1:10.20.193.78:6790/0 conn(0x7fb2d8181d50 legacy=0x7fb2d812fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 shutdown_connections 2026-02-13T18:07:40.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 >> 10.20.193.78:0/619005648 conn(0x7fb2d8091720 msgr2=0x7fb2d808d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:40.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 shutdown_connections 2026-02-13T18:07:40.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.905+0000 7fb2dcbd6640 1 -- 10.20.193.78:0/619005648 wait complete. 2026-02-13T18:07:40.923 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:07:40.923 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:07:40.923 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient: get_monmap_and_config 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient: build_initial_monmap 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient: monmap: 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:40.977927+0000 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:40.977927+0000 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:40.984 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 1 Processor -- start 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 1 -- start start 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient: init 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient(hunting): picked mon.noname-a con 0x7f82d408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient(hunting): picked mon.noname-c con 0x7f82d408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient(hunting): picked mon.noname-b con 0x7f82d408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d4089e80 con 0x7f82d408c2f0 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d4088c20 con 0x7f82d408dc80 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82da06d640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f82d408c2f0 legacy=0x7f82d408c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d4089ba0 con 0x7f82d408cdd0 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 10 monclient(hunting): authenticate will time out at 692.033112s 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82da86e640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f82d408cdd0 0x7f82d41a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52366/0 (socket says 10.20.193.78:52366) 2026-02-13T18:07:40.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82da86e640 1 -- 10.20.193.78:0/3731470579 learned_addr learned my addr 10.20.193.78:0/3731470579 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82da86e640 1 -- 10.20.193.78:0/3731470579 >> v1:10.20.193.78:6790/0 conn(0x7f82d408cdd0 legacy=0x7f82d41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d986c640 1 -- 10.20.193.78:0/3731470579 >> v1:10.20.193.187:6789/0 conn(0x7f82d408dc80 legacy=0x7f82d4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201513364 0 0) 0x7f82d4089ba0 con 0x7f82d408cdd0 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): my global_id is 4562 2026-02-13T18:07:40.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82bc003620 con 0x7f82d408cdd0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118419441 0 0) 0x7f82d4088c20 con 0x7f82d408dc80 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient(hunting): my global_id is 4582 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d4089ba0 con 0x7f82d408dc80 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3277057376 0 0) 0x7f82bc003620 con 0x7f82d408cdd0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 >> v1:10.20.193.187:6789/0 conn(0x7f82d408dc80 legacy=0x7f82d4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 >> v1:10.20.193.78:6789/0 conn(0x7f82d408c2f0 legacy=0x7f82d408c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: _finish_hunting 0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 monclient: found mon.noname-b 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d408d370 con 0x7f82d408cdd0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: _finish_auth 0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: _check_auth_tickets 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 5 monclient: authenticate success, global_id 4562 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82d00046a0 con 0x7f82d408cdd0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: dump: 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82dc2f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82d0004930 con 0x7f82d408cdd0 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.977+0000 7f82d906b640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 4 set_mon_vals no callback set 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d906b640 1 -- 10.20.193.78:0/3731470579 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82d0006060 con 0x7f82d408cdd0 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d906b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d906b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d906b640 10 monclient: dump: 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.989 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: shutdown 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- 10.20.193.78:0/3731470579 >> v1:10.20.193.78:6790/0 conn(0x7f82d408cdd0 legacy=0x7f82d41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- 10.20.193.78:0/3731470579 shutdown_connections 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- 10.20.193.78:0/3731470579 >> 10.20.193.78:0/3731470579 conn(0x7f82d4091720 msgr2=0x7f82d4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- 10.20.193.78:0/3731470579 shutdown_connections 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- 10.20.193.78:0/3731470579 wait complete. 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: build_initial_monmap 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: monmap: 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 Processor -- start 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- start start 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: init 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient(hunting): picked mon.noname-b con 0x7f82d408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient(hunting): picked mon.noname-c con 0x7f82d408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient(hunting): picked mon.noname-a con 0x7f82d408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d4057910 con 0x7f82d408dc80 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d4088910 con 0x7f82d408c2f0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d407e060 con 0x7f82d408cdd0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82da86e640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f82d408dc80 legacy=0x7f82d4193b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82dc2f8640 10 monclient(hunting): authenticate will time out at 692.037243s 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d986c640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f82d408cdd0 0x7f82d4192440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52376/0 (socket says 10.20.193.78:52376) 2026-02-13T18:07:40.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d986c640 1 -- 10.20.193.78:0/2231919100 learned_addr learned my addr 10.20.193.78:0/2231919100 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82d986c640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d408cdd0 legacy=0x7f82d4192440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496338879 0 0) 0x7f82d407e060 con 0x7f82d408cdd0 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): my global_id is 4565 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82da06d640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.187:6789/0 conn(0x7f82d408c2f0 legacy=0x7f82d4083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82a4003620 con 0x7f82d408cdd0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532191435 0 0) 0x7f82d4088910 con 0x7f82d408c2f0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): my global_id is 4585 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d407e060 con 0x7f82d408c2f0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3092413514 0 0) 0x7f82a4003620 con 0x7f82d408cdd0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82d4088910 con 0x7f82d408cdd0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82c80033f0 con 0x7f82d408cdd0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): dump: 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.992 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.981+0000 7f82baffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3912785121 0 0) 0x7f82d407e060 con 0x7f82d408c2f0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82a4003620 con 0x7f82d408c2f0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82c4004480 con 0x7f82d408c2f0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): dump: 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2762875090 0 0) 0x7f82d4088910 con 0x7f82d408cdd0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.187:6789/0 conn(0x7f82d408c2f0 legacy=0x7f82d4083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6789/0 conn(0x7f82d408dc80 legacy=0x7f82d4193b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: _finish_hunting 0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 monclient: found mon.c 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40803c0 con 0x7f82d408cdd0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: _finish_auth 0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: _check_auth_tickets 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 5 monclient: authenticate success, global_id 4565 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 10 monclient: _renew_subs 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82d407fb20 con 0x7f82d408cdd0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 10 monclient: _renew_subs 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f82d4084020 con 0x7f82d408cdd0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82c80039c0 con 0x7f82d408cdd0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82c8003d20 con 0x7f82d408cdd0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: dump: 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82d886a640 4 set_mon_vals no callback set 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f82d408f600 con 0x7f82d4151340 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f82c8003fc0 con 0x7f82d408cdd0 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(113..113 src has 1..113) ==== 3931+0+0 (unknown 1393594319 0 0) 0x7f82c804c7a0 con 0x7f82d408cdd0 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82da86e640 10 monclient: get_auth_request con 0x7f82a403d620 auth_method 0 2026-02-13T18:07:40.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82da06d640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d4151340 legacy=0x7f82d4059af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835123099 0 0) 0x7f82d408f600 con 0x7f82d4151340 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient(hunting): my global_id is 4568 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d4088910 con 0x7f82d4151340 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3228864208 0 0) 0x7f82d4088910 con 0x7f82d4151340 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82d408f600 con 0x7f82d4151340 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82c4004b80 con 0x7f82d4151340 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 10 monclient: dump: 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:40.995 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2930423628 0 0) 0x7f82d408f600 con 0x7f82d4151340 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.985+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82d40585c0 con 0x7f82d4151340 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f82c4004e30 con 0x7f82d4151340 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82baffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82baffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d4151340 legacy=0x7f82d4059af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:40.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d4151340 legacy=0x7f82d4059af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:40.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82dc2f8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:40.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.989+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f82d4090810 con 0x7f82d405a200 2026-02-13T18:07:41.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82da06d640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d405a200 legacy=0x7f82d4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435232200 0 0) 0x7f82d4090810 con 0x7f82d405a200 2026-02-13T18:07:41.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:07:41.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient(hunting): my global_id is 4571 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d408f600 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1966941389 0 0) 0x7f82d408f600 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82d4090810 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82c4005410 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient: dump: 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2685893356 0 0) 0x7f82d4090810 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f82d40510e0 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4497 (unknown 0 0 1065467670) 0x7f82c40057a0 con 0x7f82d405a200 2026-02-13T18:07:41.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d405a200 legacy=0x7f82d4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82baffd640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d405a200 legacy=0x7f82d4196290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 12, 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 142384, 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:41.003 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:41.004 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:41.005 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:41.006 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:41.007 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.187:6812/2668687789 conn(0x7f82a403d620 legacy=0x7f82a405dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 10 monclient: shutdown 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 >> v1:10.20.193.78:6790/0 conn(0x7f82d408cdd0 legacy=0x7f82d4192440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82da86e640 1 -- 10.20.193.78:0/2231919100 reap_dead start 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82da86e640 1 -- 10.20.193.78:0/2231919100 reap_dead start 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 shutdown_connections 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 >> 10.20.193.78:0/2231919100 conn(0x7f82d4091720 msgr2=0x7f82d405cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 shutdown_connections 2026-02-13T18:07:41.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:40.993+0000 7f82dc2f8640 1 -- 10.20.193.78:0/2231919100 wait complete. 2026-02-13T18:07:41.010 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:07:41.010 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:07:41.010 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:07:41.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.069+0000 7f10254f7640 10 monclient: get_monmap_and_config 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.069+0000 7f10254f7640 10 monclient: build_initial_monmap 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.069+0000 7f10254f7640 10 monclient: monmap: 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:07:41.073372+0000 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:07:41.073372+0000 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:07:41.080 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 Processor -- start 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- start start 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient: init 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient(hunting): picked mon.noname-b con 0x7f102008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient(hunting): picked mon.noname-a con 0x7f102008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient(hunting): picked mon.noname-c con 0x7f102008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1020089e80 con 0x7f102008dc80 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1020088c20 con 0x7f102008cdd0 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1020089ba0 con 0x7f102008c2f0 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient(hunting): authenticate will time out at 692.128678s 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101e7fc640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f102008dc80 legacy=0x7f1020181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 0x7f102008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52404/0 (socket says 10.20.193.78:52404) 2026-02-13T18:07:41.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101effd640 1 -- 10.20.193.78:0/2025113629 learned_addr learned my addr 10.20.193.78:0/2025113629 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:41.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101effd640 1 -- 10.20.193.78:0/2025113629 >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 legacy=0x7f102008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942828380 0 0) 0x7f1020089ba0 con 0x7f102008c2f0 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient(hunting): my global_id is 4574 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f100c003620 con 0x7f102008c2f0 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101f7fe640 1 -- 10.20.193.78:0/2025113629 >> v1:10.20.193.187:6789/0 conn(0x7f102008cdd0 legacy=0x7f10201a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2718288184 0 0) 0x7f100c003620 con 0x7f102008c2f0 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 >> v1:10.20.193.187:6789/0 conn(0x7f102008cdd0 legacy=0x7f10201a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 >> v1:10.20.193.78:6789/0 conn(0x7f102008dc80 legacy=0x7f1020181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 monclient: found mon.noname-b 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102008d370 con 0x7f102008c2f0 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: _finish_auth 0 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 5 monclient: authenticate success, global_id 4574 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1014003110 con 0x7f102008c2f0 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: dump: 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.087 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10140033e0 con 0x7f102008c2f0 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 1 -- 10.20.193.78:0/2025113629 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1014004b50 con 0x7f102008c2f0 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f101dffb640 10 monclient: dump: 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.088 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient: get_monmap_and_config success 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 4 set_mon_vals no callback set 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 10 monclient: shutdown 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- 10.20.193.78:0/2025113629 >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 legacy=0x7f102008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- 10.20.193.78:0/2025113629 shutdown_connections 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- 10.20.193.78:0/2025113629 >> 10.20.193.78:0/2025113629 conn(0x7f1020091720 msgr2=0x7f1020091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- 10.20.193.78:0/2025113629 shutdown_connections 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.073+0000 7f10254f7640 1 -- 10.20.193.78:0/2025113629 wait complete. 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient: build_initial_monmap 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient: monmap: 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 1 Processor -- start 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 1 -- start start 2026-02-13T18:07:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient: init 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient: _reopen_session rank -1 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient(hunting): picked mon.noname-c con 0x7f102008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient(hunting): picked mon.noname-b con 0x7f102008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient(hunting): picked mon.noname-a con 0x7f102008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102007ddb0 con 0x7f102008dc80 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1020057830 con 0x7f102008cdd0 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1020088910 con 0x7f102008c2f0 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient(hunting): _renew_subs 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f10254f7640 10 monclient(hunting): authenticate will time out at 692.133117s 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f101effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 0x7f1020151010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:52414/0 (socket says 10.20.193.78:52414) 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f101effd640 1 -- 10.20.193.78:0/1311870575 learned_addr learned my addr 10.20.193.78:0/1311870575 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:07:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f101f7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.78:6789/0 conn(0x7f102008dc80 legacy=0x7f1020193a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f101effd640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 legacy=0x7f1020151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f101effd640 1 --1- 10.20.193.78:0/1311870575 >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 0x7f1020151010 :-1 s=OPENED pgs=228 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f1020088910 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f101e7fc640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f102008cdd0 legacy=0x7f1020192340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041558757 0 0) 0x7f1020057830 con 0x7f102008cdd0 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f0fff7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f0fff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f0fff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f0fff7fe640 10 monclient(hunting): my global_id is 4591 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.077+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fec003620 con 0x7f102008cdd0 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 718170276 0 0) 0x7f0fec003620 con 0x7f102008cdd0 2026-02-13T18:07:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1020057830 con 0x7f102008cdd0 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1008004480 con 0x7f102008cdd0 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): dump: 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 168744882 0 0) 0x7f1020057830 con 0x7f102008cdd0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.78:6790/0 conn(0x7f102008c2f0 legacy=0x7f1020151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.78:6789/0 conn(0x7f102008dc80 legacy=0x7f1020193a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 monclient: found mon.b 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1020080110 con 0x7f102008cdd0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: _finish_auth 0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551586789 0 0) 0x7f1020088910 con 0x7f102008c2f0 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 5 monclient: authenticate success, global_id 4591 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 10 monclient: _renew_subs 2026-02-13T18:07:41.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f102007e910 con 0x7f102008cdd0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 10 monclient: _renew_subs 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f102007d550 con 0x7f102008cdd0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f101e7fc640 1 --1- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f102008cdd0 0x7f1020192340 :-1 s=OPENED pgs=249 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f1008004af0 mon_map magic: 0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1008004750 con 0x7f102008cdd0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f101d7fa640 4 set_mon_vals no callback set 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f102008f620 con 0x7f1020151720 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1008004af0 con 0x7f102008cdd0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient: dump: 2026-02-13T18:07:41.098 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1008004dc0 con 0x7f102008cdd0 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f101f7fe640 10 monclient: get_auth_request con 0x7f0fec03d2d0 auth_method 0 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f101effd640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f1020151720 legacy=0x7f102005acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349505000 0 0) 0x7f102008d370 con 0x7f1020151720 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:07:41.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 10 monclient(hunting): my global_id is 4594 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1020088910 con 0x7f1020151720 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.081+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3225027028 0 0) 0x7f1020088910 con 0x7f1020151720 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f102008d370 con 0x7f1020151720 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1014004a90 con 0x7f1020151720 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 10 monclient: dump: 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.100 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2485950061 0 0) 0x7f102008d370 con 0x7f1020151720 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1020090810 con 0x7f1020151720 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1014002c60 con 0x7f1020151720 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f1020151720 legacy=0x7f102005acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f1020151720 legacy=0x7f102005acc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:41.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f10254f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.085+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10200510e0 con 0x7f102004d200 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f101effd640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f102004d200 legacy=0x7f1020196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159693084 0 0) 0x7f10200510e0 con 0x7f102004d200 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient(hunting): my global_id is 4597 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f102008d370 con 0x7f102004d200 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3511945691 0 0) 0x7f102008d370 con 0x7f102004d200 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10200510e0 con 0x7f102004d200 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1014005000 con 0x7f102004d200 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:07:41.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient: dump: 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1743680741 0 0) 0x7f10200510e0 con 0x7f102004d200 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1020151af0 con 0x7f102004d200 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4666 (unknown 0 0 978156099) 0x7f10140071e0 con 0x7f102004d200 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:07:41.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f102004d200 legacy=0x7f1020196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f102004d200 legacy=0x7f1020196190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 12, 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 142456, 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:07:41.105 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:41.106 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:41.107 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:41.107 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:41.107 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:41.107 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.107 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:07:41.107 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.108 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:07:41.109 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.110 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:07:41.111 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:41.112 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:07:41.113 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:07:41.114 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "num": 7 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:07:41.115 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:07:41.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6812/2668687789 conn(0x7f0fec03d2d0 legacy=0x7f0fec05d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 10 monclient: shutdown 2026-02-13T18:07:41.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:07:41.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 >> v1:10.20.193.187:6789/0 conn(0x7f102008cdd0 legacy=0x7f1020192340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f101f7fe640 1 -- 10.20.193.78:0/1311870575 reap_dead start 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f0fff7fe640 1 -- 10.20.193.78:0/1311870575 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(113..113 src has 1..113) ==== 3931+0+0 (unknown 1393594319 0 0) 0x7f100804c780 con 0x7f102008cdd0 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f101f7fe640 1 -- 10.20.193.78:0/1311870575 reap_dead start 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 shutdown_connections 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 >> 10.20.193.78:0/1311870575 conn(0x7f1020091720 msgr2=0x7f102005d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 shutdown_connections 2026-02-13T18:07:41.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:07:41.089+0000 7f10254f7640 1 -- 10.20.193.78:0/1311870575 wait complete. 2026-02-13T18:07:41.117 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:07:41.117 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:07:41.771 INFO:tasks.rados.rados.0.trial187.stdout:463: done (3 left) 2026-02-13T18:07:41.772 INFO:tasks.rados.rados.0.trial187.stdout:464: done (2 left) 2026-02-13T18:07:41.772 INFO:tasks.rados.rados.0.trial187.stdout:465: done (1 left) 2026-02-13T18:07:41.772 INFO:tasks.rados.rados.0.trial187.stdout:466: done (0 left) 2026-02-13T18:07:41.772 INFO:tasks.rados.rados.0.trial187.stdout:467: delete oid 3 current snap is 47 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:467: done (0 left) 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:468: read oid 9 snap 45 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:468: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:469: read oid 41 snap 41 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:469: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:470: write oid 49 current snap is 47 2026-02-13T18:07:41.775 INFO:tasks.rados.rados.0.trial187.stdout:470: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2026-02-13T18:07:41.784 INFO:tasks.rados.rados.0.trial187.stdout:470: writing trial18717860-49 from 793330 to 1483112 tid 1 2026-02-13T18:07:41.792 INFO:tasks.rados.rados.0.trial187.stdout:470: writing trial18717860-49 from 2035461 to 2653192 tid 2 2026-02-13T18:07:41.796 INFO:tasks.rados.rados.0.trial187.stdout:470: writing trial18717860-49 from 3101545 to 3193330 tid 3 2026-02-13T18:07:41.796 INFO:tasks.rados.rados.0.trial187.stdout:471: snap_remove snap 43 2026-02-13T18:07:42.773 INFO:tasks.rados.rados.0.trial187.stdout:471: done (3 left) 2026-02-13T18:07:42.774 INFO:tasks.rados.rados.0.trial187.stdout:472: rollback oid 47 current snap is 47 2026-02-13T18:07:42.774 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 32 2026-02-13T18:07:42.774 INFO:tasks.rados.rados.0.trial187.stdout:468: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:42.889 INFO:tasks.rados.rados.0.trial187.stdout:469: expect (ObjNum 74 snap 7 seq_num 74) 2026-02-13T18:07:42.891 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 520502 2026-02-13T18:07:42.916 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: finishing write tid 1 to trial18717860-49 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: finishing write tid 2 to trial18717860-49 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: finishing write tid 3 to trial18717860-49 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: finishing write tid 4 to trial18717860-49 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: finishing write tid 5 to trial18717860-49 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: oid 49 updating version 0 to 80 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: oid 49 updating version 80 to 81 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: oid 49 updating version 81 to 82 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:470: oid 49 updating version 82 to 83 2026-02-13T18:07:42.976 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 83 (ObjNum 190 snap 47 seq_num 190) dirty exists 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:470: left oid 49 (ObjNum 190 snap 47 seq_num 190) 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:472: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:472: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:472: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 95 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:468: done (3 left) 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:469: done (2 left) 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:470: done (1 left) 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:472: done (0 left) 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:473: read oid 5 snap -1 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:473: expect (ObjNum 171 snap 42 seq_num 171) 2026-02-13T18:07:42.977 INFO:tasks.rados.rados.0.trial187.stdout:474: delete oid 42 current snap is 47 2026-02-13T18:07:42.978 INFO:tasks.rados.rados.0.trial187.stdout:474: done (1 left) 2026-02-13T18:07:42.978 INFO:tasks.rados.rados.0.trial187.stdout:475: snap_create 2026-02-13T18:07:42.981 INFO:tasks.rados.rados.0.trial187.stdout:473: expect (ObjNum 171 snap 42 seq_num 171) 2026-02-13T18:07:42.981 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:43.032 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 831455 2026-02-13T18:07:43.055 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:43.692 INFO:tasks.rados.rados.0.trial187.stdout:473: done (1 left) 2026-02-13T18:07:43.692 INFO:tasks.rados.rados.0.trial187.stdout:475: done (0 left) 2026-02-13T18:07:43.692 INFO:tasks.rados.rados.0.trial187.stdout:476: read oid 35 snap -1 2026-02-13T18:07:43.692 INFO:tasks.rados.rados.0.trial187.stdout:476: expect (ObjNum 178 snap 44 seq_num 178) 2026-02-13T18:07:43.692 INFO:tasks.rados.rados.0.trial187.stdout:477: snap_create 2026-02-13T18:07:43.698 INFO:tasks.rados.rados.0.trial187.stdout:476: expect (ObjNum 178 snap 44 seq_num 178) 2026-02-13T18:07:43.698 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:43.758 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 56979 2026-02-13T18:07:44.694 INFO:tasks.rados.rados.0.trial187.stdout:476: done (1 left) 2026-02-13T18:07:44.694 INFO:tasks.rados.rados.0.trial187.stdout:477: done (0 left) 2026-02-13T18:07:44.694 INFO:tasks.rados.rados.0.trial187.stdout:478: snap_create 2026-02-13T18:07:45.694 INFO:tasks.rados.rados.0.trial187.stdout:478: done (0 left) 2026-02-13T18:07:45.695 INFO:tasks.rados.rados.0.trial187.stdout:479: snap_remove snap 32 2026-02-13T18:07:46.698 INFO:tasks.rados.rados.0.trial187.stdout:479: done (0 left) 2026-02-13T18:07:46.698 INFO:tasks.rados.rados.0.trial187.stdout:480: copy_from oid 15 from oid 14 current snap is 50 2026-02-13T18:07:46.698 INFO:tasks.rados.rados.0.trial187.stdout:481: read oid 36 snap -1 2026-02-13T18:07:46.698 INFO:tasks.rados.rados.0.trial187.stdout:481: expect (ObjNum 166 snap 39 seq_num 166) 2026-02-13T18:07:46.698 INFO:tasks.rados.rados.0.trial187.stdout:482: snap_create 2026-02-13T18:07:46.702 INFO:tasks.rados.rados.0.trial187.stdout:481: expect (ObjNum 166 snap 39 seq_num 166) 2026-02-13T18:07:46.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:46.810 INFO:tasks.rados.rados.0.trial187.stdout:480: finishing copy_from racing read to trial18717860-15 2026-02-13T18:07:46.810 INFO:tasks.rados.rados.0.trial187.stdout:480: finishing copy_from to trial18717860-15 2026-02-13T18:07:46.810 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 66 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:07:47.701 INFO:tasks.rados.rados.0.trial187.stdout:480: done (2 left) 2026-02-13T18:07:47.701 INFO:tasks.rados.rados.0.trial187.stdout:481: done (1 left) 2026-02-13T18:07:47.701 INFO:tasks.rados.rados.0.trial187.stdout:482: done (0 left) 2026-02-13T18:07:47.701 INFO:tasks.rados.rados.0.trial187.stdout:483: read oid 37 snap -1 2026-02-13T18:07:47.701 INFO:tasks.rados.rados.0.trial187.stdout:483: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:47.701 INFO:tasks.rados.rados.0.trial187.stdout:484: snap_remove snap 41 2026-02-13T18:07:48.691 INFO:tasks.rados.rados.0.trial187.stdout:484: done (1 left) 2026-02-13T18:07:48.691 INFO:tasks.rados.rados.0.trial187.stdout:485: read oid 27 snap -1 2026-02-13T18:07:48.691 INFO:tasks.rados.rados.0.trial187.stdout:485: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:48.691 INFO:tasks.rados.rados.0.trial187.stdout:486: delete oid 19 current snap is 51 2026-02-13T18:07:48.692 INFO:tasks.rados.rados.0.trial187.stdout:483: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:48.730 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1131644 2026-02-13T18:07:48.758 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 380059 2026-02-13T18:07:48.791 INFO:tasks.rados.rados.0.trial187.stdout:485: expect (ObjNum 149 snap 26 seq_num 149) 2026-02-13T18:07:48.819 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:48.872 INFO:tasks.rados.rados.0.trial187.stdout:483: done (2 left) 2026-02-13T18:07:48.872 INFO:tasks.rados.rados.0.trial187.stdout:485: done (1 left) 2026-02-13T18:07:48.872 INFO:tasks.rados.rados.0.trial187.stdout:486: done (0 left) 2026-02-13T18:07:48.873 INFO:tasks.rados.rados.0.trial187.stdout:487: rollback oid 21 current snap is 51 2026-02-13T18:07:48.873 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 48 2026-02-13T18:07:48.873 INFO:tasks.rados.rados.0.trial187.stdout:488: read oid 14 snap 50 2026-02-13T18:07:48.873 INFO:tasks.rados.rados.0.trial187.stdout:488: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:48.873 INFO:tasks.rados.rados.0.trial187.stdout:489: snap_create 2026-02-13T18:07:48.874 INFO:tasks.rados.rados.0.trial187.stdout:487: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:07:48.875 INFO:tasks.rados.rados.0.trial187.stdout:487: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:07:48.875 INFO:tasks.rados.rados.0.trial187.stdout:487: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:07:48.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 101 (ObjNum 183 snap 45 seq_num 183) dirty exists 2026-02-13T18:07:48.878 INFO:tasks.rados.rados.0.trial187.stdout:488: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:48.878 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:48.913 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:49.705 INFO:tasks.rados.rados.0.trial187.stdout:487: done (2 left) 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:488: done (1 left) 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:489: done (0 left) 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:490: rollback oid 22 current snap is 52 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 45 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:491: read oid 16 snap -1 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:491: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:49.706 INFO:tasks.rados.rados.0.trial187.stdout:492: read oid 50 snap 47 2026-02-13T18:07:49.707 INFO:tasks.rados.rados.0.trial187.stdout:492: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:49.707 INFO:tasks.rados.rados.0.trial187.stdout:493: delete oid 34 current snap is 52 2026-02-13T18:07:49.708 INFO:tasks.rados.rados.0.trial187.stdout:490: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:07:49.708 INFO:tasks.rados.rados.0.trial187.stdout:491: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:49.708 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:49.781 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1325475 2026-02-13T18:07:49.791 INFO:tasks.rados.rados.0.trial187.stdout:492: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:49.851 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2351043 2026-02-13T18:07:49.865 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:49.906 INFO:tasks.rados.rados.0.trial187.stdout:491: done (3 left) 2026-02-13T18:07:49.906 INFO:tasks.rados.rados.0.trial187.stdout:492: done (2 left) 2026-02-13T18:07:49.906 INFO:tasks.rados.rados.0.trial187.stdout:493: done (1 left) 2026-02-13T18:07:49.906 INFO:tasks.rados.rados.0.trial187.stdout:494: write oid 23 current snap is 52 2026-02-13T18:07:49.906 INFO:tasks.rados.rados.0.trial187.stdout:494: seq_num 194 ranges {460558=707131,1869389=508716,3094884=165674} 2026-02-13T18:07:49.914 INFO:tasks.rados.rados.0.trial187.stdout:494: writing trial18717860-23 from 460558 to 1167689 tid 1 2026-02-13T18:07:49.922 INFO:tasks.rados.rados.0.trial187.stdout:494: writing trial18717860-23 from 1869389 to 2378105 tid 2 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:494: writing trial18717860-23 from 3094884 to 3260558 tid 3 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:495: delete oid 5 current snap is 52 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:494: finishing write tid 1 to trial18717860-23 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:490: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:490: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 244 (ObjNum 142 snap 26 seq_num 142) dirty exists 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:494: finishing write tid 2 to trial18717860-23 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:494: finishing write tid 3 to trial18717860-23 2026-02-13T18:07:49.931 INFO:tasks.rados.rados.0.trial187.stdout:494: finishing write tid 4 to trial18717860-23 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: finishing write tid 5 to trial18717860-23 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: oid 23 updating version 0 to 94 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: oid 23 updating version 94 to 97 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: oid 23 version 97 is already newer than 95 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: oid 23 version 97 is already newer than 96 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 97 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: left oid 23 (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:490: done (2 left) 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:494: done (1 left) 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:495: done (0 left) 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:496: write oid 9 current snap is 52 2026-02-13T18:07:49.932 INFO:tasks.rados.rados.0.trial187.stdout:496: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2026-02-13T18:07:49.934 INFO:tasks.rados.rados.0.trial187.stdout:496: writing trial18717860-9 from 494172 to 951801 tid 1 2026-02-13T18:07:49.938 INFO:tasks.rados.rados.0.trial187.stdout:496: writing trial18717860-9 from 1586353 to 2098738 tid 2 2026-02-13T18:07:49.943 INFO:tasks.rados.rados.0.trial187.stdout:496: writing trial18717860-9 from 2749730 to 3294172 tid 3 2026-02-13T18:07:49.943 INFO:tasks.rados.rados.0.trial187.stdout:497: read oid 7 snap -1 2026-02-13T18:07:49.943 INFO:tasks.rados.rados.0.trial187.stdout:497: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:07:49.943 INFO:tasks.rados.rados.0.trial187.stdout:498: snap_create 2026-02-13T18:07:49.943 INFO:tasks.rados.rados.0.trial187.stdout:496: finishing write tid 1 to trial18717860-9 2026-02-13T18:07:49.943 INFO:tasks.rados.rados.0.trial187.stdout:496: finishing write tid 2 to trial18717860-9 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: finishing write tid 3 to trial18717860-9 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: finishing write tid 4 to trial18717860-9 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: finishing write tid 5 to trial18717860-9 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: oid 9 updating version 0 to 209 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: oid 9 version 209 is already newer than 208 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: oid 9 updating version 209 to 210 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: oid 9 version 210 is already newer than 207 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 210 (ObjNum 196 snap 52 seq_num 196) dirty exists 2026-02-13T18:07:49.945 INFO:tasks.rados.rados.0.trial187.stdout:496: left oid 9 (ObjNum 196 snap 52 seq_num 196) 2026-02-13T18:07:49.946 INFO:tasks.rados.rados.0.trial187.stdout:497: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:07:50.710 INFO:tasks.rados.rados.0.trial187.stdout:496: done (2 left) 2026-02-13T18:07:50.710 INFO:tasks.rados.rados.0.trial187.stdout:497: done (1 left) 2026-02-13T18:07:50.710 INFO:tasks.rados.rados.0.trial187.stdout:498: done (0 left) 2026-02-13T18:07:50.710 INFO:tasks.rados.rados.0.trial187.stdout:499: read oid 29 snap 52 2026-02-13T18:07:50.710 INFO:tasks.rados.rados.0.trial187.stdout:499: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:50.711 INFO:tasks.rados.rados.0.trial187.stdout:500: read oid 3 snap -1 2026-02-13T18:07:50.711 INFO:tasks.rados.rados.0.trial187.stdout:500: expect deleted 2026-02-13T18:07:50.711 INFO:tasks.rados.rados.0.trial187.stdout:501: snap_remove snap 48 2026-02-13T18:07:51.710 INFO:tasks.rados.rados.0.trial187.stdout:501: done (2 left) 2026-02-13T18:07:51.711 INFO:tasks.rados.rados.0.trial187.stdout:502: copy_from oid 33 from oid 25 current snap is 53 2026-02-13T18:07:51.711 INFO:tasks.rados.rados.0.trial187.stdout:499: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:51.711 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:51.747 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1342288 2026-02-13T18:07:51.794 INFO:tasks.rados.rados.0.trial187.stdout:502: finishing copy_from racing read to trial18717860-33 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:502: finishing copy_from to trial18717860-33 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 80 (ObjNum 172 snap 42 seq_num 172) dirty exists 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:499: done (2 left) 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:500: done (1 left) 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:502: done (0 left) 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:503: read oid 14 snap -1 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:503: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:51.795 INFO:tasks.rados.rados.0.trial187.stdout:504: snap_create 2026-02-13T18:07:51.798 INFO:tasks.rados.rados.0.trial187.stdout:503: expect (ObjNum 83 snap 10 seq_num 83) 2026-02-13T18:07:51.847 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:51.882 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:52.716 INFO:tasks.rados.rados.0.trial187.stdout:503: done (1 left) 2026-02-13T18:07:52.717 INFO:tasks.rados.rados.0.trial187.stdout:504: done (0 left) 2026-02-13T18:07:52.717 INFO:tasks.rados.rados.0.trial187.stdout:505: snap_create 2026-02-13T18:07:53.691 INFO:tasks.rados.rados.0.trial187.stdout:505: done (0 left) 2026-02-13T18:07:53.692 INFO:tasks.rados.rados.0.trial187.stdout:506: snap_remove snap 51 2026-02-13T18:07:54.693 INFO:tasks.rados.rados.0.trial187.stdout:506: done (0 left) 2026-02-13T18:07:54.693 INFO:tasks.rados.rados.0.trial187.stdout:507: read oid 21 snap 50 2026-02-13T18:07:54.693 INFO:tasks.rados.rados.0.trial187.stdout:507: expect (ObjNum 183 snap 45 seq_num 183) 2026-02-13T18:07:54.693 INFO:tasks.rados.rados.0.trial187.stdout:508: snap_create 2026-02-13T18:07:54.703 INFO:tasks.rados.rados.0.trial187.stdout:507: expect (ObjNum 183 snap 45 seq_num 183) 2026-02-13T18:07:54.735 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:54.766 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:55.694 INFO:tasks.rados.rados.0.trial187.stdout:507: done (1 left) 2026-02-13T18:07:55.694 INFO:tasks.rados.rados.0.trial187.stdout:508: done (0 left) 2026-02-13T18:07:55.694 INFO:tasks.rados.rados.0.trial187.stdout:509: read oid 28 snap -1 2026-02-13T18:07:55.694 INFO:tasks.rados.rados.0.trial187.stdout:509: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:07:55.695 INFO:tasks.rados.rados.0.trial187.stdout:510: write oid 9 current snap is 56 2026-02-13T18:07:55.695 INFO:tasks.rados.rados.0.trial187.stdout:510: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2026-02-13T18:07:55.700 INFO:tasks.rados.rados.0.trial187.stdout:510: writing trial18717860-9 from 510979 to 1043857 tid 1 2026-02-13T18:07:55.707 INFO:tasks.rados.rados.0.trial187.stdout:510: writing trial18717860-9 from 1528482 to 2300878 tid 2 2026-02-13T18:07:55.714 INFO:tasks.rados.rados.0.trial187.stdout:510: writing trial18717860-9 from 3060800 to 3310979 tid 3 2026-02-13T18:07:55.714 INFO:tasks.rados.rados.0.trial187.stdout:511: rollback oid 42 current snap is 56 2026-02-13T18:07:55.714 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 42 to 54 2026-02-13T18:07:55.715 INFO:tasks.rados.rados.0.trial187.stdout:509: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:07:55.717 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1421604 2026-02-13T18:07:55.730 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:55.755 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1591130 2026-02-13T18:07:55.768 INFO:tasks.rados.rados.0.trial187.stdout:510: finishing write tid 1 to trial18717860-9 2026-02-13T18:07:55.768 INFO:tasks.rados.rados.0.trial187.stdout:510: finishing write tid 2 to trial18717860-9 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:509: done (2 left) 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:512: read oid 43 snap 50 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:512: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:513: rollback oid 50 current snap is 56 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 50 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:510: finishing write tid 3 to trial18717860-9 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:510: finishing write tid 4 to trial18717860-9 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:510: finishing write tid 5 to trial18717860-9 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:510: oid 9 updating version 0 to 217 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:510: oid 9 updating version 217 to 218 2026-02-13T18:07:55.769 INFO:tasks.rados.rados.0.trial187.stdout:510: oid 9 version 218 is already newer than 216 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:510: oid 9 updating version 218 to 219 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 219 (ObjNum 197 snap 56 seq_num 197) dirty exists 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:510: left oid 9 (ObjNum 197 snap 56 seq_num 197) 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:511: finishing rollback tid 1 to trial18717860-42 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 0 (ObjNum 33 snap 0 seq_num 3015312224) dirty dne 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:510: done (3 left) 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:511: done (2 left) 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:514: read oid 33 snap -1 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:514: expect (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:515: copy_from oid 36 from oid 46 current snap is 56 2026-02-13T18:07:55.770 INFO:tasks.rados.rados.0.trial187.stdout:516: copy_from oid 42 from oid 12 current snap is 56 2026-02-13T18:07:55.771 INFO:tasks.rados.rados.0.trial187.stdout:517: read oid 6 snap -1 2026-02-13T18:07:55.771 INFO:tasks.rados.rados.0.trial187.stdout:517: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:55.771 INFO:tasks.rados.rados.0.trial187.stdout:518: copy_from oid 8 from oid 44 current snap is 56 2026-02-13T18:07:55.771 INFO:tasks.rados.rados.0.trial187.stdout:519: delete oid 32 current snap is 56 2026-02-13T18:07:55.771 INFO:tasks.rados.rados.0.trial187.stdout:519: done (7 left) 2026-02-13T18:07:55.771 INFO:tasks.rados.rados.0.trial187.stdout:520: write (excl) oid 3 current snap is 56 2026-02-13T18:07:55.772 INFO:tasks.rados.rados.0.trial187.stdout:520: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2026-02-13T18:07:55.776 INFO:tasks.rados.rados.0.trial187.stdout:520: writing trial18717860-3 from 544593 to 1344322 tid 1 2026-02-13T18:07:55.781 INFO:tasks.rados.rados.0.trial187.stdout:520: writing trial18717860-3 from 1761799 to 2537864 tid 2 2026-02-13T18:07:55.784 INFO:tasks.rados.rados.0.trial187.stdout:520: writing trial18717860-3 from 2948352 to 3344593 tid 3 2026-02-13T18:07:55.784 INFO:tasks.rados.rados.0.trial187.stdout:521: write (excl) oid 29 current snap is 56 2026-02-13T18:07:55.785 INFO:tasks.rados.rados.0.trial187.stdout:521: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2026-02-13T18:07:55.790 INFO:tasks.rados.rados.0.trial187.stdout:521: writing trial18717860-29 from 561400 to 1036378 tid 1 2026-02-13T18:07:55.799 INFO:tasks.rados.rados.0.trial187.stdout:521: writing trial18717860-29 from 1820281 to 2340004 tid 2 2026-02-13T18:07:55.804 INFO:tasks.rados.rados.0.trial187.stdout:521: writing trial18717860-29 from 2859422 to 3317001 tid 3 2026-02-13T18:07:55.805 INFO:tasks.rados.rados.0.trial187.stdout:522: read oid 23 snap -1 2026-02-13T18:07:55.805 INFO:tasks.rados.rados.0.trial187.stdout:522: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:07:55.805 INFO:tasks.rados.rados.0.trial187.stdout:523: read oid 35 snap -1 2026-02-13T18:07:55.805 INFO:tasks.rados.rados.0.trial187.stdout:523: expect (ObjNum 178 snap 44 seq_num 178) 2026-02-13T18:07:55.805 INFO:tasks.rados.rados.0.trial187.stdout:524: delete oid 48 current snap is 56 2026-02-13T18:07:55.805 INFO:tasks.rados.rados.0.trial187.stdout:517: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:07:55.845 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:55.890 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 757576 2026-02-13T18:07:55.923 INFO:tasks.rados.rados.0.trial187.stdout:512: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:07:55.923 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:55.949 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 678828 2026-02-13T18:07:55.974 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2780534 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:513: finishing rollback tid 0 to trial18717860-50 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:513: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:512: done (11 left) 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:517: done (10 left) 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:524: done (9 left) 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:525: write oid 32 current snap is 56 2026-02-13T18:07:55.980 INFO:tasks.rados.rados.0.trial187.stdout:525: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2026-02-13T18:07:55.988 INFO:tasks.rados.rados.0.trial187.stdout:525: writing trial18717860-32 from 595014 to 1220490 tid 1 2026-02-13T18:07:55.995 INFO:tasks.rados.rados.0.trial187.stdout:525: writing trial18717860-32 from 1820892 to 2344284 tid 2 2026-02-13T18:07:56.003 INFO:tasks.rados.rados.0.trial187.stdout:525: writing trial18717860-32 from 2797915 to 3394391 tid 3 2026-02-13T18:07:56.003 INFO:tasks.rados.rados.0.trial187.stdout:526: rollback oid 37 current snap is 56 2026-02-13T18:07:56.003 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 45 2026-02-13T18:07:56.003 INFO:tasks.rados.rados.0.trial187.stdout:513: finishing rollback tid 2 to trial18717860-50 2026-02-13T18:07:56.003 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 100 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:07:56.003 INFO:tasks.rados.rados.0.trial187.stdout:514: expect (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:07:56.102 INFO:tasks.rados.rados.0.trial187.stdout:520: finishing write tid 1 to trial18717860-3 2026-02-13T18:07:56.102 INFO:tasks.rados.rados.0.trial187.stdout:516: finishing copy_from racing read to trial18717860-42 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:513: done (10 left) 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:514: done (9 left) 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:527: copy_from oid 40 from oid 4 current snap is 56 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:515: finishing copy_from racing read to trial18717860-36 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:515: finishing copy_from to trial18717860-36 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 81 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:516: finishing copy_from to trial18717860-42 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 67 (ObjNum 150 snap 26 seq_num 150) dirty exists 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:520: finishing write tid 2 to trial18717860-3 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:518: finishing copy_from racing read to trial18717860-8 2026-02-13T18:07:56.103 INFO:tasks.rados.rados.0.trial187.stdout:520: finishing write tid 3 to trial18717860-3 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: finishing write tid 4 to trial18717860-3 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: finishing write tid 5 to trial18717860-3 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: oid 3 updating version 0 to 223 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: oid 3 version 223 is already newer than 221 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: oid 3 version 223 is already newer than 220 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: oid 3 version 223 is already newer than 222 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 223 (ObjNum 199 snap 56 seq_num 199) dirty exists 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:520: left oid 3 (ObjNum 199 snap 56 seq_num 199) 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:518: finishing copy_from to trial18717860-8 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 180 (ObjNum 130 snap 23 seq_num 130) dirty exists 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:521: finishing write tid 1 to trial18717860-29 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:521: finishing write tid 2 to trial18717860-29 2026-02-13T18:07:56.104 INFO:tasks.rados.rados.0.trial187.stdout:515: done (9 left) 2026-02-13T18:07:56.105 INFO:tasks.rados.rados.0.trial187.stdout:516: done (8 left) 2026-02-13T18:07:56.105 INFO:tasks.rados.rados.0.trial187.stdout:518: done (7 left) 2026-02-13T18:07:56.105 INFO:tasks.rados.rados.0.trial187.stdout:520: done (6 left) 2026-02-13T18:07:56.105 INFO:tasks.rados.rados.0.trial187.stdout:528: write oid 44 current snap is 56 2026-02-13T18:07:56.105 INFO:tasks.rados.rados.0.trial187.stdout:528: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2026-02-13T18:07:56.111 INFO:tasks.rados.rados.0.trial187.stdout:528: writing trial18717860-44 from 611821 to 1312546 tid 1 2026-02-13T18:07:56.120 INFO:tasks.rados.rados.0.trial187.stdout:528: writing trial18717860-44 from 1879374 to 2662777 tid 2 2026-02-13T18:07:56.126 INFO:tasks.rados.rados.0.trial187.stdout:528: writing trial18717860-44 from 3341691 to 3411821 tid 3 2026-02-13T18:07:56.126 INFO:tasks.rados.rados.0.trial187.stdout:529: read oid 7 snap -1 2026-02-13T18:07:56.126 INFO:tasks.rados.rados.0.trial187.stdout:529: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:07:56.126 INFO:tasks.rados.rados.0.trial187.stdout:530: rollback oid 12 current snap is 56 2026-02-13T18:07:56.126 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 50 2026-02-13T18:07:56.126 INFO:tasks.rados.rados.0.trial187.stdout:521: finishing write tid 3 to trial18717860-29 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: finishing write tid 4 to trial18717860-29 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: finishing write tid 5 to trial18717860-29 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: oid 29 updating version 0 to 126 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: oid 29 version 126 is already newer than 125 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: oid 29 version 126 is already newer than 123 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: oid 29 version 126 is already newer than 124 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 126 (ObjNum 200 snap 56 seq_num 200) dirty exists 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:521: left oid 29 (ObjNum 200 snap 56 seq_num 200) 2026-02-13T18:07:56.127 INFO:tasks.rados.rados.0.trial187.stdout:523: expect (ObjNum 178 snap 44 seq_num 178) 2026-02-13T18:07:56.142 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2636124 2026-02-13T18:07:56.149 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 298196 2026-02-13T18:07:56.178 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.208 INFO:tasks.rados.rados.0.trial187.stdout:522: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:07:56.208 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.233 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.258 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.284 INFO:tasks.rados.rados.0.trial187.stdout:525: finishing write tid 1 to trial18717860-32 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:525: finishing write tid 2 to trial18717860-32 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:526: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:526: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:526: finishing rollback tid 2 to trial18717860-37 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 258 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:525: finishing write tid 3 to trial18717860-32 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:525: finishing write tid 4 to trial18717860-32 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:525: finishing write tid 5 to trial18717860-32 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:525: oid 32 updating version 0 to 181 2026-02-13T18:07:56.285 INFO:tasks.rados.rados.0.trial187.stdout:525: oid 32 updating version 181 to 183 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:525: oid 32 updating version 183 to 184 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:525: oid 32 version 184 is already newer than 182 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 184 (ObjNum 202 snap 56 seq_num 202) dirty exists 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:525: left oid 32 (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:527: finishing copy_from racing read to trial18717860-40 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:527: finishing copy_from to trial18717860-40 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 106 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:528: finishing write tid 1 to trial18717860-44 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:528: finishing write tid 2 to trial18717860-44 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:521: done (8 left) 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:522: done (7 left) 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:523: done (6 left) 2026-02-13T18:07:56.286 INFO:tasks.rados.rados.0.trial187.stdout:525: done (5 left) 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:526: done (4 left) 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:527: done (3 left) 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:531: read oid 40 snap -1 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:531: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:532: read oid 49 snap -1 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:532: expect (ObjNum 190 snap 47 seq_num 190) 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:533: snap_create 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:528: finishing write tid 3 to trial18717860-44 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:528: finishing write tid 4 to trial18717860-44 2026-02-13T18:07:56.287 INFO:tasks.rados.rados.0.trial187.stdout:529: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:07:56.304 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 367526 2026-02-13T18:07:56.342 INFO:tasks.rados.rados.0.trial187.stdout:530: finishing rollback tid 0 to trial18717860-12 2026-02-13T18:07:56.342 INFO:tasks.rados.rados.0.trial187.stdout:528: finishing write tid 5 to trial18717860-44 2026-02-13T18:07:56.342 INFO:tasks.rados.rados.0.trial187.stdout:528: oid 44 updating version 0 to 262 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:528: oid 44 version 262 is already newer than 260 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:528: oid 44 version 262 is already newer than 261 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:528: oid 44 updating version 262 to 263 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 263 (ObjNum 203 snap 56 seq_num 203) dirty exists 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:528: left oid 44 (ObjNum 203 snap 56 seq_num 203) 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:530: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:530: finishing rollback tid 2 to trial18717860-12 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 89 (ObjNum 150 snap 26 seq_num 150) dirty exists 2026-02-13T18:07:56.343 INFO:tasks.rados.rados.0.trial187.stdout:531: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:56.357 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.393 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2111737 2026-02-13T18:07:56.394 INFO:tasks.rados.rados.0.trial187.stdout:532: expect (ObjNum 190 snap 47 seq_num 190) 2026-02-13T18:07:56.404 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1325681 2026-02-13T18:07:56.431 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.474 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.699 INFO:tasks.rados.rados.0.trial187.stdout:528: done (5 left) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:529: done (4 left) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:530: done (3 left) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:531: done (2 left) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:532: done (1 left) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:533: done (0 left) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:534: read oid 26 snap -1 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:534: expect (ObjNum 185 snap 45 seq_num 185) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:535: read oid 16 snap -1 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:535: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:56.700 INFO:tasks.rados.rados.0.trial187.stdout:536: copy_from oid 5 from oid 47 current snap is 57 2026-02-13T18:07:56.701 INFO:tasks.rados.rados.0.trial187.stdout:537: write oid 33 current snap is 57 2026-02-13T18:07:56.701 INFO:tasks.rados.rados.0.trial187.stdout:537: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2026-02-13T18:07:56.708 INFO:tasks.rados.rados.0.trial187.stdout:537: writing trial18717860-33 from 628628 to 1404602 tid 1 2026-02-13T18:07:56.716 INFO:tasks.rados.rados.0.trial187.stdout:537: writing trial18717860-33 from 1937856 to 2464917 tid 2 2026-02-13T18:07:56.723 INFO:tasks.rados.rados.0.trial187.stdout:537: writing trial18717860-33 from 3252761 to 3428628 tid 3 2026-02-13T18:07:56.723 INFO:tasks.rados.rados.0.trial187.stdout:538: delete oid 15 current snap is 57 2026-02-13T18:07:56.723 INFO:tasks.rados.rados.0.trial187.stdout:535: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:07:56.763 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.786 INFO:tasks.rados.rados.0.trial187.stdout:534: expect (ObjNum 185 snap 45 seq_num 185) 2026-02-13T18:07:56.818 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:56.862 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1099985 2026-02-13T18:07:56.886 INFO:tasks.rados.rados.0.trial187.stdout:536: finishing copy_from racing read to trial18717860-5 2026-02-13T18:07:56.886 INFO:tasks.rados.rados.0.trial187.stdout:536: finishing copy_from to trial18717860-5 2026-02-13T18:07:56.886 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 95 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-13T18:07:56.886 INFO:tasks.rados.rados.0.trial187.stdout:537: finishing write tid 1 to trial18717860-33 2026-02-13T18:07:56.886 INFO:tasks.rados.rados.0.trial187.stdout:537: finishing write tid 2 to trial18717860-33 2026-02-13T18:07:56.886 INFO:tasks.rados.rados.0.trial187.stdout:534: done (4 left) 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:535: done (3 left) 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:536: done (2 left) 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:538: done (1 left) 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:539: copy_from oid 17 from oid 48 current snap is 57 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: finishing write tid 3 to trial18717860-33 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: finishing write tid 4 to trial18717860-33 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: finishing write tid 5 to trial18717860-33 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: oid 33 updating version 0 to 267 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: oid 33 version 267 is already newer than 266 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: oid 33 version 267 is already newer than 265 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:537: oid 33 updating version 267 to 268 2026-02-13T18:07:56.887 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 268 (ObjNum 204 snap 57 seq_num 204) dirty exists 2026-02-13T18:07:56.888 INFO:tasks.rados.rados.0.trial187.stdout:537: left oid 33 (ObjNum 204 snap 57 seq_num 204) 2026-02-13T18:07:56.888 INFO:tasks.rados.rados.0.trial187.stdout:537: done (1 left) 2026-02-13T18:07:56.888 INFO:tasks.rados.rados.0.trial187.stdout:540: write (excl) oid 47 current snap is 57 2026-02-13T18:07:56.888 INFO:tasks.rados.rados.0.trial187.stdout:540: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2026-02-13T18:07:56.894 INFO:tasks.rados.rados.0.trial187.stdout:540: writing trial18717860-47 from 662242 to 1305067 tid 1 2026-02-13T18:07:56.903 INFO:tasks.rados.rados.0.trial187.stdout:540: writing trial18717860-47 from 2054820 to 2585550 tid 2 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:540: writing trial18717860-47 from 3307607 to 3462242 tid 3 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:541: snap_create 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:539: finishing copy_from to trial18717860-17 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:539: got expected ENOENT (src dne) 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:539: finishing copy_from racing read to trial18717860-17 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:540: finishing write tid 1 to trial18717860-47 2026-02-13T18:07:56.910 INFO:tasks.rados.rados.0.trial187.stdout:540: finishing write tid 2 to trial18717860-47 2026-02-13T18:07:56.911 INFO:tasks.rados.rados.0.trial187.stdout:540: finishing write tid 3 to trial18717860-47 2026-02-13T18:07:56.911 INFO:tasks.rados.rados.0.trial187.stdout:540: finishing write tid 4 to trial18717860-47 2026-02-13T18:07:56.911 INFO:tasks.rados.rados.0.trial187.stdout:540: finishing write tid 5 to trial18717860-47 2026-02-13T18:07:56.911 INFO:tasks.rados.rados.0.trial187.stdout:540: oid 47 updating version 0 to 112 2026-02-13T18:07:56.912 INFO:tasks.rados.rados.0.trial187.stdout:540: oid 47 version 112 is already newer than 111 2026-02-13T18:07:56.912 INFO:tasks.rados.rados.0.trial187.stdout:540: oid 47 updating version 112 to 114 2026-02-13T18:07:56.912 INFO:tasks.rados.rados.0.trial187.stdout:540: oid 47 version 114 is already newer than 113 2026-02-13T18:07:56.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 114 (ObjNum 206 snap 57 seq_num 206) dirty exists 2026-02-13T18:07:56.912 INFO:tasks.rados.rados.0.trial187.stdout:540: left oid 47 (ObjNum 206 snap 57 seq_num 206) 2026-02-13T18:07:57.703 INFO:tasks.rados.rados.0.trial187.stdout:539: done (2 left) 2026-02-13T18:07:57.703 INFO:tasks.rados.rados.0.trial187.stdout:540: done (1 left) 2026-02-13T18:07:57.703 INFO:tasks.rados.rados.0.trial187.stdout:541: done (0 left) 2026-02-13T18:07:57.703 INFO:tasks.rados.rados.0.trial187.stdout:542: write oid 16 current snap is 58 2026-02-13T18:07:57.704 INFO:tasks.rados.rados.0.trial187.stdout:542: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2026-02-13T18:07:57.712 INFO:tasks.rados.rados.0.trial187.stdout:542: writing trial18717860-16 from 679049 to 1397123 tid 1 2026-02-13T18:07:57.721 INFO:tasks.rados.rados.0.trial187.stdout:542: writing trial18717860-16 from 2113302 to 2787690 tid 2 2026-02-13T18:07:57.726 INFO:tasks.rados.rados.0.trial187.stdout:542: writing trial18717860-16 from 3335030 to 3479049 tid 3 2026-02-13T18:07:57.727 INFO:tasks.rados.rados.0.trial187.stdout:543: snap_create 2026-02-13T18:07:57.727 INFO:tasks.rados.rados.0.trial187.stdout:542: finishing write tid 1 to trial18717860-16 2026-02-13T18:07:57.727 INFO:tasks.rados.rados.0.trial187.stdout:542: finishing write tid 2 to trial18717860-16 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: finishing write tid 3 to trial18717860-16 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: finishing write tid 4 to trial18717860-16 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: finishing write tid 5 to trial18717860-16 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: oid 16 updating version 0 to 118 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: oid 16 version 118 is already newer than 116 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: oid 16 updating version 118 to 119 2026-02-13T18:07:57.728 INFO:tasks.rados.rados.0.trial187.stdout:542: oid 16 version 119 is already newer than 117 2026-02-13T18:07:57.729 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 119 (ObjNum 207 snap 58 seq_num 207) dirty exists 2026-02-13T18:07:57.729 INFO:tasks.rados.rados.0.trial187.stdout:542: left oid 16 (ObjNum 207 snap 58 seq_num 207) 2026-02-13T18:07:58.692 INFO:tasks.rados.rados.0.trial187.stdout:542: done (1 left) 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:543: done (0 left) 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:544: read oid 22 snap -1 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:544: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:545: rollback oid 13 current snap is 59 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 13 to 47 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:546: rollback oid 39 current snap is 59 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 53 2026-02-13T18:07:58.693 INFO:tasks.rados.rados.0.trial187.stdout:547: delete oid 42 current snap is 59 2026-02-13T18:07:58.696 INFO:tasks.rados.rados.0.trial187.stdout:545: finishing rollback tid 0 to trial18717860-13 2026-02-13T18:07:58.697 INFO:tasks.rados.rados.0.trial187.stdout:546: finishing rollback tid 0 to trial18717860-39 2026-02-13T18:07:58.698 INFO:tasks.rados.rados.0.trial187.stdout:546: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:07:58.698 INFO:tasks.rados.rados.0.trial187.stdout:546: finishing rollback tid 2 to trial18717860-39 2026-02-13T18:07:58.698 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 227 (ObjNum 158 snap 27 seq_num 158) dirty exists 2026-02-13T18:07:58.698 INFO:tasks.rados.rados.0.trial187.stdout:545: finishing rollback tid 1 to trial18717860-13 2026-02-13T18:07:58.698 INFO:tasks.rados.rados.0.trial187.stdout:545: finishing rollback tid 2 to trial18717860-13 2026-02-13T18:07:58.698 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 91 (ObjNum 126 snap 22 seq_num 126) dirty exists 2026-02-13T18:07:58.699 INFO:tasks.rados.rados.0.trial187.stdout:545: done (3 left) 2026-02-13T18:07:58.699 INFO:tasks.rados.rados.0.trial187.stdout:546: done (2 left) 2026-02-13T18:07:58.699 INFO:tasks.rados.rados.0.trial187.stdout:547: done (1 left) 2026-02-13T18:07:58.700 INFO:tasks.rados.rados.0.trial187.stdout:548: read oid 19 snap -1 2026-02-13T18:07:58.700 INFO:tasks.rados.rados.0.trial187.stdout:548: expect deleted 2026-02-13T18:07:58.700 INFO:tasks.rados.rados.0.trial187.stdout:549: read oid 49 snap -1 2026-02-13T18:07:58.700 INFO:tasks.rados.rados.0.trial187.stdout:549: expect (ObjNum 190 snap 47 seq_num 190) 2026-02-13T18:07:58.700 INFO:tasks.rados.rados.0.trial187.stdout:550: snap_create 2026-02-13T18:07:58.700 INFO:tasks.rados.rados.0.trial187.stdout:544: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:07:58.811 INFO:tasks.rados.rados.0.trial187.stdout:549: expect (ObjNum 190 snap 47 seq_num 190) 2026-02-13T18:07:58.811 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:07:59.694 INFO:tasks.rados.rados.0.trial187.stdout:544: done (3 left) 2026-02-13T18:07:59.694 INFO:tasks.rados.rados.0.trial187.stdout:548: done (2 left) 2026-02-13T18:07:59.694 INFO:tasks.rados.rados.0.trial187.stdout:549: done (1 left) 2026-02-13T18:07:59.694 INFO:tasks.rados.rados.0.trial187.stdout:550: done (0 left) 2026-02-13T18:07:59.695 INFO:tasks.rados.rados.0.trial187.stdout:551: delete oid 8 current snap is 60 2026-02-13T18:07:59.695 INFO:tasks.rados.rados.0.trial187.stdout:551: done (0 left) 2026-02-13T18:07:59.696 INFO:tasks.rados.rados.0.trial187.stdout:552: snap_remove snap 47 2026-02-13T18:08:00.696 INFO:tasks.rados.rados.0.trial187.stdout:552: done (0 left) 2026-02-13T18:08:00.697 INFO:tasks.rados.rados.0.trial187.stdout:553: read oid 39 snap -1 2026-02-13T18:08:00.697 INFO:tasks.rados.rados.0.trial187.stdout:553: expect (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:08:00.697 INFO:tasks.rados.rados.0.trial187.stdout:554: write (excl) oid 48 current snap is 60 2026-02-13T18:08:00.697 INFO:tasks.rados.rados.0.trial187.stdout:554: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2026-02-13T18:08:00.704 INFO:tasks.rados.rados.0.trial187.stdout:554: writing trial18717860-48 from 729470 to 1273291 tid 1 2026-02-13T18:08:00.712 INFO:tasks.rados.rados.0.trial187.stdout:554: writing trial18717860-48 from 1772395 to 2310463 tid 2 2026-02-13T18:08:00.719 INFO:tasks.rados.rados.0.trial187.stdout:554: writing trial18717860-48 from 2900946 to 3303951 tid 3 2026-02-13T18:08:00.719 INFO:tasks.rados.rados.0.trial187.stdout:555: snap_remove snap 58 2026-02-13T18:08:01.697 INFO:tasks.rados.rados.0.trial187.stdout:555: done (2 left) 2026-02-13T18:08:01.697 INFO:tasks.rados.rados.0.trial187.stdout:556: snap_remove snap 57 2026-02-13T18:08:02.699 INFO:tasks.rados.rados.0.trial187.stdout:556: done (2 left) 2026-02-13T18:08:02.699 INFO:tasks.rados.rados.0.trial187.stdout:557: read oid 7 snap 54 2026-02-13T18:08:02.699 INFO:tasks.rados.rados.0.trial187.stdout:557: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:08:02.699 INFO:tasks.rados.rados.0.trial187.stdout:558: read oid 44 snap 50 2026-02-13T18:08:02.699 INFO:tasks.rados.rados.0.trial187.stdout:558: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:08:02.699 INFO:tasks.rados.rados.0.trial187.stdout:559: snap_remove snap 49 2026-02-13T18:08:03.693 INFO:tasks.rados.rados.0.trial187.stdout:559: done (4 left) 2026-02-13T18:08:03.693 INFO:tasks.rados.rados.0.trial187.stdout:560: write (excl) oid 41 current snap is 60 2026-02-13T18:08:03.693 INFO:tasks.rados.rados.0.trial187.stdout:560: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2026-02-13T18:08:03.701 INFO:tasks.rados.rados.0.trial187.stdout:560: writing trial18717860-41 from 746277 to 1365347 tid 1 2026-02-13T18:08:03.709 INFO:tasks.rados.rados.0.trial187.stdout:560: writing trial18717860-41 from 1830877 to 2512603 tid 2 2026-02-13T18:08:03.717 INFO:tasks.rados.rados.0.trial187.stdout:560: writing trial18717860-41 from 2928369 to 3546277 tid 3 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:561: read oid 43 snap -1 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:561: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:562: read oid 12 snap -1 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:562: expect (ObjNum 150 snap 26 seq_num 150) 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:563: rollback oid 18 current snap is 60 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 54 2026-02-13T18:08:03.718 INFO:tasks.rados.rados.0.trial187.stdout:553: expect (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:08:03.719 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 620879 2026-02-13T18:08:03.746 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:03.790 INFO:tasks.rados.rados.0.trial187.stdout:554: finishing write tid 1 to trial18717860-48 2026-02-13T18:08:03.791 INFO:tasks.rados.rados.0.trial187.stdout:554: finishing write tid 2 to trial18717860-48 2026-02-13T18:08:03.791 INFO:tasks.rados.rados.0.trial187.stdout:554: finishing write tid 3 to trial18717860-48 2026-02-13T18:08:03.791 INFO:tasks.rados.rados.0.trial187.stdout:553: done (7 left) 2026-02-13T18:08:03.791 INFO:tasks.rados.rados.0.trial187.stdout:564: write oid 5 current snap is 60 2026-02-13T18:08:03.791 INFO:tasks.rados.rados.0.trial187.stdout:564: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2026-02-13T18:08:03.800 INFO:tasks.rados.rados.0.trial187.stdout:564: writing trial18717860-5 from 763084 to 1457403 tid 1 2026-02-13T18:08:03.807 INFO:tasks.rados.rados.0.trial187.stdout:564: writing trial18717860-5 from 1889359 to 2431096 tid 2 2026-02-13T18:08:03.815 INFO:tasks.rados.rados.0.trial187.stdout:564: writing trial18717860-5 from 2955792 to 3497694 tid 3 2026-02-13T18:08:03.815 INFO:tasks.rados.rados.0.trial187.stdout:565: rollback oid 9 current snap is 60 2026-02-13T18:08:03.815 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 55 2026-02-13T18:08:03.815 INFO:tasks.rados.rados.0.trial187.stdout:554: finishing write tid 4 to trial18717860-48 2026-02-13T18:08:03.815 INFO:tasks.rados.rados.0.trial187.stdout:554: finishing write tid 5 to trial18717860-48 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:554: oid 48 updating version 0 to 282 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:554: oid 48 version 282 is already newer than 280 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:554: oid 48 version 282 is already newer than 281 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:554: oid 48 version 282 is already newer than 279 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 282 (ObjNum 210 snap 60 seq_num 210) dirty exists 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:554: left oid 48 (ObjNum 210 snap 60 seq_num 210) 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:554: done (8 left) 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:566: write (excl) oid 10 current snap is 60 2026-02-13T18:08:03.816 INFO:tasks.rados.rados.0.trial187.stdout:566: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2026-02-13T18:08:03.823 INFO:tasks.rados.rados.0.trial187.stdout:566: writing trial18717860-10 from 779891 to 1265812 tid 1 2026-02-13T18:08:03.833 INFO:tasks.rados.rados.0.trial187.stdout:566: writing trial18717860-10 from 1947841 to 2633236 tid 2 2026-02-13T18:08:03.836 INFO:tasks.rados.rados.0.trial187.stdout:566: writing trial18717860-10 from 3383215 to 3579891 tid 3 2026-02-13T18:08:03.837 INFO:tasks.rados.rados.0.trial187.stdout:567: write oid 48 current snap is 60 2026-02-13T18:08:03.837 INFO:tasks.rados.rados.0.trial187.stdout:567: seq_num 214 ranges {796698=561170,2006323=545406,3126991=469707} 2026-02-13T18:08:03.842 INFO:tasks.rados.rados.0.trial187.stdout:567: writing trial18717860-48 from 796698 to 1357868 tid 1 2026-02-13T18:08:03.846 INFO:tasks.rados.rados.0.trial187.stdout:567: writing trial18717860-48 from 2006323 to 2551729 tid 2 2026-02-13T18:08:03.851 INFO:tasks.rados.rados.0.trial187.stdout:567: writing trial18717860-48 from 3126991 to 3596698 tid 3 2026-02-13T18:08:03.851 INFO:tasks.rados.rados.0.trial187.stdout:568: copy_from oid 22 from oid 15 current snap is 60 2026-02-13T18:08:03.851 INFO:tasks.rados.rados.0.trial187.stdout:558: expect (ObjNum 130 snap 23 seq_num 130) 2026-02-13T18:08:03.898 INFO:tasks.rados.rados.0.trial187.stdout:557: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:08:03.908 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1586262 2026-02-13T18:08:03.928 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:03.948 INFO:tasks.rados.rados.0.trial187.stdout:560: finishing write tid 1 to trial18717860-41 2026-02-13T18:08:03.948 INFO:tasks.rados.rados.0.trial187.stdout:560: finishing write tid 2 to trial18717860-41 2026-02-13T18:08:03.948 INFO:tasks.rados.rados.0.trial187.stdout:557: done (10 left) 2026-02-13T18:08:03.948 INFO:tasks.rados.rados.0.trial187.stdout:558: done (9 left) 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:569: snap_create 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: finishing write tid 3 to trial18717860-41 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: finishing write tid 4 to trial18717860-41 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: finishing write tid 5 to trial18717860-41 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: oid 41 updating version 0 to 113 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: oid 41 updating version 113 to 114 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: oid 41 updating version 114 to 115 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: oid 41 updating version 115 to 116 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 116 (ObjNum 211 snap 60 seq_num 211) dirty exists 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:560: left oid 41 (ObjNum 211 snap 60 seq_num 211) 2026-02-13T18:08:03.949 INFO:tasks.rados.rados.0.trial187.stdout:562: expect (ObjNum 150 snap 26 seq_num 150) 2026-02-13T18:08:03.983 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:04.061 INFO:tasks.rados.rados.0.trial187.stdout:563: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:08:04.061 INFO:tasks.rados.rados.0.trial187.stdout:563: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:08:04.061 INFO:tasks.rados.rados.0.trial187.stdout:563: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:08:04.062 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 103 (ObjNum 151 snap 26 seq_num 151) dirty exists 2026-02-13T18:08:04.062 INFO:tasks.rados.rados.0.trial187.stdout:561: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:04.076 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:04.102 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1449451 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: finishing write tid 1 to trial18717860-5 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: finishing write tid 2 to trial18717860-5 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: finishing write tid 3 to trial18717860-5 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: finishing write tid 4 to trial18717860-5 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: finishing write tid 5 to trial18717860-5 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: oid 5 updating version 0 to 132 2026-02-13T18:08:04.118 INFO:tasks.rados.rados.0.trial187.stdout:564: oid 5 version 132 is already newer than 131 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:564: oid 5 updating version 132 to 134 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:564: oid 5 version 134 is already newer than 133 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 134 (ObjNum 212 snap 60 seq_num 212) dirty exists 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:564: left oid 5 (ObjNum 212 snap 60 seq_num 212) 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:565: finishing rollback tid 0 to trial18717860-9 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:565: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:565: finishing rollback tid 2 to trial18717860-9 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 243 (ObjNum 196 snap 52 seq_num 196) dirty exists 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:566: finishing write tid 1 to trial18717860-10 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:566: finishing write tid 2 to trial18717860-10 2026-02-13T18:08:04.119 INFO:tasks.rados.rados.0.trial187.stdout:566: finishing write tid 3 to trial18717860-10 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: finishing write tid 4 to trial18717860-10 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: finishing write tid 5 to trial18717860-10 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: oid 10 updating version 0 to 97 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: oid 10 updating version 97 to 98 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: oid 10 version 98 is already newer than 95 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: oid 10 version 98 is already newer than 96 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 98 (ObjNum 213 snap 60 seq_num 213) dirty exists 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:566: left oid 10 (ObjNum 213 snap 60 seq_num 213) 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:567: finishing write tid 1 to trial18717860-48 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:567: finishing write tid 2 to trial18717860-48 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:568: finishing copy_from to trial18717860-22 2026-02-13T18:08:04.120 INFO:tasks.rados.rados.0.trial187.stdout:568: got expected ENOENT (src dne) 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:568: finishing copy_from racing read to trial18717860-22 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: finishing write tid 3 to trial18717860-48 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: finishing write tid 4 to trial18717860-48 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: finishing write tid 5 to trial18717860-48 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: oid 48 updating version 0 to 295 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: oid 48 updating version 295 to 296 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: oid 48 version 296 is already newer than 294 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: oid 48 version 296 is already newer than 293 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 296 (ObjNum 214 snap 60 seq_num 214) dirty exists 2026-02-13T18:08:04.121 INFO:tasks.rados.rados.0.trial187.stdout:567: left oid 48 (ObjNum 214 snap 60 seq_num 214) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:560: done (9 left) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:561: done (8 left) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:562: done (7 left) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:563: done (6 left) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:564: done (5 left) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:565: done (4 left) 2026-02-13T18:08:04.709 INFO:tasks.rados.rados.0.trial187.stdout:566: done (3 left) 2026-02-13T18:08:04.710 INFO:tasks.rados.rados.0.trial187.stdout:567: done (2 left) 2026-02-13T18:08:04.710 INFO:tasks.rados.rados.0.trial187.stdout:568: done (1 left) 2026-02-13T18:08:04.710 INFO:tasks.rados.rados.0.trial187.stdout:569: done (0 left) 2026-02-13T18:08:04.710 INFO:tasks.rados.rados.0.trial187.stdout:570: snap_create 2026-02-13T18:08:05.710 INFO:tasks.rados.rados.0.trial187.stdout:570: done (0 left) 2026-02-13T18:08:05.710 INFO:tasks.rados.rados.0.trial187.stdout:571: rollback oid 35 current snap is 62 2026-02-13T18:08:05.710 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 35 to 55 2026-02-13T18:08:05.710 INFO:tasks.rados.rados.0.trial187.stdout:572: read oid 15 snap -1 2026-02-13T18:08:05.710 INFO:tasks.rados.rados.0.trial187.stdout:572: expect deleted 2026-02-13T18:08:05.711 INFO:tasks.rados.rados.0.trial187.stdout:573: read oid 17 snap 55 2026-02-13T18:08:05.711 INFO:tasks.rados.rados.0.trial187.stdout:573: expect (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:08:05.711 INFO:tasks.rados.rados.0.trial187.stdout:574: read oid 11 snap -1 2026-02-13T18:08:05.711 INFO:tasks.rados.rados.0.trial187.stdout:574: expect deleted 2026-02-13T18:08:05.711 INFO:tasks.rados.rados.0.trial187.stdout:575: delete oid 1 current snap is 62 2026-02-13T18:08:05.716 INFO:tasks.rados.rados.0.trial187.stdout:573: expect (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:08:05.735 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:571: finishing rollback tid 0 to trial18717860-35 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:571: finishing rollback tid 1 to trial18717860-35 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:571: finishing rollback tid 2 to trial18717860-35 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 77 (ObjNum 178 snap 44 seq_num 178) dirty exists 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:571: done (4 left) 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:572: done (3 left) 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:573: done (2 left) 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:574: done (1 left) 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:575: done (0 left) 2026-02-13T18:08:05.776 INFO:tasks.rados.rados.0.trial187.stdout:576: read oid 28 snap -1 2026-02-13T18:08:05.777 INFO:tasks.rados.rados.0.trial187.stdout:576: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:08:05.777 INFO:tasks.rados.rados.0.trial187.stdout:577: write (excl) oid 21 current snap is 62 2026-02-13T18:08:05.777 INFO:tasks.rados.rados.0.trial187.stdout:577: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2026-02-13T18:08:05.783 INFO:tasks.rados.rados.0.trial187.stdout:577: writing trial18717860-21 from 430312 to 1141980 tid 1 2026-02-13T18:08:05.791 INFO:tasks.rados.rados.0.trial187.stdout:577: writing trial18717860-21 from 1723287 to 2272362 tid 2 2026-02-13T18:08:05.800 INFO:tasks.rados.rados.0.trial187.stdout:577: writing trial18717860-21 from 2781837 to 3485180 tid 3 2026-02-13T18:08:05.800 INFO:tasks.rados.rados.0.trial187.stdout:578: delete oid 45 current snap is 62 2026-02-13T18:08:05.800 INFO:tasks.rados.rados.0.trial187.stdout:576: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:08:05.805 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1372579 2026-02-13T18:08:05.827 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:05.859 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1545165 2026-02-13T18:08:05.872 INFO:tasks.rados.rados.0.trial187.stdout:577: finishing write tid 1 to trial18717860-21 2026-02-13T18:08:05.872 INFO:tasks.rados.rados.0.trial187.stdout:577: finishing write tid 2 to trial18717860-21 2026-02-13T18:08:05.872 INFO:tasks.rados.rados.0.trial187.stdout:577: finishing write tid 3 to trial18717860-21 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: finishing write tid 4 to trial18717860-21 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: finishing write tid 5 to trial18717860-21 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: oid 21 updating version 0 to 111 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: oid 21 version 111 is already newer than 110 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: oid 21 updating version 111 to 112 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: oid 21 version 112 is already newer than 109 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 112 (ObjNum 216 snap 62 seq_num 216) dirty exists 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: left oid 21 (ObjNum 216 snap 62 seq_num 216) 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:576: done (2 left) 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:577: done (1 left) 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:578: done (0 left) 2026-02-13T18:08:05.873 INFO:tasks.rados.rados.0.trial187.stdout:579: rollback oid 1 current snap is 62 2026-02-13T18:08:05.874 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 1 to 46 2026-02-13T18:08:05.874 INFO:tasks.rados.rados.0.trial187.stdout:580: write (excl) oid 49 current snap is 62 2026-02-13T18:08:05.874 INFO:tasks.rados.rados.0.trial187.stdout:580: seq_num 218 ranges {463926=462166,1723898=436391,2603977=725887} 2026-02-13T18:08:05.875 INFO:tasks.rados.rados.0.trial187.stdout:580: writing trial18717860-49 from 463926 to 926092 tid 1 2026-02-13T18:08:05.880 INFO:tasks.rados.rados.0.trial187.stdout:580: writing trial18717860-49 from 1723898 to 2160289 tid 2 2026-02-13T18:08:05.885 INFO:tasks.rados.rados.0.trial187.stdout:580: writing trial18717860-49 from 2603977 to 3329864 tid 3 2026-02-13T18:08:05.885 INFO:tasks.rados.rados.0.trial187.stdout:581: rollback oid 37 current snap is 62 2026-02-13T18:08:05.885 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 46 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:579: finishing rollback tid 1 to trial18717860-1 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:579: finishing rollback tid 2 to trial18717860-1 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 144 (ObjNum 182 snap 44 seq_num 182) dirty exists 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:580: finishing write tid 1 to trial18717860-49 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:580: finishing write tid 2 to trial18717860-49 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:579: done (2 left) 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:582: read oid 28 snap -1 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:582: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:583: rollback oid 14 current snap is 62 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 52 2026-02-13T18:08:05.886 INFO:tasks.rados.rados.0.trial187.stdout:584: snap_remove snap 54 2026-02-13T18:08:06.715 INFO:tasks.rados.rados.0.trial187.stdout:584: done (4 left) 2026-02-13T18:08:06.715 INFO:tasks.rados.rados.0.trial187.stdout:585: snap_create 2026-02-13T18:08:06.716 INFO:tasks.rados.rados.0.trial187.stdout:582: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:08:06.737 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:06.773 INFO:tasks.rados.rados.0.trial187.stdout:581: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:08:06.773 INFO:tasks.rados.rados.0.trial187.stdout:581: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:08:06.773 INFO:tasks.rados.rados.0.trial187.stdout:581: finishing rollback tid 2 to trial18717860-37 2026-02-13T18:08:06.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 300 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:08:06.774 INFO:tasks.rados.rados.0.trial187.stdout:580: finishing write tid 3 to trial18717860-49 2026-02-13T18:08:06.774 INFO:tasks.rados.rados.0.trial187.stdout:580: finishing write tid 4 to trial18717860-49 2026-02-13T18:08:06.774 INFO:tasks.rados.rados.0.trial187.stdout:580: finishing write tid 5 to trial18717860-49 2026-02-13T18:08:06.774 INFO:tasks.rados.rados.0.trial187.stdout:580: oid 49 updating version 0 to 104 2026-02-13T18:08:06.774 INFO:tasks.rados.rados.0.trial187.stdout:580: oid 49 version 104 is already newer than 102 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:580: oid 49 version 104 is already newer than 103 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:580: oid 49 version 104 is already newer than 101 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 104 (ObjNum 218 snap 62 seq_num 218) dirty exists 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:580: left oid 49 (ObjNum 218 snap 62 seq_num 218) 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:583: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:583: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:08:06.775 INFO:tasks.rados.rados.0.trial187.stdout:583: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:08:06.776 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 107 (ObjNum 83 snap 10 seq_num 83) dirty exists 2026-02-13T18:08:07.716 INFO:tasks.rados.rados.0.trial187.stdout:580: done (4 left) 2026-02-13T18:08:07.716 INFO:tasks.rados.rados.0.trial187.stdout:581: done (3 left) 2026-02-13T18:08:07.716 INFO:tasks.rados.rados.0.trial187.stdout:582: done (2 left) 2026-02-13T18:08:07.716 INFO:tasks.rados.rados.0.trial187.stdout:583: done (1 left) 2026-02-13T18:08:07.717 INFO:tasks.rados.rados.0.trial187.stdout:585: done (0 left) 2026-02-13T18:08:07.717 INFO:tasks.rados.rados.0.trial187.stdout:586: snap_remove snap 53 2026-02-13T18:08:08.693 INFO:tasks.rados.rados.0.trial187.stdout:586: done (0 left) 2026-02-13T18:08:08.693 INFO:tasks.rados.rados.0.trial187.stdout:587: snap_remove snap 59 2026-02-13T18:08:09.694 INFO:tasks.rados.rados.0.trial187.stdout:587: done (0 left) 2026-02-13T18:08:09.695 INFO:tasks.rados.rados.0.trial187.stdout:588: copy_from oid 27 from oid 17 current snap is 63 2026-02-13T18:08:09.695 INFO:tasks.rados.rados.0.trial187.stdout:589: write oid 46 current snap is 63 2026-02-13T18:08:09.695 INFO:tasks.rados.rados.0.trial187.stdout:589: seq_num 219 ranges {480733=537415,1782380=696402,3031400=537159} 2026-02-13T18:08:09.701 INFO:tasks.rados.rados.0.trial187.stdout:589: writing trial18717860-46 from 480733 to 1018148 tid 1 2026-02-13T18:08:09.711 INFO:tasks.rados.rados.0.trial187.stdout:589: writing trial18717860-46 from 1782380 to 2478782 tid 2 2026-02-13T18:08:09.719 INFO:tasks.rados.rados.0.trial187.stdout:589: writing trial18717860-46 from 3031400 to 3568559 tid 3 2026-02-13T18:08:09.719 INFO:tasks.rados.rados.0.trial187.stdout:590: write (excl) oid 12 current snap is 63 2026-02-13T18:08:09.719 INFO:tasks.rados.rados.0.trial187.stdout:590: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2026-02-13T18:08:09.726 INFO:tasks.rados.rados.0.trial187.stdout:590: writing trial18717860-12 from 497540 to 1110204 tid 1 2026-02-13T18:08:09.734 INFO:tasks.rados.rados.0.trial187.stdout:590: writing trial18717860-12 from 1840862 to 2280922 tid 2 2026-02-13T18:08:09.743 INFO:tasks.rados.rados.0.trial187.stdout:590: writing trial18717860-12 from 3058823 to 3523607 tid 3 2026-02-13T18:08:09.743 INFO:tasks.rados.rados.0.trial187.stdout:591: copy_from oid 35 from oid 11 current snap is 63 2026-02-13T18:08:09.743 INFO:tasks.rados.rados.0.trial187.stdout:589: finishing write tid 1 to trial18717860-46 2026-02-13T18:08:09.743 INFO:tasks.rados.rados.0.trial187.stdout:588: finishing copy_from racing read to trial18717860-27 2026-02-13T18:08:09.743 INFO:tasks.rados.rados.0.trial187.stdout:588: finishing copy_from to trial18717860-27 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 125 (ObjNum 158 snap 27 seq_num 158) dirty exists 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: finishing write tid 2 to trial18717860-46 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:588: done (3 left) 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:592: read oid 7 snap -1 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:592: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: finishing write tid 3 to trial18717860-46 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: finishing write tid 4 to trial18717860-46 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: finishing write tid 5 to trial18717860-46 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: oid 46 updating version 0 to 123 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: oid 46 version 123 is already newer than 120 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: oid 46 version 123 is already newer than 122 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:589: oid 46 version 123 is already newer than 121 2026-02-13T18:08:09.744 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 123 (ObjNum 219 snap 63 seq_num 219) dirty exists 2026-02-13T18:08:09.745 INFO:tasks.rados.rados.0.trial187.stdout:589: left oid 46 (ObjNum 219 snap 63 seq_num 219) 2026-02-13T18:08:09.745 INFO:tasks.rados.rados.0.trial187.stdout:590: finishing write tid 1 to trial18717860-12 2026-02-13T18:08:09.745 INFO:tasks.rados.rados.0.trial187.stdout:589: done (3 left) 2026-02-13T18:08:09.745 INFO:tasks.rados.rados.0.trial187.stdout:593: snap_create 2026-02-13T18:08:09.745 INFO:tasks.rados.rados.0.trial187.stdout:590: finishing write tid 2 to trial18717860-12 2026-02-13T18:08:09.746 INFO:tasks.rados.rados.0.trial187.stdout:590: finishing write tid 3 to trial18717860-12 2026-02-13T18:08:09.746 INFO:tasks.rados.rados.0.trial187.stdout:590: finishing write tid 4 to trial18717860-12 2026-02-13T18:08:09.746 INFO:tasks.rados.rados.0.trial187.stdout:590: finishing write tid 5 to trial18717860-12 2026-02-13T18:08:09.746 INFO:tasks.rados.rados.0.trial187.stdout:590: oid 12 updating version 0 to 110 2026-02-13T18:08:09.746 INFO:tasks.rados.rados.0.trial187.stdout:590: oid 12 updating version 110 to 112 2026-02-13T18:08:09.746 INFO:tasks.rados.rados.0.trial187.stdout:590: oid 12 updating version 112 to 113 2026-02-13T18:08:09.747 INFO:tasks.rados.rados.0.trial187.stdout:590: oid 12 version 113 is already newer than 111 2026-02-13T18:08:09.747 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 113 (ObjNum 220 snap 63 seq_num 220) dirty exists 2026-02-13T18:08:09.747 INFO:tasks.rados.rados.0.trial187.stdout:590: left oid 12 (ObjNum 220 snap 63 seq_num 220) 2026-02-13T18:08:09.747 INFO:tasks.rados.rados.0.trial187.stdout:592: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:08:09.757 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1162190 2026-02-13T18:08:09.801 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 468798 2026-02-13T18:08:09.819 INFO:tasks.rados.rados.0.trial187.stdout:591: finishing copy_from to trial18717860-35 2026-02-13T18:08:09.819 INFO:tasks.rados.rados.0.trial187.stdout:591: got expected ENOENT (src dne) 2026-02-13T18:08:09.819 INFO:tasks.rados.rados.0.trial187.stdout:591: finishing copy_from racing read to trial18717860-35 2026-02-13T18:08:10.698 INFO:tasks.rados.rados.0.trial187.stdout:590: done (3 left) 2026-02-13T18:08:10.698 INFO:tasks.rados.rados.0.trial187.stdout:591: done (2 left) 2026-02-13T18:08:10.698 INFO:tasks.rados.rados.0.trial187.stdout:592: done (1 left) 2026-02-13T18:08:10.698 INFO:tasks.rados.rados.0.trial187.stdout:593: done (0 left) 2026-02-13T18:08:10.698 INFO:tasks.rados.rados.0.trial187.stdout:594: snap_remove snap 56 2026-02-13T18:08:11.701 INFO:tasks.rados.rados.0.trial187.stdout:594: done (0 left) 2026-02-13T18:08:11.701 INFO:tasks.rados.rados.0.trial187.stdout:595: rollback oid 41 current snap is 64 2026-02-13T18:08:11.701 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 50 2026-02-13T18:08:11.701 INFO:tasks.rados.rados.0.trial187.stdout:596: read oid 21 snap -1 2026-02-13T18:08:11.701 INFO:tasks.rados.rados.0.trial187.stdout:596: expect (ObjNum 216 snap 62 seq_num 216) 2026-02-13T18:08:11.702 INFO:tasks.rados.rados.0.trial187.stdout:597: write oid 24 current snap is 64 2026-02-13T18:08:11.702 INFO:tasks.rados.rados.0.trial187.stdout:597: seq_num 221 ranges {514347=404266,1499344=700071,2686246=676056} 2026-02-13T18:08:11.707 INFO:tasks.rados.rados.0.trial187.stdout:597: writing trial18717860-24 from 514347 to 918613 tid 1 2026-02-13T18:08:11.716 INFO:tasks.rados.rados.0.trial187.stdout:597: writing trial18717860-24 from 1499344 to 2199415 tid 2 2026-02-13T18:08:11.724 INFO:tasks.rados.rados.0.trial187.stdout:597: writing trial18717860-24 from 2686246 to 3362302 tid 3 2026-02-13T18:08:11.724 INFO:tasks.rados.rados.0.trial187.stdout:598: snap_create 2026-02-13T18:08:11.724 INFO:tasks.rados.rados.0.trial187.stdout:596: expect (ObjNum 216 snap 62 seq_num 216) 2026-02-13T18:08:11.761 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2408297 2026-02-13T18:08:11.826 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:11.874 INFO:tasks.rados.rados.0.trial187.stdout:597: finishing write tid 1 to trial18717860-24 2026-02-13T18:08:11.874 INFO:tasks.rados.rados.0.trial187.stdout:595: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:08:11.874 INFO:tasks.rados.rados.0.trial187.stdout:595: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:595: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 130 (ObjNum 126 snap 22 seq_num 126) dirty exists 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: finishing write tid 2 to trial18717860-24 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: finishing write tid 3 to trial18717860-24 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: finishing write tid 4 to trial18717860-24 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: finishing write tid 5 to trial18717860-24 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: oid 24 updating version 0 to 92 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: oid 24 updating version 92 to 93 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: oid 24 updating version 93 to 94 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: oid 24 updating version 94 to 95 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 95 (ObjNum 221 snap 64 seq_num 221) dirty exists 2026-02-13T18:08:11.875 INFO:tasks.rados.rados.0.trial187.stdout:597: left oid 24 (ObjNum 221 snap 64 seq_num 221) 2026-02-13T18:08:12.704 INFO:tasks.rados.rados.0.trial187.stdout:595: done (3 left) 2026-02-13T18:08:12.705 INFO:tasks.rados.rados.0.trial187.stdout:596: done (2 left) 2026-02-13T18:08:12.705 INFO:tasks.rados.rados.0.trial187.stdout:597: done (1 left) 2026-02-13T18:08:12.705 INFO:tasks.rados.rados.0.trial187.stdout:598: done (0 left) 2026-02-13T18:08:12.705 INFO:tasks.rados.rados.0.trial187.stdout:599: snap_remove snap 50 2026-02-13T18:08:13.694 INFO:tasks.rados.rados.0.trial187.stdout:599: done (0 left) 2026-02-13T18:08:13.694 INFO:tasks.rados.rados.0.trial187.stdout:600: copy_from oid 4 from oid 15 current snap is 65 2026-02-13T18:08:13.695 INFO:tasks.rados.rados.0.trial187.stdout:601: delete oid 2 current snap is 65 2026-02-13T18:08:13.698 INFO:tasks.rados.rados.0.trial187.stdout:601: done (1 left) 2026-02-13T18:08:13.698 INFO:tasks.rados.rados.0.trial187.stdout:602: snap_remove snap 60 2026-02-13T18:08:15.424 INFO:tasks.rados.rados.0.trial187.stdout:602: done (1 left) 2026-02-13T18:08:15.424 INFO:tasks.rados.rados.0.trial187.stdout:603: snap_create 2026-02-13T18:08:15.424 INFO:tasks.rados.rados.0.trial187.stdout:600: finishing copy_from to trial18717860-4 2026-02-13T18:08:15.425 INFO:tasks.rados.rados.0.trial187.stdout:600: got expected ENOENT (src dne) 2026-02-13T18:08:15.425 INFO:tasks.rados.rados.0.trial187.stdout:600: finishing copy_from racing read to trial18717860-4 2026-02-13T18:08:16.425 INFO:tasks.rados.rados.0.trial187.stdout:600: done (1 left) 2026-02-13T18:08:16.426 INFO:tasks.rados.rados.0.trial187.stdout:603: done (0 left) 2026-02-13T18:08:16.426 INFO:tasks.rados.rados.0.trial187.stdout:604: read oid 32 snap -1 2026-02-13T18:08:16.426 INFO:tasks.rados.rados.0.trial187.stdout:604: expect (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:08:16.426 INFO:tasks.rados.rados.0.trial187.stdout:605: write oid 5 current snap is 66 2026-02-13T18:08:16.426 INFO:tasks.rados.rados.0.trial187.stdout:605: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2026-02-13T18:08:16.432 INFO:tasks.rados.rados.0.trial187.stdout:605: writing trial18717860-5 from 547961 to 1102725 tid 1 2026-02-13T18:08:16.440 INFO:tasks.rados.rados.0.trial187.stdout:605: writing trial18717860-5 from 1616308 to 2320048 tid 2 2026-02-13T18:08:16.448 INFO:tasks.rados.rados.0.trial187.stdout:605: writing trial18717860-5 from 2741092 to 3439692 tid 3 2026-02-13T18:08:16.448 INFO:tasks.rados.rados.0.trial187.stdout:606: snap_create 2026-02-13T18:08:16.448 INFO:tasks.rados.rados.0.trial187.stdout:604: expect (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:08:16.448 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 138077 2026-02-13T18:08:16.505 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: finishing write tid 1 to trial18717860-5 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: finishing write tid 2 to trial18717860-5 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: finishing write tid 3 to trial18717860-5 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: finishing write tid 4 to trial18717860-5 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: finishing write tid 5 to trial18717860-5 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: oid 5 updating version 0 to 160 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: oid 5 updating version 160 to 162 2026-02-13T18:08:16.530 INFO:tasks.rados.rados.0.trial187.stdout:605: oid 5 version 162 is already newer than 161 2026-02-13T18:08:16.531 INFO:tasks.rados.rados.0.trial187.stdout:605: oid 5 updating version 162 to 163 2026-02-13T18:08:16.531 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 163 (ObjNum 223 snap 66 seq_num 223) dirty exists 2026-02-13T18:08:16.531 INFO:tasks.rados.rados.0.trial187.stdout:605: left oid 5 (ObjNum 223 snap 66 seq_num 223) 2026-02-13T18:08:17.431 INFO:tasks.rados.rados.0.trial187.stdout:604: done (2 left) 2026-02-13T18:08:17.431 INFO:tasks.rados.rados.0.trial187.stdout:605: done (1 left) 2026-02-13T18:08:17.431 INFO:tasks.rados.rados.0.trial187.stdout:606: done (0 left) 2026-02-13T18:08:17.431 INFO:tasks.rados.rados.0.trial187.stdout:607: snap_create 2026-02-13T18:08:18.434 INFO:tasks.rados.rados.0.trial187.stdout:607: done (0 left) 2026-02-13T18:08:18.435 INFO:tasks.rados.rados.0.trial187.stdout:608: copy_from oid 32 from oid 20 current snap is 68 2026-02-13T18:08:18.435 INFO:tasks.rados.rados.0.trial187.stdout:609: write (excl) oid 17 current snap is 68 2026-02-13T18:08:18.435 INFO:tasks.rados.rados.0.trial187.stdout:609: seq_num 224 ranges {564768=630013,1674790=447398,2768515=626225} 2026-02-13T18:08:18.442 INFO:tasks.rados.rados.0.trial187.stdout:609: writing trial18717860-17 from 564768 to 1194781 tid 1 2026-02-13T18:08:18.448 INFO:tasks.rados.rados.0.trial187.stdout:609: writing trial18717860-17 from 1674790 to 2122188 tid 2 2026-02-13T18:08:18.457 INFO:tasks.rados.rados.0.trial187.stdout:609: writing trial18717860-17 from 2768515 to 3394740 tid 3 2026-02-13T18:08:18.457 INFO:tasks.rados.rados.0.trial187.stdout:610: snap_remove snap 62 2026-02-13T18:08:18.697 INFO:tasks.rados.rados.0.trial187.stdout:610: done (2 left) 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:611: read oid 22 snap -1 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:611: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:612: rollback oid 6 current snap is 68 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 45 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:609: finishing write tid 1 to trial18717860-17 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:609: finishing write tid 2 to trial18717860-17 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:608: finishing copy_from racing read to trial18717860-32 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:608: finishing copy_from to trial18717860-32 2026-02-13T18:08:18.698 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 80 (ObjNum 180 snap 44 seq_num 180) dirty exists 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: finishing write tid 3 to trial18717860-17 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: finishing write tid 4 to trial18717860-17 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: finishing write tid 5 to trial18717860-17 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: oid 17 updating version 0 to 264 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: oid 17 version 264 is already newer than 263 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: oid 17 updating version 264 to 265 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: oid 17 updating version 265 to 266 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 266 (ObjNum 224 snap 68 seq_num 224) dirty exists 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: left oid 17 (ObjNum 224 snap 68 seq_num 224) 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:608: done (3 left) 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:609: done (2 left) 2026-02-13T18:08:18.699 INFO:tasks.rados.rados.0.trial187.stdout:613: write (excl) oid 13 current snap is 68 2026-02-13T18:08:18.700 INFO:tasks.rados.rados.0.trial187.stdout:613: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2026-02-13T18:08:18.705 INFO:tasks.rados.rados.0.trial187.stdout:613: writing trial18717860-13 from 581575 to 1286837 tid 1 2026-02-13T18:08:18.713 INFO:tasks.rados.rados.0.trial187.stdout:613: writing trial18717860-13 from 1733272 to 2440681 tid 2 2026-02-13T18:08:18.721 INFO:tasks.rados.rados.0.trial187.stdout:613: writing trial18717860-13 from 3195938 to 3633435 tid 3 2026-02-13T18:08:18.721 INFO:tasks.rados.rados.0.trial187.stdout:614: write (excl) oid 39 current snap is 68 2026-02-13T18:08:18.721 INFO:tasks.rados.rados.0.trial187.stdout:614: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2026-02-13T18:08:18.730 INFO:tasks.rados.rados.0.trial187.stdout:614: writing trial18717860-39 from 598382 to 1378893 tid 1 2026-02-13T18:08:18.738 INFO:tasks.rados.rados.0.trial187.stdout:614: writing trial18717860-39 from 2075401 to 2526468 tid 2 2026-02-13T18:08:18.744 INFO:tasks.rados.rados.0.trial187.stdout:614: writing trial18717860-39 from 3107008 to 3755777 tid 3 2026-02-13T18:08:18.744 INFO:tasks.rados.rados.0.trial187.stdout:615: copy_from oid 48 from oid 4 current snap is 68 2026-02-13T18:08:18.744 INFO:tasks.rados.rados.0.trial187.stdout:611: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:08:18.745 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:18.854 INFO:tasks.rados.rados.0.trial187.stdout:612: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:612: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:612: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 103 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:613: finishing write tid 1 to trial18717860-13 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:613: finishing write tid 2 to trial18717860-13 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:613: finishing write tid 3 to trial18717860-13 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:611: done (4 left) 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:612: done (3 left) 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:616: copy_from oid 21 from oid 6 current snap is 68 2026-02-13T18:08:18.855 INFO:tasks.rados.rados.0.trial187.stdout:613: finishing write tid 4 to trial18717860-13 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:613: finishing write tid 5 to trial18717860-13 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:613: oid 13 updating version 0 to 125 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:613: oid 13 updating version 125 to 127 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:613: oid 13 version 127 is already newer than 124 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:613: oid 13 version 127 is already newer than 126 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 127 (ObjNum 225 snap 68 seq_num 225) dirty exists 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:613: left oid 13 (ObjNum 225 snap 68 seq_num 225) 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:614: finishing write tid 1 to trial18717860-39 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:614: finishing write tid 2 to trial18717860-39 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:614: finishing write tid 3 to trial18717860-39 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:614: finishing write tid 4 to trial18717860-39 2026-02-13T18:08:18.856 INFO:tasks.rados.rados.0.trial187.stdout:614: finishing write tid 5 to trial18717860-39 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:614: oid 39 updating version 0 to 272 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:614: oid 39 version 272 is already newer than 271 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:614: oid 39 version 272 is already newer than 270 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:614: oid 39 updating version 272 to 273 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 273 (ObjNum 226 snap 68 seq_num 226) dirty exists 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:614: left oid 39 (ObjNum 226 snap 68 seq_num 226) 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:615: finishing copy_from racing read to trial18717860-48 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:615: finishing copy_from to trial18717860-48 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 106 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:613: done (3 left) 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:614: done (2 left) 2026-02-13T18:08:18.857 INFO:tasks.rados.rados.0.trial187.stdout:615: done (1 left) 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:617: rollback oid 12 current snap is 68 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 67 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:618: read oid 39 snap 52 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:618: expect (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:619: rollback oid 46 current snap is 68 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 64 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:620: copy_from oid 50 from oid 8 current snap is 68 2026-02-13T18:08:18.858 INFO:tasks.rados.rados.0.trial187.stdout:621: snap_remove snap 65 2026-02-13T18:08:19.696 INFO:tasks.rados.rados.0.trial187.stdout:621: done (5 left) 2026-02-13T18:08:19.697 INFO:tasks.rados.rados.0.trial187.stdout:622: copy_from oid 27 from oid 44 current snap is 68 2026-02-13T18:08:19.697 INFO:tasks.rados.rados.0.trial187.stdout:618: expect (ObjNum 158 snap 27 seq_num 158) 2026-02-13T18:08:19.727 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:617: finishing rollback tid 0 to trial18717860-12 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:617: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:617: finishing rollback tid 2 to trial18717860-12 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 129 (ObjNum 220 snap 63 seq_num 220) dirty exists 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:620: finishing copy_from to trial18717860-50 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:620: got expected ENOENT (src dne) 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:620: finishing copy_from racing read to trial18717860-50 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:616: finishing copy_from racing read to trial18717860-21 2026-02-13T18:08:19.773 INFO:tasks.rados.rados.0.trial187.stdout:619: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:619: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:616: finishing copy_from to trial18717860-21 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 103 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:619: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 143 (ObjNum 219 snap 63 seq_num 219) dirty exists 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:622: finishing copy_from racing read to trial18717860-27 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:622: finishing copy_from to trial18717860-27 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 263 (ObjNum 203 snap 56 seq_num 203) dirty exists 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:616: done (5 left) 2026-02-13T18:08:19.774 INFO:tasks.rados.rados.0.trial187.stdout:617: done (4 left) 2026-02-13T18:08:19.775 INFO:tasks.rados.rados.0.trial187.stdout:618: done (3 left) 2026-02-13T18:08:19.775 INFO:tasks.rados.rados.0.trial187.stdout:619: done (2 left) 2026-02-13T18:08:19.775 INFO:tasks.rados.rados.0.trial187.stdout:620: done (1 left) 2026-02-13T18:08:19.775 INFO:tasks.rados.rados.0.trial187.stdout:622: done (0 left) 2026-02-13T18:08:19.775 INFO:tasks.rados.rados.0.trial187.stdout:623: write (excl) oid 14 current snap is 68 2026-02-13T18:08:19.775 INFO:tasks.rados.rados.0.trial187.stdout:623: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2026-02-13T18:08:19.779 INFO:tasks.rados.rados.0.trial187.stdout:623: writing trial18717860-14 from 615189 to 1070949 tid 1 2026-02-13T18:08:19.789 INFO:tasks.rados.rados.0.trial187.stdout:623: writing trial18717860-14 from 1733883 to 2444961 tid 2 2026-02-13T18:08:19.797 INFO:tasks.rados.rados.0.trial187.stdout:623: writing trial18717860-14 from 3134431 to 3594472 tid 3 2026-02-13T18:08:19.797 INFO:tasks.rados.rados.0.trial187.stdout:624: write oid 18 current snap is 68 2026-02-13T18:08:19.797 INFO:tasks.rados.rados.0.trial187.stdout:623: finishing write tid 1 to trial18717860-14 2026-02-13T18:08:19.797 INFO:tasks.rados.rados.0.trial187.stdout:623: finishing write tid 2 to trial18717860-14 2026-02-13T18:08:19.798 INFO:tasks.rados.rados.0.trial187.stdout:624: seq_num 228 ranges {631996=531009,1792365=454736,2761854=671313} 2026-02-13T18:08:19.805 INFO:tasks.rados.rados.0.trial187.stdout:624: writing trial18717860-18 from 631996 to 1163005 tid 1 2026-02-13T18:08:19.812 INFO:tasks.rados.rados.0.trial187.stdout:624: writing trial18717860-18 from 1792365 to 2247101 tid 2 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:624: writing trial18717860-18 from 2761854 to 3433167 tid 3 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:625: delete oid 6 current snap is 68 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: finishing write tid 3 to trial18717860-14 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: finishing write tid 4 to trial18717860-14 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: finishing write tid 5 to trial18717860-14 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: oid 14 updating version 0 to 130 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: oid 14 version 130 is already newer than 128 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: oid 14 version 130 is already newer than 129 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:623: oid 14 version 130 is already newer than 127 2026-02-13T18:08:19.821 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 130 (ObjNum 227 snap 68 seq_num 227) dirty exists 2026-02-13T18:08:19.822 INFO:tasks.rados.rados.0.trial187.stdout:623: left oid 14 (ObjNum 227 snap 68 seq_num 227) 2026-02-13T18:08:19.822 INFO:tasks.rados.rados.0.trial187.stdout:624: finishing write tid 1 to trial18717860-18 2026-02-13T18:08:19.822 INFO:tasks.rados.rados.0.trial187.stdout:624: finishing write tid 2 to trial18717860-18 2026-02-13T18:08:19.823 INFO:tasks.rados.rados.0.trial187.stdout:623: done (2 left) 2026-02-13T18:08:19.823 INFO:tasks.rados.rados.0.trial187.stdout:625: done (1 left) 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:626: copy_from oid 23 from oid 44 current snap is 68 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:627: read oid 4 snap -1 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:627: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:628: read oid 43 snap -1 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:628: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:629: delete oid 48 current snap is 68 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:624: finishing write tid 3 to trial18717860-18 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:624: finishing write tid 4 to trial18717860-18 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:624: finishing write tid 5 to trial18717860-18 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:624: oid 18 updating version 0 to 131 2026-02-13T18:08:19.824 INFO:tasks.rados.rados.0.trial187.stdout:624: oid 18 updating version 131 to 134 2026-02-13T18:08:19.825 INFO:tasks.rados.rados.0.trial187.stdout:624: oid 18 version 134 is already newer than 132 2026-02-13T18:08:19.825 INFO:tasks.rados.rados.0.trial187.stdout:624: oid 18 version 134 is already newer than 133 2026-02-13T18:08:19.825 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 134 (ObjNum 228 snap 68 seq_num 228) dirty exists 2026-02-13T18:08:19.825 INFO:tasks.rados.rados.0.trial187.stdout:624: left oid 18 (ObjNum 228 snap 68 seq_num 228) 2026-02-13T18:08:19.825 INFO:tasks.rados.rados.0.trial187.stdout:627: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:08:19.878 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:19.901 INFO:tasks.rados.rados.0.trial187.stdout:628: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:19.905 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1018669 2026-02-13T18:08:19.944 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2358783 2026-02-13T18:08:19.949 INFO:tasks.rados.rados.0.trial187.stdout:626: finishing copy_from racing read to trial18717860-23 2026-02-13T18:08:19.949 INFO:tasks.rados.rados.0.trial187.stdout:626: finishing copy_from to trial18717860-23 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 263 (ObjNum 203 snap 56 seq_num 203) dirty exists 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:624: done (4 left) 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:626: done (3 left) 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:627: done (2 left) 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:628: done (1 left) 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:629: done (0 left) 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:630: write (excl) oid 4 current snap is 68 2026-02-13T18:08:19.950 INFO:tasks.rados.rados.0.trial187.stdout:630: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2026-02-13T18:08:19.957 INFO:tasks.rados.rados.0.trial187.stdout:630: writing trial18717860-4 from 682417 to 1155526 tid 1 2026-02-13T18:08:19.964 INFO:tasks.rados.rados.0.trial187.stdout:630: writing trial18717860-4 from 1567811 to 2169874 tid 2 2026-02-13T18:08:19.973 INFO:tasks.rados.rados.0.trial187.stdout:630: writing trial18717860-4 from 2844123 to 3465605 tid 3 2026-02-13T18:08:19.974 INFO:tasks.rados.rados.0.trial187.stdout:631: snap_remove snap 61 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:631: done (1 left) 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:632: delete oid 3 current snap is 68 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:630: finishing write tid 1 to trial18717860-4 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:630: finishing write tid 2 to trial18717860-4 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:630: finishing write tid 3 to trial18717860-4 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:630: finishing write tid 4 to trial18717860-4 2026-02-13T18:08:20.702 INFO:tasks.rados.rados.0.trial187.stdout:630: finishing write tid 5 to trial18717860-4 2026-02-13T18:08:20.703 INFO:tasks.rados.rados.0.trial187.stdout:630: oid 4 updating version 0 to 127 2026-02-13T18:08:20.703 INFO:tasks.rados.rados.0.trial187.stdout:630: oid 4 updating version 127 to 129 2026-02-13T18:08:20.703 INFO:tasks.rados.rados.0.trial187.stdout:630: oid 4 version 129 is already newer than 126 2026-02-13T18:08:20.703 INFO:tasks.rados.rados.0.trial187.stdout:630: oid 4 version 129 is already newer than 128 2026-02-13T18:08:20.703 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 129 (ObjNum 231 snap 68 seq_num 231) dirty exists 2026-02-13T18:08:20.703 INFO:tasks.rados.rados.0.trial187.stdout:630: left oid 4 (ObjNum 231 snap 68 seq_num 231) 2026-02-13T18:08:20.704 INFO:tasks.rados.rados.0.trial187.stdout:630: done (1 left) 2026-02-13T18:08:20.704 INFO:tasks.rados.rados.0.trial187.stdout:632: done (0 left) 2026-02-13T18:08:20.705 INFO:tasks.rados.rados.0.trial187.stdout:633: copy_from oid 3 from oid 6 current snap is 68 2026-02-13T18:08:20.705 INFO:tasks.rados.rados.0.trial187.stdout:634: copy_from oid 46 from oid 39 current snap is 68 2026-02-13T18:08:20.705 INFO:tasks.rados.rados.0.trial187.stdout:635: write oid 45 current snap is 68 2026-02-13T18:08:20.705 INFO:tasks.rados.rados.0.trial187.stdout:635: seq_num 233 ranges {716031=623607,2084775=605732,3298969=617062} 2026-02-13T18:08:20.714 INFO:tasks.rados.rados.0.trial187.stdout:635: writing trial18717860-45 from 716031 to 1339638 tid 1 2026-02-13T18:08:20.723 INFO:tasks.rados.rados.0.trial187.stdout:635: writing trial18717860-45 from 2084775 to 2690507 tid 2 2026-02-13T18:08:20.732 INFO:tasks.rados.rados.0.trial187.stdout:635: writing trial18717860-45 from 3298969 to 3916031 tid 3 2026-02-13T18:08:20.732 INFO:tasks.rados.rados.0.trial187.stdout:636: write (excl) oid 10 current snap is 68 2026-02-13T18:08:20.732 INFO:tasks.rados.rados.0.trial187.stdout:633: finishing copy_from to trial18717860-3 2026-02-13T18:08:20.732 INFO:tasks.rados.rados.0.trial187.stdout:633: got expected ENOENT (src dne) 2026-02-13T18:08:20.732 INFO:tasks.rados.rados.0.trial187.stdout:633: finishing copy_from racing read to trial18717860-3 2026-02-13T18:08:20.732 INFO:tasks.rados.rados.0.trial187.stdout:636: seq_num 234 ranges {732838=698856,2026904=465743,3210039=571651} 2026-02-13T18:08:20.741 INFO:tasks.rados.rados.0.trial187.stdout:636: writing trial18717860-10 from 732838 to 1431694 tid 1 2026-02-13T18:08:20.749 INFO:tasks.rados.rados.0.trial187.stdout:636: writing trial18717860-10 from 2026904 to 2492647 tid 2 2026-02-13T18:08:20.757 INFO:tasks.rados.rados.0.trial187.stdout:636: writing trial18717860-10 from 3210039 to 3781690 tid 3 2026-02-13T18:08:20.757 INFO:tasks.rados.rados.0.trial187.stdout:633: done (3 left) 2026-02-13T18:08:20.757 INFO:tasks.rados.rados.0.trial187.stdout:637: write oid 18 current snap is 68 2026-02-13T18:08:20.758 INFO:tasks.rados.rados.0.trial187.stdout:637: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2026-02-13T18:08:20.763 INFO:tasks.rados.rados.0.trial187.stdout:637: writing trial18717860-18 from 749645 to 1523750 tid 1 2026-02-13T18:08:20.767 INFO:tasks.rados.rados.0.trial187.stdout:637: writing trial18717860-18 from 2085386 to 2694787 tid 2 2026-02-13T18:08:20.774 INFO:tasks.rados.rados.0.trial187.stdout:637: writing trial18717860-18 from 3237462 to 3949645 tid 3 2026-02-13T18:08:20.774 INFO:tasks.rados.rados.0.trial187.stdout:638: rollback oid 16 current snap is 68 2026-02-13T18:08:20.775 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 45 2026-02-13T18:08:20.775 INFO:tasks.rados.rados.0.trial187.stdout:635: finishing write tid 1 to trial18717860-45 2026-02-13T18:08:20.775 INFO:tasks.rados.rados.0.trial187.stdout:634: finishing copy_from racing read to trial18717860-46 2026-02-13T18:08:20.775 INFO:tasks.rados.rados.0.trial187.stdout:634: finishing copy_from to trial18717860-46 2026-02-13T18:08:20.775 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 273 (ObjNum 226 snap 68 seq_num 226) dirty exists 2026-02-13T18:08:20.776 INFO:tasks.rados.rados.0.trial187.stdout:634: done (4 left) 2026-02-13T18:08:20.776 INFO:tasks.rados.rados.0.trial187.stdout:639: read oid 6 snap -1 2026-02-13T18:08:20.776 INFO:tasks.rados.rados.0.trial187.stdout:639: expect deleted 2026-02-13T18:08:20.776 INFO:tasks.rados.rados.0.trial187.stdout:640: read oid 34 snap -1 2026-02-13T18:08:20.776 INFO:tasks.rados.rados.0.trial187.stdout:640: expect deleted 2026-02-13T18:08:20.776 INFO:tasks.rados.rados.0.trial187.stdout:641: read oid 49 snap -1 2026-02-13T18:08:20.777 INFO:tasks.rados.rados.0.trial187.stdout:641: expect (ObjNum 218 snap 62 seq_num 218) 2026-02-13T18:08:20.777 INFO:tasks.rados.rados.0.trial187.stdout:642: snap_create 2026-02-13T18:08:20.777 INFO:tasks.rados.rados.0.trial187.stdout:635: finishing write tid 2 to trial18717860-45 2026-02-13T18:08:20.777 INFO:tasks.rados.rados.0.trial187.stdout:635: finishing write tid 3 to trial18717860-45 2026-02-13T18:08:20.777 INFO:tasks.rados.rados.0.trial187.stdout:635: finishing write tid 4 to trial18717860-45 2026-02-13T18:08:20.778 INFO:tasks.rados.rados.0.trial187.stdout:635: finishing write tid 5 to trial18717860-45 2026-02-13T18:08:20.778 INFO:tasks.rados.rados.0.trial187.stdout:635: oid 45 updating version 0 to 172 2026-02-13T18:08:20.778 INFO:tasks.rados.rados.0.trial187.stdout:635: oid 45 updating version 172 to 175 2026-02-13T18:08:20.778 INFO:tasks.rados.rados.0.trial187.stdout:635: oid 45 version 175 is already newer than 174 2026-02-13T18:08:20.778 INFO:tasks.rados.rados.0.trial187.stdout:635: oid 45 version 175 is already newer than 173 2026-02-13T18:08:20.778 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 175 (ObjNum 233 snap 68 seq_num 233) dirty exists 2026-02-13T18:08:20.779 INFO:tasks.rados.rados.0.trial187.stdout:635: left oid 45 (ObjNum 233 snap 68 seq_num 233) 2026-02-13T18:08:20.779 INFO:tasks.rados.rados.0.trial187.stdout:636: finishing write tid 1 to trial18717860-10 2026-02-13T18:08:20.779 INFO:tasks.rados.rados.0.trial187.stdout:636: finishing write tid 2 to trial18717860-10 2026-02-13T18:08:20.779 INFO:tasks.rados.rados.0.trial187.stdout:636: finishing write tid 3 to trial18717860-10 2026-02-13T18:08:20.779 INFO:tasks.rados.rados.0.trial187.stdout:636: finishing write tid 4 to trial18717860-10 2026-02-13T18:08:20.779 INFO:tasks.rados.rados.0.trial187.stdout:636: finishing write tid 5 to trial18717860-10 2026-02-13T18:08:20.780 INFO:tasks.rados.rados.0.trial187.stdout:636: oid 10 updating version 0 to 135 2026-02-13T18:08:20.780 INFO:tasks.rados.rados.0.trial187.stdout:636: oid 10 updating version 135 to 138 2026-02-13T18:08:20.780 INFO:tasks.rados.rados.0.trial187.stdout:636: oid 10 version 138 is already newer than 137 2026-02-13T18:08:20.780 INFO:tasks.rados.rados.0.trial187.stdout:636: oid 10 version 138 is already newer than 136 2026-02-13T18:08:20.780 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 138 (ObjNum 234 snap 68 seq_num 234) dirty exists 2026-02-13T18:08:20.781 INFO:tasks.rados.rados.0.trial187.stdout:636: left oid 10 (ObjNum 234 snap 68 seq_num 234) 2026-02-13T18:08:20.781 INFO:tasks.rados.rados.0.trial187.stdout:637: finishing write tid 1 to trial18717860-18 2026-02-13T18:08:20.781 INFO:tasks.rados.rados.0.trial187.stdout:637: finishing write tid 2 to trial18717860-18 2026-02-13T18:08:20.783 INFO:tasks.rados.rados.0.trial187.stdout:638: finishing rollback tid 0 to trial18717860-16 2026-02-13T18:08:20.783 INFO:tasks.rados.rados.0.trial187.stdout:638: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:08:20.784 INFO:tasks.rados.rados.0.trial187.stdout:637: finishing write tid 3 to trial18717860-18 2026-02-13T18:08:20.784 INFO:tasks.rados.rados.0.trial187.stdout:638: finishing rollback tid 2 to trial18717860-16 2026-02-13T18:08:20.784 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 149 (ObjNum 139 snap 25 seq_num 139) dirty exists 2026-02-13T18:08:20.784 INFO:tasks.rados.rados.0.trial187.stdout:637: finishing write tid 4 to trial18717860-18 2026-02-13T18:08:20.784 INFO:tasks.rados.rados.0.trial187.stdout:637: finishing write tid 5 to trial18717860-18 2026-02-13T18:08:20.784 INFO:tasks.rados.rados.0.trial187.stdout:637: oid 18 updating version 0 to 139 2026-02-13T18:08:20.785 INFO:tasks.rados.rados.0.trial187.stdout:637: oid 18 updating version 139 to 140 2026-02-13T18:08:20.785 INFO:tasks.rados.rados.0.trial187.stdout:637: oid 18 updating version 140 to 141 2026-02-13T18:08:20.785 INFO:tasks.rados.rados.0.trial187.stdout:637: oid 18 updating version 141 to 142 2026-02-13T18:08:20.785 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 142 (ObjNum 235 snap 68 seq_num 235) dirty exists 2026-02-13T18:08:20.785 INFO:tasks.rados.rados.0.trial187.stdout:637: left oid 18 (ObjNum 235 snap 68 seq_num 235) 2026-02-13T18:08:20.785 INFO:tasks.rados.rados.0.trial187.stdout:641: expect (ObjNum 218 snap 62 seq_num 218) 2026-02-13T18:08:20.786 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:20.874 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:21.706 INFO:tasks.rados.rados.0.trial187.stdout:635: done (7 left) 2026-02-13T18:08:21.706 INFO:tasks.rados.rados.0.trial187.stdout:636: done (6 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:637: done (5 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:638: done (4 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:639: done (3 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:640: done (2 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:641: done (1 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:642: done (0 left) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:643: read oid 22 snap -1 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:643: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:08:21.707 INFO:tasks.rados.rados.0.trial187.stdout:644: delete oid 47 current snap is 69 2026-02-13T18:08:21.708 INFO:tasks.rados.rados.0.trial187.stdout:644: done (1 left) 2026-02-13T18:08:21.708 INFO:tasks.rados.rados.0.trial187.stdout:645: delete oid 37 current snap is 69 2026-02-13T18:08:21.712 INFO:tasks.rados.rados.0.trial187.stdout:643: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:08:21.712 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:21.788 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1641981 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:643: done (1 left) 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:645: done (0 left) 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:646: rollback oid 26 current snap is 69 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 63 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:647: copy_from oid 44 from oid 45 current snap is 69 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:648: rollback oid 2 current snap is 69 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 67 2026-02-13T18:08:21.799 INFO:tasks.rados.rados.0.trial187.stdout:649: snap_remove snap 66 2026-02-13T18:08:22.720 INFO:tasks.rados.rados.0.trial187.stdout:649: done (3 left) 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:650: rollback oid 23 current snap is 69 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 23 to 55 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:648: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:646: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:646: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:646: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 287 (ObjNum 185 snap 45 seq_num 185) dirty exists 2026-02-13T18:08:22.721 INFO:tasks.rados.rados.0.trial187.stdout:647: finishing copy_from racing read to trial18717860-44 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:647: finishing copy_from to trial18717860-44 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 175 (ObjNum 233 snap 68 seq_num 233) dirty exists 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:646: done (3 left) 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:647: done (2 left) 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:648: done (1 left) 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:651: read oid 6 snap -1 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:651: expect deleted 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:652: write oid 38 current snap is 69 2026-02-13T18:08:22.722 INFO:tasks.rados.rados.0.trial187.stdout:652: seq_num 238 ranges {400066=716205,1860832=139234} 2026-02-13T18:08:22.727 INFO:tasks.rados.rados.0.trial187.stdout:652: writing trial18717860-38 from 400066 to 1116271 tid 1 2026-02-13T18:08:22.733 INFO:tasks.rados.rados.0.trial187.stdout:652: writing trial18717860-38 from 1860832 to 2000066 tid 2 2026-02-13T18:08:22.733 INFO:tasks.rados.rados.0.trial187.stdout:653: write (excl) oid 11 current snap is 69 2026-02-13T18:08:22.733 INFO:tasks.rados.rados.0.trial187.stdout:653: seq_num 239 ranges {416873=791454,1919314=97559} 2026-02-13T18:08:22.741 INFO:tasks.rados.rados.0.trial187.stdout:653: writing trial18717860-11 from 416873 to 1208327 tid 1 2026-02-13T18:08:22.747 INFO:tasks.rados.rados.0.trial187.stdout:653: writing trial18717860-11 from 1919314 to 2016873 tid 2 2026-02-13T18:08:22.747 INFO:tasks.rados.rados.0.trial187.stdout:654: snap_create 2026-02-13T18:08:22.747 INFO:tasks.rados.rados.0.trial187.stdout:650: finishing rollback tid 0 to trial18717860-23 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:650: finishing rollback tid 1 to trial18717860-23 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:650: finishing rollback tid 2 to trial18717860-23 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 266 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: finishing write tid 1 to trial18717860-38 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: finishing write tid 2 to trial18717860-38 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: finishing write tid 3 to trial18717860-38 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: finishing write tid 4 to trial18717860-38 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: oid 38 updating version 0 to 90 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: oid 38 version 90 is already newer than 88 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: oid 38 version 90 is already newer than 89 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 90 (ObjNum 238 snap 69 seq_num 238) dirty exists 2026-02-13T18:08:22.748 INFO:tasks.rados.rados.0.trial187.stdout:652: left oid 38 (ObjNum 238 snap 69 seq_num 238) 2026-02-13T18:08:22.749 INFO:tasks.rados.rados.0.trial187.stdout:653: finishing write tid 1 to trial18717860-11 2026-02-13T18:08:22.749 INFO:tasks.rados.rados.0.trial187.stdout:653: finishing write tid 2 to trial18717860-11 2026-02-13T18:08:22.749 INFO:tasks.rados.rados.0.trial187.stdout:653: finishing write tid 3 to trial18717860-11 2026-02-13T18:08:22.750 INFO:tasks.rados.rados.0.trial187.stdout:653: finishing write tid 4 to trial18717860-11 2026-02-13T18:08:22.750 INFO:tasks.rados.rados.0.trial187.stdout:653: oid 11 updating version 0 to 123 2026-02-13T18:08:22.750 INFO:tasks.rados.rados.0.trial187.stdout:653: oid 11 version 123 is already newer than 121 2026-02-13T18:08:22.750 INFO:tasks.rados.rados.0.trial187.stdout:653: oid 11 version 123 is already newer than 122 2026-02-13T18:08:22.750 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 123 (ObjNum 239 snap 69 seq_num 239) dirty exists 2026-02-13T18:08:22.750 INFO:tasks.rados.rados.0.trial187.stdout:653: left oid 11 (ObjNum 239 snap 69 seq_num 239) 2026-02-13T18:08:23.697 INFO:tasks.rados.rados.0.trial187.stdout:650: done (4 left) 2026-02-13T18:08:23.697 INFO:tasks.rados.rados.0.trial187.stdout:651: done (3 left) 2026-02-13T18:08:23.697 INFO:tasks.rados.rados.0.trial187.stdout:652: done (2 left) 2026-02-13T18:08:23.697 INFO:tasks.rados.rados.0.trial187.stdout:653: done (1 left) 2026-02-13T18:08:23.697 INFO:tasks.rados.rados.0.trial187.stdout:654: done (0 left) 2026-02-13T18:08:23.697 INFO:tasks.rados.rados.0.trial187.stdout:655: snap_create 2026-02-13T18:08:24.697 INFO:tasks.rados.rados.0.trial187.stdout:655: done (0 left) 2026-02-13T18:08:24.697 INFO:tasks.rados.rados.0.trial187.stdout:656: delete oid 39 current snap is 71 2026-02-13T18:08:24.700 INFO:tasks.rados.rados.0.trial187.stdout:656: done (0 left) 2026-02-13T18:08:24.701 INFO:tasks.rados.rados.0.trial187.stdout:657: snap_remove snap 46 2026-02-13T18:08:25.698 INFO:tasks.rados.rados.0.trial187.stdout:657: done (0 left) 2026-02-13T18:08:25.698 INFO:tasks.rados.rados.0.trial187.stdout:658: write oid 40 current snap is 71 2026-02-13T18:08:25.698 INFO:tasks.rados.rados.0.trial187.stdout:658: seq_num 241 ranges {450487=541952,1636278=414209} 2026-02-13T18:08:25.705 INFO:tasks.rados.rados.0.trial187.stdout:658: writing trial18717860-40 from 450487 to 992439 tid 1 2026-02-13T18:08:25.712 INFO:tasks.rados.rados.0.trial187.stdout:658: writing trial18717860-40 from 1636278 to 2050487 tid 2 2026-02-13T18:08:25.713 INFO:tasks.rados.rados.0.trial187.stdout:659: rollback oid 17 current snap is 71 2026-02-13T18:08:25.713 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 64 2026-02-13T18:08:25.713 INFO:tasks.rados.rados.0.trial187.stdout:658: finishing write tid 1 to trial18717860-40 2026-02-13T18:08:25.713 INFO:tasks.rados.rados.0.trial187.stdout:660: copy_from oid 16 from oid 4 current snap is 71 2026-02-13T18:08:25.713 INFO:tasks.rados.rados.0.trial187.stdout:661: snap_create 2026-02-13T18:08:25.715 INFO:tasks.rados.rados.0.trial187.stdout:658: finishing write tid 2 to trial18717860-40 2026-02-13T18:08:25.715 INFO:tasks.rados.rados.0.trial187.stdout:658: finishing write tid 3 to trial18717860-40 2026-02-13T18:08:25.715 INFO:tasks.rados.rados.0.trial187.stdout:658: finishing write tid 4 to trial18717860-40 2026-02-13T18:08:25.715 INFO:tasks.rados.rados.0.trial187.stdout:658: oid 40 updating version 0 to 185 2026-02-13T18:08:25.715 INFO:tasks.rados.rados.0.trial187.stdout:658: oid 40 version 185 is already newer than 183 2026-02-13T18:08:25.715 INFO:tasks.rados.rados.0.trial187.stdout:658: oid 40 version 185 is already newer than 184 2026-02-13T18:08:25.716 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 185 (ObjNum 241 snap 71 seq_num 241) dirty exists 2026-02-13T18:08:25.716 INFO:tasks.rados.rados.0.trial187.stdout:658: left oid 40 (ObjNum 241 snap 71 seq_num 241) 2026-02-13T18:08:25.716 INFO:tasks.rados.rados.0.trial187.stdout:659: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:08:25.716 INFO:tasks.rados.rados.0.trial187.stdout:659: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:08:25.717 INFO:tasks.rados.rados.0.trial187.stdout:659: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:08:25.717 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 311 (ObjNum 158 snap 27 seq_num 158) dirty exists 2026-02-13T18:08:25.726 INFO:tasks.rados.rados.0.trial187.stdout:660: finishing copy_from racing read to trial18717860-16 2026-02-13T18:08:25.727 INFO:tasks.rados.rados.0.trial187.stdout:660: finishing copy_from to trial18717860-16 2026-02-13T18:08:25.727 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 129 (ObjNum 231 snap 68 seq_num 231) dirty exists 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:658: done (3 left) 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:659: done (2 left) 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:660: done (1 left) 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:661: done (0 left) 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:662: read oid 31 snap 71 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:662: expect deleted 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:663: read oid 47 snap 64 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:663: expect (ObjNum 206 snap 57 seq_num 206) 2026-02-13T18:08:26.701 INFO:tasks.rados.rados.0.trial187.stdout:664: write oid 10 current snap is 72 2026-02-13T18:08:26.702 INFO:tasks.rados.rados.0.trial187.stdout:664: seq_num 242 ranges {467294=617201,1578407=488887} 2026-02-13T18:08:26.708 INFO:tasks.rados.rados.0.trial187.stdout:664: writing trial18717860-10 from 467294 to 1084495 tid 1 2026-02-13T18:08:26.715 INFO:tasks.rados.rados.0.trial187.stdout:664: writing trial18717860-10 from 1578407 to 2067294 tid 2 2026-02-13T18:08:26.716 INFO:tasks.rados.rados.0.trial187.stdout:665: snap_create 2026-02-13T18:08:26.716 INFO:tasks.rados.rados.0.trial187.stdout:663: expect (ObjNum 206 snap 57 seq_num 206) 2026-02-13T18:08:26.716 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:26.817 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1787308 2026-02-13T18:08:26.839 INFO:tasks.rados.rados.0.trial187.stdout:664: finishing write tid 1 to trial18717860-10 2026-02-13T18:08:26.839 INFO:tasks.rados.rados.0.trial187.stdout:664: finishing write tid 2 to trial18717860-10 2026-02-13T18:08:26.839 INFO:tasks.rados.rados.0.trial187.stdout:664: finishing write tid 3 to trial18717860-10 2026-02-13T18:08:26.839 INFO:tasks.rados.rados.0.trial187.stdout:664: finishing write tid 4 to trial18717860-10 2026-02-13T18:08:26.840 INFO:tasks.rados.rados.0.trial187.stdout:664: oid 10 updating version 0 to 150 2026-02-13T18:08:26.840 INFO:tasks.rados.rados.0.trial187.stdout:664: oid 10 version 150 is already newer than 148 2026-02-13T18:08:26.840 INFO:tasks.rados.rados.0.trial187.stdout:664: oid 10 version 150 is already newer than 149 2026-02-13T18:08:26.840 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 150 (ObjNum 242 snap 72 seq_num 242) dirty exists 2026-02-13T18:08:26.840 INFO:tasks.rados.rados.0.trial187.stdout:664: left oid 10 (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:08:27.703 INFO:tasks.rados.rados.0.trial187.stdout:662: done (3 left) 2026-02-13T18:08:27.703 INFO:tasks.rados.rados.0.trial187.stdout:663: done (2 left) 2026-02-13T18:08:27.703 INFO:tasks.rados.rados.0.trial187.stdout:664: done (1 left) 2026-02-13T18:08:27.703 INFO:tasks.rados.rados.0.trial187.stdout:665: done (0 left) 2026-02-13T18:08:27.703 INFO:tasks.rados.rados.0.trial187.stdout:666: snap_remove snap 69 2026-02-13T18:08:28.696 INFO:tasks.rados.rados.0.trial187.stdout:666: done (0 left) 2026-02-13T18:08:28.697 INFO:tasks.rados.rados.0.trial187.stdout:667: delete oid 26 current snap is 73 2026-02-13T18:08:28.701 INFO:tasks.rados.rados.0.trial187.stdout:667: done (0 left) 2026-02-13T18:08:28.701 INFO:tasks.rados.rados.0.trial187.stdout:668: write (excl) oid 32 current snap is 73 2026-02-13T18:08:28.701 INFO:tasks.rados.rados.0.trial187.stdout:668: seq_num 244 ranges {500908=484052,1411724=689184} 2026-02-13T18:08:28.707 INFO:tasks.rados.rados.0.trial187.stdout:668: writing trial18717860-32 from 500908 to 984960 tid 1 2026-02-13T18:08:28.715 INFO:tasks.rados.rados.0.trial187.stdout:668: writing trial18717860-32 from 1411724 to 2100908 tid 2 2026-02-13T18:08:28.715 INFO:tasks.rados.rados.0.trial187.stdout:669: delete oid 35 current snap is 73 2026-02-13T18:08:28.715 INFO:tasks.rados.rados.0.trial187.stdout:668: finishing write tid 1 to trial18717860-32 2026-02-13T18:08:28.717 INFO:tasks.rados.rados.0.trial187.stdout:669: done (1 left) 2026-02-13T18:08:28.717 INFO:tasks.rados.rados.0.trial187.stdout:670: read oid 37 snap -1 2026-02-13T18:08:28.717 INFO:tasks.rados.rados.0.trial187.stdout:670: expect deleted 2026-02-13T18:08:28.717 INFO:tasks.rados.rados.0.trial187.stdout:671: read oid 45 snap 70 2026-02-13T18:08:28.717 INFO:tasks.rados.rados.0.trial187.stdout:671: expect (ObjNum 233 snap 68 seq_num 233) 2026-02-13T18:08:28.717 INFO:tasks.rados.rados.0.trial187.stdout:672: snap_remove snap 55 2026-02-13T18:08:29.708 INFO:tasks.rados.rados.0.trial187.stdout:672: done (3 left) 2026-02-13T18:08:29.709 INFO:tasks.rados.rados.0.trial187.stdout:673: read oid 28 snap 45 2026-02-13T18:08:29.709 INFO:tasks.rados.rados.0.trial187.stdout:673: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:08:29.709 INFO:tasks.rados.rados.0.trial187.stdout:674: write (excl) oid 34 current snap is 73 2026-02-13T18:08:29.709 INFO:tasks.rados.rados.0.trial187.stdout:674: seq_num 246 ranges {534522=634550,1812335=322187} 2026-02-13T18:08:29.716 INFO:tasks.rados.rados.0.trial187.stdout:674: writing trial18717860-34 from 534522 to 1169072 tid 1 2026-02-13T18:08:29.723 INFO:tasks.rados.rados.0.trial187.stdout:674: writing trial18717860-34 from 1812335 to 2134522 tid 2 2026-02-13T18:08:29.723 INFO:tasks.rados.rados.0.trial187.stdout:675: snap_remove snap 68 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:675: done (5 left) 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:676: snap_create 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:668: finishing write tid 2 to trial18717860-32 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:668: finishing write tid 3 to trial18717860-32 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:668: finishing write tid 4 to trial18717860-32 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:668: oid 32 updating version 0 to 187 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:668: oid 32 version 187 is already newer than 186 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:668: oid 32 updating version 187 to 188 2026-02-13T18:08:30.712 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 188 (ObjNum 244 snap 73 seq_num 244) dirty exists 2026-02-13T18:08:30.713 INFO:tasks.rados.rados.0.trial187.stdout:668: left oid 32 (ObjNum 244 snap 73 seq_num 244) 2026-02-13T18:08:30.713 INFO:tasks.rados.rados.0.trial187.stdout:671: expect (ObjNum 233 snap 68 seq_num 233) 2026-02-13T18:08:30.807 INFO:tasks.rados.rados.0.trial187.stdout:673: expect (ObjNum 165 snap 39 seq_num 165) 2026-02-13T18:08:30.859 INFO:tasks.rados.rados.0.trial187.stdout:674: finishing write tid 1 to trial18717860-34 2026-02-13T18:08:30.859 INFO:tasks.rados.rados.0.trial187.stdout:674: finishing write tid 2 to trial18717860-34 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:674: finishing write tid 3 to trial18717860-34 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:674: finishing write tid 4 to trial18717860-34 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:674: oid 34 updating version 0 to 131 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:674: oid 34 updating version 131 to 132 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:674: oid 34 version 132 is already newer than 130 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 132 (ObjNum 246 snap 73 seq_num 246) dirty exists 2026-02-13T18:08:30.860 INFO:tasks.rados.rados.0.trial187.stdout:674: left oid 34 (ObjNum 246 snap 73 seq_num 246) 2026-02-13T18:08:31.721 INFO:tasks.rados.rados.0.trial187.stdout:668: done (5 left) 2026-02-13T18:08:31.721 INFO:tasks.rados.rados.0.trial187.stdout:670: done (4 left) 2026-02-13T18:08:31.721 INFO:tasks.rados.rados.0.trial187.stdout:671: done (3 left) 2026-02-13T18:08:31.722 INFO:tasks.rados.rados.0.trial187.stdout:673: done (2 left) 2026-02-13T18:08:31.722 INFO:tasks.rados.rados.0.trial187.stdout:674: done (1 left) 2026-02-13T18:08:31.722 INFO:tasks.rados.rados.0.trial187.stdout:676: done (0 left) 2026-02-13T18:08:31.722 INFO:tasks.rados.rados.0.trial187.stdout:677: snap_remove snap 73 2026-02-13T18:08:32.723 INFO:tasks.rados.rados.0.trial187.stdout:677: done (0 left) 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:678: read oid 8 snap -1 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:678: expect deleted 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:679: read oid 44 snap -1 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:679: expect (ObjNum 233 snap 68 seq_num 233) 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:680: read oid 14 snap 70 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:680: expect (ObjNum 227 snap 68 seq_num 227) 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:681: read oid 7 snap -1 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:681: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:682: copy_from oid 16 from oid 25 current snap is 74 2026-02-13T18:08:32.724 INFO:tasks.rados.rados.0.trial187.stdout:683: rollback oid 3 current snap is 74 2026-02-13T18:08:32.725 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 67 2026-02-13T18:08:32.725 INFO:tasks.rados.rados.0.trial187.stdout:684: write oid 46 current snap is 74 2026-02-13T18:08:32.725 INFO:tasks.rados.rados.0.trial187.stdout:684: seq_num 247 ranges {551329=709799,1870817=280512} 2026-02-13T18:08:32.731 INFO:tasks.rados.rados.0.trial187.stdout:684: writing trial18717860-46 from 551329 to 1261128 tid 1 2026-02-13T18:08:32.737 INFO:tasks.rados.rados.0.trial187.stdout:684: writing trial18717860-46 from 1870817 to 2151329 tid 2 2026-02-13T18:08:32.738 INFO:tasks.rados.rados.0.trial187.stdout:685: read oid 19 snap -1 2026-02-13T18:08:32.738 INFO:tasks.rados.rados.0.trial187.stdout:685: expect deleted 2026-02-13T18:08:32.738 INFO:tasks.rados.rados.0.trial187.stdout:686: write oid 36 current snap is 74 2026-02-13T18:08:32.738 INFO:tasks.rados.rados.0.trial187.stdout:686: seq_num 248 ranges {568136=785048,1929299=238837} 2026-02-13T18:08:32.746 INFO:tasks.rados.rados.0.trial187.stdout:686: writing trial18717860-36 from 568136 to 1353184 tid 1 2026-02-13T18:08:32.752 INFO:tasks.rados.rados.0.trial187.stdout:686: writing trial18717860-36 from 1929299 to 2168136 tid 2 2026-02-13T18:08:32.752 INFO:tasks.rados.rados.0.trial187.stdout:687: copy_from oid 40 from oid 11 current snap is 74 2026-02-13T18:08:32.752 INFO:tasks.rados.rados.0.trial187.stdout:683: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:08:32.753 INFO:tasks.rados.rados.0.trial187.stdout:683: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:08:32.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 333 (ObjNum 199 snap 56 seq_num 199) dirty exists 2026-02-13T18:08:32.753 INFO:tasks.rados.rados.0.trial187.stdout:681: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T18:08:32.764 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1472197 2026-02-13T18:08:32.801 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:32.820 INFO:tasks.rados.rados.0.trial187.stdout:680: expect (ObjNum 227 snap 68 seq_num 227) 2026-02-13T18:08:32.909 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:32.959 INFO:tasks.rados.rados.0.trial187.stdout:684: finishing write tid 1 to trial18717860-46 2026-02-13T18:08:32.959 INFO:tasks.rados.rados.0.trial187.stdout:679: expect (ObjNum 233 snap 68 seq_num 233) 2026-02-13T18:08:32.959 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:32.995 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3239970 2026-02-13T18:08:33.032 INFO:tasks.rados.rados.0.trial187.stdout:684: finishing write tid 2 to trial18717860-46 2026-02-13T18:08:33.032 INFO:tasks.rados.rados.0.trial187.stdout:684: finishing write tid 3 to trial18717860-46 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:684: finishing write tid 4 to trial18717860-46 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:684: oid 46 updating version 0 to 276 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:684: oid 46 version 276 is already newer than 274 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:684: oid 46 version 276 is already newer than 275 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 276 (ObjNum 247 snap 74 seq_num 247) dirty exists 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:684: left oid 46 (ObjNum 247 snap 74 seq_num 247) 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:682: finishing copy_from racing read to trial18717860-16 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:682: finishing copy_from to trial18717860-16 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 80 (ObjNum 172 snap 42 seq_num 172) dirty exists 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:686: finishing write tid 1 to trial18717860-36 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:686: finishing write tid 2 to trial18717860-36 2026-02-13T18:08:33.033 INFO:tasks.rados.rados.0.trial187.stdout:686: finishing write tid 3 to trial18717860-36 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:686: finishing write tid 4 to trial18717860-36 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:686: oid 36 updating version 0 to 269 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:686: oid 36 version 269 is already newer than 268 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:686: oid 36 version 269 is already newer than 267 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 269 (ObjNum 248 snap 74 seq_num 248) dirty exists 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:686: left oid 36 (ObjNum 248 snap 74 seq_num 248) 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:687: finishing copy_from racing read to trial18717860-40 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:687: finishing copy_from to trial18717860-40 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 123 (ObjNum 239 snap 69 seq_num 239) dirty exists 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:678: done (9 left) 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:679: done (8 left) 2026-02-13T18:08:33.034 INFO:tasks.rados.rados.0.trial187.stdout:680: done (7 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:681: done (6 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:682: done (5 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:683: done (4 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:684: done (3 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:685: done (2 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:686: done (1 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:687: done (0 left) 2026-02-13T18:08:33.035 INFO:tasks.rados.rados.0.trial187.stdout:688: delete oid 32 current snap is 74 2026-02-13T18:08:33.036 INFO:tasks.rados.rados.0.trial187.stdout:688: done (0 left) 2026-02-13T18:08:33.036 INFO:tasks.rados.rados.0.trial187.stdout:689: copy_from oid 30 from oid 26 current snap is 74 2026-02-13T18:08:33.036 INFO:tasks.rados.rados.0.trial187.stdout:690: snap_create 2026-02-13T18:08:33.038 INFO:tasks.rados.rados.0.trial187.stdout:689: finishing copy_from to trial18717860-30 2026-02-13T18:08:33.038 INFO:tasks.rados.rados.0.trial187.stdout:689: got expected ENOENT (src dne) 2026-02-13T18:08:33.038 INFO:tasks.rados.rados.0.trial187.stdout:689: finishing copy_from racing read to trial18717860-30 2026-02-13T18:08:33.708 INFO:tasks.rados.rados.0.trial187.stdout:689: done (1 left) 2026-02-13T18:08:33.709 INFO:tasks.rados.rados.0.trial187.stdout:690: done (0 left) 2026-02-13T18:08:33.709 INFO:tasks.rados.rados.0.trial187.stdout:691: read oid 30 snap -1 2026-02-13T18:08:33.709 INFO:tasks.rados.rados.0.trial187.stdout:691: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:08:33.709 INFO:tasks.rados.rados.0.trial187.stdout:692: delete oid 18 current snap is 75 2026-02-13T18:08:33.714 INFO:tasks.rados.rados.0.trial187.stdout:692: done (1 left) 2026-02-13T18:08:33.714 INFO:tasks.rados.rados.0.trial187.stdout:693: write oid 4 current snap is 75 2026-02-13T18:08:33.714 INFO:tasks.rados.rados.0.trial187.stdout:693: seq_num 251 ranges {618557=727148,2104745=113812} 2026-02-13T18:08:33.723 INFO:tasks.rados.rados.0.trial187.stdout:693: writing trial18717860-4 from 618557 to 1345705 tid 1 2026-02-13T18:08:33.729 INFO:tasks.rados.rados.0.trial187.stdout:693: writing trial18717860-4 from 2104745 to 2218557 tid 2 2026-02-13T18:08:33.729 INFO:tasks.rados.rados.0.trial187.stdout:694: rollback oid 12 current snap is 75 2026-02-13T18:08:33.729 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 64 2026-02-13T18:08:33.729 INFO:tasks.rados.rados.0.trial187.stdout:691: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:08:33.762 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:693: finishing write tid 1 to trial18717860-4 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:693: finishing write tid 2 to trial18717860-4 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:693: finishing write tid 3 to trial18717860-4 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:691: done (2 left) 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:695: snap_create 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:694: finishing rollback tid 0 to trial18717860-12 2026-02-13T18:08:33.781 INFO:tasks.rados.rados.0.trial187.stdout:693: finishing write tid 4 to trial18717860-4 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:693: oid 4 updating version 0 to 141 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:693: oid 4 version 141 is already newer than 139 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:693: oid 4 version 141 is already newer than 140 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 141 (ObjNum 251 snap 75 seq_num 251) dirty exists 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:693: left oid 4 (ObjNum 251 snap 75 seq_num 251) 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:694: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:694: finishing rollback tid 2 to trial18717860-12 2026-02-13T18:08:33.782 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 162 (ObjNum 220 snap 63 seq_num 220) dirty exists 2026-02-13T18:08:34.713 INFO:tasks.rados.rados.0.trial187.stdout:693: done (2 left) 2026-02-13T18:08:34.714 INFO:tasks.rados.rados.0.trial187.stdout:694: done (1 left) 2026-02-13T18:08:34.714 INFO:tasks.rados.rados.0.trial187.stdout:695: done (0 left) 2026-02-13T18:08:34.714 INFO:tasks.rados.rados.0.trial187.stdout:696: snap_remove snap 45 2026-02-13T18:08:35.715 INFO:tasks.rados.rados.0.trial187.stdout:696: done (0 left) 2026-02-13T18:08:35.715 INFO:tasks.rados.rados.0.trial187.stdout:697: write oid 33 current snap is 76 2026-02-13T18:08:35.716 INFO:tasks.rados.rados.0.trial187.stdout:697: seq_num 252 ranges {635364=402397,1763227=472137} 2026-02-13T18:08:35.722 INFO:tasks.rados.rados.0.trial187.stdout:697: writing trial18717860-33 from 635364 to 1037761 tid 1 2026-02-13T18:08:35.730 INFO:tasks.rados.rados.0.trial187.stdout:697: writing trial18717860-33 from 1763227 to 2235364 tid 2 2026-02-13T18:08:35.731 INFO:tasks.rados.rados.0.trial187.stdout:698: snap_create 2026-02-13T18:08:35.731 INFO:tasks.rados.rados.0.trial187.stdout:697: finishing write tid 1 to trial18717860-33 2026-02-13T18:08:35.732 INFO:tasks.rados.rados.0.trial187.stdout:697: finishing write tid 2 to trial18717860-33 2026-02-13T18:08:35.733 INFO:tasks.rados.rados.0.trial187.stdout:697: finishing write tid 3 to trial18717860-33 2026-02-13T18:08:35.733 INFO:tasks.rados.rados.0.trial187.stdout:697: finishing write tid 4 to trial18717860-33 2026-02-13T18:08:35.733 INFO:tasks.rados.rados.0.trial187.stdout:697: oid 33 updating version 0 to 388 2026-02-13T18:08:35.733 INFO:tasks.rados.rados.0.trial187.stdout:697: oid 33 version 388 is already newer than 387 2026-02-13T18:08:35.733 INFO:tasks.rados.rados.0.trial187.stdout:697: oid 33 updating version 388 to 389 2026-02-13T18:08:35.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 389 (ObjNum 252 snap 76 seq_num 252) dirty exists 2026-02-13T18:08:35.734 INFO:tasks.rados.rados.0.trial187.stdout:697: left oid 33 (ObjNum 252 snap 76 seq_num 252) 2026-02-13T18:08:36.717 INFO:tasks.rados.rados.0.trial187.stdout:697: done (1 left) 2026-02-13T18:08:36.718 INFO:tasks.rados.rados.0.trial187.stdout:698: done (0 left) 2026-02-13T18:08:36.718 INFO:tasks.rados.rados.0.trial187.stdout:699: copy_from oid 32 from oid 29 current snap is 77 2026-02-13T18:08:36.718 INFO:tasks.rados.rados.0.trial187.stdout:700: write (excl) oid 19 current snap is 77 2026-02-13T18:08:36.718 INFO:tasks.rados.rados.0.trial187.stdout:700: seq_num 253 ranges {652171=477646,1821709=430462} 2026-02-13T18:08:36.725 INFO:tasks.rados.rados.0.trial187.stdout:700: writing trial18717860-19 from 652171 to 1129817 tid 1 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:700: writing trial18717860-19 from 1821709 to 2252171 tid 2 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:701: read oid 49 snap -1 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:701: expect (ObjNum 218 snap 62 seq_num 218) 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:702: read oid 48 snap -1 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:702: expect deleted 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:703: write (excl) oid 38 current snap is 77 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:700: finishing write tid 1 to trial18717860-19 2026-02-13T18:08:36.733 INFO:tasks.rados.rados.0.trial187.stdout:699: finishing copy_from racing read to trial18717860-32 2026-02-13T18:08:36.734 INFO:tasks.rados.rados.0.trial187.stdout:699: finishing copy_from to trial18717860-32 2026-02-13T18:08:36.734 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 126 (ObjNum 200 snap 56 seq_num 200) dirty exists 2026-02-13T18:08:36.734 INFO:tasks.rados.rados.0.trial187.stdout:703: seq_num 254 ranges {668978=552895,1763838=505140} 2026-02-13T18:08:36.740 INFO:tasks.rados.rados.0.trial187.stdout:703: writing trial18717860-38 from 668978 to 1221873 tid 1 2026-02-13T18:08:36.748 INFO:tasks.rados.rados.0.trial187.stdout:703: writing trial18717860-38 from 1763838 to 2268978 tid 2 2026-02-13T18:08:36.748 INFO:tasks.rados.rados.0.trial187.stdout:699: done (4 left) 2026-02-13T18:08:36.748 INFO:tasks.rados.rados.0.trial187.stdout:704: rollback oid 46 current snap is 77 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 67 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: finishing write tid 2 to trial18717860-19 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: finishing write tid 3 to trial18717860-19 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: finishing write tid 4 to trial18717860-19 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: oid 19 updating version 0 to 198 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: oid 19 updating version 198 to 199 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: oid 19 version 199 is already newer than 197 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 199 (ObjNum 253 snap 77 seq_num 253) dirty exists 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:700: left oid 19 (ObjNum 253 snap 77 seq_num 253) 2026-02-13T18:08:36.749 INFO:tasks.rados.rados.0.trial187.stdout:701: expect (ObjNum 218 snap 62 seq_num 218) 2026-02-13T18:08:36.789 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3524545 2026-02-13T18:08:36.828 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 268063 2026-02-13T18:08:36.865 INFO:tasks.rados.rados.0.trial187.stdout:703: finishing write tid 1 to trial18717860-38 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:703: finishing write tid 2 to trial18717860-38 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:703: finishing write tid 3 to trial18717860-38 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:700: done (4 left) 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:701: done (3 left) 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:702: done (2 left) 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:705: copy_from oid 9 from oid 1 current snap is 77 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:703: finishing write tid 4 to trial18717860-38 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:703: oid 38 updating version 0 to 112 2026-02-13T18:08:36.866 INFO:tasks.rados.rados.0.trial187.stdout:703: oid 38 version 112 is already newer than 110 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:703: oid 38 version 112 is already newer than 111 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 112 (ObjNum 254 snap 77 seq_num 254) dirty exists 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:703: left oid 38 (ObjNum 254 snap 77 seq_num 254) 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:704: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:704: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:704: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 279 (ObjNum 219 snap 63 seq_num 219) dirty exists 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:703: done (2 left) 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:704: done (1 left) 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:706: write oid 38 current snap is 77 2026-02-13T18:08:36.867 INFO:tasks.rados.rados.0.trial187.stdout:706: seq_num 255 ranges {685785=628144,1822320=463465} 2026-02-13T18:08:36.873 INFO:tasks.rados.rados.0.trial187.stdout:706: writing trial18717860-38 from 685785 to 1313929 tid 1 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:706: writing trial18717860-38 from 1822320 to 2285785 tid 2 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:707: copy_from oid 26 from oid 32 current snap is 77 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:705: finishing copy_from racing read to trial18717860-9 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:705: finishing copy_from to trial18717860-9 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 144 (ObjNum 182 snap 44 seq_num 182) dirty exists 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:706: finishing write tid 1 to trial18717860-38 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:705: done (2 left) 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:708: read oid 14 snap -1 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:708: expect (ObjNum 227 snap 68 seq_num 227) 2026-02-13T18:08:36.881 INFO:tasks.rados.rados.0.trial187.stdout:709: read oid 31 snap -1 2026-02-13T18:08:36.882 INFO:tasks.rados.rados.0.trial187.stdout:709: expect deleted 2026-02-13T18:08:36.882 INFO:tasks.rados.rados.0.trial187.stdout:710: write oid 27 current snap is 77 2026-02-13T18:08:36.882 INFO:tasks.rados.rados.0.trial187.stdout:710: seq_num 256 ranges {702592=703393,1880802=421790} 2026-02-13T18:08:36.889 INFO:tasks.rados.rados.0.trial187.stdout:710: writing trial18717860-27 from 702592 to 1405985 tid 1 2026-02-13T18:08:36.896 INFO:tasks.rados.rados.0.trial187.stdout:710: writing trial18717860-27 from 1880802 to 2302592 tid 2 2026-02-13T18:08:36.896 INFO:tasks.rados.rados.0.trial187.stdout:711: snap_create 2026-02-13T18:08:36.896 INFO:tasks.rados.rados.0.trial187.stdout:706: finishing write tid 2 to trial18717860-38 2026-02-13T18:08:36.896 INFO:tasks.rados.rados.0.trial187.stdout:706: finishing write tid 3 to trial18717860-38 2026-02-13T18:08:36.896 INFO:tasks.rados.rados.0.trial187.stdout:706: finishing write tid 4 to trial18717860-38 2026-02-13T18:08:36.896 INFO:tasks.rados.rados.0.trial187.stdout:706: oid 38 updating version 0 to 114 2026-02-13T18:08:36.897 INFO:tasks.rados.rados.0.trial187.stdout:706: oid 38 updating version 114 to 115 2026-02-13T18:08:36.897 INFO:tasks.rados.rados.0.trial187.stdout:706: oid 38 version 115 is already newer than 113 2026-02-13T18:08:36.897 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 115 (ObjNum 255 snap 77 seq_num 255) dirty exists 2026-02-13T18:08:36.897 INFO:tasks.rados.rados.0.trial187.stdout:706: left oid 38 (ObjNum 255 snap 77 seq_num 255) 2026-02-13T18:08:36.897 INFO:tasks.rados.rados.0.trial187.stdout:708: expect (ObjNum 227 snap 68 seq_num 227) 2026-02-13T18:08:36.995 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:707: finishing copy_from racing read to trial18717860-26 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:707: finishing copy_from to trial18717860-26 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 126 (ObjNum 200 snap 56 seq_num 200) dirty exists 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: finishing write tid 1 to trial18717860-27 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: finishing write tid 2 to trial18717860-27 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: finishing write tid 3 to trial18717860-27 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: finishing write tid 4 to trial18717860-27 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: oid 27 updating version 0 to 266 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: oid 27 version 266 is already newer than 264 2026-02-13T18:08:37.047 INFO:tasks.rados.rados.0.trial187.stdout:710: oid 27 version 266 is already newer than 265 2026-02-13T18:08:37.048 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 266 (ObjNum 256 snap 77 seq_num 256) dirty exists 2026-02-13T18:08:37.048 INFO:tasks.rados.rados.0.trial187.stdout:710: left oid 27 (ObjNum 256 snap 77 seq_num 256) 2026-02-13T18:08:37.719 INFO:tasks.rados.rados.0.trial187.stdout:706: done (5 left) 2026-02-13T18:08:37.719 INFO:tasks.rados.rados.0.trial187.stdout:707: done (4 left) 2026-02-13T18:08:37.719 INFO:tasks.rados.rados.0.trial187.stdout:708: done (3 left) 2026-02-13T18:08:37.719 INFO:tasks.rados.rados.0.trial187.stdout:709: done (2 left) 2026-02-13T18:08:37.719 INFO:tasks.rados.rados.0.trial187.stdout:710: done (1 left) 2026-02-13T18:08:37.719 INFO:tasks.rados.rados.0.trial187.stdout:711: done (0 left) 2026-02-13T18:08:37.720 INFO:tasks.rados.rados.0.trial187.stdout:712: delete oid 26 current snap is 78 2026-02-13T18:08:37.721 INFO:tasks.rados.rados.0.trial187.stdout:712: done (0 left) 2026-02-13T18:08:37.721 INFO:tasks.rados.rados.0.trial187.stdout:713: snap_create 2026-02-13T18:08:38.699 INFO:tasks.rados.rados.0.trial187.stdout:713: done (0 left) 2026-02-13T18:08:38.699 INFO:tasks.rados.rados.0.trial187.stdout:714: read oid 11 snap 63 2026-02-13T18:08:38.699 INFO:tasks.rados.rados.0.trial187.stdout:714: expect deleted 2026-02-13T18:08:38.700 INFO:tasks.rados.rados.0.trial187.stdout:715: copy_from oid 20 from oid 24 current snap is 79 2026-02-13T18:08:38.700 INFO:tasks.rados.rados.0.trial187.stdout:716: read oid 3 snap -1 2026-02-13T18:08:38.700 INFO:tasks.rados.rados.0.trial187.stdout:716: expect (ObjNum 199 snap 56 seq_num 199) 2026-02-13T18:08:38.700 INFO:tasks.rados.rados.0.trial187.stdout:717: delete oid 12 current snap is 79 2026-02-13T18:08:38.705 INFO:tasks.rados.rados.0.trial187.stdout:714: done (3 left) 2026-02-13T18:08:38.705 INFO:tasks.rados.rados.0.trial187.stdout:717: done (2 left) 2026-02-13T18:08:38.705 INFO:tasks.rados.rados.0.trial187.stdout:718: read oid 42 snap -1 2026-02-13T18:08:38.705 INFO:tasks.rados.rados.0.trial187.stdout:718: expect deleted 2026-02-13T18:08:38.705 INFO:tasks.rados.rados.0.trial187.stdout:719: delete oid 35 current snap is 79 2026-02-13T18:08:38.707 INFO:tasks.rados.rados.0.trial187.stdout:716: expect (ObjNum 199 snap 56 seq_num 199) 2026-02-13T18:08:38.728 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3169810 2026-02-13T18:08:38.730 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:38.762 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:38.786 INFO:tasks.rados.rados.0.trial187.stdout:715: finishing copy_from racing read to trial18717860-20 2026-02-13T18:08:38.786 INFO:tasks.rados.rados.0.trial187.stdout:715: finishing copy_from to trial18717860-20 2026-02-13T18:08:38.786 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 95 (ObjNum 221 snap 64 seq_num 221) dirty exists 2026-02-13T18:08:38.786 INFO:tasks.rados.rados.0.trial187.stdout:715: done (3 left) 2026-02-13T18:08:38.786 INFO:tasks.rados.rados.0.trial187.stdout:716: done (2 left) 2026-02-13T18:08:38.787 INFO:tasks.rados.rados.0.trial187.stdout:718: done (1 left) 2026-02-13T18:08:38.787 INFO:tasks.rados.rados.0.trial187.stdout:719: done (0 left) 2026-02-13T18:08:38.787 INFO:tasks.rados.rados.0.trial187.stdout:720: snap_create 2026-02-13T18:08:39.722 INFO:tasks.rados.rados.0.trial187.stdout:720: done (0 left) 2026-02-13T18:08:39.723 INFO:tasks.rados.rados.0.trial187.stdout:721: snap_create 2026-02-13T18:08:40.725 INFO:tasks.rados.rados.0.trial187.stdout:721: done (0 left) 2026-02-13T18:08:40.726 INFO:tasks.rados.rados.0.trial187.stdout:722: write (excl) oid 3 current snap is 81 2026-02-13T18:08:40.726 INFO:tasks.rados.rados.0.trial187.stdout:722: seq_num 260 ranges {769820=720742,2114730=255090} 2026-02-13T18:08:40.735 INFO:tasks.rados.rados.0.trial187.stdout:722: writing trial18717860-3 from 769820 to 1490562 tid 1 2026-02-13T18:08:40.741 INFO:tasks.rados.rados.0.trial187.stdout:722: writing trial18717860-3 from 2114730 to 2369820 tid 2 2026-02-13T18:08:40.741 INFO:tasks.rados.rados.0.trial187.stdout:723: write (excl) oid 7 current snap is 81 2026-02-13T18:08:40.741 INFO:tasks.rados.rados.0.trial187.stdout:723: seq_num 261 ranges {786627=795991,2173212=213415} 2026-02-13T18:08:40.751 INFO:tasks.rados.rados.0.trial187.stdout:723: writing trial18717860-7 from 786627 to 1582618 tid 1 2026-02-13T18:08:40.757 INFO:tasks.rados.rados.0.trial187.stdout:723: writing trial18717860-7 from 2173212 to 2386627 tid 2 2026-02-13T18:08:40.757 INFO:tasks.rados.rados.0.trial187.stdout:724: delete oid 33 current snap is 81 2026-02-13T18:08:40.757 INFO:tasks.rados.rados.0.trial187.stdout:722: finishing write tid 1 to trial18717860-3 2026-02-13T18:08:40.757 INFO:tasks.rados.rados.0.trial187.stdout:722: finishing write tid 2 to trial18717860-3 2026-02-13T18:08:40.757 INFO:tasks.rados.rados.0.trial187.stdout:722: finishing write tid 3 to trial18717860-3 2026-02-13T18:08:40.757 INFO:tasks.rados.rados.0.trial187.stdout:722: finishing write tid 4 to trial18717860-3 2026-02-13T18:08:40.758 INFO:tasks.rados.rados.0.trial187.stdout:722: oid 3 updating version 0 to 351 2026-02-13T18:08:40.758 INFO:tasks.rados.rados.0.trial187.stdout:722: oid 3 updating version 351 to 352 2026-02-13T18:08:40.758 INFO:tasks.rados.rados.0.trial187.stdout:722: oid 3 version 352 is already newer than 350 2026-02-13T18:08:40.758 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 352 (ObjNum 260 snap 81 seq_num 260) dirty exists 2026-02-13T18:08:40.758 INFO:tasks.rados.rados.0.trial187.stdout:722: left oid 3 (ObjNum 260 snap 81 seq_num 260) 2026-02-13T18:08:40.760 INFO:tasks.rados.rados.0.trial187.stdout:723: finishing write tid 1 to trial18717860-7 2026-02-13T18:08:40.760 INFO:tasks.rados.rados.0.trial187.stdout:723: finishing write tid 2 to trial18717860-7 2026-02-13T18:08:40.760 INFO:tasks.rados.rados.0.trial187.stdout:723: finishing write tid 3 to trial18717860-7 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:723: finishing write tid 4 to trial18717860-7 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:723: oid 7 updating version 0 to 280 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:723: oid 7 updating version 280 to 281 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:723: oid 7 updating version 281 to 282 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 282 (ObjNum 261 snap 81 seq_num 261) dirty exists 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:723: left oid 7 (ObjNum 261 snap 81 seq_num 261) 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:722: done (2 left) 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:723: done (1 left) 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:724: done (0 left) 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:725: read oid 34 snap -1 2026-02-13T18:08:40.761 INFO:tasks.rados.rados.0.trial187.stdout:725: expect (ObjNum 246 snap 73 seq_num 246) 2026-02-13T18:08:40.762 INFO:tasks.rados.rados.0.trial187.stdout:726: snap_remove snap 74 2026-02-13T18:08:41.726 INFO:tasks.rados.rados.0.trial187.stdout:726: done (1 left) 2026-02-13T18:08:41.726 INFO:tasks.rados.rados.0.trial187.stdout:727: delete oid 48 current snap is 81 2026-02-13T18:08:41.726 INFO:tasks.rados.rados.0.trial187.stdout:725: expect (ObjNum 246 snap 73 seq_num 246) 2026-02-13T18:08:41.726 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:41.786 INFO:tasks.rados.rados.0.trial187.stdout:725: done (1 left) 2026-02-13T18:08:41.786 INFO:tasks.rados.rados.0.trial187.stdout:727: done (0 left) 2026-02-13T18:08:41.786 INFO:tasks.rados.rados.0.trial187.stdout:728: snap_remove snap 76 2026-02-13T18:08:42.729 INFO:tasks.rados.rados.0.trial187.stdout:728: done (0 left) 2026-02-13T18:08:42.729 INFO:tasks.rados.rados.0.trial187.stdout:729: copy_from oid 26 from oid 11 current snap is 81 2026-02-13T18:08:42.730 INFO:tasks.rados.rados.0.trial187.stdout:730: snap_create 2026-02-13T18:08:42.736 INFO:tasks.rados.rados.0.trial187.stdout:729: finishing copy_from racing read to trial18717860-26 2026-02-13T18:08:42.737 INFO:tasks.rados.rados.0.trial187.stdout:729: finishing copy_from to trial18717860-26 2026-02-13T18:08:42.737 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 123 (ObjNum 239 snap 69 seq_num 239) dirty exists 2026-02-13T18:08:43.700 INFO:tasks.rados.rados.0.trial187.stdout:729: done (1 left) 2026-02-13T18:08:43.700 INFO:tasks.rados.rados.0.trial187.stdout:730: done (0 left) 2026-02-13T18:08:43.700 INFO:tasks.rados.rados.0.trial187.stdout:731: write oid 44 current snap is 82 2026-02-13T18:08:43.700 INFO:tasks.rados.rados.0.trial187.stdout:731: seq_num 264 ranges {437048=621738,1832305=404425} 2026-02-13T18:08:43.707 INFO:tasks.rados.rados.0.trial187.stdout:731: writing trial18717860-44 from 437048 to 1058786 tid 1 2026-02-13T18:08:43.715 INFO:tasks.rados.rados.0.trial187.stdout:731: writing trial18717860-44 from 1832305 to 2236730 tid 2 2026-02-13T18:08:43.715 INFO:tasks.rados.rados.0.trial187.stdout:732: delete oid 31 current snap is 82 2026-02-13T18:08:43.715 INFO:tasks.rados.rados.0.trial187.stdout:731: finishing write tid 1 to trial18717860-44 2026-02-13T18:08:43.717 INFO:tasks.rados.rados.0.trial187.stdout:731: finishing write tid 2 to trial18717860-44 2026-02-13T18:08:43.717 INFO:tasks.rados.rados.0.trial187.stdout:732: done (1 left) 2026-02-13T18:08:43.717 INFO:tasks.rados.rados.0.trial187.stdout:733: rollback oid 45 current snap is 82 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 64 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:734: read oid 37 snap -1 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:734: expect deleted 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:735: read oid 15 snap -1 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:735: expect deleted 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:736: write (excl) oid 27 current snap is 82 2026-02-13T18:08:43.718 INFO:tasks.rados.rados.0.trial187.stdout:736: seq_num 266 ranges {470662=772236,1832916=408094} 2026-02-13T18:08:43.725 INFO:tasks.rados.rados.0.trial187.stdout:736: writing trial18717860-27 from 470662 to 1242898 tid 1 2026-02-13T18:08:43.732 INFO:tasks.rados.rados.0.trial187.stdout:736: writing trial18717860-27 from 1832916 to 2241010 tid 2 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:737: delete oid 4 current snap is 82 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:731: finishing write tid 3 to trial18717860-44 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:731: finishing write tid 4 to trial18717860-44 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:731: oid 44 updating version 0 to 399 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:731: oid 44 updating version 399 to 400 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:731: oid 44 version 400 is already newer than 398 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 400 (ObjNum 264 snap 82 seq_num 264) dirty exists 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:731: left oid 44 (ObjNum 264 snap 82 seq_num 264) 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:733: finishing rollback tid 0 to trial18717860-45 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:733: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:08:43.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 204 (ObjNum 129 snap 0 seq_num 4014031398) dirty dne 2026-02-13T18:08:43.734 INFO:tasks.rados.rados.0.trial187.stdout:736: finishing write tid 1 to trial18717860-27 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:731: done (5 left) 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:733: done (4 left) 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:734: done (3 left) 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:735: done (2 left) 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:737: done (1 left) 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:738: read oid 30 snap -1 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:738: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:08:43.735 INFO:tasks.rados.rados.0.trial187.stdout:739: read oid 10 snap -1 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:739: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:740: copy_from oid 24 from oid 42 current snap is 82 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:741: rollback oid 31 current snap is 82 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 75 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:742: snap_create 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:736: finishing write tid 2 to trial18717860-27 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:740: finishing copy_from to trial18717860-24 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:740: got expected ENOENT (src dne) 2026-02-13T18:08:43.736 INFO:tasks.rados.rados.0.trial187.stdout:740: finishing copy_from racing read to trial18717860-24 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:736: finishing write tid 3 to trial18717860-27 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:736: finishing write tid 4 to trial18717860-27 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:736: oid 27 updating version 0 to 267 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:736: oid 27 updating version 267 to 269 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:736: oid 27 version 269 is already newer than 268 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 269 (ObjNum 266 snap 82 seq_num 266) dirty exists 2026-02-13T18:08:43.737 INFO:tasks.rados.rados.0.trial187.stdout:736: left oid 27 (ObjNum 266 snap 82 seq_num 266) 2026-02-13T18:08:43.738 INFO:tasks.rados.rados.0.trial187.stdout:741: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:08:43.738 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 0 (ObjNum 129 snap 0 seq_num 3012742992) dirty dne 2026-02-13T18:08:43.739 INFO:tasks.rados.rados.0.trial187.stdout:739: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:08:43.739 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 364451 2026-02-13T18:08:43.791 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2004476 2026-02-13T18:08:43.806 INFO:tasks.rados.rados.0.trial187.stdout:738: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:08:43.815 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2307412 2026-02-13T18:08:43.817 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:43.836 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:736: done (5 left) 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:738: done (4 left) 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:739: done (3 left) 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:740: done (2 left) 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:741: done (1 left) 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:742: done (0 left) 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:743: write oid 19 current snap is 83 2026-02-13T18:08:44.706 INFO:tasks.rados.rados.0.trial187.stdout:743: seq_num 268 ranges {504276=639087,1666233=695410} 2026-02-13T18:08:44.713 INFO:tasks.rados.rados.0.trial187.stdout:743: writing trial18717860-19 from 504276 to 1143363 tid 1 2026-02-13T18:08:44.721 INFO:tasks.rados.rados.0.trial187.stdout:743: writing trial18717860-19 from 1666233 to 2361643 tid 2 2026-02-13T18:08:44.721 INFO:tasks.rados.rados.0.trial187.stdout:744: write (excl) oid 11 current snap is 83 2026-02-13T18:08:44.722 INFO:tasks.rados.rados.0.trial187.stdout:744: seq_num 269 ranges {521083=714336,1724715=555421} 2026-02-13T18:08:44.729 INFO:tasks.rados.rados.0.trial187.stdout:744: writing trial18717860-11 from 521083 to 1235419 tid 1 2026-02-13T18:08:44.737 INFO:tasks.rados.rados.0.trial187.stdout:744: writing trial18717860-11 from 1724715 to 2280136 tid 2 2026-02-13T18:08:44.737 INFO:tasks.rados.rados.0.trial187.stdout:745: read oid 26 snap -1 2026-02-13T18:08:44.737 INFO:tasks.rados.rados.0.trial187.stdout:745: expect (ObjNum 239 snap 69 seq_num 239) 2026-02-13T18:08:44.737 INFO:tasks.rados.rados.0.trial187.stdout:746: write (excl) oid 18 current snap is 83 2026-02-13T18:08:44.737 INFO:tasks.rados.rados.0.trial187.stdout:746: seq_num 270 ranges {537890=789585,1783197=699079} 2026-02-13T18:08:44.745 INFO:tasks.rados.rados.0.trial187.stdout:746: writing trial18717860-18 from 537890 to 1327475 tid 1 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:746: writing trial18717860-18 from 1783197 to 2482276 tid 2 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:747: delete oid 38 current snap is 83 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: finishing write tid 1 to trial18717860-19 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: finishing write tid 2 to trial18717860-19 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: finishing write tid 3 to trial18717860-19 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: finishing write tid 4 to trial18717860-19 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: oid 19 updating version 0 to 203 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: oid 19 version 203 is already newer than 202 2026-02-13T18:08:44.752 INFO:tasks.rados.rados.0.trial187.stdout:743: oid 19 version 203 is already newer than 201 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 203 (ObjNum 268 snap 83 seq_num 268) dirty exists 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:743: left oid 19 (ObjNum 268 snap 83 seq_num 268) 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: finishing write tid 1 to trial18717860-11 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: finishing write tid 2 to trial18717860-11 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: finishing write tid 3 to trial18717860-11 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: finishing write tid 4 to trial18717860-11 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: oid 11 updating version 0 to 138 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: oid 11 updating version 138 to 140 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: oid 11 version 140 is already newer than 139 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 140 (ObjNum 269 snap 83 seq_num 269) dirty exists 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:744: left oid 11 (ObjNum 269 snap 83 seq_num 269) 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:745: expect (ObjNum 239 snap 69 seq_num 239) 2026-02-13T18:08:44.753 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:44.778 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 50645 2026-02-13T18:08:44.803 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1276297 2026-02-13T18:08:44.813 INFO:tasks.rados.rados.0.trial187.stdout:746: finishing write tid 1 to trial18717860-18 2026-02-13T18:08:44.813 INFO:tasks.rados.rados.0.trial187.stdout:746: finishing write tid 2 to trial18717860-18 2026-02-13T18:08:44.813 INFO:tasks.rados.rados.0.trial187.stdout:746: finishing write tid 3 to trial18717860-18 2026-02-13T18:08:44.813 INFO:tasks.rados.rados.0.trial187.stdout:746: finishing write tid 4 to trial18717860-18 2026-02-13T18:08:44.813 INFO:tasks.rados.rados.0.trial187.stdout:746: oid 18 updating version 0 to 164 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:746: oid 18 updating version 164 to 166 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:746: oid 18 version 166 is already newer than 165 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 166 (ObjNum 270 snap 83 seq_num 270) dirty exists 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:746: left oid 18 (ObjNum 270 snap 83 seq_num 270) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:743: done (4 left) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:744: done (3 left) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:745: done (2 left) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:746: done (1 left) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:747: done (0 left) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:748: read oid 9 snap -1 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:748: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:44.814 INFO:tasks.rados.rados.0.trial187.stdout:749: read oid 21 snap 81 2026-02-13T18:08:44.815 INFO:tasks.rados.rados.0.trial187.stdout:749: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:08:44.815 INFO:tasks.rados.rados.0.trial187.stdout:750: delete oid 48 current snap is 83 2026-02-13T18:08:44.815 INFO:tasks.rados.rados.0.trial187.stdout:748: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:44.855 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:44.902 INFO:tasks.rados.rados.0.trial187.stdout:749: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:08:44.902 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:44.941 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:44.986 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1256319 2026-02-13T18:08:45.015 INFO:tasks.rados.rados.0.trial187.stdout:748: done (2 left) 2026-02-13T18:08:45.015 INFO:tasks.rados.rados.0.trial187.stdout:749: done (1 left) 2026-02-13T18:08:45.015 INFO:tasks.rados.rados.0.trial187.stdout:750: done (0 left) 2026-02-13T18:08:45.015 INFO:tasks.rados.rados.0.trial187.stdout:751: delete oid 26 current snap is 83 2026-02-13T18:08:45.016 INFO:tasks.rados.rados.0.trial187.stdout:751: done (0 left) 2026-02-13T18:08:45.016 INFO:tasks.rados.rados.0.trial187.stdout:752: read oid 20 snap -1 2026-02-13T18:08:45.017 INFO:tasks.rados.rados.0.trial187.stdout:752: expect (ObjNum 221 snap 64 seq_num 221) 2026-02-13T18:08:45.017 INFO:tasks.rados.rados.0.trial187.stdout:753: write (excl) oid 2 current snap is 83 2026-02-13T18:08:45.017 INFO:tasks.rados.rados.0.trial187.stdout:753: seq_num 274 ranges {605118=406934,1617125=706417} 2026-02-13T18:08:45.023 INFO:tasks.rados.rados.0.trial187.stdout:753: writing trial18717860-2 from 605118 to 1012052 tid 1 2026-02-13T18:08:45.033 INFO:tasks.rados.rados.0.trial187.stdout:753: writing trial18717860-2 from 1617125 to 2323542 tid 2 2026-02-13T18:08:45.033 INFO:tasks.rados.rados.0.trial187.stdout:754: snap_create 2026-02-13T18:08:45.033 INFO:tasks.rados.rados.0.trial187.stdout:752: expect (ObjNum 221 snap 64 seq_num 221) 2026-02-13T18:08:45.093 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3607269 2026-02-13T18:08:45.210 INFO:tasks.rados.rados.0.trial187.stdout:753: finishing write tid 1 to trial18717860-2 2026-02-13T18:08:45.210 INFO:tasks.rados.rados.0.trial187.stdout:753: finishing write tid 2 to trial18717860-2 2026-02-13T18:08:45.210 INFO:tasks.rados.rados.0.trial187.stdout:753: finishing write tid 3 to trial18717860-2 2026-02-13T18:08:45.210 INFO:tasks.rados.rados.0.trial187.stdout:753: finishing write tid 4 to trial18717860-2 2026-02-13T18:08:45.210 INFO:tasks.rados.rados.0.trial187.stdout:753: oid 2 updating version 0 to 169 2026-02-13T18:08:45.211 INFO:tasks.rados.rados.0.trial187.stdout:753: oid 2 version 169 is already newer than 168 2026-02-13T18:08:45.211 INFO:tasks.rados.rados.0.trial187.stdout:753: oid 2 version 169 is already newer than 167 2026-02-13T18:08:45.211 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 169 (ObjNum 274 snap 83 seq_num 274) dirty exists 2026-02-13T18:08:45.211 INFO:tasks.rados.rados.0.trial187.stdout:753: left oid 2 (ObjNum 274 snap 83 seq_num 274) 2026-02-13T18:08:45.708 INFO:tasks.rados.rados.0.trial187.stdout:752: done (2 left) 2026-02-13T18:08:45.709 INFO:tasks.rados.rados.0.trial187.stdout:753: done (1 left) 2026-02-13T18:08:45.709 INFO:tasks.rados.rados.0.trial187.stdout:754: done (0 left) 2026-02-13T18:08:45.709 INFO:tasks.rados.rados.0.trial187.stdout:755: read oid 41 snap -1 2026-02-13T18:08:45.709 INFO:tasks.rados.rados.0.trial187.stdout:755: expect (ObjNum 126 snap 22 seq_num 126) 2026-02-13T18:08:45.709 INFO:tasks.rados.rados.0.trial187.stdout:756: write oid 28 current snap is 84 2026-02-13T18:08:45.710 INFO:tasks.rados.rados.0.trial187.stdout:756: seq_num 275 ranges {621925=482183,1559254=566428} 2026-02-13T18:08:45.715 INFO:tasks.rados.rados.0.trial187.stdout:756: writing trial18717860-28 from 621925 to 1104108 tid 1 2026-02-13T18:08:45.722 INFO:tasks.rados.rados.0.trial187.stdout:756: writing trial18717860-28 from 1559254 to 2125682 tid 2 2026-02-13T18:08:45.722 INFO:tasks.rados.rados.0.trial187.stdout:757: write (excl) oid 21 current snap is 84 2026-02-13T18:08:45.723 INFO:tasks.rados.rados.0.trial187.stdout:757: seq_num 276 ranges {638732=557432,1617736=710086} 2026-02-13T18:08:45.730 INFO:tasks.rados.rados.0.trial187.stdout:757: writing trial18717860-21 from 638732 to 1196164 tid 1 2026-02-13T18:08:45.737 INFO:tasks.rados.rados.0.trial187.stdout:757: writing trial18717860-21 from 1617736 to 2327822 tid 2 2026-02-13T18:08:45.737 INFO:tasks.rados.rados.0.trial187.stdout:758: snap_remove snap 82 2026-02-13T18:08:46.713 INFO:tasks.rados.rados.0.trial187.stdout:758: done (3 left) 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:759: read oid 23 snap 75 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:759: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:760: read oid 1 snap -1 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:760: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:761: read oid 4 snap 63 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:761: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:762: write (excl) oid 36 current snap is 84 2026-02-13T18:08:46.714 INFO:tasks.rados.rados.0.trial187.stdout:762: seq_num 277 ranges {655539=632681,2076218=570097} 2026-02-13T18:08:46.722 INFO:tasks.rados.rados.0.trial187.stdout:762: writing trial18717860-36 from 655539 to 1288220 tid 1 2026-02-13T18:08:46.731 INFO:tasks.rados.rados.0.trial187.stdout:762: writing trial18717860-36 from 2076218 to 2646315 tid 2 2026-02-13T18:08:46.731 INFO:tasks.rados.rados.0.trial187.stdout:763: rollback oid 32 current snap is 84 2026-02-13T18:08:46.731 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 72 2026-02-13T18:08:46.731 INFO:tasks.rados.rados.0.trial187.stdout:755: expect (ObjNum 126 snap 22 seq_num 126) 2026-02-13T18:08:46.732 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:46.815 INFO:tasks.rados.rados.0.trial187.stdout:756: finishing write tid 1 to trial18717860-28 2026-02-13T18:08:46.815 INFO:tasks.rados.rados.0.trial187.stdout:756: finishing write tid 2 to trial18717860-28 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: finishing write tid 3 to trial18717860-28 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: finishing write tid 4 to trial18717860-28 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: oid 28 updating version 0 to 130 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: oid 28 version 130 is already newer than 129 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: oid 28 version 130 is already newer than 128 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 130 (ObjNum 275 snap 84 seq_num 275) dirty exists 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: left oid 28 (ObjNum 275 snap 84 seq_num 275) 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:757: finishing write tid 1 to trial18717860-21 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:757: finishing write tid 2 to trial18717860-21 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:755: done (7 left) 2026-02-13T18:08:46.816 INFO:tasks.rados.rados.0.trial187.stdout:756: done (6 left) 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:764: snap_create 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:757: finishing write tid 3 to trial18717860-21 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:757: finishing write tid 4 to trial18717860-21 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:757: oid 21 updating version 0 to 284 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:757: oid 21 version 284 is already newer than 283 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:757: oid 21 updating version 284 to 285 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 285 (ObjNum 276 snap 84 seq_num 276) dirty exists 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:757: left oid 21 (ObjNum 276 snap 84 seq_num 276) 2026-02-13T18:08:46.817 INFO:tasks.rados.rados.0.trial187.stdout:760: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:08:46.838 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:46.884 INFO:tasks.rados.rados.0.trial187.stdout:759: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:08:46.884 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:46.934 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 948582 2026-02-13T18:08:46.952 INFO:tasks.rados.rados.0.trial187.stdout:761: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:08:46.953 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:46.975 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:46.997 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:47.020 INFO:tasks.rados.rados.0.trial187.stdout:762: finishing write tid 1 to trial18717860-36 2026-02-13T18:08:47.020 INFO:tasks.rados.rados.0.trial187.stdout:763: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: finishing write tid 2 to trial18717860-36 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:763: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: finishing write tid 3 to trial18717860-36 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:763: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 192 (ObjNum 180 snap 44 seq_num 180) dirty exists 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: finishing write tid 4 to trial18717860-36 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: oid 36 updating version 0 to 270 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: oid 36 updating version 270 to 271 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: oid 36 updating version 271 to 272 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 272 (ObjNum 277 snap 84 seq_num 277) dirty exists 2026-02-13T18:08:47.021 INFO:tasks.rados.rados.0.trial187.stdout:762: left oid 36 (ObjNum 277 snap 84 seq_num 277) 2026-02-13T18:08:47.717 INFO:tasks.rados.rados.0.trial187.stdout:757: done (6 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:759: done (5 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:760: done (4 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:761: done (3 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:762: done (2 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:763: done (1 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:764: done (0 left) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:765: read oid 50 snap 78 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:765: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:766: write oid 38 current snap is 85 2026-02-13T18:08:47.718 INFO:tasks.rados.rados.0.trial187.stdout:766: seq_num 278 ranges {672346=707930,2134700=537646} 2026-02-13T18:08:47.726 INFO:tasks.rados.rados.0.trial187.stdout:766: writing trial18717860-38 from 672346 to 1380276 tid 1 2026-02-13T18:08:47.735 INFO:tasks.rados.rados.0.trial187.stdout:766: writing trial18717860-38 from 2134700 to 2672346 tid 2 2026-02-13T18:08:47.735 INFO:tasks.rados.rados.0.trial187.stdout:767: read oid 30 snap -1 2026-02-13T18:08:47.735 INFO:tasks.rados.rados.0.trial187.stdout:767: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:08:47.735 INFO:tasks.rados.rados.0.trial187.stdout:768: read oid 22 snap -1 2026-02-13T18:08:47.735 INFO:tasks.rados.rados.0.trial187.stdout:768: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:08:47.735 INFO:tasks.rados.rados.0.trial187.stdout:769: write oid 36 current snap is 85 2026-02-13T18:08:47.736 INFO:tasks.rados.rados.0.trial187.stdout:769: seq_num 279 ranges {689153=783179,2076829=457413} 2026-02-13T18:08:47.745 INFO:tasks.rados.rados.0.trial187.stdout:769: writing trial18717860-36 from 689153 to 1472332 tid 1 2026-02-13T18:08:47.752 INFO:tasks.rados.rados.0.trial187.stdout:769: writing trial18717860-36 from 2076829 to 2534242 tid 2 2026-02-13T18:08:47.752 INFO:tasks.rados.rados.0.trial187.stdout:770: rollback oid 14 current snap is 85 2026-02-13T18:08:47.752 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 80 2026-02-13T18:08:47.752 INFO:tasks.rados.rados.0.trial187.stdout:765: expect (ObjNum 173 snap 42 seq_num 173) 2026-02-13T18:08:47.874 INFO:tasks.rados.rados.0.trial187.stdout:766: finishing write tid 1 to trial18717860-38 2026-02-13T18:08:47.875 INFO:tasks.rados.rados.0.trial187.stdout:767: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-13T18:08:47.886 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 512545 2026-02-13T18:08:47.921 INFO:tasks.rados.rados.0.trial187.stdout:766: finishing write tid 2 to trial18717860-38 2026-02-13T18:08:47.922 INFO:tasks.rados.rados.0.trial187.stdout:766: finishing write tid 3 to trial18717860-38 2026-02-13T18:08:47.922 INFO:tasks.rados.rados.0.trial187.stdout:765: done (5 left) 2026-02-13T18:08:47.922 INFO:tasks.rados.rados.0.trial187.stdout:767: done (4 left) 2026-02-13T18:08:47.922 INFO:tasks.rados.rados.0.trial187.stdout:771: read oid 48 snap -1 2026-02-13T18:08:47.922 INFO:tasks.rados.rados.0.trial187.stdout:771: expect deleted 2026-02-13T18:08:47.922 INFO:tasks.rados.rados.0.trial187.stdout:772: snap_remove snap 84 2026-02-13T18:08:48.701 INFO:tasks.rados.rados.0.trial187.stdout:772: done (5 left) 2026-02-13T18:08:48.701 INFO:tasks.rados.rados.0.trial187.stdout:773: snap_remove snap 75 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:766: finishing write tid 4 to trial18717860-38 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:766: oid 38 updating version 0 to 127 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:766: oid 38 version 127 is already newer than 126 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:766: oid 38 version 127 is already newer than 125 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 127 (ObjNum 278 snap 85 seq_num 278) dirty exists 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:766: left oid 38 (ObjNum 278 snap 85 seq_num 278) 2026-02-13T18:08:48.702 INFO:tasks.rados.rados.0.trial187.stdout:768: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:08:48.732 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:48.793 INFO:tasks.rados.rados.0.trial187.stdout:769: finishing write tid 1 to trial18717860-36 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: finishing write tid 2 to trial18717860-36 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: finishing write tid 3 to trial18717860-36 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: finishing write tid 4 to trial18717860-36 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: oid 36 updating version 0 to 274 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: oid 36 version 274 is already newer than 273 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: oid 36 updating version 274 to 275 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 275 (ObjNum 279 snap 85 seq_num 279) dirty exists 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:769: left oid 36 (ObjNum 279 snap 85 seq_num 279) 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:770: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:08:48.794 INFO:tasks.rados.rados.0.trial187.stdout:770: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:08:49.720 INFO:tasks.rados.rados.0.trial187.stdout:766: done (5 left) 2026-02-13T18:08:49.720 INFO:tasks.rados.rados.0.trial187.stdout:768: done (4 left) 2026-02-13T18:08:49.720 INFO:tasks.rados.rados.0.trial187.stdout:769: done (3 left) 2026-02-13T18:08:49.720 INFO:tasks.rados.rados.0.trial187.stdout:773: done (2 left) 2026-02-13T18:08:49.721 INFO:tasks.rados.rados.0.trial187.stdout:774: write oid 33 current snap is 85 2026-02-13T18:08:49.721 INFO:tasks.rados.rados.0.trial187.stdout:774: seq_num 280 ranges {705960=458428,1735311=717424} 2026-02-13T18:08:49.728 INFO:tasks.rados.rados.0.trial187.stdout:774: writing trial18717860-33 from 705960 to 1164388 tid 1 2026-02-13T18:08:49.737 INFO:tasks.rados.rados.0.trial187.stdout:774: writing trial18717860-33 from 1735311 to 2452735 tid 2 2026-02-13T18:08:49.737 INFO:tasks.rados.rados.0.trial187.stdout:775: snap_remove snap 77 2026-02-13T18:08:50.723 INFO:tasks.rados.rados.0.trial187.stdout:775: done (3 left) 2026-02-13T18:08:50.723 INFO:tasks.rados.rados.0.trial187.stdout:776: snap_remove snap 64 2026-02-13T18:08:51.724 INFO:tasks.rados.rados.0.trial187.stdout:776: done (3 left) 2026-02-13T18:08:51.724 INFO:tasks.rados.rados.0.trial187.stdout:777: write oid 34 current snap is 85 2026-02-13T18:08:51.724 INFO:tasks.rados.rados.0.trial187.stdout:777: seq_num 281 ranges {722767=533677,1793793=461082} 2026-02-13T18:08:51.732 INFO:tasks.rados.rados.0.trial187.stdout:777: writing trial18717860-34 from 722767 to 1256444 tid 1 2026-02-13T18:08:51.739 INFO:tasks.rados.rados.0.trial187.stdout:777: writing trial18717860-34 from 1793793 to 2254875 tid 2 2026-02-13T18:08:51.739 INFO:tasks.rados.rados.0.trial187.stdout:778: write (excl) oid 31 current snap is 85 2026-02-13T18:08:51.739 INFO:tasks.rados.rados.0.trial187.stdout:778: seq_num 282 ranges {739574=725279,1968628=721093} 2026-02-13T18:08:51.749 INFO:tasks.rados.rados.0.trial187.stdout:778: writing trial18717860-31 from 739574 to 1464853 tid 1 2026-02-13T18:08:51.757 INFO:tasks.rados.rados.0.trial187.stdout:778: writing trial18717860-31 from 1968628 to 2689721 tid 2 2026-02-13T18:08:51.758 INFO:tasks.rados.rados.0.trial187.stdout:779: rollback oid 36 current snap is 85 2026-02-13T18:08:51.758 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 36 to 80 2026-02-13T18:08:51.758 INFO:tasks.rados.rados.0.trial187.stdout:770: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:08:51.758 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 278 (ObjNum 227 snap 68 seq_num 227) dirty exists 2026-02-13T18:08:51.758 INFO:tasks.rados.rados.0.trial187.stdout:770: done (5 left) 2026-02-13T18:08:51.758 INFO:tasks.rados.rados.0.trial187.stdout:780: snap_remove snap 52 2026-02-13T18:08:52.731 INFO:tasks.rados.rados.0.trial187.stdout:780: done (5 left) 2026-02-13T18:08:52.731 INFO:tasks.rados.rados.0.trial187.stdout:781: write (excl) oid 14 current snap is 85 2026-02-13T18:08:52.731 INFO:tasks.rados.rados.0.trial187.stdout:781: seq_num 283 ranges {756381=400528,1910757=464751} 2026-02-13T18:08:52.738 INFO:tasks.rados.rados.0.trial187.stdout:781: writing trial18717860-14 from 756381 to 1156909 tid 1 2026-02-13T18:08:52.747 INFO:tasks.rados.rados.0.trial187.stdout:781: writing trial18717860-14 from 1910757 to 2375508 tid 2 2026-02-13T18:08:52.747 INFO:tasks.rados.rados.0.trial187.stdout:782: snap_remove snap 67 2026-02-13T18:08:53.702 INFO:tasks.rados.rados.0.trial187.stdout:782: done (6 left) 2026-02-13T18:08:53.702 INFO:tasks.rados.rados.0.trial187.stdout:783: delete oid 32 current snap is 85 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: finishing write tid 1 to trial18717860-33 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: finishing write tid 2 to trial18717860-33 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: finishing write tid 3 to trial18717860-33 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: finishing write tid 4 to trial18717860-33 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: oid 33 updating version 0 to 407 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: oid 33 version 407 is already newer than 406 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: oid 33 updating version 407 to 408 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 408 (ObjNum 280 snap 85 seq_num 280) dirty exists 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:774: left oid 33 (ObjNum 280 snap 85 seq_num 280) 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:777: finishing write tid 1 to trial18717860-34 2026-02-13T18:08:53.703 INFO:tasks.rados.rados.0.trial187.stdout:777: finishing write tid 2 to trial18717860-34 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:777: finishing write tid 3 to trial18717860-34 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:777: finishing write tid 4 to trial18717860-34 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:777: oid 34 updating version 0 to 149 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:777: oid 34 version 149 is already newer than 148 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:777: oid 34 updating version 149 to 150 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 150 (ObjNum 281 snap 85 seq_num 281) dirty exists 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:777: left oid 34 (ObjNum 281 snap 85 seq_num 281) 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:778: finishing write tid 1 to trial18717860-31 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:779: finishing rollback tid 0 to trial18717860-36 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:779: finishing rollback tid 1 to trial18717860-36 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:779: finishing rollback tid 2 to trial18717860-36 2026-02-13T18:08:53.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 281 (ObjNum 248 snap 74 seq_num 248) dirty exists 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: finishing write tid 2 to trial18717860-31 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: finishing write tid 3 to trial18717860-31 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: finishing write tid 4 to trial18717860-31 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: oid 31 updating version 0 to 159 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: oid 31 version 159 is already newer than 158 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: oid 31 version 159 is already newer than 157 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 159 (ObjNum 282 snap 85 seq_num 282) dirty exists 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:778: left oid 31 (ObjNum 282 snap 85 seq_num 282) 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:781: finishing write tid 1 to trial18717860-14 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:781: finishing write tid 2 to trial18717860-14 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:781: finishing write tid 3 to trial18717860-14 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:781: finishing write tid 4 to trial18717860-14 2026-02-13T18:08:53.705 INFO:tasks.rados.rados.0.trial187.stdout:781: oid 14 updating version 0 to 282 2026-02-13T18:08:53.706 INFO:tasks.rados.rados.0.trial187.stdout:781: oid 14 updating version 282 to 284 2026-02-13T18:08:53.706 INFO:tasks.rados.rados.0.trial187.stdout:781: oid 14 version 284 is already newer than 283 2026-02-13T18:08:53.706 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 284 (ObjNum 283 snap 85 seq_num 283) dirty exists 2026-02-13T18:08:53.706 INFO:tasks.rados.rados.0.trial187.stdout:781: left oid 14 (ObjNum 283 snap 85 seq_num 283) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:771: done (6 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:774: done (5 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:777: done (4 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:778: done (3 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:779: done (2 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:781: done (1 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:783: done (0 left) 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:784: write oid 29 current snap is 85 2026-02-13T18:08:53.707 INFO:tasks.rados.rados.0.trial187.stdout:784: seq_num 285 ranges {789995=551026,2027721=468420} 2026-02-13T18:08:53.716 INFO:tasks.rados.rados.0.trial187.stdout:784: writing trial18717860-29 from 789995 to 1341021 tid 1 2026-02-13T18:08:53.724 INFO:tasks.rados.rados.0.trial187.stdout:784: writing trial18717860-29 from 2027721 to 2496141 tid 2 2026-02-13T18:08:53.724 INFO:tasks.rados.rados.0.trial187.stdout:785: copy_from oid 10 from oid 6 current snap is 85 2026-02-13T18:08:53.724 INFO:tasks.rados.rados.0.trial187.stdout:784: finishing write tid 1 to trial18717860-29 2026-02-13T18:08:53.724 INFO:tasks.rados.rados.0.trial187.stdout:786: write oid 46 current snap is 85 2026-02-13T18:08:53.724 INFO:tasks.rados.rados.0.trial187.stdout:786: seq_num 286 ranges {406802=626275,1686203=728431} 2026-02-13T18:08:53.730 INFO:tasks.rados.rados.0.trial187.stdout:786: writing trial18717860-46 from 406802 to 1033077 tid 1 2026-02-13T18:08:53.740 INFO:tasks.rados.rados.0.trial187.stdout:786: writing trial18717860-46 from 1686203 to 2414634 tid 2 2026-02-13T18:08:53.740 INFO:tasks.rados.rados.0.trial187.stdout:787: snap_remove snap 81 2026-02-13T18:08:54.736 INFO:tasks.rados.rados.0.trial187.stdout:787: done (3 left) 2026-02-13T18:08:54.736 INFO:tasks.rados.rados.0.trial187.stdout:788: copy_from oid 50 from oid 22 current snap is 85 2026-02-13T18:08:54.736 INFO:tasks.rados.rados.0.trial187.stdout:785: finishing copy_from to trial18717860-10 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:785: got expected ENOENT (src dne) 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:785: finishing copy_from racing read to trial18717860-10 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: finishing write tid 2 to trial18717860-29 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: finishing write tid 3 to trial18717860-29 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: finishing write tid 4 to trial18717860-29 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: oid 29 updating version 0 to 215 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: oid 29 updating version 215 to 216 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: oid 29 updating version 216 to 217 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 217 (ObjNum 285 snap 85 seq_num 285) dirty exists 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:784: left oid 29 (ObjNum 285 snap 85 seq_num 285) 2026-02-13T18:08:54.737 INFO:tasks.rados.rados.0.trial187.stdout:786: finishing write tid 1 to trial18717860-46 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: finishing write tid 2 to trial18717860-46 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: finishing write tid 3 to trial18717860-46 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: finishing write tid 4 to trial18717860-46 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: oid 46 updating version 0 to 288 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: oid 46 version 288 is already newer than 287 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: oid 46 version 288 is already newer than 286 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 288 (ObjNum 286 snap 85 seq_num 286) dirty exists 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: left oid 46 (ObjNum 286 snap 85 seq_num 286) 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:784: done (3 left) 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:785: done (2 left) 2026-02-13T18:08:54.738 INFO:tasks.rados.rados.0.trial187.stdout:786: done (1 left) 2026-02-13T18:08:54.739 INFO:tasks.rados.rados.0.trial187.stdout:789: delete oid 38 current snap is 85 2026-02-13T18:08:54.739 INFO:tasks.rados.rados.0.trial187.stdout:789: done (1 left) 2026-02-13T18:08:54.739 INFO:tasks.rados.rados.0.trial187.stdout:790: copy_from oid 38 from oid 20 current snap is 85 2026-02-13T18:08:54.739 INFO:tasks.rados.rados.0.trial187.stdout:791: snap_remove snap 78 2026-02-13T18:08:55.738 INFO:tasks.rados.rados.0.trial187.stdout:791: done (2 left) 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:792: delete oid 27 current snap is 85 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:788: finishing copy_from racing read to trial18717860-50 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:788: finishing copy_from to trial18717860-50 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 244 (ObjNum 142 snap 26 seq_num 142) dirty exists 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:790: finishing copy_from racing read to trial18717860-38 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:790: finishing copy_from to trial18717860-38 2026-02-13T18:08:55.739 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 95 (ObjNum 221 snap 64 seq_num 221) dirty exists 2026-02-13T18:08:55.743 INFO:tasks.rados.rados.0.trial187.stdout:788: done (2 left) 2026-02-13T18:08:55.743 INFO:tasks.rados.rados.0.trial187.stdout:790: done (1 left) 2026-02-13T18:08:55.743 INFO:tasks.rados.rados.0.trial187.stdout:792: done (0 left) 2026-02-13T18:08:55.743 INFO:tasks.rados.rados.0.trial187.stdout:793: rollback oid 14 current snap is 85 2026-02-13T18:08:55.744 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 83 2026-02-13T18:08:55.744 INFO:tasks.rados.rados.0.trial187.stdout:794: snap_remove snap 79 2026-02-13T18:08:56.747 INFO:tasks.rados.rados.0.trial187.stdout:794: done (1 left) 2026-02-13T18:08:56.747 INFO:tasks.rados.rados.0.trial187.stdout:795: write oid 45 current snap is 85 2026-02-13T18:08:56.747 INFO:tasks.rados.rados.0.trial187.stdout:795: seq_num 289 ranges {457223=568375,1461649=475758,2420186=437037} 2026-02-13T18:08:56.753 INFO:tasks.rados.rados.0.trial187.stdout:795: writing trial18717860-45 from 457223 to 1025598 tid 1 2026-02-13T18:08:56.759 INFO:tasks.rados.rados.0.trial187.stdout:795: writing trial18717860-45 from 1461649 to 1937407 tid 2 2026-02-13T18:08:56.766 INFO:tasks.rados.rados.0.trial187.stdout:795: writing trial18717860-45 from 2420186 to 2857223 tid 3 2026-02-13T18:08:56.766 INFO:tasks.rados.rados.0.trial187.stdout:796: delete oid 5 current snap is 85 2026-02-13T18:08:56.766 INFO:tasks.rados.rados.0.trial187.stdout:793: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:08:56.766 INFO:tasks.rados.rados.0.trial187.stdout:793: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:08:56.767 INFO:tasks.rados.rados.0.trial187.stdout:793: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:08:56.767 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 287 (ObjNum 227 snap 68 seq_num 227) dirty exists 2026-02-13T18:08:56.767 INFO:tasks.rados.rados.0.trial187.stdout:795: finishing write tid 1 to trial18717860-45 2026-02-13T18:08:56.767 INFO:tasks.rados.rados.0.trial187.stdout:795: finishing write tid 2 to trial18717860-45 2026-02-13T18:08:56.769 INFO:tasks.rados.rados.0.trial187.stdout:795: finishing write tid 3 to trial18717860-45 2026-02-13T18:08:56.769 INFO:tasks.rados.rados.0.trial187.stdout:795: finishing write tid 4 to trial18717860-45 2026-02-13T18:08:56.769 INFO:tasks.rados.rados.0.trial187.stdout:795: finishing write tid 5 to trial18717860-45 2026-02-13T18:08:56.769 INFO:tasks.rados.rados.0.trial187.stdout:795: oid 45 updating version 0 to 228 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:795: oid 45 version 228 is already newer than 227 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:795: oid 45 version 228 is already newer than 226 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:795: oid 45 version 228 is already newer than 223 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 228 (ObjNum 289 snap 85 seq_num 289) dirty exists 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:795: left oid 45 (ObjNum 289 snap 85 seq_num 289) 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:793: done (2 left) 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:795: done (1 left) 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:796: done (0 left) 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:797: write (excl) oid 28 current snap is 85 2026-02-13T18:08:56.770 INFO:tasks.rados.rados.0.trial187.stdout:797: seq_num 291 ranges {490837=718873,1862260=479427,2875032=15805} 2026-02-13T18:08:56.777 INFO:tasks.rados.rados.0.trial187.stdout:797: writing trial18717860-28 from 490837 to 1209710 tid 1 2026-02-13T18:08:56.785 INFO:tasks.rados.rados.0.trial187.stdout:797: writing trial18717860-28 from 1862260 to 2341687 tid 2 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:797: writing trial18717860-28 from 2875032 to 2890837 tid 3 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:798: read oid 36 snap -1 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:798: expect (ObjNum 248 snap 74 seq_num 248) 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:799: write oid 43 current snap is 85 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:797: finishing write tid 1 to trial18717860-28 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:797: finishing write tid 2 to trial18717860-28 2026-02-13T18:08:56.789 INFO:tasks.rados.rados.0.trial187.stdout:799: seq_num 292 ranges {507644=794122,1920742=623085} 2026-02-13T18:08:56.797 INFO:tasks.rados.rados.0.trial187.stdout:799: writing trial18717860-43 from 507644 to 1301766 tid 1 2026-02-13T18:08:56.805 INFO:tasks.rados.rados.0.trial187.stdout:799: writing trial18717860-43 from 1920742 to 2543827 tid 2 2026-02-13T18:08:56.805 INFO:tasks.rados.rados.0.trial187.stdout:800: write (excl) oid 26 current snap is 85 2026-02-13T18:08:56.805 INFO:tasks.rados.rados.0.trial187.stdout:800: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2026-02-13T18:08:56.808 INFO:tasks.rados.rados.0.trial187.stdout:800: writing trial18717860-26 from 524451 to 993822 tid 1 2026-02-13T18:08:56.812 INFO:tasks.rados.rados.0.trial187.stdout:800: writing trial18717860-26 from 1579224 to 2062320 tid 2 2026-02-13T18:08:56.816 INFO:tasks.rados.rados.0.trial187.stdout:800: writing trial18717860-26 from 2529878 to 2924451 tid 3 2026-02-13T18:08:56.816 INFO:tasks.rados.rados.0.trial187.stdout:801: delete oid 39 current snap is 85 2026-02-13T18:08:56.816 INFO:tasks.rados.rados.0.trial187.stdout:797: finishing write tid 3 to trial18717860-28 2026-02-13T18:08:56.816 INFO:tasks.rados.rados.0.trial187.stdout:797: finishing write tid 4 to trial18717860-28 2026-02-13T18:08:56.816 INFO:tasks.rados.rados.0.trial187.stdout:797: finishing write tid 5 to trial18717860-28 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:797: oid 28 updating version 0 to 158 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:797: oid 28 updating version 158 to 159 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:797: oid 28 updating version 159 to 160 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:797: oid 28 version 160 is already newer than 157 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 160 (ObjNum 291 snap 85 seq_num 291) dirty exists 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:797: left oid 28 (ObjNum 291 snap 85 seq_num 291) 2026-02-13T18:08:56.817 INFO:tasks.rados.rados.0.trial187.stdout:798: expect (ObjNum 248 snap 74 seq_num 248) 2026-02-13T18:08:56.868 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1081111 2026-02-13T18:08:56.912 INFO:tasks.rados.rados.0.trial187.stdout:799: finishing write tid 1 to trial18717860-43 2026-02-13T18:08:56.912 INFO:tasks.rados.rados.0.trial187.stdout:799: finishing write tid 2 to trial18717860-43 2026-02-13T18:08:56.912 INFO:tasks.rados.rados.0.trial187.stdout:799: finishing write tid 3 to trial18717860-43 2026-02-13T18:08:56.912 INFO:tasks.rados.rados.0.trial187.stdout:799: finishing write tid 4 to trial18717860-43 2026-02-13T18:08:56.912 INFO:tasks.rados.rados.0.trial187.stdout:799: oid 43 updating version 0 to 450 2026-02-13T18:08:56.912 INFO:tasks.rados.rados.0.trial187.stdout:799: oid 43 version 450 is already newer than 448 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:799: oid 43 version 450 is already newer than 449 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 450 (ObjNum 292 snap 85 seq_num 292) dirty exists 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:799: left oid 43 (ObjNum 292 snap 85 seq_num 292) 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: finishing write tid 1 to trial18717860-26 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: finishing write tid 2 to trial18717860-26 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: finishing write tid 3 to trial18717860-26 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: finishing write tid 4 to trial18717860-26 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: finishing write tid 5 to trial18717860-26 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: oid 26 updating version 0 to 408 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: oid 26 updating version 408 to 409 2026-02-13T18:08:56.913 INFO:tasks.rados.rados.0.trial187.stdout:800: oid 26 updating version 409 to 411 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:800: oid 26 version 411 is already newer than 410 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 411 (ObjNum 293 snap 85 seq_num 293) dirty exists 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:800: left oid 26 (ObjNum 293 snap 85 seq_num 293) 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:797: done (4 left) 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:798: done (3 left) 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:799: done (2 left) 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:800: done (1 left) 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:801: done (0 left) 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:802: write (excl) oid 34 current snap is 85 2026-02-13T18:08:56.914 INFO:tasks.rados.rados.0.trial187.stdout:802: seq_num 295 ranges {558065=619869,1579835=486765,2468371=489694} 2026-02-13T18:08:56.920 INFO:tasks.rados.rados.0.trial187.stdout:802: writing trial18717860-34 from 558065 to 1177934 tid 1 2026-02-13T18:08:56.926 INFO:tasks.rados.rados.0.trial187.stdout:802: writing trial18717860-34 from 1579835 to 2066600 tid 2 2026-02-13T18:08:56.932 INFO:tasks.rados.rados.0.trial187.stdout:802: writing trial18717860-34 from 2468371 to 2958065 tid 3 2026-02-13T18:08:56.932 INFO:tasks.rados.rados.0.trial187.stdout:803: write (excl) oid 32 current snap is 85 2026-02-13T18:08:56.932 INFO:tasks.rados.rados.0.trial187.stdout:803: seq_num 296 ranges {574872=695118,2038317=630423} 2026-02-13T18:08:56.940 INFO:tasks.rados.rados.0.trial187.stdout:803: writing trial18717860-32 from 574872 to 1269990 tid 1 2026-02-13T18:08:56.950 INFO:tasks.rados.rados.0.trial187.stdout:803: writing trial18717860-32 from 2038317 to 2668740 tid 2 2026-02-13T18:08:56.950 INFO:tasks.rados.rados.0.trial187.stdout:804: delete oid 35 current snap is 85 2026-02-13T18:08:56.950 INFO:tasks.rados.rados.0.trial187.stdout:802: finishing write tid 1 to trial18717860-34 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: finishing write tid 2 to trial18717860-34 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: finishing write tid 3 to trial18717860-34 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: finishing write tid 4 to trial18717860-34 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: finishing write tid 5 to trial18717860-34 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: oid 34 updating version 0 to 168 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: oid 34 version 168 is already newer than 167 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: oid 34 version 168 is already newer than 165 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: oid 34 version 168 is already newer than 166 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 168 (ObjNum 295 snap 85 seq_num 295) dirty exists 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:802: left oid 34 (ObjNum 295 snap 85 seq_num 295) 2026-02-13T18:08:56.951 INFO:tasks.rados.rados.0.trial187.stdout:803: finishing write tid 1 to trial18717860-32 2026-02-13T18:08:56.952 INFO:tasks.rados.rados.0.trial187.stdout:802: done (2 left) 2026-02-13T18:08:56.952 INFO:tasks.rados.rados.0.trial187.stdout:804: done (1 left) 2026-02-13T18:08:56.952 INFO:tasks.rados.rados.0.trial187.stdout:805: snap_create 2026-02-13T18:08:56.952 INFO:tasks.rados.rados.0.trial187.stdout:803: finishing write tid 2 to trial18717860-32 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:803: finishing write tid 3 to trial18717860-32 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:803: finishing write tid 4 to trial18717860-32 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:803: oid 32 updating version 0 to 195 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:803: oid 32 version 195 is already newer than 194 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:803: oid 32 updating version 195 to 196 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 196 (ObjNum 296 snap 85 seq_num 296) dirty exists 2026-02-13T18:08:56.953 INFO:tasks.rados.rados.0.trial187.stdout:803: left oid 32 (ObjNum 296 snap 85 seq_num 296) 2026-02-13T18:08:57.748 INFO:tasks.rados.rados.0.trial187.stdout:803: done (1 left) 2026-02-13T18:08:57.748 INFO:tasks.rados.rados.0.trial187.stdout:805: done (0 left) 2026-02-13T18:08:57.748 INFO:tasks.rados.rados.0.trial187.stdout:806: read oid 40 snap 63 2026-02-13T18:08:57.748 INFO:tasks.rados.rados.0.trial187.stdout:806: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:08:57.748 INFO:tasks.rados.rados.0.trial187.stdout:807: rollback oid 30 current snap is 86 2026-02-13T18:08:57.748 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 83 2026-02-13T18:08:57.749 INFO:tasks.rados.rados.0.trial187.stdout:808: copy_from oid 1 from oid 42 current snap is 86 2026-02-13T18:08:57.749 INFO:tasks.rados.rados.0.trial187.stdout:809: read oid 19 snap -1 2026-02-13T18:08:57.749 INFO:tasks.rados.rados.0.trial187.stdout:809: expect (ObjNum 268 snap 83 seq_num 268) 2026-02-13T18:08:57.749 INFO:tasks.rados.rados.0.trial187.stdout:810: write oid 41 current snap is 86 2026-02-13T18:08:57.749 INFO:tasks.rados.rados.0.trial187.stdout:810: seq_num 298 ranges {608486=561969,1871634=634092,2950640=57846} 2026-02-13T18:08:57.755 INFO:tasks.rados.rados.0.trial187.stdout:810: writing trial18717860-41 from 608486 to 1170455 tid 1 2026-02-13T18:08:57.764 INFO:tasks.rados.rados.0.trial187.stdout:810: writing trial18717860-41 from 1871634 to 2505726 tid 2 2026-02-13T18:08:57.767 INFO:tasks.rados.rados.0.trial187.stdout:810: writing trial18717860-41 from 2950640 to 3008486 tid 3 2026-02-13T18:08:57.768 INFO:tasks.rados.rados.0.trial187.stdout:811: write (excl) oid 13 current snap is 86 2026-02-13T18:08:57.768 INFO:tasks.rados.rados.0.trial187.stdout:811: seq_num 299 ranges {625293=637218,1813763=494103,2978063=47230} 2026-02-13T18:08:57.776 INFO:tasks.rados.rados.0.trial187.stdout:811: writing trial18717860-13 from 625293 to 1262511 tid 1 2026-02-13T18:08:57.783 INFO:tasks.rados.rados.0.trial187.stdout:811: writing trial18717860-13 from 1813763 to 2307866 tid 2 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:811: writing trial18717860-13 from 2978063 to 3025293 tid 3 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:812: read oid 25 snap 85 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:812: expect (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:813: read oid 18 snap 80 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:813: expect deleted 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:814: write (excl) oid 24 current snap is 86 2026-02-13T18:08:57.789 INFO:tasks.rados.rados.0.trial187.stdout:814: seq_num 300 ranges {642100=712467,1872245=637761} 2026-02-13T18:08:57.795 INFO:tasks.rados.rados.0.trial187.stdout:814: writing trial18717860-24 from 642100 to 1354567 tid 1 2026-02-13T18:08:57.800 INFO:tasks.rados.rados.0.trial187.stdout:814: writing trial18717860-24 from 1872245 to 2510006 tid 2 2026-02-13T18:08:57.800 INFO:tasks.rados.rados.0.trial187.stdout:815: read oid 29 snap -1 2026-02-13T18:08:57.800 INFO:tasks.rados.rados.0.trial187.stdout:815: expect (ObjNum 285 snap 85 seq_num 285) 2026-02-13T18:08:57.800 INFO:tasks.rados.rados.0.trial187.stdout:816: read oid 33 snap 72 2026-02-13T18:08:57.800 INFO:tasks.rados.rados.0.trial187.stdout:816: expect (ObjNum 204 snap 57 seq_num 204) 2026-02-13T18:08:57.801 INFO:tasks.rados.rados.0.trial187.stdout:817: read oid 12 snap -1 2026-02-13T18:08:57.801 INFO:tasks.rados.rados.0.trial187.stdout:817: expect deleted 2026-02-13T18:08:57.801 INFO:tasks.rados.rados.0.trial187.stdout:818: snap_remove snap 71 2026-02-13T18:08:58.704 INFO:tasks.rados.rados.0.trial187.stdout:818: done (12 left) 2026-02-13T18:08:58.705 INFO:tasks.rados.rados.0.trial187.stdout:819: read oid 2 snap -1 2026-02-13T18:08:58.705 INFO:tasks.rados.rados.0.trial187.stdout:819: expect (ObjNum 274 snap 83 seq_num 274) 2026-02-13T18:08:58.705 INFO:tasks.rados.rados.0.trial187.stdout:820: write (excl) oid 36 current snap is 86 2026-02-13T18:08:58.705 INFO:tasks.rados.rados.0.trial187.stdout:820: seq_num 301 ranges {658907=787716,1930727=497772,3032909=25998} 2026-02-13T18:08:58.712 INFO:tasks.rados.rados.0.trial187.stdout:820: writing trial18717860-36 from 658907 to 1446623 tid 1 2026-02-13T18:08:58.716 INFO:tasks.rados.rados.0.trial187.stdout:820: writing trial18717860-36 from 1930727 to 2428499 tid 2 2026-02-13T18:08:58.718 INFO:tasks.rados.rados.0.trial187.stdout:820: writing trial18717860-36 from 3032909 to 3058907 tid 3 2026-02-13T18:08:58.719 INFO:tasks.rados.rados.0.trial187.stdout:821: snap_remove snap 70 2026-02-13T18:08:59.704 INFO:tasks.rados.rados.0.trial187.stdout:821: done (14 left) 2026-02-13T18:08:59.704 INFO:tasks.rados.rados.0.trial187.stdout:822: write oid 16 current snap is 86 2026-02-13T18:08:59.704 INFO:tasks.rados.rados.0.trial187.stdout:822: seq_num 302 ranges {675714=462965,1589209=641430,2943979=131735} 2026-02-13T18:08:59.711 INFO:tasks.rados.rados.0.trial187.stdout:822: writing trial18717860-16 from 675714 to 1138679 tid 1 2026-02-13T18:08:59.719 INFO:tasks.rados.rados.0.trial187.stdout:822: writing trial18717860-16 from 1589209 to 2230639 tid 2 2026-02-13T18:08:59.725 INFO:tasks.rados.rados.0.trial187.stdout:822: writing trial18717860-16 from 2943979 to 3075714 tid 3 2026-02-13T18:08:59.725 INFO:tasks.rados.rados.0.trial187.stdout:823: read oid 15 snap 85 2026-02-13T18:08:59.725 INFO:tasks.rados.rados.0.trial187.stdout:823: expect deleted 2026-02-13T18:08:59.725 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:08:59.725 INFO:tasks.rados.rados.0.trial187.stdout:806: expect (ObjNum 139 snap 25 seq_num 139) 2026-02-13T18:08:59.725 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:59.785 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:08:59.807 INFO:tasks.rados.rados.0.trial187.stdout:808: finishing copy_from to trial18717860-1 2026-02-13T18:08:59.807 INFO:tasks.rados.rados.0.trial187.stdout:808: got expected ENOENT (src dne) 2026-02-13T18:08:59.807 INFO:tasks.rados.rados.0.trial187.stdout:808: finishing copy_from racing read to trial18717860-1 2026-02-13T18:08:59.807 INFO:tasks.rados.rados.0.trial187.stdout:809: expect (ObjNum 268 snap 83 seq_num 268) 2026-02-13T18:08:59.886 INFO:tasks.rados.rados.0.trial187.stdout:807: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:807: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:807: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 199 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:810: finishing write tid 1 to trial18717860-41 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:810: finishing write tid 2 to trial18717860-41 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:810: finishing write tid 3 to trial18717860-41 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:810: finishing write tid 4 to trial18717860-41 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:806: done (15 left) 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:807: done (14 left) 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:808: done (13 left) 2026-02-13T18:08:59.887 INFO:tasks.rados.rados.0.trial187.stdout:809: done (12 left) 2026-02-13T18:08:59.888 INFO:tasks.rados.rados.0.trial187.stdout:824: read oid 27 snap -1 2026-02-13T18:08:59.888 INFO:tasks.rados.rados.0.trial187.stdout:824: expect deleted 2026-02-13T18:08:59.888 INFO:tasks.rados.rados.0.trial187.stdout:825: write oid 49 current snap is 86 2026-02-13T18:08:59.888 INFO:tasks.rados.rados.0.trial187.stdout:825: seq_num 303 ranges {692521=538214,1931338=785088} 2026-02-13T18:08:59.895 INFO:tasks.rados.rados.0.trial187.stdout:825: writing trial18717860-49 from 692521 to 1230735 tid 1 2026-02-13T18:08:59.905 INFO:tasks.rados.rados.0.trial187.stdout:825: writing trial18717860-49 from 1931338 to 2716426 tid 2 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:826: delete oid 9 current snap is 86 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:810: finishing write tid 5 to trial18717860-41 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:810: oid 41 updating version 0 to 245 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:810: oid 41 updating version 245 to 247 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:810: oid 41 updating version 247 to 248 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:810: oid 41 version 248 is already newer than 246 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 248 (ObjNum 298 snap 86 seq_num 298) dirty exists 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:810: left oid 41 (ObjNum 298 snap 86 seq_num 298) 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:811: finishing write tid 1 to trial18717860-13 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:811: finishing write tid 2 to trial18717860-13 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:811: finishing write tid 3 to trial18717860-13 2026-02-13T18:08:59.906 INFO:tasks.rados.rados.0.trial187.stdout:811: finishing write tid 4 to trial18717860-13 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:811: finishing write tid 5 to trial18717860-13 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:811: oid 13 updating version 0 to 185 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:811: oid 13 version 185 is already newer than 184 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:811: oid 13 updating version 185 to 186 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:811: oid 13 version 186 is already newer than 183 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 186 (ObjNum 299 snap 86 seq_num 299) dirty exists 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:811: left oid 13 (ObjNum 299 snap 86 seq_num 299) 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:812: expect (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:08:59.907 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:00.016 INFO:tasks.rados.rados.0.trial187.stdout:814: finishing write tid 1 to trial18717860-24 2026-02-13T18:09:00.016 INFO:tasks.rados.rados.0.trial187.stdout:815: expect (ObjNum 285 snap 85 seq_num 285) 2026-02-13T18:09:00.037 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1642651 2026-02-13T18:09:00.140 INFO:tasks.rados.rados.0.trial187.stdout:814: finishing write tid 2 to trial18717860-24 2026-02-13T18:09:00.140 INFO:tasks.rados.rados.0.trial187.stdout:814: finishing write tid 3 to trial18717860-24 2026-02-13T18:09:00.140 INFO:tasks.rados.rados.0.trial187.stdout:814: finishing write tid 4 to trial18717860-24 2026-02-13T18:09:00.140 INFO:tasks.rados.rados.0.trial187.stdout:814: oid 24 updating version 0 to 162 2026-02-13T18:09:00.140 INFO:tasks.rados.rados.0.trial187.stdout:814: oid 24 updating version 162 to 164 2026-02-13T18:09:00.140 INFO:tasks.rados.rados.0.trial187.stdout:814: oid 24 version 164 is already newer than 163 2026-02-13T18:09:00.141 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 164 (ObjNum 300 snap 86 seq_num 300) dirty exists 2026-02-13T18:09:00.141 INFO:tasks.rados.rados.0.trial187.stdout:814: left oid 24 (ObjNum 300 snap 86 seq_num 300) 2026-02-13T18:09:00.141 INFO:tasks.rados.rados.0.trial187.stdout:816: expect (ObjNum 204 snap 57 seq_num 204) 2026-02-13T18:09:00.141 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:00.276 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2661818 2026-02-13T18:09:00.288 INFO:tasks.rados.rados.0.trial187.stdout:819: expect (ObjNum 274 snap 83 seq_num 274) 2026-02-13T18:09:00.302 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:00.321 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 40189 2026-02-13T18:09:00.341 INFO:tasks.rados.rados.0.trial187.stdout:820: finishing write tid 1 to trial18717860-36 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:820: finishing write tid 2 to trial18717860-36 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:820: finishing write tid 3 to trial18717860-36 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:820: finishing write tid 4 to trial18717860-36 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:810: done (14 left) 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:811: done (13 left) 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:812: done (12 left) 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:813: done (11 left) 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:814: done (10 left) 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:815: done (9 left) 2026-02-13T18:09:00.342 INFO:tasks.rados.rados.0.trial187.stdout:816: done (8 left) 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:817: done (7 left) 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:819: done (6 left) 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:826: done (5 left) 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:827: copy_from oid 5 from oid 13 current snap is 86 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:820: finishing write tid 5 to trial18717860-36 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:820: oid 36 updating version 0 to 291 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:820: oid 36 version 291 is already newer than 289 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:820: oid 36 version 291 is already newer than 290 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:820: oid 36 version 291 is already newer than 288 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 291 (ObjNum 301 snap 86 seq_num 301) dirty exists 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:820: left oid 36 (ObjNum 301 snap 86 seq_num 301) 2026-02-13T18:09:00.343 INFO:tasks.rados.rados.0.trial187.stdout:822: finishing write tid 1 to trial18717860-16 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: finishing write tid 2 to trial18717860-16 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: finishing write tid 3 to trial18717860-16 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: finishing write tid 4 to trial18717860-16 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: finishing write tid 5 to trial18717860-16 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: oid 16 updating version 0 to 219 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: oid 16 version 219 is already newer than 218 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: oid 16 updating version 219 to 220 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: oid 16 version 220 is already newer than 217 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 220 (ObjNum 302 snap 86 seq_num 302) dirty exists 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:822: left oid 16 (ObjNum 302 snap 86 seq_num 302) 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:825: finishing write tid 1 to trial18717860-49 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:825: finishing write tid 2 to trial18717860-49 2026-02-13T18:09:00.344 INFO:tasks.rados.rados.0.trial187.stdout:825: finishing write tid 3 to trial18717860-49 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:825: finishing write tid 4 to trial18717860-49 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:825: oid 49 updating version 0 to 176 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:825: oid 49 version 176 is already newer than 174 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:825: oid 49 version 176 is already newer than 175 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 176 (ObjNum 303 snap 86 seq_num 303) dirty exists 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:825: left oid 49 (ObjNum 303 snap 86 seq_num 303) 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:820: done (5 left) 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:822: done (4 left) 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:823: done (3 left) 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:824: done (2 left) 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:825: done (1 left) 2026-02-13T18:09:00.345 INFO:tasks.rados.rados.0.trial187.stdout:828: snap_remove snap 80 2026-02-13T18:09:00.708 INFO:tasks.rados.rados.0.trial187.stdout:828: done (1 left) 2026-02-13T18:09:00.708 INFO:tasks.rados.rados.0.trial187.stdout:829: copy_from oid 27 from oid 36 current snap is 86 2026-02-13T18:09:00.708 INFO:tasks.rados.rados.0.trial187.stdout:827: finishing copy_from racing read to trial18717860-5 2026-02-13T18:09:00.708 INFO:tasks.rados.rados.0.trial187.stdout:827: finishing copy_from to trial18717860-5 2026-02-13T18:09:00.708 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 186 (ObjNum 299 snap 86 seq_num 299) dirty exists 2026-02-13T18:09:00.709 INFO:tasks.rados.rados.0.trial187.stdout:827: done (1 left) 2026-02-13T18:09:00.709 INFO:tasks.rados.rados.0.trial187.stdout:830: delete oid 49 current snap is 86 2026-02-13T18:09:00.711 INFO:tasks.rados.rados.0.trial187.stdout:830: done (1 left) 2026-02-13T18:09:00.711 INFO:tasks.rados.rados.0.trial187.stdout:831: rollback oid 19 current snap is 86 2026-02-13T18:09:00.712 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 72 2026-02-13T18:09:00.712 INFO:tasks.rados.rados.0.trial187.stdout:832: rollback oid 4 current snap is 86 2026-02-13T18:09:00.712 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 85 2026-02-13T18:09:00.712 INFO:tasks.rados.rados.0.trial187.stdout:833: write oid 11 current snap is 86 2026-02-13T18:09:00.712 INFO:tasks.rados.rados.0.trial187.stdout:833: seq_num 306 ranges {742942=480314,1823137=648768} 2026-02-13T18:09:00.719 INFO:tasks.rados.rados.0.trial187.stdout:833: writing trial18717860-11 from 742942 to 1223256 tid 1 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:833: writing trial18717860-11 from 1823137 to 2471905 tid 2 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:834: rollback oid 42 current snap is 86 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:832: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 150 (ObjNum 65 snap 0 seq_num 3013900624) dirty dne 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:831: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:831: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:09:00.729 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 240 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:833: finishing write tid 1 to trial18717860-11 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:829: finishing copy_from racing read to trial18717860-27 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:829: finishing copy_from to trial18717860-27 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 291 (ObjNum 301 snap 86 seq_num 301) dirty exists 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 42 to 85 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:829: done (4 left) 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:831: done (3 left) 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:832: done (2 left) 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:835: read oid 3 snap 83 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:835: expect (ObjNum 260 snap 81 seq_num 260) 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:836: copy_from oid 20 from oid 31 current snap is 86 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:837: read oid 19 snap -1 2026-02-13T18:09:00.730 INFO:tasks.rados.rados.0.trial187.stdout:837: expect deleted 2026-02-13T18:09:00.731 INFO:tasks.rados.rados.0.trial187.stdout:838: snap_remove snap 72 2026-02-13T18:09:02.202 INFO:tasks.rados.rados.0.trial187.stdout:838: done (5 left) 2026-02-13T18:09:02.202 INFO:tasks.rados.rados.0.trial187.stdout:839: write (excl) oid 43 current snap is 86 2026-02-13T18:09:02.202 INFO:tasks.rados.rados.0.trial187.stdout:839: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2026-02-13T18:09:02.210 INFO:tasks.rados.rados.0.trial187.stdout:839: writing trial18717860-43 from 759749 to 1315312 tid 1 2026-02-13T18:09:02.219 INFO:tasks.rados.rados.0.trial187.stdout:839: writing trial18717860-43 from 1765266 to 2557692 tid 2 2026-02-13T18:09:02.223 INFO:tasks.rados.rados.0.trial187.stdout:839: writing trial18717860-43 from 2964741 to 3159749 tid 3 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:840: rollback oid 48 current snap is 86 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 48 to 85 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:834: finishing rollback tid 1 to trial18717860-42 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 0 (ObjNum 81 snap 0 seq_num 4016633748) dirty dne 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:833: finishing write tid 2 to trial18717860-11 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:834: done (6 left) 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:841: read oid 36 snap 83 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:841: expect (ObjNum 248 snap 74 seq_num 248) 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:842: rollback oid 18 current snap is 86 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 85 2026-02-13T18:09:02.224 INFO:tasks.rados.rados.0.trial187.stdout:835: expect (ObjNum 260 snap 81 seq_num 260) 2026-02-13T18:09:02.269 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 676146 2026-02-13T18:09:02.293 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 791782 2026-02-13T18:09:02.309 INFO:tasks.rados.rados.0.trial187.stdout:833: finishing write tid 3 to trial18717860-11 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:833: finishing write tid 4 to trial18717860-11 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:833: oid 11 updating version 0 to 186 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:833: oid 11 updating version 186 to 187 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:833: oid 11 version 187 is already newer than 185 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 187 (ObjNum 306 snap 86 seq_num 306) dirty exists 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:833: left oid 11 (ObjNum 306 snap 86 seq_num 306) 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:836: finishing copy_from racing read to trial18717860-20 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:836: finishing copy_from to trial18717860-20 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 159 (ObjNum 282 snap 85 seq_num 282) dirty exists 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:839: finishing write tid 1 to trial18717860-43 2026-02-13T18:09:02.310 INFO:tasks.rados.rados.0.trial187.stdout:839: finishing write tid 2 to trial18717860-43 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:833: done (7 left) 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:835: done (6 left) 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:836: done (5 left) 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:837: done (4 left) 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:843: copy_from oid 7 from oid 47 current snap is 86 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:842: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: finishing write tid 3 to trial18717860-43 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: finishing write tid 4 to trial18717860-43 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: finishing write tid 5 to trial18717860-43 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: oid 43 updating version 0 to 477 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: oid 43 version 477 is already newer than 476 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: oid 43 updating version 477 to 479 2026-02-13T18:09:02.311 INFO:tasks.rados.rados.0.trial187.stdout:839: oid 43 version 479 is already newer than 478 2026-02-13T18:09:02.312 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 479 (ObjNum 307 snap 86 seq_num 307) dirty exists 2026-02-13T18:09:02.312 INFO:tasks.rados.rados.0.trial187.stdout:839: left oid 43 (ObjNum 307 snap 86 seq_num 307) 2026-02-13T18:09:02.312 INFO:tasks.rados.rados.0.trial187.stdout:840: finishing rollback tid 1 to trial18717860-48 2026-02-13T18:09:02.312 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 339 (ObjNum 129 snap 0 seq_num 3013697576) dirty dne 2026-02-13T18:09:02.312 INFO:tasks.rados.rados.0.trial187.stdout:841: expect (ObjNum 248 snap 74 seq_num 248) 2026-02-13T18:09:02.388 INFO:tasks.rados.rados.0.trial187.stdout:842: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:09:02.388 INFO:tasks.rados.rados.0.trial187.stdout:842: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:09:02.388 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 204 (ObjNum 270 snap 83 seq_num 270) dirty exists 2026-02-13T18:09:02.388 INFO:tasks.rados.rados.0.trial187.stdout:843: finishing copy_from to trial18717860-7 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:843: got expected ENOENT (src dne) 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:843: finishing copy_from racing read to trial18717860-7 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:839: done (4 left) 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:840: done (3 left) 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:841: done (2 left) 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:842: done (1 left) 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:843: done (0 left) 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:844: rollback oid 41 current snap is 86 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 63 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:845: write (excl) oid 5 current snap is 86 2026-02-13T18:09:02.389 INFO:tasks.rados.rados.0.trial187.stdout:845: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2026-02-13T18:09:02.397 INFO:tasks.rados.rados.0.trial187.stdout:845: writing trial18717860-5 from 776556 to 1407368 tid 1 2026-02-13T18:09:02.404 INFO:tasks.rados.rados.0.trial187.stdout:845: writing trial18717860-5 from 1823748 to 2476185 tid 2 2026-02-13T18:09:02.409 INFO:tasks.rados.rados.0.trial187.stdout:845: writing trial18717860-5 from 3108517 to 3176556 tid 3 2026-02-13T18:09:02.409 INFO:tasks.rados.rados.0.trial187.stdout:846: delete oid 40 current snap is 86 2026-02-13T18:09:02.409 INFO:tasks.rados.rados.0.trial187.stdout:844: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:09:02.409 INFO:tasks.rados.rados.0.trial187.stdout:844: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:09:02.410 INFO:tasks.rados.rados.0.trial187.stdout:844: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:09:02.410 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 251 (ObjNum 211 snap 60 seq_num 211) dirty exists 2026-02-13T18:09:02.410 INFO:tasks.rados.rados.0.trial187.stdout:845: finishing write tid 1 to trial18717860-5 2026-02-13T18:09:02.410 INFO:tasks.rados.rados.0.trial187.stdout:845: finishing write tid 2 to trial18717860-5 2026-02-13T18:09:02.411 INFO:tasks.rados.rados.0.trial187.stdout:845: finishing write tid 3 to trial18717860-5 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: finishing write tid 4 to trial18717860-5 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: finishing write tid 5 to trial18717860-5 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: oid 5 updating version 0 to 254 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: oid 5 updating version 254 to 256 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: oid 5 updating version 256 to 257 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: oid 5 version 257 is already newer than 255 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 257 (ObjNum 308 snap 86 seq_num 308) dirty exists 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: left oid 5 (ObjNum 308 snap 86 seq_num 308) 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:844: done (2 left) 2026-02-13T18:09:02.412 INFO:tasks.rados.rados.0.trial187.stdout:845: done (1 left) 2026-02-13T18:09:02.413 INFO:tasks.rados.rados.0.trial187.stdout:846: done (0 left) 2026-02-13T18:09:02.413 INFO:tasks.rados.rados.0.trial187.stdout:847: rollback oid 32 current snap is 86 2026-02-13T18:09:02.413 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 63 2026-02-13T18:09:02.413 INFO:tasks.rados.rados.0.trial187.stdout:848: rollback oid 37 current snap is 86 2026-02-13T18:09:02.413 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 83 2026-02-13T18:09:02.413 INFO:tasks.rados.rados.0.trial187.stdout:849: delete oid 1 current snap is 86 2026-02-13T18:09:02.414 INFO:tasks.rados.rados.0.trial187.stdout:848: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:09:02.414 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 345 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:09:02.414 INFO:tasks.rados.rados.0.trial187.stdout:848: done (2 left) 2026-02-13T18:09:02.414 INFO:tasks.rados.rados.0.trial187.stdout:849: done (1 left) 2026-02-13T18:09:02.414 INFO:tasks.rados.rados.0.trial187.stdout:850: rollback oid 43 current snap is 86 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 43 to 63 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:851: read oid 12 snap -1 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:851: expect deleted 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:852: rollback oid 17 current snap is 86 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 85 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:853: read oid 45 snap 63 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:853: expect deleted 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:854: rollback oid 11 current snap is 86 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 63 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:855: read oid 3 snap 63 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:855: expect (ObjNum 199 snap 56 seq_num 199) 2026-02-13T18:09:02.415 INFO:tasks.rados.rados.0.trial187.stdout:856: write oid 26 current snap is 86 2026-02-13T18:09:02.416 INFO:tasks.rados.rados.0.trial187.stdout:856: seq_num 311 ranges {426977=456559,1482841=799764,2958080=268897} 2026-02-13T18:09:02.419 INFO:tasks.rados.rados.0.trial187.stdout:856: writing trial18717860-26 from 426977 to 883536 tid 1 2026-02-13T18:09:02.428 INFO:tasks.rados.rados.0.trial187.stdout:856: writing trial18717860-26 from 1482841 to 2282605 tid 2 2026-02-13T18:09:02.435 INFO:tasks.rados.rados.0.trial187.stdout:856: writing trial18717860-26 from 2958080 to 3226977 tid 3 2026-02-13T18:09:02.435 INFO:tasks.rados.rados.0.trial187.stdout:857: copy_from oid 16 from oid 23 current snap is 86 2026-02-13T18:09:02.435 INFO:tasks.rados.rados.0.trial187.stdout:847: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:09:02.435 INFO:tasks.rados.rados.0.trial187.stdout:851: done (8 left) 2026-02-13T18:09:02.435 INFO:tasks.rados.rados.0.trial187.stdout:858: write oid 48 current snap is 86 2026-02-13T18:09:02.435 INFO:tasks.rados.rados.0.trial187.stdout:858: seq_num 312 ranges {443784=648161,1657676=659775,2818209=425575} 2026-02-13T18:09:02.441 INFO:tasks.rados.rados.0.trial187.stdout:858: writing trial18717860-48 from 443784 to 1091945 tid 1 2026-02-13T18:09:02.446 INFO:tasks.rados.rados.0.trial187.stdout:858: writing trial18717860-48 from 1657676 to 2317451 tid 2 2026-02-13T18:09:02.449 INFO:tasks.rados.rados.0.trial187.stdout:858: writing trial18717860-48 from 2818209 to 3243784 tid 3 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:859: read oid 31 snap -1 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:859: expect (ObjNum 282 snap 85 seq_num 282) 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:860: write (excl) oid 5 current snap is 86 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:847: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:847: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 202 (ObjNum 202 snap 56 seq_num 202) dirty exists 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:850: finishing rollback tid 0 to trial18717860-43 2026-02-13T18:09:02.450 INFO:tasks.rados.rados.0.trial187.stdout:860: seq_num 313 ranges {460591=723410,1716158=403433,2729279=440140} 2026-02-13T18:09:02.454 INFO:tasks.rados.rados.0.trial187.stdout:860: writing trial18717860-5 from 460591 to 1184001 tid 1 2026-02-13T18:09:02.457 INFO:tasks.rados.rados.0.trial187.stdout:860: writing trial18717860-5 from 1716158 to 2119591 tid 2 2026-02-13T18:09:02.461 INFO:tasks.rados.rados.0.trial187.stdout:860: writing trial18717860-5 from 2729279 to 3169419 tid 3 2026-02-13T18:09:02.461 INFO:tasks.rados.rados.0.trial187.stdout:847: done (10 left) 2026-02-13T18:09:02.461 INFO:tasks.rados.rados.0.trial187.stdout:861: write (excl) oid 14 current snap is 86 2026-02-13T18:09:02.462 INFO:tasks.rados.rados.0.trial187.stdout:850: finishing rollback tid 1 to trial18717860-43 2026-02-13T18:09:02.462 INFO:tasks.rados.rados.0.trial187.stdout:850: finishing rollback tid 2 to trial18717860-43 2026-02-13T18:09:02.462 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 484 (ObjNum 182 snap 44 seq_num 182) dirty exists 2026-02-13T18:09:02.462 INFO:tasks.rados.rados.0.trial187.stdout:854: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:09:02.462 INFO:tasks.rados.rados.0.trial187.stdout:861: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2026-02-13T18:09:02.466 INFO:tasks.rados.rados.0.trial187.stdout:861: writing trial18717860-14 from 477398 to 1276057 tid 1 2026-02-13T18:09:02.470 INFO:tasks.rados.rados.0.trial187.stdout:861: writing trial18717860-14 from 1774640 to 2438084 tid 2 2026-02-13T18:09:02.473 INFO:tasks.rados.rados.0.trial187.stdout:861: writing trial18717860-14 from 2873055 to 3277398 tid 3 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:850: done (10 left) 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:862: delete oid 36 current snap is 86 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:852: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:854: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 193 (ObjNum 33 snap 0 seq_num 3015319904) dirty dne 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:852: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:852: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 438 (ObjNum 158 snap 27 seq_num 158) dirty exists 2026-02-13T18:09:02.474 INFO:tasks.rados.rados.0.trial187.stdout:855: expect (ObjNum 199 snap 56 seq_num 199) 2026-02-13T18:09:02.481 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2014845 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: finishing write tid 1 to trial18717860-26 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: finishing write tid 2 to trial18717860-26 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: finishing write tid 3 to trial18717860-26 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: finishing write tid 4 to trial18717860-26 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: finishing write tid 5 to trial18717860-26 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: oid 26 updating version 0 to 440 2026-02-13T18:09:02.526 INFO:tasks.rados.rados.0.trial187.stdout:856: oid 26 updating version 440 to 442 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:856: oid 26 version 442 is already newer than 441 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:856: oid 26 updating version 442 to 443 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 443 (ObjNum 311 snap 86 seq_num 311) dirty exists 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:856: left oid 26 (ObjNum 311 snap 86 seq_num 311) 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:858: finishing write tid 1 to trial18717860-48 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:858: finishing write tid 2 to trial18717860-48 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:857: finishing copy_from racing read to trial18717860-16 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:852: done (10 left) 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:853: done (9 left) 2026-02-13T18:09:02.527 INFO:tasks.rados.rados.0.trial187.stdout:854: done (8 left) 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:855: done (7 left) 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:856: done (6 left) 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:862: done (5 left) 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:863: delete oid 45 current snap is 86 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:857: finishing copy_from to trial18717860-16 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 266 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:09:02.528 INFO:tasks.rados.rados.0.trial187.stdout:859: expect (ObjNum 282 snap 85 seq_num 282) 2026-02-13T18:09:02.545 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:02.574 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2053721 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: finishing write tid 3 to trial18717860-48 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: finishing write tid 4 to trial18717860-48 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: finishing write tid 5 to trial18717860-48 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: oid 48 updating version 0 to 487 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: oid 48 version 487 is already newer than 485 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: oid 48 version 487 is already newer than 486 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: oid 48 updating version 487 to 488 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 488 (ObjNum 312 snap 86 seq_num 312) dirty exists 2026-02-13T18:09:02.579 INFO:tasks.rados.rados.0.trial187.stdout:858: left oid 48 (ObjNum 312 snap 86 seq_num 312) 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: finishing write tid 1 to trial18717860-5 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: finishing write tid 2 to trial18717860-5 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: finishing write tid 3 to trial18717860-5 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: finishing write tid 4 to trial18717860-5 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: finishing write tid 5 to trial18717860-5 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: oid 5 updating version 0 to 260 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: oid 5 updating version 260 to 263 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: oid 5 version 263 is already newer than 262 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: oid 5 version 263 is already newer than 261 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 263 (ObjNum 313 snap 86 seq_num 313) dirty exists 2026-02-13T18:09:02.580 INFO:tasks.rados.rados.0.trial187.stdout:860: left oid 5 (ObjNum 313 snap 86 seq_num 313) 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: finishing write tid 1 to trial18717860-14 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: finishing write tid 2 to trial18717860-14 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: finishing write tid 3 to trial18717860-14 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: finishing write tid 4 to trial18717860-14 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: finishing write tid 5 to trial18717860-14 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: oid 14 updating version 0 to 294 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: oid 14 updating version 294 to 295 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: oid 14 version 295 is already newer than 293 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: oid 14 version 295 is already newer than 292 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 295 (ObjNum 314 snap 86 seq_num 314) dirty exists 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:861: left oid 14 (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:02.581 INFO:tasks.rados.rados.0.trial187.stdout:857: done (5 left) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:858: done (4 left) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:859: done (3 left) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:860: done (2 left) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:861: done (1 left) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:863: done (0 left) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:864: read oid 43 snap -1 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:864: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:865: rollback oid 12 current snap is 86 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 85 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:866: write oid 20 current snap is 86 2026-02-13T18:09:02.582 INFO:tasks.rados.rados.0.trial187.stdout:866: seq_num 317 ranges {527819=624406,1833733=410771,2722618=601581} 2026-02-13T18:09:02.585 INFO:tasks.rados.rados.0.trial187.stdout:866: writing trial18717860-20 from 527819 to 1152225 tid 1 2026-02-13T18:09:02.592 INFO:tasks.rados.rados.0.trial187.stdout:866: writing trial18717860-20 from 1833733 to 2244504 tid 2 2026-02-13T18:09:02.599 INFO:tasks.rados.rados.0.trial187.stdout:866: writing trial18717860-20 from 2722618 to 3324199 tid 3 2026-02-13T18:09:02.600 INFO:tasks.rados.rados.0.trial187.stdout:867: read oid 8 snap -1 2026-02-13T18:09:02.600 INFO:tasks.rados.rados.0.trial187.stdout:867: expect deleted 2026-02-13T18:09:02.600 INFO:tasks.rados.rados.0.trial187.stdout:868: snap_create 2026-02-13T18:09:02.600 INFO:tasks.rados.rados.0.trial187.stdout:865: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:09:02.600 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 168 (ObjNum 1201 snap 0 seq_num 1704178912) dirty dne 2026-02-13T18:09:02.600 INFO:tasks.rados.rados.0.trial187.stdout:864: expect (ObjNum 182 snap 44 seq_num 182) 2026-02-13T18:09:02.661 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 471995 2026-02-13T18:09:02.681 INFO:tasks.rados.rados.0.trial187.stdout:866: finishing write tid 1 to trial18717860-20 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: finishing write tid 2 to trial18717860-20 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: finishing write tid 3 to trial18717860-20 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: finishing write tid 4 to trial18717860-20 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: finishing write tid 5 to trial18717860-20 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: oid 20 updating version 0 to 270 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: oid 20 version 270 is already newer than 269 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: oid 20 version 270 is already newer than 267 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: oid 20 version 270 is already newer than 268 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 270 (ObjNum 317 snap 86 seq_num 317) dirty exists 2026-02-13T18:09:02.682 INFO:tasks.rados.rados.0.trial187.stdout:866: left oid 20 (ObjNum 317 snap 86 seq_num 317) 2026-02-13T18:09:03.206 INFO:tasks.rados.rados.0.trial187.stdout:864: done (4 left) 2026-02-13T18:09:03.206 INFO:tasks.rados.rados.0.trial187.stdout:865: done (3 left) 2026-02-13T18:09:03.206 INFO:tasks.rados.rados.0.trial187.stdout:866: done (2 left) 2026-02-13T18:09:03.206 INFO:tasks.rados.rados.0.trial187.stdout:867: done (1 left) 2026-02-13T18:09:03.206 INFO:tasks.rados.rados.0.trial187.stdout:868: done (0 left) 2026-02-13T18:09:03.206 INFO:tasks.rados.rados.0.trial187.stdout:869: delete oid 17 current snap is 87 2026-02-13T18:09:03.208 INFO:tasks.rados.rados.0.trial187.stdout:869: done (0 left) 2026-02-13T18:09:03.209 INFO:tasks.rados.rados.0.trial187.stdout:870: snap_remove snap 63 2026-02-13T18:09:03.703 INFO:tasks.rados.rados.0.trial187.stdout:870: done (0 left) 2026-02-13T18:09:03.704 INFO:tasks.rados.rados.0.trial187.stdout:871: rollback oid 46 current snap is 87 2026-02-13T18:09:03.704 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 85 2026-02-13T18:09:03.704 INFO:tasks.rados.rados.0.trial187.stdout:872: rollback oid 43 current snap is 87 2026-02-13T18:09:03.704 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 43 to 85 2026-02-13T18:09:03.704 INFO:tasks.rados.rados.0.trial187.stdout:873: write oid 7 current snap is 87 2026-02-13T18:09:03.704 INFO:tasks.rados.rados.0.trial187.stdout:873: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2026-02-13T18:09:03.712 INFO:tasks.rados.rados.0.trial187.stdout:873: writing trial18717860-7 from 561433 to 1336337 tid 1 2026-02-13T18:09:03.719 INFO:tasks.rados.rados.0.trial187.stdout:873: writing trial18717860-7 from 1950697 to 2365137 tid 2 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:873: writing trial18717860-7 from 2777464 to 3361433 tid 3 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:874: read oid 5 snap -1 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:874: expect (ObjNum 313 snap 86 seq_num 313) 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:875: rollback oid 34 current snap is 87 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 34 to 86 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:872: finishing rollback tid 0 to trial18717860-43 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:872: finishing rollback tid 1 to trial18717860-43 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:872: finishing rollback tid 2 to trial18717860-43 2026-02-13T18:09:03.727 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 492 (ObjNum 292 snap 85 seq_num 292) dirty exists 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:871: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:871: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:871: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 291 (ObjNum 286 snap 85 seq_num 286) dirty exists 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:873: finishing write tid 1 to trial18717860-7 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:873: finishing write tid 2 to trial18717860-7 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:871: done (4 left) 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:872: done (3 left) 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:876: read oid 11 snap 85 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:876: expect (ObjNum 269 snap 83 seq_num 269) 2026-02-13T18:09:03.728 INFO:tasks.rados.rados.0.trial187.stdout:877: delete oid 41 current snap is 87 2026-02-13T18:09:03.729 INFO:tasks.rados.rados.0.trial187.stdout:873: finishing write tid 3 to trial18717860-7 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: finishing write tid 4 to trial18717860-7 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: finishing write tid 5 to trial18717860-7 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: oid 7 updating version 0 to 295 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: oid 7 version 295 is already newer than 293 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: oid 7 version 295 is already newer than 294 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: oid 7 version 295 is already newer than 292 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 295 (ObjNum 319 snap 87 seq_num 319) dirty exists 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:873: left oid 7 (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:874: expect (ObjNum 313 snap 86 seq_num 313) 2026-02-13T18:09:03.730 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:03.809 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2003308 2026-02-13T18:09:03.872 INFO:tasks.rados.rados.0.trial187.stdout:875: finishing rollback tid 0 to trial18717860-34 2026-02-13T18:09:03.872 INFO:tasks.rados.rados.0.trial187.stdout:875: finishing rollback tid 1 to trial18717860-34 2026-02-13T18:09:03.872 INFO:tasks.rados.rados.0.trial187.stdout:876: expect (ObjNum 269 snap 83 seq_num 269) 2026-02-13T18:09:03.926 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1227904 2026-02-13T18:09:03.944 INFO:tasks.rados.rados.0.trial187.stdout:875: finishing rollback tid 2 to trial18717860-34 2026-02-13T18:09:03.944 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 199 (ObjNum 295 snap 85 seq_num 295) dirty exists 2026-02-13T18:09:03.944 INFO:tasks.rados.rados.0.trial187.stdout:873: done (4 left) 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:874: done (3 left) 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:875: done (2 left) 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:876: done (1 left) 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:877: done (0 left) 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:878: read oid 14 snap -1 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:878: expect (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:03.945 INFO:tasks.rados.rados.0.trial187.stdout:879: copy_from oid 43 from oid 39 current snap is 87 2026-02-13T18:09:03.946 INFO:tasks.rados.rados.0.trial187.stdout:880: rollback oid 50 current snap is 87 2026-02-13T18:09:03.946 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 83 2026-02-13T18:09:03.946 INFO:tasks.rados.rados.0.trial187.stdout:881: snap_remove snap 86 2026-02-13T18:09:04.713 INFO:tasks.rados.rados.0.trial187.stdout:881: done (3 left) 2026-02-13T18:09:04.713 INFO:tasks.rados.rados.0.trial187.stdout:882: read oid 25 snap -1 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:882: expect (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:883: copy_from oid 20 from oid 40 current snap is 87 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:879: finishing copy_from to trial18717860-43 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:879: got expected ENOENT (src dne) 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:879: finishing copy_from racing read to trial18717860-43 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:880: finishing rollback tid 0 to trial18717860-50 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:880: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:880: finishing rollback tid 2 to trial18717860-50 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 255 (ObjNum 173 snap 42 seq_num 173) dirty exists 2026-02-13T18:09:04.714 INFO:tasks.rados.rados.0.trial187.stdout:878: expect (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:04.767 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2837988 2026-02-13T18:09:04.874 INFO:tasks.rados.rados.0.trial187.stdout:882: expect (ObjNum 172 snap 42 seq_num 172) 2026-02-13T18:09:04.874 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:04.947 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:04.985 INFO:tasks.rados.rados.0.trial187.stdout:878: done (4 left) 2026-02-13T18:09:04.985 INFO:tasks.rados.rados.0.trial187.stdout:879: done (3 left) 2026-02-13T18:09:04.985 INFO:tasks.rados.rados.0.trial187.stdout:880: done (2 left) 2026-02-13T18:09:04.985 INFO:tasks.rados.rados.0.trial187.stdout:882: done (1 left) 2026-02-13T18:09:04.985 INFO:tasks.rados.rados.0.trial187.stdout:884: write oid 4 current snap is 87 2026-02-13T18:09:04.985 INFO:tasks.rados.rados.0.trial187.stdout:884: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2026-02-13T18:09:04.993 INFO:tasks.rados.rados.0.trial187.stdout:884: writing trial18717860-4 from 595047 to 1236802 tid 1 2026-02-13T18:09:04.999 INFO:tasks.rados.rados.0.trial187.stdout:884: writing trial18717860-4 from 1667661 to 2085770 tid 2 2026-02-13T18:09:05.008 INFO:tasks.rados.rados.0.trial187.stdout:884: writing trial18717860-4 from 2548663 to 3311685 tid 3 2026-02-13T18:09:05.008 INFO:tasks.rados.rados.0.trial187.stdout:885: copy_from oid 3 from oid 8 current snap is 87 2026-02-13T18:09:05.008 INFO:tasks.rados.rados.0.trial187.stdout:883: finishing copy_from to trial18717860-20 2026-02-13T18:09:05.008 INFO:tasks.rados.rados.0.trial187.stdout:883: got expected ENOENT (src dne) 2026-02-13T18:09:05.009 INFO:tasks.rados.rados.0.trial187.stdout:883: finishing copy_from racing read to trial18717860-20 2026-02-13T18:09:05.009 INFO:tasks.rados.rados.0.trial187.stdout:884: finishing write tid 1 to trial18717860-4 2026-02-13T18:09:05.009 INFO:tasks.rados.rados.0.trial187.stdout:884: finishing write tid 2 to trial18717860-4 2026-02-13T18:09:05.009 INFO:tasks.rados.rados.0.trial187.stdout:883: done (2 left) 2026-02-13T18:09:05.009 INFO:tasks.rados.rados.0.trial187.stdout:886: snap_remove snap 83 2026-02-13T18:09:05.713 INFO:tasks.rados.rados.0.trial187.stdout:886: done (2 left) 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:887: read oid 22 snap 85 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:887: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:888: snap_create 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:885: finishing copy_from to trial18717860-3 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:885: got expected ENOENT (src dne) 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:885: finishing copy_from racing read to trial18717860-3 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:884: finishing write tid 3 to trial18717860-4 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:884: finishing write tid 4 to trial18717860-4 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:884: finishing write tid 5 to trial18717860-4 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:884: oid 4 updating version 0 to 182 2026-02-13T18:09:05.714 INFO:tasks.rados.rados.0.trial187.stdout:884: oid 4 version 182 is already newer than 181 2026-02-13T18:09:05.715 INFO:tasks.rados.rados.0.trial187.stdout:884: oid 4 updating version 182 to 183 2026-02-13T18:09:05.715 INFO:tasks.rados.rados.0.trial187.stdout:884: oid 4 updating version 183 to 184 2026-02-13T18:09:05.715 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 184 (ObjNum 321 snap 87 seq_num 321) dirty exists 2026-02-13T18:09:05.715 INFO:tasks.rados.rados.0.trial187.stdout:884: left oid 4 (ObjNum 321 snap 87 seq_num 321) 2026-02-13T18:09:05.719 INFO:tasks.rados.rados.0.trial187.stdout:887: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:09:06.714 INFO:tasks.rados.rados.0.trial187.stdout:884: done (3 left) 2026-02-13T18:09:06.715 INFO:tasks.rados.rados.0.trial187.stdout:885: done (2 left) 2026-02-13T18:09:06.715 INFO:tasks.rados.rados.0.trial187.stdout:887: done (1 left) 2026-02-13T18:09:06.715 INFO:tasks.rados.rados.0.trial187.stdout:888: done (0 left) 2026-02-13T18:09:06.715 INFO:tasks.rados.rados.0.trial187.stdout:889: write oid 45 current snap is 88 2026-02-13T18:09:06.715 INFO:tasks.rados.rados.0.trial187.stdout:889: seq_num 322 ranges {611854=717004,2126143=561767,3259733=152121} 2026-02-13T18:09:06.723 INFO:tasks.rados.rados.0.trial187.stdout:889: writing trial18717860-45 from 611854 to 1328858 tid 1 2026-02-13T18:09:06.733 INFO:tasks.rados.rados.0.trial187.stdout:889: writing trial18717860-45 from 2126143 to 2687910 tid 2 2026-02-13T18:09:06.738 INFO:tasks.rados.rados.0.trial187.stdout:889: writing trial18717860-45 from 3259733 to 3411854 tid 3 2026-02-13T18:09:06.738 INFO:tasks.rados.rados.0.trial187.stdout:890: snap_create 2026-02-13T18:09:06.738 INFO:tasks.rados.rados.0.trial187.stdout:889: finishing write tid 1 to trial18717860-45 2026-02-13T18:09:06.738 INFO:tasks.rados.rados.0.trial187.stdout:889: finishing write tid 2 to trial18717860-45 2026-02-13T18:09:06.739 INFO:tasks.rados.rados.0.trial187.stdout:889: finishing write tid 3 to trial18717860-45 2026-02-13T18:09:06.739 INFO:tasks.rados.rados.0.trial187.stdout:889: finishing write tid 4 to trial18717860-45 2026-02-13T18:09:06.739 INFO:tasks.rados.rados.0.trial187.stdout:889: finishing write tid 5 to trial18717860-45 2026-02-13T18:09:06.739 INFO:tasks.rados.rados.0.trial187.stdout:889: oid 45 updating version 0 to 276 2026-02-13T18:09:06.740 INFO:tasks.rados.rados.0.trial187.stdout:889: oid 45 updating version 276 to 277 2026-02-13T18:09:06.740 INFO:tasks.rados.rados.0.trial187.stdout:889: oid 45 version 277 is already newer than 274 2026-02-13T18:09:06.740 INFO:tasks.rados.rados.0.trial187.stdout:889: oid 45 version 277 is already newer than 275 2026-02-13T18:09:06.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 277 (ObjNum 322 snap 88 seq_num 322) dirty exists 2026-02-13T18:09:06.740 INFO:tasks.rados.rados.0.trial187.stdout:889: left oid 45 (ObjNum 322 snap 88 seq_num 322) 2026-02-13T18:09:07.719 INFO:tasks.rados.rados.0.trial187.stdout:889: done (1 left) 2026-02-13T18:09:07.719 INFO:tasks.rados.rados.0.trial187.stdout:890: done (0 left) 2026-02-13T18:09:07.719 INFO:tasks.rados.rados.0.trial187.stdout:891: snap_remove snap 88 2026-02-13T18:09:08.704 INFO:tasks.rados.rados.0.trial187.stdout:891: done (0 left) 2026-02-13T18:09:08.704 INFO:tasks.rados.rados.0.trial187.stdout:892: snap_create 2026-02-13T18:09:09.706 INFO:tasks.rados.rados.0.trial187.stdout:892: done (0 left) 2026-02-13T18:09:09.706 INFO:tasks.rados.rados.0.trial187.stdout:893: read oid 9 snap 87 2026-02-13T18:09:09.706 INFO:tasks.rados.rados.0.trial187.stdout:893: expect deleted 2026-02-13T18:09:09.706 INFO:tasks.rados.rados.0.trial187.stdout:894: snap_remove snap 85 2026-02-13T18:09:10.706 INFO:tasks.rados.rados.0.trial187.stdout:894: done (1 left) 2026-02-13T18:09:10.707 INFO:tasks.rados.rados.0.trial187.stdout:895: write (excl) oid 38 current snap is 90 2026-02-13T18:09:10.707 INFO:tasks.rados.rados.0.trial187.stdout:895: seq_num 323 ranges {628661=792253,2184625=421778,3403509=25152} 2026-02-13T18:09:10.716 INFO:tasks.rados.rados.0.trial187.stdout:895: writing trial18717860-38 from 628661 to 1420914 tid 1 2026-02-13T18:09:10.724 INFO:tasks.rados.rados.0.trial187.stdout:895: writing trial18717860-38 from 2184625 to 2606403 tid 2 2026-02-13T18:09:10.730 INFO:tasks.rados.rados.0.trial187.stdout:895: writing trial18717860-38 from 3403509 to 3428661 tid 3 2026-02-13T18:09:10.730 INFO:tasks.rados.rados.0.trial187.stdout:896: delete oid 29 current snap is 90 2026-02-13T18:09:10.730 INFO:tasks.rados.rados.0.trial187.stdout:895: finishing write tid 1 to trial18717860-38 2026-02-13T18:09:10.730 INFO:tasks.rados.rados.0.trial187.stdout:895: finishing write tid 2 to trial18717860-38 2026-02-13T18:09:10.732 INFO:tasks.rados.rados.0.trial187.stdout:895: finishing write tid 3 to trial18717860-38 2026-02-13T18:09:10.732 INFO:tasks.rados.rados.0.trial187.stdout:895: finishing write tid 4 to trial18717860-38 2026-02-13T18:09:10.732 INFO:tasks.rados.rados.0.trial187.stdout:895: finishing write tid 5 to trial18717860-38 2026-02-13T18:09:10.732 INFO:tasks.rados.rados.0.trial187.stdout:895: oid 38 updating version 0 to 173 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:895: oid 38 updating version 173 to 174 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:895: oid 38 version 174 is already newer than 172 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:895: oid 38 updating version 174 to 175 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 175 (ObjNum 323 snap 90 seq_num 323) dirty exists 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:895: left oid 38 (ObjNum 323 snap 90 seq_num 323) 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:893: done (2 left) 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:895: done (1 left) 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:896: done (0 left) 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:897: read oid 43 snap 87 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:897: expect (ObjNum 292 snap 85 seq_num 292) 2026-02-13T18:09:10.733 INFO:tasks.rados.rados.0.trial187.stdout:898: snap_remove snap 89 2026-02-13T18:09:11.118 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:09:11.118 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:09:11.118 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T18:09:11.119 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T18:09:11.120 INFO:tasks.ceph.mon.a:Started 2026-02-13T18:09:11.121 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:09:11.121 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:09:11.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.174+0000 7fc4e2153640 10 monclient: get_monmap_and_config 2026-02-13T18:09:11.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.174+0000 7fc4e2153640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.174+0000 7fc4e2153640 10 monclient: monmap: 2026-02-13T18:09:11.183 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.183 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:11.181165+0000 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:11.181165+0000 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:11.184 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 Processor -- start 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- start start 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient: init 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient(hunting): picked mon.noname-c con 0x7fc4dc13f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient(hunting): picked mon.noname-b con 0x7fc4dc095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient(hunting): picked mon.noname-a con 0x7fc4dc1851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc140290 con 0x7fc4dc1851c0 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc094750 con 0x7fc4dc13f7b0 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc093c80 con 0x7fc4dc095410 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient(hunting): authenticate will time out at 782.236684s 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e1952640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc4dc1851c0 0x7fc4dc1a55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39622/0 (socket says 10.20.193.78:39622) 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e0950640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fc4dc095410 0x7fc4dc183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59230/0 (socket says 10.20.193.78:59230) 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e1952640 1 -- 10.20.193.78:0/1751867303 learned_addr learned my addr 10.20.193.78:0/1751867303 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e1952640 1 -- 10.20.193.78:0/1751867303 >> v1:10.20.193.78:6789/0 conn(0x7fc4dc1851c0 legacy=0x7fc4dc1a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e0950640 1 -- 10.20.193.78:0/1751867303 >> v1:10.20.193.78:6790/0 conn(0x7fc4dc095410 legacy=0x7fc4dc183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e1151640 1 -- 10.20.193.78:0/1751867303 >> v1:10.20.193.187:6789/0 conn(0x7fc4dc13f7b0 legacy=0x7fc4dc13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038185195 0 0) 0x7fc4dc093c80 con 0x7fc4dc095410 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): my global_id is 4580 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c4003620 con 0x7fc4dc095410 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830738744 0 0) 0x7fc4dc094750 con 0x7fc4dc13f7b0 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient(hunting): my global_id is 4600 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4dc093c80 con 0x7fc4dc13f7b0 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510071384 0 0) 0x7fc4c4003620 con 0x7fc4dc095410 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 >> v1:10.20.193.187:6789/0 conn(0x7fc4dc13f7b0 legacy=0x7fc4dc13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 >> v1:10.20.193.78:6789/0 conn(0x7fc4dc1851c0 legacy=0x7fc4dc1a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 monclient: found mon.noname-b 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc094190 con 0x7fc4dc095410 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc4d0003110 con 0x7fc4dc095410 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: dump: 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.194 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 5 monclient: authenticate success, global_id 4580 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4d00033e0 con 0x7fc4dc095410 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 1 -- 10.20.193.78:0/1751867303 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc4d0004a90 con 0x7fc4dc095410 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4cbfff640 10 monclient: dump: 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.195 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 4 set_mon_vals no callback set 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 10 monclient: shutdown 2026-02-13T18:09:11.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- 10.20.193.78:0/1751867303 >> v1:10.20.193.78:6790/0 conn(0x7fc4dc095410 legacy=0x7fc4dc183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- 10.20.193.78:0/1751867303 shutdown_connections 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- 10.20.193.78:0/1751867303 >> 10.20.193.78:0/1751867303 conn(0x7fc4dc054400 msgr2=0x7fc4dc054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- 10.20.193.78:0/1751867303 shutdown_connections 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.178+0000 7fc4e2153640 1 -- 10.20.193.78:0/1751867303 wait complete. 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient: monmap: 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:11.197 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 1 Processor -- start 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 1 -- start start 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient: init 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient(hunting): picked mon.noname-c con 0x7fc4dc095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient(hunting): picked mon.noname-b con 0x7fc4dc13f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient(hunting): picked mon.noname-a con 0x7fc4dc1851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc111c70 con 0x7fc4dc1851c0 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc110e00 con 0x7fc4dc13f7b0 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc10f910 con 0x7fc4dc095410 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e2153640 10 monclient(hunting): authenticate will time out at 782.240623s 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e1952640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc4dc1851c0 0x7fc4dc181bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39626/0 (socket says 10.20.193.78:39626) 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e1952640 1 -- 10.20.193.78:0/2990643652 learned_addr learned my addr 10.20.193.78:0/2990643652 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e1952640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.78:6789/0 conn(0x7fc4dc1851c0 legacy=0x7fc4dc181bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e1151640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.78:6790/0 conn(0x7fc4dc095410 legacy=0x7fc4dc13e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.182+0000 7fc4e0950640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.187:6789/0 conn(0x7fc4dc13f7b0 legacy=0x7fc4dc180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156238290 0 0) 0x7fc4dc10f910 con 0x7fc4dc095410 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): my global_id is 4583 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4ac003620 con 0x7fc4dc095410 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 210428470 0 0) 0x7fc4ac003620 con 0x7fc4dc095410 2026-02-13T18:09:11.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4dc10f910 con 0x7fc4dc095410 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc4cc0033f0 con 0x7fc4dc095410 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): dump: 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.217 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2799875231 0 0) 0x7fc4dc10f910 con 0x7fc4dc095410 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.187:6789/0 conn(0x7fc4dc13f7b0 legacy=0x7fc4dc180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.78:6789/0 conn(0x7fc4dc1851c0 legacy=0x7fc4dc181bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 monclient: found mon.c 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc1113d0 con 0x7fc4dc095410 2026-02-13T18:09:11.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 5 monclient: authenticate success, global_id 4583 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 monclient: _renew_subs 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc10f230 con 0x7fc4dc095410 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 monclient: _renew_subs 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc4dc1106f0 con 0x7fc4dc095410 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4cc0039c0 con 0x7fc4dc095410 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc4cc003d60 con 0x7fc4dc095410 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4c9ffb640 10 monclient: dump: 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.220 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4cb7fe640 4 set_mon_vals no callback set 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.206+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc0008e0 con 0x7fc4dc095410 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.210+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fc4cc004000 con 0x7fc4dc095410 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.210+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(203..203 src has 1..203) ==== 3991+0+0 (unknown 3392097856 0 0) 0x7fc4cc04c7b0 con 0x7fc4dc095410 2026-02-13T18:09:11.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.210+0000 7fc4e0950640 10 monclient: get_auth_request con 0x7fc4ac03d450 auth_method 0 2026-02-13T18:09:11.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.210+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fc4cc017710 con 0x7fc4dc095410 2026-02-13T18:09:11.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.210+0000 7fc4c9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.210+0000 7fc4c9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:11.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.330+0000 7fc4e2153640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.330+0000 7fc4e2153640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.330+0000 7fc4e2153640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.330+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc4dc092cd0 con 0x7fc4dc095410 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4c9ffb640 1 -- 10.20.193.78:0/2990643652 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3600258640) 0x7fc4cc016ff0 con 0x7fc4dc095410 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4c9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4c9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:11.340 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:09:11.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc4ac03d450 legacy=0x7fc4ac05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 10 monclient: shutdown 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 >> v1:10.20.193.78:6790/0 conn(0x7fc4dc095410 legacy=0x7fc4dc13e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 shutdown_connections 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 >> 10.20.193.78:0/2990643652 conn(0x7fc4dc054400 msgr2=0x7fc4dc1a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 shutdown_connections 2026-02-13T18:09:11.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.334+0000 7fc4e2153640 1 -- 10.20.193.78:0/2990643652 wait complete. 2026-02-13T18:09:11.350 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:09:11.350 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:09:11.351 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:09:11.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: get_monmap_and_config 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: monmap: 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:11.417645+0000 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:11.417645+0000 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.421 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 1 Processor -- start 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 1 -- start start 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: init 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient(hunting): picked mon.noname-a con 0x7f20d808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient(hunting): picked mon.noname-c con 0x7f20d808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient(hunting): picked mon.noname-b con 0x7f20d808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d8089e80 con 0x7f20d808c2f0 2026-02-13T18:09:11.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d8088c20 con 0x7f20d808dc80 2026-02-13T18:09:11.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d8089ba0 con 0x7f20d808cdd0 2026-02-13T18:09:11.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient(hunting): authenticate will time out at 782.472766s 2026-02-13T18:09:11.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f20d808c2f0 0x7f20d808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39628/0 (socket says 10.20.193.78:39628) 2026-02-13T18:09:11.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d77fe640 1 -- 10.20.193.78:0/1835240397 learned_addr learned my addr 10.20.193.78:0/1835240397 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d77fe640 1 -- 10.20.193.78:0/1835240397 >> v1:10.20.193.78:6789/0 conn(0x7f20d808c2f0 legacy=0x7f20d808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d7fff640 1 -- 10.20.193.78:0/1835240397 >> v1:10.20.193.78:6790/0 conn(0x7f20d808cdd0 legacy=0x7f20d81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d6ffd640 1 -- 10.20.193.78:0/1835240397 >> v1:10.20.193.187:6789/0 conn(0x7f20d808dc80 legacy=0x7f20d8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381325840 0 0) 0x7f20d8089ba0 con 0x7f20d808cdd0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient(hunting): my global_id is 4586 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20bc003620 con 0x7f20d808cdd0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011079887 0 0) 0x7f20bc003620 con 0x7f20d808cdd0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 >> v1:10.20.193.187:6789/0 conn(0x7f20d808dc80 legacy=0x7f20d8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 >> v1:10.20.193.78:6789/0 conn(0x7f20d808c2f0 legacy=0x7f20d808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 monclient: found mon.noname-b 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d808d370 con 0x7f20d808cdd0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20cc004670 con 0x7f20d808cdd0 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 5 monclient: authenticate success, global_id 4586 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: dump: 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20cc004940 con 0x7f20d808cdd0 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 1 -- 10.20.193.78:0/1835240397 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20cc004dd0 con 0x7f20d808cdd0 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20d67fc640 10 monclient: dump: 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.414+0000 7f20de0f4640 4 set_mon_vals no callback set 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient: shutdown 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- 10.20.193.78:0/1835240397 >> v1:10.20.193.78:6790/0 conn(0x7f20d808cdd0 legacy=0x7f20d81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- 10.20.193.78:0/1835240397 shutdown_connections 2026-02-13T18:09:11.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- 10.20.193.78:0/1835240397 >> 10.20.193.78:0/1835240397 conn(0x7f20d8091720 msgr2=0x7f20d8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- 10.20.193.78:0/1835240397 shutdown_connections 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- 10.20.193.78:0/1835240397 wait complete. 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient: monmap: 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 Processor -- start 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- start start 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient: init 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient(hunting): picked mon.noname-c con 0x7f20d808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient(hunting): picked mon.noname-a con 0x7f20d808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient(hunting): picked mon.noname-b con 0x7f20d808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d8085ed0 con 0x7f20d808cdd0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d8085af0 con 0x7f20d808dc80 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d8082480 con 0x7f20d808c2f0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20de0f4640 10 monclient(hunting): authenticate will time out at 782.477520s 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20d77fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f20d808c2f0 0x7f20d807e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59254/0 (socket says 10.20.193.78:59254) 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20d77fe640 1 -- 10.20.193.78:0/4180922512 learned_addr learned my addr 10.20.193.78:0/4180922512 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20d77fe640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6790/0 conn(0x7f20d808c2f0 legacy=0x7f20d807e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20d6ffd640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d808cdd0 legacy=0x7f20d807f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938680941 0 0) 0x7f20d8088c20 con 0x7f20d808cdd0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): my global_id is 64098 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20a8003620 con 0x7f20d808cdd0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20d7fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.187:6789/0 conn(0x7f20d808dc80 legacy=0x7f20d8195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021526419 0 0) 0x7f20d8082480 con 0x7f20d808c2f0 2026-02-13T18:09:11.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 10 monclient(hunting): my global_id is 4589 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.418+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d8088c20 con 0x7f20d808c2f0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1941614695 0 0) 0x7f20a8003620 con 0x7f20d808cdd0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20d8082480 con 0x7f20d808cdd0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20c8003380 con 0x7f20d808cdd0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): dump: 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139199071 0 0) 0x7f20d808d370 con 0x7f20d808dc80 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): my global_id is 4603 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20a8003620 con 0x7f20d808dc80 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3557574965 0 0) 0x7f20d8088c20 con 0x7f20d808c2f0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20d808d370 con 0x7f20d808c2f0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20c4003330 con 0x7f20d808c2f0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): dump: 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.431 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2225737959 0 0) 0x7f20d8082480 con 0x7f20d808cdd0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6790/0 conn(0x7f20d808c2f0 legacy=0x7f20d807e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.187:6789/0 conn(0x7f20d808dc80 legacy=0x7f20d8195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 monclient: found mon.a 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d8082760 con 0x7f20d808cdd0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 5 monclient: authenticate success, global_id 64098 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 10 monclient: _renew_subs 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f20d807f760 con 0x7f20d808cdd0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 10 monclient: _renew_subs 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f20d8083330 con 0x7f20d808cdd0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20c80039c0 con 0x7f20d808cdd0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20c8003d20 con 0x7f20d808cdd0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: dump: 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20d5ffb640 4 set_mon_vals no callback set 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f20d808f5e0 con 0x7f20d8083e50 2026-02-13T18:09:11.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f20c8003fc0 con 0x7f20d808cdd0 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(203..203 src has 1..203) ==== 3991+0+0 (unknown 3392097856 0 0) 0x7f20c804c6e0 con 0x7f20d808cdd0 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20d7fff640 10 monclient: get_auth_request con 0x7f20a803d8c0 auth_method 0 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20d77fe640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d8083e50 legacy=0x7f20d807a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945728012 0 0) 0x7f20d808f5e0 con 0x7f20d8083e50 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient(hunting): my global_id is 64101 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d8082480 con 0x7f20d8083e50 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3294736388 0 0) 0x7f20d8082480 con 0x7f20d8083e50 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20d808f5e0 con 0x7f20d8083e50 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20c4004cc0 con 0x7f20d8083e50 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:11.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 10 monclient: dump: 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3911956266 0 0) 0x7f20d808f5e0 con 0x7f20d8083e50 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.422+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20d805d410 con 0x7f20d8083e50 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f20c40059d0 con 0x7f20d8083e50 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20b3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d8083e50 legacy=0x7f20d807a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d8083e50 legacy=0x7f20d807a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20de0f4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:11.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.426+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f20d8084220 con 0x7f20d807aae0 2026-02-13T18:09:11.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20d77fe640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d807aae0 legacy=0x7f20d8198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962299749 0 0) 0x7f20d8084220 con 0x7f20d807aae0 2026-02-13T18:09:11.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient(hunting): my global_id is 64104 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d808f5e0 con 0x7f20d807aae0 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 286206475 0 0) 0x7f20d808f5e0 con 0x7f20d807aae0 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20d8084220 con 0x7f20d807aae0 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f20c40052d0 con 0x7f20d807aae0 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient: dump: 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.437 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3685031107 0 0) 0x7f20d8084220 con 0x7f20d807aae0 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20d8090810 con 0x7f20d807aae0 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4338 (unknown 0 0 440738820) 0x7f20c40055f0 con 0x7f20d807aae0 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d807aae0 legacy=0x7f20d8198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20b3fff640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d807aae0 legacy=0x7f20d8198550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 14, 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 276, 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.438 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:11.439 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.440 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:11.441 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:11.442 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.187:6812/2668687789 conn(0x7f20a803d8c0 legacy=0x7f20a805dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 10 monclient: shutdown 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 >> v1:10.20.193.78:6789/0 conn(0x7f20d808cdd0 legacy=0x7f20d807f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20d7fff640 1 -- 10.20.193.78:0/4180922512 reap_dead start 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20d7fff640 1 -- 10.20.193.78:0/4180922512 reap_dead start 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 shutdown_connections 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 >> 10.20.193.78:0/4180922512 conn(0x7f20d8091720 msgr2=0x7f20d805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 shutdown_connections 2026-02-13T18:09:11.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.430+0000 7f20de0f4640 1 -- 10.20.193.78:0/4180922512 wait complete. 2026-02-13T18:09:11.445 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:09:11.445 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:09:11.446 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient: get_monmap_and_config 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient: monmap: 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:11.504273+0000 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:11.504273+0000 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:11.506 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 1 Processor -- start 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 1 -- start start 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient: init 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient(hunting): picked mon.noname-b con 0x7fe228084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient(hunting): picked mon.noname-a con 0x7fe22808d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient(hunting): picked mon.noname-c con 0x7fe2281831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22808da30 con 0x7fe22808d5f0 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe228089e60 con 0x7fe2281831f0 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe228085410 con 0x7fe228084930 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe22d794640 10 monclient(hunting): authenticate will time out at 782.559671s 2026-02-13T18:09:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe226ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 0x7fe228084d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59262/0 (socket says 10.20.193.78:59262) 2026-02-13T18:09:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.498+0000 7fe226ffd640 1 -- 10.20.193.78:0/2829363829 learned_addr learned my addr 10.20.193.78:0/2829363829 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe226ffd640 1 -- 10.20.193.78:0/2829363829 >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 legacy=0x7fe228084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe2267fc640 1 -- 10.20.193.78:0/2829363829 >> v1:10.20.193.78:6789/0 conn(0x7fe22808d5f0 legacy=0x7fe228181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161433914 0 0) 0x7fe228085410 con 0x7fe228084930 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): my global_id is 4592 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe214003620 con 0x7fe228084930 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe2277fe640 1 -- 10.20.193.78:0/2829363829 >> v1:10.20.193.187:6789/0 conn(0x7fe2281831f0 legacy=0x7fe2281a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455371553 0 0) 0x7fe210002cb0 con 0x7fe22808d5f0 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient(hunting): my global_id is 64107 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe228085410 con 0x7fe22808d5f0 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4285858163 0 0) 0x7fe228085410 con 0x7fe22808d5f0 2026-02-13T18:09:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 legacy=0x7fe228084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 >> v1:10.20.193.187:6789/0 conn(0x7fe2281831f0 legacy=0x7fe2281a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 monclient: found mon.noname-a 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe228089b80 con 0x7fe22808d5f0 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 5 monclient: authenticate success, global_id 64107 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe210003330 con 0x7fe22808d5f0 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: dump: 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.512 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe210003710 con 0x7fe22808d5f0 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 1 -- 10.20.193.78:0/2829363829 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe210003aa0 con 0x7fe22808d5f0 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe225ffb640 10 monclient: dump: 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.513 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 4 set_mon_vals no callback set 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 10 monclient: shutdown 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 -- 10.20.193.78:0/2829363829 >> v1:10.20.193.78:6789/0 conn(0x7fe22808d5f0 legacy=0x7fe228181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 -- 10.20.193.78:0/2829363829 shutdown_connections 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 -- 10.20.193.78:0/2829363829 >> 10.20.193.78:0/2829363829 conn(0x7fe228091720 msgr2=0x7fe228091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 -- 10.20.193.78:0/2829363829 shutdown_connections 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 -- 10.20.193.78:0/2829363829 wait complete. 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 10 monclient: monmap: 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.514 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 Processor -- start 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 1 -- start start 2026-02-13T18:09:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.502+0000 7fe22d794640 10 monclient: init 2026-02-13T18:09:11.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:11.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient(hunting): picked mon.noname-c con 0x7fe228084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient(hunting): picked mon.noname-a con 0x7fe22808d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient(hunting): picked mon.noname-b con 0x7fe2281831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22807ea50 con 0x7fe22808d5f0 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22807ed30 con 0x7fe2281831f0 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22807e140 con 0x7fe228084930 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient(hunting): authenticate will time out at 782.564112s 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe226ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 0x7fe228131bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59270/0 (socket says 10.20.193.78:59270) 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe226ffd640 1 -- 10.20.193.78:0/3331292678 learned_addr learned my addr 10.20.193.78:0/3331292678 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe226ffd640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 legacy=0x7fe228131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2267fc640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6789/0 conn(0x7fe22808d5f0 legacy=0x7fe228172bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe226ffd640 1 --1- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 0x7fe228131bf0 :-1 s=OPENED pgs=256 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fe22807e140 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2277fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.187:6789/0 conn(0x7fe2281831f0 legacy=0x7fe2281742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462659593 0 0) 0x7fe22807ea50 con 0x7fe22808d5f0 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): my global_id is 64110 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f4003620 con 0x7fe22808d5f0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901859947 0 0) 0x7fe22807ed30 con 0x7fe2281831f0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): my global_id is 4609 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe22807ea50 con 0x7fe2281831f0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 559173500 0 0) 0x7fe1f4003620 con 0x7fe22808d5f0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe22807ed30 con 0x7fe22808d5f0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe210002d10 con 0x7fe22808d5f0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): dump: 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.520 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4227603308 0 0) 0x7fe22807ed30 con 0x7fe22808d5f0 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe228084930 legacy=0x7fe228131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.187:6789/0 conn(0x7fe2281831f0 legacy=0x7fe2281742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 monclient: found mon.a 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22807d530 con 0x7fe22808d5f0 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76867174 0 0) 0x7fe22807e140 con 0x7fe228084930 2026-02-13T18:09:11.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 5 monclient: authenticate success, global_id 64110 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient: _renew_subs 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe228082230 con 0x7fe22808d5f0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient: _renew_subs 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe22807bf20 con 0x7fe22808d5f0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe210003710 con 0x7fe22808d5f0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe210003f80 con 0x7fe22808d5f0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 10 monclient: dump: 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.522 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2257fa640 4 set_mon_vals no callback set 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe2280389c0 con 0x7fe228132300 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe210004250 con 0x7fe22808d5f0 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.506+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(203..203 src has 1..203) ==== 3991+0+0 (unknown 3392097856 0 0) 0x7fe21004c6e0 con 0x7fe22808d5f0 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2277fe640 10 monclient: get_auth_request con 0x7fe1f403d4b0 auth_method 0 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe226ffd640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe228132300 legacy=0x7fe22805b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984364009 0 0) 0x7fe2280389c0 con 0x7fe228132300 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient(hunting): my global_id is 4598 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe22807e140 con 0x7fe228132300 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1383496432 0 0) 0x7fe22807e140 con 0x7fe228132300 2026-02-13T18:09:11.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2280389c0 con 0x7fe228132300 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe21c002f40 con 0x7fe228132300 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient: dump: 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 548436150 0 0) 0x7fe2280389c0 con 0x7fe228132300 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe22808f600 con 0x7fe228132300 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe21c0048e0 con 0x7fe228132300 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:11.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe228132300 legacy=0x7fe22805b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.510+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe228132300 legacy=0x7fe22805b3a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:11.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.514+0000 7fe22d794640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.514+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe228090810 con 0x7fe22807c210 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe226ffd640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe22807c210 legacy=0x7fe22805bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213900345 0 0) 0x7fe228090810 con 0x7fe22807c210 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient(hunting): my global_id is 4601 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2280389c0 con 0x7fe22807c210 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1817106242 0 0) 0x7fe2280389c0 con 0x7fe22807c210 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe228090810 con 0x7fe22807c210 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe21c004f40 con 0x7fe22807c210 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient: dump: 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.526 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2942306157 0 0) 0x7fe228090810 con 0x7fe22807c210 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe2280510e0 con 0x7fe22807c210 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 369682856) 0x7fe21c0091b0 con 0x7fe22807c210 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe22807c210 legacy=0x7fe22805bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2077fe640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6790/0 conn(0x7fe22807c210 legacy=0x7fe22805bab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:09:11.527 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 14, 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 232909, 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.528 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.529 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.530 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.531 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.532 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.533 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:11.534 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:11.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe1f403d4b0 legacy=0x7fe1f405d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 10 monclient: shutdown 2026-02-13T18:09:11.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 >> v1:10.20.193.78:6789/0 conn(0x7fe22808d5f0 legacy=0x7fe228172bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2277fe640 1 -- 10.20.193.78:0/3331292678 reap_dead start 2026-02-13T18:09:11.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe2277fe640 1 -- 10.20.193.78:0/3331292678 reap_dead start 2026-02-13T18:09:11.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 shutdown_connections 2026-02-13T18:09:11.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 >> 10.20.193.78:0/3331292678 conn(0x7fe228091720 msgr2=0x7fe228085790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 shutdown_connections 2026-02-13T18:09:11.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.518+0000 7fe22d794640 1 -- 10.20.193.78:0/3331292678 wait complete. 2026-02-13T18:09:11.536 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:09:11.536 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:09:11.536 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient: get_monmap_and_config 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient: monmap: 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:11.603832+0000 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:11.603832+0000 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.605 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 1 Processor -- start 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 1 -- start start 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient: init 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e808d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e808d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e8085ad0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e8085ee0 con 0x7fb5e808d190 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e808e000 con 0x7fb5e808cdc0 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5ed664640 10 monclient(hunting): authenticate will time out at 782.658976s 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5e77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb5e808d5d0 0x7fb5e81a53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39676/0 (socket says 10.20.193.78:39676) 2026-02-13T18:09:11.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.598+0000 7fb5e77fe640 1 -- 10.20.193.78:0/393230839 learned_addr learned my addr 10.20.193.78:0/393230839 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e77fe640 1 -- 10.20.193.78:0/393230839 >> v1:10.20.193.78:6789/0 conn(0x7fb5e808d5d0 legacy=0x7fb5e81a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e6ffd640 1 -- 10.20.193.78:0/393230839 >> v1:10.20.193.78:6790/0 conn(0x7fb5e808cdc0 legacy=0x7fb5e808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e67fc640 1 -- 10.20.193.78:0/393230839 >> v1:10.20.193.187:6789/0 conn(0x7fb5e808d190 legacy=0x7fb5e8183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181620595 0 0) 0x7fb5e8085ad0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): my global_id is 64113 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d4003620 con 0x7fb5e808d5d0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173765848 0 0) 0x7fb5e808e000 con 0x7fb5e808cdc0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient(hunting): my global_id is 4604 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e8085ad0 con 0x7fb5e808cdc0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2011018186 0 0) 0x7fb5d4003620 con 0x7fb5e808d5d0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 >> v1:10.20.193.78:6790/0 conn(0x7fb5e808cdc0 legacy=0x7fb5e808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 >> v1:10.20.193.187:6789/0 conn(0x7fb5e808d190 legacy=0x7fb5e8183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 monclient: found mon.noname-a 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e8086f80 con 0x7fb5e808d5d0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 5 monclient: authenticate success, global_id 64113 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5d8004620 con 0x7fb5e808d5d0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: dump: 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.609 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5d80048f0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 1 -- 10.20.193.78:0/393230839 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5d8006060 con 0x7fb5e808d5d0 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e5ffb640 10 monclient: dump: 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:11.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 4 set_mon_vals no callback set 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: shutdown 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- 10.20.193.78:0/393230839 >> v1:10.20.193.78:6789/0 conn(0x7fb5e808d5d0 legacy=0x7fb5e81a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- 10.20.193.78:0/393230839 shutdown_connections 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- 10.20.193.78:0/393230839 >> 10.20.193.78:0/393230839 conn(0x7fb5e8091720 msgr2=0x7fb5e8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- 10.20.193.78:0/393230839 shutdown_connections 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- 10.20.193.78:0/393230839 wait complete. 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: monmap: 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 Processor -- start 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- start start 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: init 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e808cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e808d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e808d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e80832b0 con 0x7fb5e808cdc0 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e8081f70 con 0x7fb5e808d190 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e8080f50 con 0x7fb5e808d5d0 2026-02-13T18:09:11.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5ed664640 10 monclient(hunting): authenticate will time out at 782.663557s 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e6ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb5e808cdc0 0x7fb5e80847e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39688/0 (socket says 10.20.193.78:39688) 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.602+0000 7fb5e6ffd640 1 -- 10.20.193.78:0/571201240 learned_addr learned my addr 10.20.193.78:0/571201240 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5e6ffd640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.78:6789/0 conn(0x7fb5e808cdc0 legacy=0x7fb5e80847e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5e77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.78:6790/0 conn(0x7fb5e808d5d0 legacy=0x7fb5e81956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5e6ffd640 1 --1- 10.20.193.78:0/571201240 >> v1:10.20.193.78:6789/0 conn(0x7fb5e808cdc0 0x7fb5e80847e0 :-1 s=OPENED pgs=133 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fb5e80832b0 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:09:11.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201755679 0 0) 0x7fb5e8080f50 con 0x7fb5e808d5d0 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): my global_id is 4607 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b4003620 con 0x7fb5e808d5d0 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3615729782 0 0) 0x7fb5b4003620 con 0x7fb5e808d5d0 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5e8080f50 con 0x7fb5e808d5d0 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5d8005df0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): dump: 2026-02-13T18:09:11.613 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5e67fc640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e808d190 legacy=0x7fb5e8193fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2744586894 0 0) 0x7fb5e8080f50 con 0x7fb5e808d5d0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e808d190 legacy=0x7fb5e8193fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.78:6789/0 conn(0x7fb5e808cdc0 legacy=0x7fb5e80847e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 monclient: found mon.c 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e8082fd0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609156649 0 0) 0x7fb5e80832b0 con 0x7fb5e808cdc0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 5 monclient: authenticate success, global_id 4607 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 10 monclient: _renew_subs 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e8081ab0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 10 monclient: _renew_subs 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5e80850c0 con 0x7fb5e808d5d0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5d8006050 con 0x7fb5e808d5d0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5d8004a70 con 0x7fb5e808d5d0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 10 monclient: dump: 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.614 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5e57fa640 4 set_mon_vals no callback set 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5e808f620 con 0x7fb5e8152c50 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb5d8012b30 con 0x7fb5e808d5d0 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(203..203 src has 1..203) ==== 3991+0+0 (unknown 3392097856 0 0) 0x7fb5d804da20 con 0x7fb5e808d5d0 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.606+0000 7fb5e67fc640 10 monclient: get_auth_request con 0x7fb5b403d510 auth_method 0 2026-02-13T18:09:11.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5e6ffd640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e8152c50 legacy=0x7fb5e807b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177175203 0 0) 0x7fb5dc003450 con 0x7fb5e8152c50 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient(hunting): my global_id is 4615 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e80832b0 con 0x7fb5e8152c50 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 426016460 0 0) 0x7fb5e80832b0 con 0x7fb5e8152c50 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5dc003450 con 0x7fb5e8152c50 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5dc003710 con 0x7fb5e8152c50 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient: dump: 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.616 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2441665431 0 0) 0x7fb5dc003450 con 0x7fb5e8152c50 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5e8082ba0 con 0x7fb5e8152c50 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb5dc0058c0 con 0x7fb5e8152c50 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e8152c50 legacy=0x7fb5e807b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.610+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e8152c50 legacy=0x7fb5e807b550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:11.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.614+0000 7fb5ed664640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:11.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.614+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5e8090810 con 0x7fb5e804d200 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5e6ffd640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e804d200 legacy=0x7fb5e8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523616146 0 0) 0x7fb5e8090810 con 0x7fb5e804d200 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient(hunting): my global_id is 4618 2026-02-13T18:09:11.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5dc003450 con 0x7fb5e804d200 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1394103923 0 0) 0x7fb5dc003450 con 0x7fb5e804d200 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5e8090810 con 0x7fb5e804d200 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5dc003d80 con 0x7fb5e804d200 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient: dump: 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.624 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1107196601 0 0) 0x7fb5e8090810 con 0x7fb5e804d200 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5e80510e0 con 0x7fb5e804d200 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 2082599706) 0x7fb5dc005af0 con 0x7fb5e804d200 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e804d200 legacy=0x7fb5e8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5c77fe640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6789/0 conn(0x7fb5e804d200 legacy=0x7fb5e8197e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:11.625 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 14, 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 232984, 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.626 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.627 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:11.628 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:11.629 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.630 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:11.631 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:11.632 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:11.633 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:11.633 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:11.633 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:11.633 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:11.633 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:11.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb5b403d510 legacy=0x7fb5b405d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 10 monclient: shutdown 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 >> v1:10.20.193.78:6790/0 conn(0x7fb5e808d5d0 legacy=0x7fb5e81956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5e77fe640 1 -- 10.20.193.78:0/571201240 reap_dead start 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5e77fe640 1 -- 10.20.193.78:0/571201240 reap_dead start 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 shutdown_connections 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 >> 10.20.193.78:0/571201240 conn(0x7fb5e8091720 msgr2=0x7fb5e805ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 shutdown_connections 2026-02-13T18:09:11.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.618+0000 7fb5ed664640 1 -- 10.20.193.78:0/571201240 wait complete. 2026-02-13T18:09:11.634 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:09:11.634 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:09:11.634 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:09:11.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.686+0000 7f351f5d4640 10 monclient: get_monmap_and_config 2026-02-13T18:09:11.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.686+0000 7f351f5d4640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.686+0000 7f351f5d4640 10 monclient: monmap: 2026-02-13T18:09:11.694 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.694 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.694 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:11.692996+0000 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:11.692996+0000 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:11.695 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.686+0000 7f351f5d4640 1 Processor -- start 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.686+0000 7f351f5d4640 1 -- start start 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.686+0000 7f351f5d4640 10 monclient: init 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f351808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f351808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f351808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3518089e80 con 0x7f351808cdd0 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3518088c20 con 0x7f351808dc80 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3518089ba0 con 0x7f351808c2f0 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient(hunting): authenticate will time out at 782.748112s 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351d349640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f351808c2f0 0x7f351808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59314/0 (socket says 10.20.193.78:59314) 2026-02-13T18:09:11.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351d349640 1 -- 10.20.193.78:0/2518918755 learned_addr learned my addr 10.20.193.78:0/2518918755 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351d349640 1 -- 10.20.193.78:0/2518918755 >> v1:10.20.193.78:6790/0 conn(0x7f351808c2f0 legacy=0x7f351808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351db4a640 1 -- 10.20.193.78:0/2518918755 >> v1:10.20.193.78:6789/0 conn(0x7f351808cdd0 legacy=0x7f35181a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530553548 0 0) 0x7f3518089ba0 con 0x7f351808c2f0 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351cb48640 1 -- 10.20.193.78:0/2518918755 >> v1:10.20.193.187:6789/0 conn(0x7f351808dc80 legacy=0x7f3518181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): my global_id is 4610 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3500003620 con 0x7f351808c2f0 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710007393 0 0) 0x7f3518089e80 con 0x7f351808cdd0 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient(hunting): my global_id is 64119 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3518089ba0 con 0x7f351808cdd0 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1528479550 0 0) 0x7f3500003620 con 0x7f351808c2f0 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 >> v1:10.20.193.187:6789/0 conn(0x7f351808dc80 legacy=0x7f3518181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 >> v1:10.20.193.78:6789/0 conn(0x7f351808cdd0 legacy=0x7f35181a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 monclient: found mon.noname-b 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351808d370 con 0x7f351808c2f0 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3508003110 con 0x7f351808c2f0 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 5 monclient: authenticate success, global_id 4610 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: dump: 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.702 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35080033e0 con 0x7f351808c2f0 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 1 -- 10.20.193.78:0/2518918755 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3508004b50 con 0x7f351808c2f0 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f3507fff640 10 monclient: dump: 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.703 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 4 set_mon_vals no callback set 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: shutdown 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- 10.20.193.78:0/2518918755 >> v1:10.20.193.78:6790/0 conn(0x7f351808c2f0 legacy=0x7f351808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- 10.20.193.78:0/2518918755 shutdown_connections 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- 10.20.193.78:0/2518918755 >> 10.20.193.78:0/2518918755 conn(0x7f3518091720 msgr2=0x7f3518091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- 10.20.193.78:0/2518918755 shutdown_connections 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- 10.20.193.78:0/2518918755 wait complete. 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: build_initial_monmap 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: monmap: 2026-02-13T18:09:11.704 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 Processor -- start 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 1 -- start start 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.690+0000 7f351f5d4640 10 monclient: init 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f351808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f351808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f351808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351805de60 con 0x7f351808dc80 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3518088910 con 0x7f351808c2f0 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35181537b0 con 0x7f351808cdd0 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient(hunting): authenticate will time out at 782.752254s 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351cb48640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f351808cdd0 0x7f3518194460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59316/0 (socket says 10.20.193.78:59316) 2026-02-13T18:09:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351cb48640 1 -- 10.20.193.78:0/3028047267 learned_addr learned my addr 10.20.193.78:0/3028047267 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:11.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351cb48640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.78:6790/0 conn(0x7f351808cdd0 legacy=0x7f3518194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351db4a640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.78:6789/0 conn(0x7f351808dc80 legacy=0x7f3518195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646260768 0 0) 0x7f35181537b0 con 0x7f351808cdd0 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): my global_id is 4613 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e8003620 con 0x7f351808cdd0 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351db4a640 1 --1- 10.20.193.78:0/3028047267 >> v1:10.20.193.78:6789/0 conn(0x7f351808dc80 0x7f3518195b80 :-1 s=OPENED pgs=135 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f351805de60 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3659241256 0 0) 0x7f34e8003620 con 0x7f351808cdd0 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35181537b0 con 0x7f351808cdd0 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f350c003400 con 0x7f351808cdd0 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): dump: 2026-02-13T18:09:11.709 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351d349640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.187:6789/0 conn(0x7f351808c2f0 legacy=0x7f3518083980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1922460288 0 0) 0x7f35181537b0 con 0x7f351808cdd0 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.187:6789/0 conn(0x7f351808c2f0 legacy=0x7f3518083980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.78:6789/0 conn(0x7f351808dc80 legacy=0x7f3518195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:09:11.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 monclient: found mon.c 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35180800f0 con 0x7f351808cdd0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: _finish_auth 0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107522512 0 0) 0x7f351805de60 con 0x7f351808dc80 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 5 monclient: authenticate success, global_id 4613 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _renew_subs 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3518082450 con 0x7f351808cdd0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _renew_subs 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3518084090 con 0x7f351808cdd0 2026-02-13T18:09:11.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f350c0039c0 con 0x7f351808cdd0 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f350c003d20 con 0x7f351808cdd0 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 10 monclient: dump: 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:11.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f35077fe640 4 set_mon_vals no callback set 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f350c003ff0 con 0x7f351808cdd0 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3518081cc0 con 0x7f351808cdd0 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.694+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(203..203 src has 1..203) ==== 3991+0+0 (unknown 3392097856 0 0) 0x7f350c04c7b0 con 0x7f351808cdd0 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.698+0000 7f351d349640 10 monclient: get_auth_request con 0x7f34e803d320 auth_method 0 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.698+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f350c0176b0 con 0x7f351808cdd0 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.698+0000 7f3505ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.698+0000 7f3505ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:11.715 INFO:tasks.rados.rados.0.trial187.stdout:898: done (1 left) 2026-02-13T18:09:11.715 INFO:tasks.rados.rados.0.trial187.stdout:899: write oid 42 current snap is 90 2026-02-13T18:09:11.715 INFO:tasks.rados.rados.0.trial187.stdout:899: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2026-02-13T18:09:11.723 INFO:tasks.rados.rados.0.trial187.stdout:899: writing trial18717860-42 from 662275 to 1205026 tid 1 2026-02-13T18:09:11.730 INFO:tasks.rados.rados.0.trial187.stdout:899: writing trial18717860-42 from 1785236 to 2210683 tid 2 2026-02-13T18:09:11.739 INFO:tasks.rados.rados.0.trial187.stdout:899: writing trial18717860-42 from 2942002 to 3462275 tid 3 2026-02-13T18:09:11.739 INFO:tasks.rados.rados.0.trial187.stdout:900: copy_from oid 20 from oid 39 current snap is 90 2026-02-13T18:09:11.739 INFO:tasks.rados.rados.0.trial187.stdout:897: expect (ObjNum 292 snap 85 seq_num 292) 2026-02-13T18:09:11.739 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:11.789 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:11.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.814+0000 7f351f5d4640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:09:11.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.814+0000 7f351f5d4640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:09:11.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.814+0000 7f351f5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:11.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.814+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f351808f600 con 0x7f351808cdd0 2026-02-13T18:09:11.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f3505ffb640 1 -- 10.20.193.78:0/3028047267 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f350c01c9d0 con 0x7f351808cdd0 2026-02-13T18:09:11.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f3505ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:09:11.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f3505ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:11.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.187:6812/2668687789 conn(0x7f34e803d320 legacy=0x7f34e805d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 10 monclient: shutdown 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 >> v1:10.20.193.78:6790/0 conn(0x7f351808cdd0 legacy=0x7f3518194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 shutdown_connections 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 >> 10.20.193.78:0/3028047267 conn(0x7f3518091720 msgr2=0x7f351805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 shutdown_connections 2026-02-13T18:09:11.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:11.818+0000 7f351f5d4640 1 -- 10.20.193.78:0/3028047267 wait complete. 2026-02-13T18:09:11.835 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:09:11.849 INFO:tasks.rados.rados.0.trial187.stdout:899: finishing write tid 1 to trial18717860-42 2026-02-13T18:09:11.849 INFO:tasks.rados.rados.0.trial187.stdout:899: finishing write tid 2 to trial18717860-42 2026-02-13T18:09:11.849 INFO:tasks.rados.rados.0.trial187.stdout:899: finishing write tid 3 to trial18717860-42 2026-02-13T18:09:11.849 INFO:tasks.rados.rados.0.trial187.stdout:897: done (2 left) 2026-02-13T18:09:11.849 INFO:tasks.rados.rados.0.trial187.stdout:901: delete oid 45 current snap is 90 2026-02-13T18:09:11.849 INFO:tasks.rados.rados.0.trial187.stdout:900: finishing copy_from to trial18717860-20 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:900: got expected ENOENT (src dne) 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: finishing write tid 4 to trial18717860-42 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:900: finishing copy_from racing read to trial18717860-20 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: finishing write tid 5 to trial18717860-42 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: oid 42 updating version 0 to 256 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: oid 42 updating version 256 to 259 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: oid 42 version 259 is already newer than 257 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: oid 42 version 259 is already newer than 258 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 259 (ObjNum 325 snap 90 seq_num 325) dirty exists 2026-02-13T18:09:11.850 INFO:tasks.rados.rados.0.trial187.stdout:899: left oid 42 (ObjNum 325 snap 90 seq_num 325) 2026-02-13T18:09:11.851 INFO:tasks.rados.rados.0.trial187.stdout:899: done (2 left) 2026-02-13T18:09:11.851 INFO:tasks.rados.rados.0.trial187.stdout:900: done (1 left) 2026-02-13T18:09:11.851 INFO:tasks.rados.rados.0.trial187.stdout:901: done (0 left) 2026-02-13T18:09:11.851 INFO:tasks.rados.rados.0.trial187.stdout:902: delete oid 19 current snap is 90 2026-02-13T18:09:11.851 INFO:tasks.rados.rados.0.trial187.stdout:902: done (0 left) 2026-02-13T18:09:11.851 INFO:tasks.rados.rados.0.trial187.stdout:903: snap_create 2026-02-13T18:09:12.176 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.171+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.176 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.171+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=2726074785,config=1618278320,health=1796179531,kv=4087868365,logm=4113424258}) 2026-02-13T18:09:12.177 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.171+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=13,kv=10,logm=64} crc {auth=1336148920,config=1618278320,health=1057542925,kv=470106001,logm=3922949954}) 2026-02-13T18:09:12.177 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.171+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.177 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.171+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=2726074785,config=1618278320,health=1796179531,kv=4087868365,logm=4113424258}) 2026-02-13T18:09:12.177 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.171+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=13,kv=10,logm=62} crc {auth=975212536,config=1618278320,health=1796179531,kv=2742496795,logm=1798848294}) 2026-02-13T18:09:12.213 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.207+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.213 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.207+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2833112488}) 2026-02-13T18:09:12.213 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.207+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3054522117}) 2026-02-13T18:09:12.213 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.207+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.213 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.207+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2833112488}) 2026-02-13T18:09:12.213 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.207+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1829025139}) 2026-02-13T18:09:12.269 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.269 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2096327058}) 2026-02-13T18:09:12.269 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287542921}) 2026-02-13T18:09:12.269 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.269 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2096327058}) 2026-02-13T18:09:12.269 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=857933973}) 2026-02-13T18:09:12.271 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.271 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=627262734}) 2026-02-13T18:09:12.271 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3717401632}) 2026-02-13T18:09:12.271 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.271 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=627262734}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1370743562}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3129628102}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630145861}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3129628102}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1904651216}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1270307090}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3131205962}) 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.272 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1270307090}) 2026-02-13T18:09:12.273 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.263+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4019495854}) 2026-02-13T18:09:12.275 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.275 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=955043395}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034863296}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=955043395}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3490932601}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3112402495}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3075833184}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3112402495}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4063257553}) 2026-02-13T18:09:12.276 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=8,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=10} crc {logm=63195408,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2768709203,mon_config_key=1414807831,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=1114887149,osd_snap=2236634839}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=45,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=8} crc {logm=525953802,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2949768965,mon_config_key=2615342343,monmap=2635724903,nvmeofgw=3360707892,osd_metadata=1252444728,osd_snap=1686863486}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=8,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=10} crc {logm=63195408,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2768709203,mon_config_key=1414807831,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=1114887149,osd_snap=2236634839}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=45,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=8} crc {logm=525953802,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2768709203,mon_config_key=3718364256,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=1114887149,osd_snap=2582167927}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=28,osdmap=72} crc {osd_snap=3035336596,osdmap=1954116524}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=30,osdmap=70} crc {osd_snap=1957745616,osdmap=1673347079}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=28,osdmap=72} crc {osd_snap=3035336596,osdmap=1954116524}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=29,osdmap=71} crc {osd_snap=629295388,osdmap=1892737258}) 2026-02-13T18:09:12.277 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.278 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=988630029}) 2026-02-13T18:09:12.278 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3246699033}) 2026-02-13T18:09:12.278 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.278 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=988630029}) 2026-02-13T18:09:12.278 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.267+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3298323262}) 2026-02-13T18:09:12.279 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.279 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1995824814}) 2026-02-13T18:09:12.279 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2836866898}) 2026-02-13T18:09:12.279 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.279 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1995824814}) 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4118836173}) 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=32} crc {osdmap=3547160736}) 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=3888944377}) 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=32} crc {osdmap=3547160736}) 2026-02-13T18:09:12.280 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:09:12.271+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=31} crc {osdmap=2521990879}) 2026-02-13T18:09:12.836 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:09:12.837 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:09:12.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient: get_monmap_and_config 2026-02-13T18:09:12.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient: build_initial_monmap 2026-02-13T18:09:12.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient: monmap: 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:12.904313+0000 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:12.904313+0000 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 1 Processor -- start 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 1 -- start start 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient: init 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient(hunting): picked mon.noname-b con 0x7f16f40561f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient(hunting): picked mon.noname-a con 0x7f16f4057f90 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient(hunting): picked mon.noname-c con 0x7f16f4056cd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4089dc0 con 0x7f16f4057f90 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4089800 con 0x7f16f4056cd0 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4089ae0 con 0x7f16f40561f0 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16fbb09640 10 monclient(hunting): authenticate will time out at 783.959471s 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16f907d640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f16f4057f90 0x7f16f4183e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39714/0 (socket says 10.20.193.78:39714) 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16f907d640 1 -- 10.20.193.78:0/214113071 learned_addr learned my addr 10.20.193.78:0/214113071 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:12.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.898+0000 7f16f987e640 1 --1- 10.20.193.78:0/214113071 >> v1:10.20.193.78:6790/0 conn(0x7f16f40561f0 0x7f16f40565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59326/0 (socket says 10.20.193.78:59326) 2026-02-13T18:09:12.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f907d640 1 -- 10.20.193.78:0/214113071 >> v1:10.20.193.78:6789/0 conn(0x7f16f4057f90 legacy=0x7f16f4183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:12.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f987e640 1 -- 10.20.193.78:0/214113071 >> v1:10.20.193.78:6790/0 conn(0x7f16f40561f0 legacy=0x7f16f40565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:12.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fa07f640 1 -- 10.20.193.78:0/214113071 >> v1:10.20.193.187:6789/0 conn(0x7f16f4056cd0 legacy=0x7f16f41a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967753010 0 0) 0x7f16f4089800 con 0x7f16f4056cd0 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient(hunting): _negotiate 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient(hunting): my global_id is 4627 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16dc003620 con 0x7f16f4056cd0 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275167682 0 0) 0x7f16dc003620 con 0x7f16f4056cd0 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 >> v1:10.20.193.78:6790/0 conn(0x7f16f40561f0 legacy=0x7f16f40565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 >> v1:10.20.193.78:6789/0 conn(0x7f16f4057f90 legacy=0x7f16f4183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: _finish_hunting 0 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 monclient: found mon.noname-c 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:12.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f405dab0 con 0x7f16f4056cd0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: _finish_auth 0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: _check_auth_tickets 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 5 monclient: authenticate success, global_id 4627 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16f00046f0 con 0x7f16f4056cd0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: dump: 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16f0004900 con 0x7f16f4056cd0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 1 -- 10.20.193.78:0/214113071 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16f0004dd0 con 0x7f16f4056cd0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16f887c640 10 monclient: dump: 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:12.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 4 set_mon_vals no callback set 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 10 monclient: shutdown 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 1 -- 10.20.193.78:0/214113071 >> v1:10.20.193.187:6789/0 conn(0x7f16f4056cd0 legacy=0x7f16f41a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 1 -- 10.20.193.78:0/214113071 shutdown_connections 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 1 -- 10.20.193.78:0/214113071 >> 10.20.193.78:0/214113071 conn(0x7f16f4054e70 msgr2=0x7f16f4093b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 1 -- 10.20.193.78:0/214113071 shutdown_connections 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 1 -- 10.20.193.78:0/214113071 wait complete. 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 10 monclient: build_initial_monmap 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.902+0000 7f16fbb09640 10 monclient: monmap: 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 Processor -- start 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 -- start start 2026-02-13T18:09:12.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: init 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient(hunting): picked mon.noname-c con 0x7f16f40561f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient(hunting): picked mon.noname-a con 0x7f16f4056cd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient(hunting): picked mon.noname-b con 0x7f16f4057f90 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4131960 con 0x7f16f4056cd0 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f4131c40 con 0x7f16f4057f90 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f412fbc0 con 0x7f16f40561f0 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient(hunting): authenticate will time out at 783.964566s 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16f987e640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f16f40561f0 0x7f16f4153180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59334/0 (socket says 10.20.193.78:59334) 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16f987e640 1 -- 10.20.193.78:0/951485167 learned_addr learned my addr 10.20.193.78:0/951485167 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:12.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16f907d640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f16f4056cd0 0x7f16f4194390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39722/0 (socket says 10.20.193.78:39722) 2026-02-13T18:09:12.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16f987e640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.78:6790/0 conn(0x7f16f40561f0 legacy=0x7f16f4153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:12.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16f907d640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.78:6789/0 conn(0x7f16f4056cd0 legacy=0x7f16f4194390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:12.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fa07f640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.187:6789/0 conn(0x7f16f4057f90 legacy=0x7f16f4195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87315835 0 0) 0x7f16f4131c40 con 0x7f16f4057f90 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): my global_id is 4630 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16c4003620 con 0x7f16f4057f90 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3780821626 0 0) 0x7f16c4003620 con 0x7f16f4057f90 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16f4131c40 con 0x7f16f4057f90 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16f00046f0 con 0x7f16f4057f90 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): dump: 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:12.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 265194237 0 0) 0x7f16f4131c40 con 0x7f16f4057f90 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.78:6790/0 conn(0x7f16f40561f0 legacy=0x7f16f4153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.78:6789/0 conn(0x7f16f4056cd0 legacy=0x7f16f4194390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: _finish_hunting 0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 monclient: found mon.b 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4131f20 con 0x7f16f4057f90 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: _finish_auth 0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: _check_auth_tickets 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 5 monclient: authenticate success, global_id 4630 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: _renew_subs 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16f41414e0 con 0x7f16f4057f90 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: _renew_subs 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f16f412f150 con 0x7f16f4057f90 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16f0004900 con 0x7f16f4057f90 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16f00055c0 con 0x7f16f4057f90 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e27fc640 10 monclient: dump: 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:12.915 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.906+0000 7f16e3fff640 4 set_mon_vals no callback set 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16fbb09640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16fbb09640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16fbb09640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f405e420 con 0x7f16f4057f90 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f16f0005860 con 0x7f16f4057f90 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(204..204 src has 1..204) ==== 3991+0+0 (unknown 502367614 0 0) 0x7f16f004db50 con 0x7f16f4057f90 2026-02-13T18:09:12.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.910+0000 7f16f987e640 10 monclient: get_auth_request con 0x7f16c403d520 auth_method 0 2026-02-13T18:09:12.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.914+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f16f405e420 con 0x7f16f4057f90 2026-02-13T18:09:12.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.914+0000 7f16e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:12.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:12.914+0000 7f16e27fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16fbb09640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16fbb09640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16fbb09640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f16f40919f0 con 0x7f16f4057f90 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16e27fc640 1 -- 10.20.193.78:0/951485167 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3132471068) 0x7f16f0018b10 con 0x7f16f4057f90 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16e27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.026+0000 7f16e27fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:13.034 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.187:6812/2668687789 conn(0x7f16c403d520 legacy=0x7f16c405d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 10 monclient: shutdown 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 >> v1:10.20.193.187:6789/0 conn(0x7f16f4057f90 legacy=0x7f16f4195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 shutdown_connections 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 >> 10.20.193.78:0/951485167 conn(0x7f16f4054e70 msgr2=0x7f16f408ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 shutdown_connections 2026-02-13T18:09:13.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.030+0000 7f16fbb09640 1 -- 10.20.193.78:0/951485167 wait complete. 2026-02-13T18:09:13.044 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:09:13.044 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:09:13.044 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:09:13.044 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.098+0000 7f2bbd12c640 10 monclient: get_monmap_and_config 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.098+0000 7f2bbd12c640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.098+0000 7f2bbd12c640 10 monclient: monmap: 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:13.105517+0000 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:13.105517+0000 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 1 Processor -- start 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 1 -- start start 2026-02-13T18:09:13.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient: init 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient(hunting): picked mon.noname-b con 0x7f2bb808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient(hunting): picked mon.noname-a con 0x7f2bb808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient(hunting): picked mon.noname-c con 0x7f2bb808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb8089e80 con 0x7f2bb808dc80 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb8088c20 con 0x7f2bb808cdd0 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb8089ba0 con 0x7f2bb808c2f0 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 10 monclient(hunting): authenticate will time out at 784.160999s 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb6d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2bb808c2f0 0x7f2bb808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59348/0 (socket says 10.20.193.78:59348) 2026-02-13T18:09:13.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb6d76640 1 -- 10.20.193.78:0/3603028311 learned_addr learned my addr 10.20.193.78:0/3603028311 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb6d76640 1 -- 10.20.193.78:0/3603028311 >> v1:10.20.193.78:6790/0 conn(0x7f2bb808c2f0 legacy=0x7f2bb808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb6575640 1 -- 10.20.193.78:0/3603028311 >> v1:10.20.193.78:6789/0 conn(0x7f2bb808dc80 legacy=0x7f2bb8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb7577640 1 -- 10.20.193.78:0/3603028311 >> v1:10.20.193.187:6789/0 conn(0x7f2bb808cdd0 legacy=0x7f2bb81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667599651 0 0) 0x7f2bb8088c20 con 0x7f2bb808cdd0 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient(hunting): my global_id is 4633 2026-02-13T18:09:13.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ba4003620 con 0x7f2bb808cdd0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 599229901 0 0) 0x7f2ba4003620 con 0x7f2bb808cdd0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 >> v1:10.20.193.78:6790/0 conn(0x7f2bb808c2f0 legacy=0x7f2bb808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 >> v1:10.20.193.78:6789/0 conn(0x7f2bb808dc80 legacy=0x7f2bb8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 monclient: found mon.noname-c 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb808d370 con 0x7f2bb808cdd0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2ba8004670 con 0x7f2bb808cdd0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bb5d74640 10 monclient: dump: 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 5 monclient: authenticate success, global_id 4633 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.102+0000 7f2bbd12c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ba8004940 con 0x7f2bb808cdd0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb5d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb5d74640 1 -- 10.20.193.78:0/3603028311 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2ba8004dd0 con 0x7f2bb808cdd0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb5d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb5d74640 10 monclient: dump: 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.111 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 4 set_mon_vals no callback set 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: shutdown 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- 10.20.193.78:0/3603028311 >> v1:10.20.193.187:6789/0 conn(0x7f2bb808cdd0 legacy=0x7f2bb81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- 10.20.193.78:0/3603028311 shutdown_connections 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- 10.20.193.78:0/3603028311 >> 10.20.193.78:0/3603028311 conn(0x7f2bb8091720 msgr2=0x7f2bb8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- 10.20.193.78:0/3603028311 shutdown_connections 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- 10.20.193.78:0/3603028311 wait complete. 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: monmap: 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 Processor -- start 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- start start 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: init 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient(hunting): picked mon.noname-c con 0x7f2bb808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient(hunting): picked mon.noname-a con 0x7f2bb808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient(hunting): picked mon.noname-b con 0x7f2bb808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb807df80 con 0x7f2bb808cdd0 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb8057ab0 con 0x7f2bb808dc80 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb8088910 con 0x7f2bb808c2f0 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bbd12c640 10 monclient(hunting): authenticate will time out at 784.165933s 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb6d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2bb808c2f0 0x7f2bb8083830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59364/0 (socket says 10.20.193.78:59364) 2026-02-13T18:09:13.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.106+0000 7f2bb6d76640 1 -- 10.20.193.78:0/2791236405 learned_addr learned my addr 10.20.193.78:0/2791236405 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6d76640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6790/0 conn(0x7f2bb808c2f0 legacy=0x7f2bb8083830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6575640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb808cdd0 legacy=0x7f2bb8192310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb7577640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.187:6789/0 conn(0x7f2bb808dc80 legacy=0x7f2bb8193a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986469868 0 0) 0x7f2bb8057ab0 con 0x7f2bb808dc80 2026-02-13T18:09:13.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): my global_id is 4636 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b84003620 con 0x7f2bb808dc80 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3863537085 0 0) 0x7f2b84003620 con 0x7f2bb808dc80 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bb8057ab0 con 0x7f2bb808dc80 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2ba8004dd0 con 0x7f2bb808dc80 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): dump: 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.119 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1255491699 0 0) 0x7f2bb8057ab0 con 0x7f2bb808dc80 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6790/0 conn(0x7f2bb808c2f0 legacy=0x7f2bb8083830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb808cdd0 legacy=0x7f2bb8192310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 monclient: found mon.b 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb80802e0 con 0x7f2bb808dc80 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 5 monclient: authenticate success, global_id 4636 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 10 monclient: _renew_subs 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb807eae0 con 0x7f2bb808dc80 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 10 monclient: _renew_subs 2026-02-13T18:09:13.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2bb8084110 con 0x7f2bb808dc80 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ba8004940 con 0x7f2bb808dc80 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2ba8005560 con 0x7f2bb808dc80 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 10 monclient: dump: 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.122 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb5573640 4 set_mon_vals no callback set 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2bb808f620 con 0x7f2bb8151210 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f2ba8005800 con 0x7f2bb808dc80 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6d76640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb8151210 legacy=0x7f2bb805b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6d76640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb8151210 legacy=0x7f2bb805b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6d76640 1 --1- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb8151210 0x7f2bb805b4c0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=4 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-13T18:09:13.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6d76640 1 --1- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb8151210 0x7f2bb805b4c0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=4 cs=0 l=1).fault on lossy channel, failing 2026-02-13T18:09:13.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb8151210 legacy=0x7f2bb805b4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb8151210 legacy=0x7f2bb805b4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2bb8057ab0 con 0x7f2b8405f110 2026-02-13T18:09:13.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(204..204 src has 1..204) ==== 3991+0+0 (unknown 502367614 0 0) 0x7f2ba804dab0 con 0x7f2bb808dc80 2026-02-13T18:09:13.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.110+0000 7f2bb6d76640 10 monclient: get_auth_request con 0x7f2b8403d450 auth_method 0 2026-02-13T18:09:13.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.114+0000 7f2bb6575640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2b8405f110 legacy=0x7f2b8407f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.458+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969517966 0 0) 0x7f2bb8057ab0 con 0x7f2b8405f110 2026-02-13T18:09:13.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.458+0000 7f2b977fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.458+0000 7f2b977fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.458+0000 7f2b977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.458+0000 7f2b977fe640 10 monclient(hunting): my global_id is 64125 2026-02-13T18:09:13.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.458+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b84003620 con 0x7f2b8405f110 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2984650916 0 0) 0x7f2b84003620 con 0x7f2b8405f110 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bb8057ab0 con 0x7f2b8405f110 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2ba0003170 con 0x7f2b8405f110 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 10 monclient: dump: 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.471 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4267676899 0 0) 0x7f2bb8057ab0 con 0x7f2b8405f110 2026-02-13T18:09:13.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.462+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ba80053b0 con 0x7f2b8405f110 2026-02-13T18:09:13.473 INFO:tasks.rados.rados.0.trial187.stdout:903: done (0 left) 2026-02-13T18:09:13.473 INFO:tasks.rados.rados.0.trial187.stdout:904: snap_create 2026-02-13T18:09:13.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.466+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2ba00058c0 con 0x7f2b8405f110 2026-02-13T18:09:13.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.466+0000 7f2b977fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.466+0000 7f2b977fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:13.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.466+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2b8405f110 legacy=0x7f2b8407f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.466+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2b8405f110 legacy=0x7f2b8407f4f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.470+0000 7f2bbd12c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:13.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.470+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2bb80510e0 con 0x7f2bb804d200 2026-02-13T18:09:13.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bb6575640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb804d200 legacy=0x7f2bb8196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821938311 0 0) 0x7f2bb80510e0 con 0x7f2bb804d200 2026-02-13T18:09:13.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient(hunting): my global_id is 64128 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb8057ab0 con 0x7f2bb804d200 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3689469769 0 0) 0x7f2bb8057ab0 con 0x7f2bb804d200 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bb80510e0 con 0x7f2bb804d200 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2ba0003b20 con 0x7f2bb804d200 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient: dump: 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.481 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3771046200 0 0) 0x7f2bb80510e0 con 0x7f2bb804d200 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2bb81515e0 con 0x7f2bb804d200 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4339 (unknown 0 0 3488640142) 0x7f2ba0005b40 con 0x7f2bb804d200 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:13.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb804d200 legacy=0x7f2bb8196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2b977fe640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.78:6789/0 conn(0x7f2bb804d200 legacy=0x7f2bb8196160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bb7577640 1 -- 10.20.193.78:0/2791236405 reap_dead start 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:13.483 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 14, 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 2320, 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:13.484 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.485 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.486 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:13.487 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:13.488 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.489 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:13.490 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.491 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:13.492 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.493 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.494 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.495 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.496 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:13.496 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.496 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.496 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.496 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:13.496 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:13.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.187:6812/2668687789 conn(0x7f2b8403d450 legacy=0x7f2b8405d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 10 monclient: shutdown 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 >> v1:10.20.193.187:6789/0 conn(0x7f2bb808dc80 legacy=0x7f2bb8193a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 shutdown_connections 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 >> 10.20.193.78:0/2791236405 conn(0x7f2bb8091720 msgr2=0x7f2bb8058c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 shutdown_connections 2026-02-13T18:09:13.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.474+0000 7f2bbd12c640 1 -- 10.20.193.78:0/2791236405 wait complete. 2026-02-13T18:09:13.499 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:09:13.499 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:09:13.499 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: get_monmap_and_config 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: monmap: 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:13.557817+0000 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:13.557817+0000 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.561 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 1 Processor -- start 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 1 -- start start 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: init 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient(hunting): picked mon.noname-a con 0x7f326813e910 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient(hunting): picked mon.noname-c con 0x7f3268163d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient(hunting): picked mon.noname-b con 0x7f3268185850 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3268090f70 con 0x7f326813e910 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3268091250 con 0x7f3268163d50 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3268091530 con 0x7f3268185850 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient(hunting): authenticate will time out at 784.612997s 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32677fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f326813e910 0x7f326813ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39782/0 (socket says 10.20.193.78:39782) 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32677fe640 1 -- 10.20.193.78:0/494645879 learned_addr learned my addr 10.20.193.78:0/494645879 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f3267fff640 1 --1- 10.20.193.78:0/494645879 >> v1:10.20.193.78:6790/0 conn(0x7f3268185850 0x7f32681a5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59366/0 (socket says 10.20.193.78:59366) 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32677fe640 1 -- 10.20.193.78:0/494645879 >> v1:10.20.193.78:6789/0 conn(0x7f326813e910 legacy=0x7f326813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f3267fff640 1 -- 10.20.193.78:0/494645879 >> v1:10.20.193.78:6790/0 conn(0x7f3268185850 legacy=0x7f32681a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f3266ffd640 1 -- 10.20.193.78:0/494645879 >> v1:10.20.193.187:6789/0 conn(0x7f3268163d50 legacy=0x7f3268184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706294042 0 0) 0x7f3268090f70 con 0x7f326813e910 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): my global_id is 64131 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f324c003620 con 0x7f326813e910 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849348870 0 0) 0x7f3268091530 con 0x7f3268185850 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): my global_id is 4616 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3268090f70 con 0x7f3268185850 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673006369 0 0) 0x7f3268091250 con 0x7f3268163d50 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient(hunting): my global_id is 4639 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3268091530 con 0x7f3268163d50 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1742001305 0 0) 0x7f324c003620 con 0x7f326813e910 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 >> v1:10.20.193.78:6790/0 conn(0x7f3268185850 legacy=0x7f32681a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 >> v1:10.20.193.187:6789/0 conn(0x7f3268163d50 legacy=0x7f3268184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 monclient: found mon.noname-a 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32680921f0 con 0x7f326813e910 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3254003110 con 0x7f326813e910 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: dump: 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.575 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 5 monclient: authenticate success, global_id 64131 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32540033e0 con 0x7f326813e910 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 1 -- 10.20.193.78:0/494645879 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3254004b50 con 0x7f326813e910 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f326daa1640 4 set_mon_vals no callback set 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.554+0000 7f32667fc640 10 monclient: dump: 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient: shutdown 2026-02-13T18:09:13.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- 10.20.193.78:0/494645879 >> v1:10.20.193.78:6789/0 conn(0x7f326813e910 legacy=0x7f326813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- 10.20.193.78:0/494645879 shutdown_connections 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- 10.20.193.78:0/494645879 >> 10.20.193.78:0/494645879 conn(0x7f3268095f10 msgr2=0x7f3268096310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- 10.20.193.78:0/494645879 shutdown_connections 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- 10.20.193.78:0/494645879 wait complete. 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient: monmap: 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.578 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 Processor -- start 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- start start 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient: init 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient(hunting): picked mon.noname-c con 0x7f326813e910 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient(hunting): picked mon.noname-b con 0x7f3268163d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient(hunting): picked mon.noname-a con 0x7f3268185850 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f326808e8b0 con 0x7f3268185850 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3268182b80 con 0x7f3268163d50 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32681654f0 con 0x7f326813e910 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f326daa1640 10 monclient(hunting): authenticate will time out at 784.617719s 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f32677fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f326813e910 0x7f3268181d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59370/0 (socket says 10.20.193.78:59370) 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f32677fe640 1 -- 10.20.193.78:0/4238687176 learned_addr learned my addr 10.20.193.78:0/4238687176 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f3267fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6789/0 conn(0x7f3268185850 legacy=0x7f326812d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.558+0000 7f32677fe640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326813e910 legacy=0x7f3268181d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409604379 0 0) 0x7f32681654f0 con 0x7f326813e910 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): my global_id is 4619 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3266ffd640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.187:6789/0 conn(0x7f3268163d50 legacy=0x7f3268182470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3238003620 con 0x7f326813e910 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410994185 0 0) 0x7f326808e8b0 con 0x7f3268185850 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): my global_id is 64134 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32681654f0 con 0x7f3268185850 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713101222 0 0) 0x7f3268182b80 con 0x7f3268163d50 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): my global_id is 4642 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f326808e8b0 con 0x7f3268163d50 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1492416399 0 0) 0x7f3238003620 con 0x7f326813e910 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3268182b80 con 0x7f326813e910 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f32540048e0 con 0x7f326813e910 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): dump: 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.582 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 952508849 0 0) 0x7f32681654f0 con 0x7f3268185850 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3238003620 con 0x7f3268185850 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f325c004380 con 0x7f3268185850 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:13.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): dump: 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 565722063 0 0) 0x7f3268182b80 con 0x7f326813e910 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.187:6789/0 conn(0x7f3268163d50 legacy=0x7f3268182470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6789/0 conn(0x7f3268185850 legacy=0x7f326812d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 monclient: found mon.c 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3268166be0 con 0x7f326813e910 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 5 monclient: authenticate success, global_id 4619 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 10 monclient: _renew_subs 2026-02-13T18:09:13.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3268166340 con 0x7f326813e910 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 10 monclient: _renew_subs 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f32681a6e70 con 0x7f326813e910 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32540033c0 con 0x7f326813e910 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3254004f60 con 0x7f326813e910 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: dump: 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.586 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3265ffb640 4 set_mon_vals no callback set 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3254005200 con 0x7f326813e910 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f32681a7160 con 0x7f326808dd90 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(205..205 src has 1..205) ==== 3963+0+0 (unknown 4173050335 0 0) 0x7f325404c660 con 0x7f326813e910 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3267fff640 10 monclient: get_auth_request con 0x7f323803d800 auth_method 0 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3266ffd640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326808dd90 legacy=0x7f3268089e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281527194 0 0) 0x7f32681a7160 con 0x7f326808dd90 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient(hunting): my global_id is 4622 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3268182b80 con 0x7f326808dd90 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3958946460 0 0) 0x7f3268182b80 con 0x7f326808dd90 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32681a7160 con 0x7f326808dd90 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f32580032f0 con 0x7f326808dd90 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.562+0000 7f3243fff640 10 monclient: dump: 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.588 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1904645767 0 0) 0x7f32681a7160 con 0x7f326808dd90 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3268057e30 con 0x7f326808dd90 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f32580058c0 con 0x7f326808dd90 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326808dd90 legacy=0x7f3268089e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326808dd90 legacy=0x7f3268089e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f326daa1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:13.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.566+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f326808e160 con 0x7f326808a560 2026-02-13T18:09:13.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3266ffd640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326808a560 legacy=0x7f326812fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498876281 0 0) 0x7f326808e160 con 0x7f326808a560 2026-02-13T18:09:13.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient(hunting): my global_id is 4625 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32681a7160 con 0x7f326808a560 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 211615873 0 0) 0x7f32681a7160 con 0x7f326808a560 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f326808e160 con 0x7f326808a560 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3258003bd0 con 0x7f326808a560 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient: dump: 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.592 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3203855249 0 0) 0x7f326808e160 con 0x7f326808a560 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f326805dc10 con 0x7f326808a560 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 3295758973) 0x7f3258005b20 con 0x7f326808a560 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326808a560 legacy=0x7f326812fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3243fff640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326808a560 legacy=0x7f326812fae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.593 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 14, 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 234961, 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.594 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.595 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:13.596 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.597 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.598 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.599 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:13.600 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.601 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:13.602 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.187:6812/2668687789 conn(0x7f323803d800 legacy=0x7f323805dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 10 monclient: shutdown 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 >> v1:10.20.193.78:6790/0 conn(0x7f326813e910 legacy=0x7f3268181d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3267fff640 1 -- 10.20.193.78:0/4238687176 reap_dead start 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f3267fff640 1 -- 10.20.193.78:0/4238687176 reap_dead start 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 shutdown_connections 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 >> 10.20.193.78:0/4238687176 conn(0x7f3268095f10 msgr2=0x7f3268054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 shutdown_connections 2026-02-13T18:09:13.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.570+0000 7f326daa1640 1 -- 10.20.193.78:0/4238687176 wait complete. 2026-02-13T18:09:13.604 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:09:13.604 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:09:13.604 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:09:13.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient: get_monmap_and_config 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient: monmap: 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:13.668584+0000 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:13.668584+0000 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 1 Processor -- start 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 1 -- start start 2026-02-13T18:09:13.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient: init 2026-02-13T18:09:13.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.662+0000 7f57661db640 10 monclient(hunting): picked mon.noname-c con 0x7f5760085b00 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient(hunting): picked mon.noname-b con 0x7f5760085ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient(hunting): picked mon.noname-a con 0x7f57600862a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f576008d4e0 con 0x7f57600862a0 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5760054660 con 0x7f5760085b00 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57601a8b20 con 0x7f5760085ed0 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient(hunting): authenticate will time out at 784.724082s 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5760085ed0 0x7f5760183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59402/0 (socket says 10.20.193.78:59402) 2026-02-13T18:09:13.673 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575effd640 1 -- 10.20.193.78:0/2402617513 learned_addr learned my addr 10.20.193.78:0/2402617513 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575ffff640 1 -- 10.20.193.78:0/2402617513 >> v1:10.20.193.78:6789/0 conn(0x7f57600862a0 legacy=0x7f57601a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575effd640 1 -- 10.20.193.78:0/2402617513 >> v1:10.20.193.78:6790/0 conn(0x7f5760085ed0 legacy=0x7f5760183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575f7fe640 1 -- 10.20.193.78:0/2402617513 >> v1:10.20.193.187:6789/0 conn(0x7f5760085b00 legacy=0x7f576008e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087451927 0 0) 0x7f576008d4e0 con 0x7f57600862a0 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): my global_id is 64137 2026-02-13T18:09:13.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5744003620 con 0x7f57600862a0 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715999785 0 0) 0x7f57601a8b20 con 0x7f5760085ed0 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): my global_id is 4628 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f576008d4e0 con 0x7f5760085ed0 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090957547 0 0) 0x7f5760054660 con 0x7f5760085b00 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient(hunting): my global_id is 4645 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57601a8b20 con 0x7f5760085b00 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2938436300 0 0) 0x7f5744003620 con 0x7f57600862a0 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 >> v1:10.20.193.78:6790/0 conn(0x7f5760085ed0 legacy=0x7f5760183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 >> v1:10.20.193.187:6789/0 conn(0x7f5760085b00 legacy=0x7f576008e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 monclient: found mon.noname-a 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57601a9d00 con 0x7f57600862a0 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5754004670 con 0x7f57600862a0 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: dump: 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.678 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 5 monclient: authenticate success, global_id 64137 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5754004940 con 0x7f57600862a0 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 1 -- 10.20.193.78:0/2402617513 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5754004dd0 con 0x7f57600862a0 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 4 set_mon_vals no callback set 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f575e7fc640 10 monclient: dump: 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.679 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient: shutdown 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- 10.20.193.78:0/2402617513 >> v1:10.20.193.78:6789/0 conn(0x7f57600862a0 legacy=0x7f57601a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- 10.20.193.78:0/2402617513 shutdown_connections 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- 10.20.193.78:0/2402617513 >> 10.20.193.78:0/2402617513 conn(0x7f5760056aa0 msgr2=0x7f57600928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- 10.20.193.78:0/2402617513 shutdown_connections 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- 10.20.193.78:0/2402617513 wait complete. 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient: monmap: 2026-02-13T18:09:13.680 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 Processor -- start 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 1 -- start start 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.666+0000 7f57661db640 10 monclient: init 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient(hunting): picked mon.noname-a con 0x7f5760085b00 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient(hunting): picked mon.noname-b con 0x7f5760085ed0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient(hunting): picked mon.noname-c con 0x7f57600862a0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57601dae00 con 0x7f5760085b00 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5760089ae0 con 0x7f5760085ed0 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f576007e750 con 0x7f57600862a0 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient(hunting): authenticate will time out at 784.728210s 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f57600862a0 0x7f576023c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59416/0 (socket says 10.20.193.78:59416) 2026-02-13T18:09:13.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575ffff640 1 -- 10.20.193.78:0/3362744047 learned_addr learned my addr 10.20.193.78:0/3362744047 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575ffff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.78:6790/0 conn(0x7f57600862a0 legacy=0x7f576023c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575f7fe640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.78:6789/0 conn(0x7f5760085b00 legacy=0x7f57601d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182079231 0 0) 0x7f576007e750 con 0x7f57600862a0 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): my global_id is 4631 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5730003620 con 0x7f57600862a0 2026-02-13T18:09:13.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666890582 0 0) 0x7f57601dae00 con 0x7f5760085b00 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): my global_id is 64140 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f576007e750 con 0x7f5760085b00 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575effd640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f5760085ed0 legacy=0x7f57601da6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2555131456 0 0) 0x7f5730003620 con 0x7f57600862a0 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57601dae00 con 0x7f57600862a0 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5754004c20 con 0x7f57600862a0 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): dump: 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.686 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3354031702 0 0) 0x7f576007e750 con 0x7f5760085b00 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5730003620 con 0x7f5760085b00 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f574c003710 con 0x7f5760085b00 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): dump: 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.687 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005845062 0 0) 0x7f5760089ae0 con 0x7f5760085ed0 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient(hunting): my global_id is 4648 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f576007e750 con 0x7f5760085ed0 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2439358806 0 0) 0x7f57601dae00 con 0x7f57600862a0 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f5760085ed0 legacy=0x7f57601da6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.78:6789/0 conn(0x7f5760085b00 legacy=0x7f57601d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 monclient: found mon.c 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576007ea30 con 0x7f57600862a0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 5 monclient: authenticate success, global_id 4631 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient: _renew_subs 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f576007e460 con 0x7f57600862a0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient: _renew_subs 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f576007c710 con 0x7f57600862a0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5754004920 con 0x7f57600862a0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57540055a0 con 0x7f57600862a0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575dffb640 4 set_mon_vals no callback set 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 10 monclient: dump: 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5754005870 con 0x7f57600862a0 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f576007eda0 con 0x7f57600907d0 2026-02-13T18:09:13.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(205..205 src has 1..205) ==== 3963+0+0 (unknown 4173050335 0 0) 0x7f575404db60 con 0x7f57600862a0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.670+0000 7f575effd640 10 monclient: get_auth_request con 0x7f573003d870 auth_method 0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f575f7fe640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f57600907d0 legacy=0x7f576004ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405614892 0 0) 0x7f576007eda0 con 0x7f57600907d0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient(hunting): my global_id is 4651 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57601dae00 con 0x7f57600907d0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 402100857 0 0) 0x7f57601dae00 con 0x7f57600907d0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f576007eda0 con 0x7f57600907d0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f574c003d80 con 0x7f57600907d0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient: dump: 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.691 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 40381106 0 0) 0x7f576007eda0 con 0x7f57600907d0 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57600008e0 con 0x7f57600907d0 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f574c0058c0 con 0x7f57600907d0 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f57600907d0 legacy=0x7f576004ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.674+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f57600907d0 legacy=0x7f576004ca40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.678+0000 7f57661db640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.678+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f576007cae0 con 0x7f57601a8f40 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f575f7fe640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f57601a8f40 legacy=0x7f576004d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692737005 0 0) 0x7f576007cae0 con 0x7f57601a8f40 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient(hunting): my global_id is 4654 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f576007eda0 con 0x7f57601a8f40 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1065082860 0 0) 0x7f576007eda0 con 0x7f57601a8f40 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f576007cae0 con 0x7f57601a8f40 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f574c004330 con 0x7f57601a8f40 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient: dump: 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4102865441 0 0) 0x7f576007cae0 con 0x7f57601a8f40 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f576004d860 con 0x7f57601a8f40 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 1477632600) 0x7f574c005a70 con 0x7f57601a8f40 2026-02-13T18:09:13.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f57601a8f40 legacy=0x7f576004d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f573bfff640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6789/0 conn(0x7f57601a8f40 legacy=0x7f576004d150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:09:13.696 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 14, 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 235048, 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.697 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.698 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:13.699 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:13.700 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.701 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.702 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:13.703 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.704 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:13.705 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:13.706 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.187:6812/2668687789 conn(0x7f573003d870 legacy=0x7f573005dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 10 monclient: shutdown 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 >> v1:10.20.193.78:6790/0 conn(0x7f57600862a0 legacy=0x7f576023c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f575ffff640 1 -- 10.20.193.78:0/3362744047 reap_dead start 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f575ffff640 1 -- 10.20.193.78:0/3362744047 reap_dead start 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 shutdown_connections 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 >> 10.20.193.78:0/3362744047 conn(0x7f5760056aa0 msgr2=0x7f576008a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 shutdown_connections 2026-02-13T18:09:13.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.682+0000 7f57661db640 1 -- 10.20.193.78:0/3362744047 wait complete. 2026-02-13T18:09:13.708 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:09:13.708 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T18:09:13.708 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:09:13.708 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T18:09:13.708 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T18:09:13.708 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T18:09:13.708 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:09:13.709 INFO:tasks.rados.rados.0.trial187.stdout:904: done (0 left) 2026-02-13T18:09:13.709 INFO:tasks.rados.rados.0.trial187.stdout:905: write oid 21 current snap is 92 2026-02-13T18:09:13.709 INFO:tasks.rados.rados.0.trial187.stdout:905: seq_num 328 ranges {712696=484851,1960682=572774,3307918=204778} 2026-02-13T18:09:13.713 INFO:tasks.rados.rados.0.trial187.stdout:905: writing trial18717860-21 from 712696 to 1197547 tid 1 2026-02-13T18:09:13.718 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T18:09:13.718 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:09:13.718 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:09:13.722 INFO:tasks.rados.rados.0.trial187.stdout:905: writing trial18717860-21 from 1960682 to 2533456 tid 2 2026-02-13T18:09:13.728 INFO:tasks.rados.rados.0.trial187.stdout:905: writing trial18717860-21 from 3307918 to 3512696 tid 3 2026-02-13T18:09:13.728 INFO:tasks.rados.rados.0.trial187.stdout:906: write oid 38 current snap is 92 2026-02-13T18:09:13.728 INFO:tasks.rados.rados.0.trial187.stdout:906: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2026-02-13T18:09:13.737 INFO:tasks.rados.rados.0.trial187.stdout:906: writing trial18717860-38 from 729503 to 1289603 tid 1 2026-02-13T18:09:13.747 INFO:tasks.rados.rados.0.trial187.stdout:906: writing trial18717860-38 from 2019164 to 2735596 tid 2 2026-02-13T18:09:13.750 INFO:tasks.rados.rados.0.trial187.stdout:906: writing trial18717860-38 from 3335341 to 3529503 tid 3 2026-02-13T18:09:13.750 INFO:tasks.rados.rados.0.trial187.stdout:907: write (excl) oid 35 current snap is 92 2026-02-13T18:09:13.750 INFO:tasks.rados.rados.0.trial187.stdout:907: seq_num 330 ranges {746310=635349,2077646=576443,3362764=183546} 2026-02-13T18:09:13.755 INFO:tasks.rados.rados.0.trial187.stdout:907: writing trial18717860-35 from 746310 to 1381659 tid 1 2026-02-13T18:09:13.760 INFO:tasks.rados.rados.0.trial187.stdout:907: writing trial18717860-35 from 2077646 to 2654089 tid 2 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:907: writing trial18717860-35 from 3362764 to 3546310 tid 3 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:908: copy_from oid 24 from oid 44 current snap is 92 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: finishing write tid 1 to trial18717860-21 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: finishing write tid 2 to trial18717860-21 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:909: copy_from oid 28 from oid 36 current snap is 92 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: finishing write tid 3 to trial18717860-21 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: finishing write tid 4 to trial18717860-21 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: finishing write tid 5 to trial18717860-21 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: oid 21 updating version 0 to 298 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: oid 21 updating version 298 to 300 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: oid 21 version 300 is already newer than 297 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: oid 21 version 300 is already newer than 299 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 300 (ObjNum 328 snap 92 seq_num 328) dirty exists 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:905: left oid 21 (ObjNum 328 snap 92 seq_num 328) 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: finishing write tid 1 to trial18717860-38 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: finishing write tid 2 to trial18717860-38 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: finishing write tid 3 to trial18717860-38 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: finishing write tid 4 to trial18717860-38 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: finishing write tid 5 to trial18717860-38 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: oid 38 updating version 0 to 180 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: oid 38 version 180 is already newer than 179 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: oid 38 updating version 180 to 182 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: oid 38 version 182 is already newer than 181 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 182 (ObjNum 329 snap 92 seq_num 329) dirty exists 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:906: left oid 38 (ObjNum 329 snap 92 seq_num 329) 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:907: finishing write tid 1 to trial18717860-35 2026-02-13T18:09:13.764 INFO:tasks.rados.rados.0.trial187.stdout:907: finishing write tid 2 to trial18717860-35 2026-02-13T18:09:13.765 INFO:tasks.rados.rados.0.trial187.stdout:905: done (4 left) 2026-02-13T18:09:13.765 INFO:tasks.rados.rados.0.trial187.stdout:906: done (3 left) 2026-02-13T18:09:13.765 INFO:tasks.rados.rados.0.trial187.stdout:910: copy_from oid 30 from oid 33 current snap is 92 2026-02-13T18:09:13.765 INFO:tasks.rados.rados.0.trial187.stdout:911: write (excl) oid 4 current snap is 92 2026-02-13T18:09:13.765 INFO:tasks.rados.rados.0.trial187.stdout:911: seq_num 331 ranges {763117=710598,2136128=720101,3390187=172930} 2026-02-13T18:09:13.769 INFO:tasks.rados.rados.0.trial187.stdout:911: writing trial18717860-4 from 763117 to 1473715 tid 1 2026-02-13T18:09:13.775 INFO:tasks.rados.rados.0.trial187.stdout:911: writing trial18717860-4 from 2136128 to 2856229 tid 2 2026-02-13T18:09:13.777 INFO:tasks.rados.rados.0.trial187.stdout:911: writing trial18717860-4 from 3390187 to 3563117 tid 3 2026-02-13T18:09:13.778 INFO:tasks.rados.rados.0.trial187.stdout:912: write oid 34 current snap is 92 2026-02-13T18:09:13.778 INFO:tasks.rados.rados.0.trial187.stdout:912: seq_num 332 ranges {779924=785847,2078257=580112,3301257=278667} 2026-02-13T18:09:13.783 INFO:tasks.rados.rados.0.trial187.stdout:912: writing trial18717860-34 from 779924 to 1565771 tid 1 2026-02-13T18:09:13.787 INFO:tasks.rados.rados.0.trial187.stdout:912: writing trial18717860-34 from 2078257 to 2658369 tid 2 2026-02-13T18:09:13.791 INFO:tasks.rados.rados.0.trial187.stdout:912: writing trial18717860-34 from 3301257 to 3579924 tid 3 2026-02-13T18:09:13.791 INFO:tasks.rados.rados.0.trial187.stdout:913: write oid 48 current snap is 92 2026-02-13T18:09:13.791 INFO:tasks.rados.rados.0.trial187.stdout:913: seq_num 333 ranges {796731=461096,1736739=723770,2928680=668051} 2026-02-13T18:09:13.795 INFO:tasks.rados.rados.0.trial187.stdout:913: writing trial18717860-48 from 796731 to 1257827 tid 1 2026-02-13T18:09:13.800 INFO:tasks.rados.rados.0.trial187.stdout:913: writing trial18717860-48 from 1736739 to 2460509 tid 2 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:913: writing trial18717860-48 from 2928680 to 3596731 tid 3 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:914: read oid 20 snap 90 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:914: expect (ObjNum 317 snap 86 seq_num 317) 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:915: snap_create 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:909: finishing copy_from to trial18717860-28 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:909: got expected ENOENT (src dne) 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:909: finishing copy_from racing read to trial18717860-28 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: finishing write tid 3 to trial18717860-35 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: finishing write tid 4 to trial18717860-35 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: finishing write tid 5 to trial18717860-35 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: oid 35 updating version 0 to 185 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: oid 35 version 185 is already newer than 183 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: oid 35 version 185 is already newer than 184 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: oid 35 updating version 185 to 186 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 186 (ObjNum 330 snap 92 seq_num 330) dirty exists 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:907: left oid 35 (ObjNum 330 snap 92 seq_num 330) 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: finishing write tid 1 to trial18717860-4 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: finishing write tid 2 to trial18717860-4 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:908: finishing copy_from racing read to trial18717860-24 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:908: finishing copy_from to trial18717860-24 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 400 (ObjNum 264 snap 82 seq_num 264) dirty exists 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:910: finishing copy_from racing read to trial18717860-30 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:910: finishing copy_from to trial18717860-30 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 408 (ObjNum 280 snap 85 seq_num 280) dirty exists 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: finishing write tid 3 to trial18717860-4 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: finishing write tid 4 to trial18717860-4 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: finishing write tid 5 to trial18717860-4 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: oid 4 updating version 0 to 186 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: oid 4 updating version 186 to 188 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: oid 4 updating version 188 to 189 2026-02-13T18:09:13.805 INFO:tasks.rados.rados.0.trial187.stdout:911: oid 4 version 189 is already newer than 187 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 189 (ObjNum 331 snap 92 seq_num 331) dirty exists 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:911: left oid 4 (ObjNum 331 snap 92 seq_num 331) 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: finishing write tid 1 to trial18717860-34 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: finishing write tid 2 to trial18717860-34 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: finishing write tid 3 to trial18717860-34 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: finishing write tid 4 to trial18717860-34 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: finishing write tid 5 to trial18717860-34 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: oid 34 updating version 0 to 217 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: oid 34 version 217 is already newer than 215 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: oid 34 version 217 is already newer than 216 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: oid 34 updating version 217 to 218 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 218 (ObjNum 332 snap 92 seq_num 332) dirty exists 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:912: left oid 34 (ObjNum 332 snap 92 seq_num 332) 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:913: finishing write tid 1 to trial18717860-48 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:913: finishing write tid 2 to trial18717860-48 2026-02-13T18:09:13.806 INFO:tasks.rados.rados.0.trial187.stdout:913: finishing write tid 3 to trial18717860-48 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: finishing write tid 4 to trial18717860-48 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: finishing write tid 5 to trial18717860-48 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: oid 48 updating version 0 to 511 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: oid 48 updating version 511 to 513 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: oid 48 version 513 is already newer than 512 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: oid 48 version 513 is already newer than 510 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 513 (ObjNum 333 snap 92 seq_num 333) dirty exists 2026-02-13T18:09:13.807 INFO:tasks.rados.rados.0.trial187.stdout:913: left oid 48 (ObjNum 333 snap 92 seq_num 333) 2026-02-13T18:09:13.810 INFO:tasks.rados.rados.0.trial187.stdout:914: expect (ObjNum 317 snap 86 seq_num 317) 2026-02-13T18:09:13.814 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 621713 2026-02-13T18:09:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient: get_monmap_and_config 2026-02-13T18:09:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient: monmap: 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:13.820273+0000 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:13.820273+0000 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:13.822 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 1 Processor -- start 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 1 -- start start 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient: init 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient(hunting): picked mon.noname-a con 0x7f5f6408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient(hunting): picked mon.noname-b con 0x7f5f6408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient(hunting): picked mon.noname-c con 0x7f5f6408cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f64089e80 con 0x7f5f6408c2f0 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f64088c20 con 0x7f5f6408cdd0 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f64089ba0 con 0x7f5f6408dc80 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6c4f2640 10 monclient(hunting): authenticate will time out at 784.875392s 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f6a267640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f5f6408c2f0 legacy=0x7f5f6408c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f69a66640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5f6408dc80 0x7f5f64181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59432/0 (socket says 10.20.193.78:59432) 2026-02-13T18:09:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.814+0000 7f5f69a66640 1 -- 10.20.193.78:0/3861390785 learned_addr learned my addr 10.20.193.78:0/3861390785 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69a66640 1 -- 10.20.193.78:0/3861390785 >> v1:10.20.193.78:6790/0 conn(0x7f5f6408dc80 legacy=0x7f5f64181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6aa68640 1 -- 10.20.193.78:0/3861390785 >> v1:10.20.193.187:6789/0 conn(0x7f5f6408cdd0 legacy=0x7f5f641a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512188931 0 0) 0x7f5f64089ba0 con 0x7f5f6408dc80 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): my global_id is 4634 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4c003620 con 0x7f5f6408dc80 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630085937 0 0) 0x7f5f64088c20 con 0x7f5f6408cdd0 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient(hunting): my global_id is 4657 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f64089ba0 con 0x7f5f6408cdd0 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 168515019 0 0) 0x7f5f4c003620 con 0x7f5f6408dc80 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 >> v1:10.20.193.187:6789/0 conn(0x7f5f6408cdd0 legacy=0x7f5f641a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 >> v1:10.20.193.78:6789/0 conn(0x7f5f6408c2f0 legacy=0x7f5f6408c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 monclient: found mon.noname-b 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6408d370 con 0x7f5f6408dc80 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5f58003110 con 0x7f5f6408dc80 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 5 monclient: authenticate success, global_id 4634 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: dump: 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.827 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f580033e0 con 0x7f5f6408dc80 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 1 -- 10.20.193.78:0/3861390785 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5f58004b50 con 0x7f5f6408dc80 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69265640 10 monclient: dump: 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.828 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 4 set_mon_vals no callback set 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: shutdown 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/3861390785 >> v1:10.20.193.78:6790/0 conn(0x7f5f6408dc80 legacy=0x7f5f64181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/3861390785 shutdown_connections 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/3861390785 >> 10.20.193.78:0/3861390785 conn(0x7f5f64091720 msgr2=0x7f5f64091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/3861390785 shutdown_connections 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/3861390785 wait complete. 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: build_initial_monmap 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: monmap: 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:13.830 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 Processor -- start 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- start start 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: init 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient(hunting): picked mon.noname-a con 0x7f5f6408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient(hunting): picked mon.noname-c con 0x7f5f6408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient(hunting): picked mon.noname-b con 0x7f5f6408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f6407f500 con 0x7f5f6408c2f0 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f6405ddd0 con 0x7f5f6408dc80 2026-02-13T18:09:13.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f64088910 con 0x7f5f6408cdd0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6c4f2640 10 monclient(hunting): authenticate will time out at 784.879884s 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f6a267640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f5f6408c2f0 legacy=0x7f5f6407e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.818+0000 7f5f69a66640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5f6408cdd0 0x7f5f6407edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59436/0 (socket says 10.20.193.78:59436) 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f69a66640 1 -- 10.20.193.78:0/329839342 learned_addr learned my addr 10.20.193.78:0/329839342 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f69a66640 1 -- 10.20.193.78:0/329839342 >> v1:10.20.193.78:6790/0 conn(0x7f5f6408cdd0 legacy=0x7f5f6407edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529773593 0 0) 0x7f5f64088910 con 0x7f5f6408cdd0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): _negotiate 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): my global_id is 4637 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f34003620 con 0x7f5f6408cdd0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2667245510 0 0) 0x7f5f34003620 con 0x7f5f6408cdd0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f64088910 con 0x7f5f6408cdd0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5f58002b70 con 0x7f5f6408cdd0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): dump: 2026-02-13T18:09:13.833 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6aa68640 1 -- 10.20.193.78:0/329839342 >> v1:10.20.193.187:6789/0 conn(0x7f5f6408dc80 legacy=0x7f5f641954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 981725729 0 0) 0x7f5f64088910 con 0x7f5f6408cdd0 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 >> v1:10.20.193.187:6789/0 conn(0x7f5f6408dc80 legacy=0x7f5f641954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 >> v1:10.20.193.78:6789/0 conn(0x7f5f6408c2f0 legacy=0x7f5f6407e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: _finish_hunting 0 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 monclient: found mon.c 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:13.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f640812d0 con 0x7f5f6408cdd0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: _finish_auth 0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: _check_auth_tickets 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 5 monclient: authenticate success, global_id 4637 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 monclient: _renew_subs 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f640801b0 con 0x7f5f6408cdd0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 monclient: _renew_subs 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f64081920 con 0x7f5f6408cdd0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f580033c0 con 0x7f5f6408cdd0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5f58003570 con 0x7f5f6408cdd0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f68a64640 4 set_mon_vals no callback set 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 10 monclient: dump: 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:13.835 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6408f620 con 0x7f5f6408cdd0 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5f58011810 con 0x7f5f6408cdd0 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 4007+0+0 (unknown 3867467811 0 0) 0x7f5f5804c770 con 0x7f5f6408cdd0 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.822+0000 7f5f6a267640 10 monclient: get_auth_request con 0x7f5f3403d390 auth_method 0 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.826+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f5f6408f620 con 0x7f5f6408cdd0 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.826+0000 7f5f4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:13.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.826+0000 7f5f4affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:13.862 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5f64081da0 con 0x7f5f6408cdd0 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f4affd640 1 -- 10.20.193.78:0/329839342 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 248763592) 0x7f5f58017720 con 0x7f5f6408cdd0 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f4affd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:13.954 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:09:13.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 >> v1:10.20.193.187:6812/2668687789 conn(0x7f5f3403d390 legacy=0x7f5f3405d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 10 monclient: shutdown 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 >> v1:10.20.193.78:6790/0 conn(0x7f5f6408cdd0 legacy=0x7f5f6407edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 shutdown_connections 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 >> 10.20.193.78:0/329839342 conn(0x7f5f64091720 msgr2=0x7f5f64087250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 shutdown_connections 2026-02-13T18:09:13.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:13.946+0000 7f5f6c4f2640 1 -- 10.20.193.78:0/329839342 wait complete. 2026-02-13T18:09:16.965 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:09:17.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 10 monclient: get_monmap_and_config 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 10 monclient: build_initial_monmap 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 10 monclient: monmap: 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:17.032763+0000 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:17.032763+0000 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:17.061 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:17.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 1 Processor -- start 2026-02-13T18:09:17.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 1 -- start start 2026-02-13T18:09:17.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 10 monclient: init 2026-02-13T18:09:17.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.026+0000 7f602eacc640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:17.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient(hunting): picked mon.noname-b con 0x7f602808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient(hunting): picked mon.noname-a con 0x7f602808d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient(hunting): picked mon.noname-c con 0x7f602808d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028085ad0 con 0x7f602808d190 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028085ee0 con 0x7f602808d5d0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602808e000 con 0x7f602808cdc0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601ffff640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f602808d190 legacy=0x7f6028183cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient(hunting): authenticate will time out at 788.088108s 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602c841640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f602808cdc0 0x7f602808c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59444/0 (socket says 10.20.193.78:59444) 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602c841640 1 -- 10.20.193.78:0/1761602697 learned_addr learned my addr 10.20.193.78:0/1761602697 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602c841640 1 -- 10.20.193.78:0/1761602697 >> v1:10.20.193.78:6790/0 conn(0x7f602808cdc0 legacy=0x7f602808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602d042640 1 -- 10.20.193.78:0/1761602697 >> v1:10.20.193.187:6789/0 conn(0x7f602808d5d0 legacy=0x7f60281a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708232910 0 0) 0x7f60240041c0 con 0x7f602808d5d0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient(hunting): my global_id is 4663 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6014003620 con 0x7f602808d5d0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3132298479 0 0) 0x7f6014003620 con 0x7f602808d5d0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 >> v1:10.20.193.78:6790/0 conn(0x7f602808cdc0 legacy=0x7f602808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 >> v1:10.20.193.78:6789/0 conn(0x7f602808d190 legacy=0x7f6028183cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:09:17.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 monclient: found mon.noname-c 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6028086f80 con 0x7f602808d5d0 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: _finish_auth 0 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6024004840 con 0x7f602808d5d0 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: dump: 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 5 monclient: authenticate success, global_id 4663 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:17.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6024004c20 con 0x7f602808d5d0 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 1 -- 10.20.193.78:0/1761602697 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6024004fb0 con 0x7f602808d5d0 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f601f7fe640 10 monclient: dump: 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 4 set_mon_vals no callback set 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 10 monclient: shutdown 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- 10.20.193.78:0/1761602697 >> v1:10.20.193.187:6789/0 conn(0x7f602808d5d0 legacy=0x7f60281a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- 10.20.193.78:0/1761602697 shutdown_connections 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- 10.20.193.78:0/1761602697 >> 10.20.193.78:0/1761602697 conn(0x7f6028091720 msgr2=0x7f6028091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- 10.20.193.78:0/1761602697 shutdown_connections 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.030+0000 7f602eacc640 1 -- 10.20.193.78:0/1761602697 wait complete. 2026-02-13T18:09:17.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: build_initial_monmap 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: monmap: 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 Processor -- start 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 -- start start 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: init 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient(hunting): picked mon.noname-c con 0x7f602808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient(hunting): picked mon.noname-a con 0x7f602808d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient(hunting): picked mon.noname-b con 0x7f602808d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028083560 con 0x7f602808d190 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601ffff640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f602808d190 legacy=0x7f6028194260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028081200 con 0x7f602808d5d0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6028082cc0 con 0x7f602808cdc0 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient(hunting): authenticate will time out at 788.092892s 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602c841640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f602808cdc0 0x7f6028084a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:59450/0 (socket says 10.20.193.78:59450) 2026-02-13T18:09:17.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602c841640 1 -- 10.20.193.78:0/500325305 learned_addr learned my addr 10.20.193.78:0/500325305 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602c841640 1 -- 10.20.193.78:0/500325305 >> v1:10.20.193.78:6790/0 conn(0x7f602808cdc0 legacy=0x7f6028084a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602d042640 1 -- 10.20.193.78:0/500325305 >> v1:10.20.193.187:6789/0 conn(0x7f602808d5d0 legacy=0x7f6028195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944208847 0 0) 0x7f6028081200 con 0x7f602808d5d0 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): my global_id is 4666 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff8003620 con 0x7f602808d5d0 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3824211051 0 0) 0x7f5ff8003620 con 0x7f602808d5d0 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6028081200 con 0x7f602808d5d0 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6024004620 con 0x7f602808d5d0 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): dump: 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:17.070 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2186385349 0 0) 0x7f6028081200 con 0x7f602808d5d0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 >> v1:10.20.193.78:6790/0 conn(0x7f602808cdc0 legacy=0x7f6028084a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 >> v1:10.20.193.78:6789/0 conn(0x7f602808d190 legacy=0x7f6028194260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient: _finish_hunting 0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 monclient: found mon.b 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6028082fa0 con 0x7f602808d5d0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient: _finish_auth 0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 10 monclient: _check_auth_tickets 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f601d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 5 monclient: authenticate success, global_id 4666 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: _renew_subs 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f60280824c0 con 0x7f602808d5d0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: _renew_subs 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.034+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6028085370 con 0x7f602808d5d0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6024004c20 con 0x7f602808d5d0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6024004840 con 0x7f602808d5d0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 10 monclient: dump: 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:17.071 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601effd640 4 set_mon_vals no callback set 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f602eacc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f602eacc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f602eacc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602808f620 con 0x7f602808d5d0 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f6024005600 con 0x7f602808d5d0 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(206..206 src has 1..206) ==== 4007+0+0 (unknown 3867467811 0 0) 0x7f602404daa0 con 0x7f602808d5d0 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.038+0000 7f602c841640 10 monclient: get_auth_request con 0x7f5ff803d390 auth_method 0 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.042+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f602808f620 con 0x7f602808d5d0 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.042+0000 7f601d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:17.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.042+0000 7f601d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:17.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:09:17.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:17.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:09:17.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f60280831e0 con 0x7f602808d5d0 2026-02-13T18:09:17.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f601d7fa640 1 -- 10.20.193.78:0/500325305 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 265372893) 0x7f6028085ee0 con 0x7f602808d5d0 2026-02-13T18:09:17.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f601d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:17.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f601d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:17.166 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 >> v1:10.20.193.187:6812/2668687789 conn(0x7f5ff803d390 legacy=0x7f5ff805d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 10 monclient: shutdown 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 >> v1:10.20.193.187:6789/0 conn(0x7f602808d5d0 legacy=0x7f6028195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 shutdown_connections 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 >> 10.20.193.78:0/500325305 conn(0x7f6028091720 msgr2=0x7f602805cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 shutdown_connections 2026-02-13T18:09:17.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:17.158+0000 7f602eacc640 1 -- 10.20.193.78:0/500325305 wait complete. 2026-02-13T18:09:20.175 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient: get_monmap_and_config 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient: build_initial_monmap 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient: monmap: 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:20.238997+0000 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:20.238997+0000 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:20.240 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 1 Processor -- start 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 1 -- start start 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient: init 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient(hunting): picked mon.noname-b con 0x7f5af808e220 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:20.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient(hunting): picked mon.noname-a con 0x7f5af8057740 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient(hunting): picked mon.noname-c con 0x7f5af808ed00 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af805ea40 con 0x7f5af8057740 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af8056d40 con 0x7f5af808ed00 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af8056a60 con 0x7f5af808e220 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af7577640 10 monclient(hunting): authenticate will time out at 791.294337s 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af5d74640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af8183de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af6575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 0x7f5af808e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37848/0 (socket says 10.20.193.78:37848) 2026-02-13T18:09:20.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.234+0000 7f5af6575640 1 -- 10.20.193.78:0/560810756 learned_addr learned my addr 10.20.193.78:0/560810756 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:20.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.238+0000 7f5af6575640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5af808e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:20.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.238+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.187:6789/0 conn(0x7f5af808ed00 legacy=0x7f5af81a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:20.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.434+0000 7f5af5d74640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af8183de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:20.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:20.834+0000 7f5af5d74640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af8183de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:21.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:21.638+0000 7f5af5d74640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af8183de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:23.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): tick 2026-02-13T18:09:23.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 monclient(hunting): continuing hunt 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5af808e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.187:6789/0 conn(0x7f5af808ed00 legacy=0x7f5af81a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af8183de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): picked mon.noname-c con 0x7f5af808ed00 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): picked mon.noname-b con 0x7f5af808e220 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): picked mon.noname-a con 0x7f5af8057740 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:23.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af805e730 con 0x7f5af8057740 2026-02-13T18:09:23.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af805ea40 con 0x7f5af808ed00 2026-02-13T18:09:23.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad406a150 con 0x7f5af808e220 2026-02-13T18:09:23.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5adffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:23.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:23.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5af5d74640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5ad40450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:23.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.238+0000 7f5af6575640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.187:6789/0 conn(0x7f5af808ed00 legacy=0x7f5ad40238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:23.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.438+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:23.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:23.838+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:24.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:24.638+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): tick 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 monclient(hunting): continuing hunt 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5ad40450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.187:6789/0 conn(0x7f5af808ed00 legacy=0x7f5ad40238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): picked mon.noname-c con 0x7f5ad4069200 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): picked mon.noname-b con 0x7f5af808e220 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): picked mon.noname-a con 0x7f5af8057740 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad406b450 con 0x7f5af8057740 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af805e730 con 0x7f5ad4069200 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad4069e90 con 0x7f5af808e220 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5adffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5af5d74640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5ad40450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.238+0000 7f5af6575640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.187:6789/0 conn(0x7f5ad4069200 legacy=0x7f5ad40695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:26.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.438+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:26.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:26.842+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:27.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:27.646+0000 7f5af6d76640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:28.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901754615 0 0) 0x7f5ad4069e90 con 0x7f5af808e220 2026-02-13T18:09:28.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient(hunting): my global_id is 4640 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae4003620 con 0x7f5af808e220 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2249755463 0 0) 0x7f5ae4003620 con 0x7f5af808e220 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.187:6789/0 conn(0x7f5ad4069200 legacy=0x7f5ad40695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5ad40668a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: _finish_hunting 0 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 monclient: found mon.noname-b 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:28.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad4004930 con 0x7f5af808e220 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: _finish_auth 0 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: _check_auth_tickets 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5ae00045a0 con 0x7f5af808e220 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 5 monclient: authenticate success, global_id 4640 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: dump: 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.767 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ae00048e0 con 0x7f5af808e220 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:28.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 1 -- 10.20.193.78:0/560810756 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5ae0004c70 con 0x7f5af808e220 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5573640 10 monclient: dump: 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 4 set_mon_vals no callback set 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: shutdown 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- 10.20.193.78:0/560810756 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5ad40450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- 10.20.193.78:0/560810756 shutdown_connections 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- 10.20.193.78:0/560810756 >> 10.20.193.78:0/560810756 conn(0x7f5af80941d0 msgr2=0x7f5af8054400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- 10.20.193.78:0/560810756 shutdown_connections 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- 10.20.193.78:0/560810756 wait complete. 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: build_initial_monmap 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: monmap: 2026-02-13T18:09:28.770 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:28.771 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 Processor -- start 2026-02-13T18:09:28.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- start start 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: init 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient(hunting): picked mon.noname-b con 0x7f5ad4069200 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient(hunting): picked mon.noname-a con 0x7f5af8057740 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient(hunting): picked mon.noname-c con 0x7f5af808e220 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af813e920 con 0x7f5af8057740 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af5d74640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af821b400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af81409a0 con 0x7f5ad4069200 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af8140c80 con 0x7f5af808e220 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af7577640 10 monclient(hunting): authenticate will time out at 799.819303s 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af6d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 0x7f5af823cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37862/0 (socket says 10.20.193.78:37862) 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.758+0000 7f5af6d76640 1 -- 10.20.193.78:0/3053221264 learned_addr learned my addr 10.20.193.78:0/3053221264 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af6d76640 1 -- 10.20.193.78:0/3053221264 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5af823cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571965880 0 0) 0x7f5af8140c80 con 0x7f5af808e220 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): my global_id is 4643 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac4003620 con 0x7f5af808e220 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af6575640 1 -- 10.20.193.78:0/3053221264 >> v1:10.20.193.187:6789/0 conn(0x7f5ad4069200 legacy=0x7f5af81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1368054625 0 0) 0x7f5ac4003620 con 0x7f5af808e220 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5af8140c80 con 0x7f5af808e220 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5ae8004960 con 0x7f5af808e220 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): dump: 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.778 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361123613 0 0) 0x7f5af81409a0 con 0x7f5ad4069200 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient(hunting): my global_id is 4669 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac4003620 con 0x7f5ad4069200 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3215250186 0 0) 0x7f5af8140c80 con 0x7f5af808e220 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 >> v1:10.20.193.187:6789/0 conn(0x7f5ad4069200 legacy=0x7f5af81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 >> v1:10.20.193.78:6789/0 conn(0x7f5af8057740 legacy=0x7f5af821b400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: _finish_hunting 0 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 monclient: found mon.c 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af8089830 con 0x7f5af808e220 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: _finish_auth 0 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: _check_auth_tickets 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 5 monclient: authenticate success, global_id 4643 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 monclient: _renew_subs 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5af813f630 con 0x7f5af808e220 2026-02-13T18:09:28.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 monclient: _renew_subs 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5af81438d0 con 0x7f5af808e220 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ae80050d0 con 0x7f5af808e220 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5ae8005460 con 0x7f5af808e220 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 10 monclient: dump: 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.781 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af4d72640 4 set_mon_vals no callback set 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af80008e0 con 0x7f5af808e220 2026-02-13T18:09:28.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5ae8005600 con 0x7f5af808e220 2026-02-13T18:09:28.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 4007+0+0 (unknown 3867467811 0 0) 0x7f5ae804dc70 con 0x7f5af808e220 2026-02-13T18:09:28.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.762+0000 7f5af6575640 10 monclient: get_auth_request con 0x7f5ac403d4d0 auth_method 0 2026-02-13T18:09:28.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.766+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f5ae8018c80 con 0x7f5af808e220 2026-02-13T18:09:28.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.766+0000 7f5adeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:28.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.766+0000 7f5adeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:28.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5af7577640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:09:28.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5af7577640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:28.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5af7577640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5af8140490 con 0x7f5af808e220 2026-02-13T18:09:28.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5adeffd640 1 -- 10.20.193.78:0/3053221264 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 2831180739) 0x7f5ae8018560 con 0x7f5af808e220 2026-02-13T18:09:28.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5adeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:09:28.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.886+0000 7f5adeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:28.896 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:09:28.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 >> v1:10.20.193.187:6812/2668687789 conn(0x7f5ac403d4d0 legacy=0x7f5ac405d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 10 monclient: shutdown 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 >> v1:10.20.193.78:6790/0 conn(0x7f5af808e220 legacy=0x7f5af823cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 shutdown_connections 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 >> 10.20.193.78:0/3053221264 conn(0x7f5af80941d0 msgr2=0x7f5af80880a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 shutdown_connections 2026-02-13T18:09:28.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.890+0000 7f5af7577640 1 -- 10.20.193.78:0/3053221264 wait complete. 2026-02-13T18:09:28.906 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:09:28.906 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:09:28.906 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.966+0000 7feb7d335640 10 monclient: get_monmap_and_config 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.966+0000 7feb7d335640 10 monclient: build_initial_monmap 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.966+0000 7feb7d335640 10 monclient: monmap: 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:28.972893+0000 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:28.972893+0000 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:28.974 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.966+0000 7feb7d335640 1 Processor -- start 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.966+0000 7feb7d335640 1 -- start start 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.966+0000 7feb7d335640 10 monclient: init 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:28.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient(hunting): picked mon.noname-a con 0x7feb7808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient(hunting): picked mon.noname-c con 0x7feb7808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient(hunting): picked mon.noname-b con 0x7feb7808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb78089e80 con 0x7feb7808c2f0 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb78088c20 con 0x7feb7808dc80 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb78089ba0 con 0x7feb7808cdd0 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb76ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7feb7808c2f0 legacy=0x7feb7808c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient(hunting): authenticate will time out at 800.028361s 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb777fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7feb7808cdd0 0x7feb781a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37870/0 (socket says 10.20.193.78:37870) 2026-02-13T18:09:28.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb777fe640 1 -- 10.20.193.78:0/3174746446 learned_addr learned my addr 10.20.193.78:0/3174746446 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:28.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb777fe640 1 -- 10.20.193.78:0/3174746446 >> v1:10.20.193.78:6790/0 conn(0x7feb7808cdd0 legacy=0x7feb781a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617350666 0 0) 0x7feb78089ba0 con 0x7feb7808cdd0 2026-02-13T18:09:28.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient(hunting): my global_id is 4646 2026-02-13T18:09:28.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb64003620 con 0x7feb7808cdd0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb767fc640 1 -- 10.20.193.78:0/3174746446 >> v1:10.20.193.187:6789/0 conn(0x7feb7808dc80 legacy=0x7feb78181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2578471882 0 0) 0x7feb64003620 con 0x7feb7808cdd0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 >> v1:10.20.193.187:6789/0 conn(0x7feb7808dc80 legacy=0x7feb78181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 >> v1:10.20.193.78:6789/0 conn(0x7feb7808c2f0 legacy=0x7feb7808c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 monclient: found mon.noname-b 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7808d370 con 0x7feb7808cdd0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: _finish_auth 0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 5 monclient: authenticate success, global_id 4646 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb68004620 con 0x7feb7808cdd0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: dump: 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.979 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb680048f0 con 0x7feb7808cdd0 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 1 -- 10.20.193.78:0/3174746446 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb68006060 con 0x7feb7808cdd0 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 4 set_mon_vals no callback set 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb75ffb640 10 monclient: dump: 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 10 monclient: shutdown 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- 10.20.193.78:0/3174746446 >> v1:10.20.193.78:6790/0 conn(0x7feb7808cdd0 legacy=0x7feb781a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- 10.20.193.78:0/3174746446 shutdown_connections 2026-02-13T18:09:28.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- 10.20.193.78:0/3174746446 >> 10.20.193.78:0/3174746446 conn(0x7feb78091720 msgr2=0x7feb78091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:28.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- 10.20.193.78:0/3174746446 shutdown_connections 2026-02-13T18:09:28.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.970+0000 7feb7d335640 1 -- 10.20.193.78:0/3174746446 wait complete. 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: build_initial_monmap 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: monmap: 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 Processor -- start 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 -- start start 2026-02-13T18:09:28.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: init 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient(hunting): picked mon.noname-a con 0x7feb7808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient(hunting): picked mon.noname-b con 0x7feb7808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient(hunting): picked mon.noname-c con 0x7feb7808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb78082240 con 0x7feb7808c2f0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb78088910 con 0x7feb7808cdd0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7805d4e0 con 0x7feb7808dc80 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb76ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7feb7808c2f0 legacy=0x7feb78083770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient(hunting): authenticate will time out at 800.032626s 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb777fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7feb7808dc80 0x7feb781959c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37878/0 (socket says 10.20.193.78:37878) 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb777fe640 1 -- 10.20.193.78:0/1993142719 learned_addr learned my addr 10.20.193.78:0/1993142719 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb777fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb7808dc80 legacy=0x7feb781959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb767fc640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.187:6789/0 conn(0x7feb7808cdd0 legacy=0x7feb781942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841037933 0 0) 0x7feb7805d4e0 con 0x7feb7808dc80 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): my global_id is 4649 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb44003620 con 0x7feb7808dc80 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654442951 0 0) 0x7feb78088910 con 0x7feb7808cdd0 2026-02-13T18:09:28.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): my global_id is 4675 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb7805d4e0 con 0x7feb7808cdd0 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1496507333 0 0) 0x7feb44003620 con 0x7feb7808dc80 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb78088910 con 0x7feb7808dc80 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb68005df0 con 0x7feb7808dc80 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): dump: 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2439673945 0 0) 0x7feb7805d4e0 con 0x7feb7808cdd0 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb44003620 con 0x7feb7808cdd0 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb60003380 con 0x7feb7808cdd0 2026-02-13T18:09:28.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient(hunting): dump: 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1854132855 0 0) 0x7feb78088910 con 0x7feb7808dc80 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.187:6789/0 conn(0x7feb7808cdd0 legacy=0x7feb781942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6789/0 conn(0x7feb7808c2f0 legacy=0x7feb78083770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: _finish_hunting 0 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 monclient: found mon.c 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7807fee0 con 0x7feb7808dc80 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: _finish_auth 0 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: _check_auth_tickets 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 5 monclient: authenticate success, global_id 4649 2026-02-13T18:09:28.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: _renew_subs 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb78081f60 con 0x7feb7808dc80 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: _renew_subs 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7feb78084050 con 0x7feb7808dc80 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb68004890 con 0x7feb7808dc80 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb680067f0 con 0x7feb7808dc80 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb577fe640 10 monclient: dump: 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb757fa640 4 set_mon_vals no callback set 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.974+0000 7feb7d335640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb7808f5e0 con 0x7feb78152f40 2026-02-13T18:09:28.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7feb68012e80 con 0x7feb7808dc80 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 4007+0+0 (unknown 3867467811 0 0) 0x7feb6804db70 con 0x7feb7808dc80 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb767fc640 10 monclient: get_auth_request con 0x7feb4403d610 auth_method 0 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb76ffd640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb78152f40 legacy=0x7feb7807a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015671392 0 0) 0x7feb7808f5e0 con 0x7feb78152f40 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient(hunting): my global_id is 4652 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb78088910 con 0x7feb78152f40 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2823442746 0 0) 0x7feb78088910 con 0x7feb78152f40 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb7808f5e0 con 0x7feb78152f40 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb6c004310 con 0x7feb78152f40 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient: dump: 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.988 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1734590647 0 0) 0x7feb7808f5e0 con 0x7feb78152f40 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb78090810 con 0x7feb78152f40 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7feb6c006740 con 0x7feb78152f40 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb78152f40 legacy=0x7feb7807a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.978+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb78152f40 legacy=0x7feb7807a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.982+0000 7feb7d335640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:28.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.982+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb780819d0 con 0x7feb7807aae0 2026-02-13T18:09:28.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb76ffd640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb7807aae0 legacy=0x7feb781980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:28.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477508474 0 0) 0x7feb780819d0 con 0x7feb7807aae0 2026-02-13T18:09:28.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient(hunting): _negotiate 2026-02-13T18:09:28.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:28.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient(hunting): my global_id is 4655 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb7808f5e0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 865493809 0 0) 0x7feb7808f5e0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb780819d0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb6c004ad0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient: dump: 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 637804839 0 0) 0x7feb780819d0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb780510e0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4497 (unknown 0 0 2156999215) 0x7feb6c0069c0 con 0x7feb7807aae0 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:28.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb7807aae0 legacy=0x7feb781980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb577fe640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb7807aae0 legacy=0x7feb781980f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 18, 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 250377, 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:28.993 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:28.994 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:28.995 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:28.996 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:28.997 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:28.998 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:28.999 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.187:6812/2668687789 conn(0x7feb4403d610 legacy=0x7feb4405dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 10 monclient: shutdown 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 >> v1:10.20.193.78:6790/0 conn(0x7feb7808dc80 legacy=0x7feb781959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb777fe640 1 -- 10.20.193.78:0/1993142719 reap_dead start 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb777fe640 1 -- 10.20.193.78:0/1993142719 reap_dead start 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 shutdown_connections 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 >> 10.20.193.78:0/1993142719 conn(0x7feb78091720 msgr2=0x7feb7805da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 shutdown_connections 2026-02-13T18:09:29.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:28.986+0000 7feb7d335640 1 -- 10.20.193.78:0/1993142719 wait complete. 2026-02-13T18:09:29.001 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:09:29.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:09:29.001 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:09:29.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient: get_monmap_and_config 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient: build_initial_monmap 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient: monmap: 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:09:29.062280+0000 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:09:29.062280+0000 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:09:29.065 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 1 Processor -- start 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 1 -- start start 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient: init 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient(hunting): picked mon.noname-c con 0x7f8bec08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient(hunting): picked mon.noname-b con 0x7f8bec08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient(hunting): picked mon.noname-a con 0x7f8bec08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec089e80 con 0x7f8bec08cdd0 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec088c20 con 0x7f8bec08c2f0 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec089ba0 con 0x7f8bec08dc80 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf3e71640 10 monclient(hunting): authenticate will time out at 800.117385s 2026-02-13T18:09:29.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf23e7640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f8bec08cdd0 legacy=0x7f8bec1a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf13e5640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f8bec08dc80 0x7f8bec181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37888/0 (socket says 10.20.193.78:37888) 2026-02-13T18:09:29.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf13e5640 1 -- 10.20.193.78:0/1824776118 learned_addr learned my addr 10.20.193.78:0/1824776118 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:29.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf13e5640 1 -- 10.20.193.78:0/1824776118 >> v1:10.20.193.78:6790/0 conn(0x7f8bec08dc80 legacy=0x7f8bec181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174240149 0 0) 0x7f8bec089ba0 con 0x7f8bec08dc80 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf0be4640 10 monclient(hunting): _negotiate 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf0be4640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf0be4640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf0be4640 10 monclient(hunting): my global_id is 4658 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf1be6640 1 -- 10.20.193.78:0/1824776118 >> v1:10.20.193.187:6789/0 conn(0x7f8bec08c2f0 legacy=0x7f8bec08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.058+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd4003620 con 0x7f8bec08dc80 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3450520580 0 0) 0x7f8bd4003620 con 0x7f8bec08dc80 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 >> v1:10.20.193.187:6789/0 conn(0x7f8bec08c2f0 legacy=0x7f8bec08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 >> v1:10.20.193.78:6789/0 conn(0x7f8bec08cdd0 legacy=0x7f8bec1a3410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: _finish_hunting 0 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 monclient: found mon.noname-b 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:29.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec08d370 con 0x7f8bec08dc80 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: _finish_auth 0 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: _check_auth_tickets 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 5 monclient: authenticate success, global_id 4658 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8be0003110 con 0x7f8bec08dc80 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: dump: 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.071 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8be00033e0 con 0x7f8bec08dc80 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 1 -- 10.20.193.78:0/1824776118 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8be0004b50 con 0x7f8bec08dc80 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf0be4640 10 monclient: dump: 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.072 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: get_monmap_and_config success 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 4 set_mon_vals no callback set 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: shutdown 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- 10.20.193.78:0/1824776118 >> v1:10.20.193.78:6790/0 conn(0x7f8bec08dc80 legacy=0x7f8bec181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- 10.20.193.78:0/1824776118 shutdown_connections 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- 10.20.193.78:0/1824776118 >> 10.20.193.78:0/1824776118 conn(0x7f8bec091720 msgr2=0x7f8bec091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- 10.20.193.78:0/1824776118 shutdown_connections 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- 10.20.193.78:0/1824776118 wait complete. 2026-02-13T18:09:29.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: build_initial_monmap 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: monmap: 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 Processor -- start 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- start start 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: init 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: _reopen_session rank -1 2026-02-13T18:09:29.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient(hunting): picked mon.noname-b con 0x7f8bec08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient(hunting): picked mon.noname-a con 0x7f8bec08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient(hunting): picked mon.noname-c con 0x7f8bec08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec05de10 con 0x7f8bec08cdd0 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec088910 con 0x7f8bec08c2f0 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec1537b0 con 0x7f8bec08dc80 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient(hunting): _renew_subs 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf3e71640 10 monclient(hunting): authenticate will time out at 800.122024s 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf13e5640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f8bec08cdd0 legacy=0x7f8bec194460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf23e7640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f8bec08dc80 0x7f8bec195b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37904/0 (socket says 10.20.193.78:37904) 2026-02-13T18:09:29.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.062+0000 7f8bf23e7640 1 -- 10.20.193.78:0/2665268037 learned_addr learned my addr 10.20.193.78:0/2665268037 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:09:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf23e7640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.78:6790/0 conn(0x7f8bec08dc80 legacy=0x7f8bec195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf1be6640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec08c2f0 legacy=0x7f8bec083930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983052504 0 0) 0x7f8bec1537b0 con 0x7f8bec08dc80 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): my global_id is 4661 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bbc003620 con 0x7f8bec08dc80 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458017664 0 0) 0x7f8bec088910 con 0x7f8bec08c2f0 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): my global_id is 4681 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bec1537b0 con 0x7f8bec08c2f0 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1317836947 0 0) 0x7f8bbc003620 con 0x7f8bec08dc80 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bec088910 con 0x7f8bec08dc80 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8be8005930 con 0x7f8bec08dc80 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): dump: 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.081 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3574547746 0 0) 0x7f8bec1537b0 con 0x7f8bec08c2f0 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bbc003620 con 0x7f8bec08c2f0 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8bdc003380 con 0x7f8bec08c2f0 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient(hunting): dump: 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.082 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1239581678 0 0) 0x7f8bec088910 con 0x7f8bec08dc80 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec08c2f0 legacy=0x7f8bec083930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.78:6789/0 conn(0x7f8bec08cdd0 legacy=0x7f8bec194460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 monclient: found mon.c 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec0800a0 con 0x7f8bec08dc80 2026-02-13T18:09:29.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: _finish_auth 0 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 5 monclient: authenticate success, global_id 4661 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 10 monclient: _renew_subs 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec081b60 con 0x7f8bec08dc80 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 10 monclient: _renew_subs 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8bec084040 con 0x7f8bec08dc80 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8be8005c00 con 0x7f8bec08dc80 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8be8005f60 con 0x7f8bec08dc80 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 10 monclient: dump: 2026-02-13T18:09:29.084 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bdbfff640 4 set_mon_vals no callback set 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8bec08f600 con 0x7f8bec153100 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f8be8006230 con 0x7f8bec08dc80 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 4007+0+0 (unknown 3867467811 0 0) 0x7f8be804dae0 con 0x7f8bec08dc80 2026-02-13T18:09:29.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf13e5640 10 monclient: get_auth_request con 0x7f8bbc03d610 auth_method 0 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.066+0000 7f8bf1be6640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec153100 legacy=0x7f8bec07a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177332929 0 0) 0x7f8bec08f600 con 0x7f8bec153100 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient(hunting): my global_id is 4684 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bec088910 con 0x7f8bec153100 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2415794407 0 0) 0x7f8bec088910 con 0x7f8bec153100 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bec08f600 con 0x7f8bec153100 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8bdc003b10 con 0x7f8bec153100 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient: dump: 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.086 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2635824961 0 0) 0x7f8bec08f600 con 0x7f8bec153100 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bec1534d0 con 0x7f8bec153100 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8bdc0058c0 con 0x7f8bec153100 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec153100 legacy=0x7f8bec07a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.070+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec153100 legacy=0x7f8bec07a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bf3e71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:09:29.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8bec090810 con 0x7f8bec07aae0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bf1be6640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec07aae0 legacy=0x7f8bec1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444966847 0 0) 0x7f8bec090810 con 0x7f8bec07aae0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient(hunting): my global_id is 4687 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bec08f600 con 0x7f8bec07aae0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3708576062 0 0) 0x7f8bec08f600 con 0x7f8bec07aae0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bec090810 con 0x7f8bec07aae0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8bdc004260 con 0x7f8bec07aae0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:09:29.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient: dump: 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1215114368 0 0) 0x7f8bec090810 con 0x7f8bec07aae0 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8bec081f20 con 0x7f8bec07aae0 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4666 (unknown 0 0 1604044734) 0x7f8bdc005a70 con 0x7f8bec07aae0 2026-02-13T18:09:29.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec07aae0 legacy=0x7f8bec1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.074+0000 7f8bda7fc640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6789/0 conn(0x7f8bec07aae0 legacy=0x7f8bec1982b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 18, 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 250440, 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:09:29.091 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:29.092 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:29.093 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:09:29.094 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:09:29.095 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:09:29.096 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.097 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:29.098 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:09:29.099 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:09:29.100 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.187:6812/2668687789 conn(0x7f8bbc03d610 legacy=0x7f8bbc05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 10 monclient: shutdown 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 >> v1:10.20.193.78:6790/0 conn(0x7f8bec08dc80 legacy=0x7f8bec195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf23e7640 1 -- 10.20.193.78:0/2665268037 reap_dead start 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf23e7640 1 -- 10.20.193.78:0/2665268037 reap_dead start 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 shutdown_connections 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 >> 10.20.193.78:0/2665268037 conn(0x7f8bec091720 msgr2=0x7f8bec05b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:09:29.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 shutdown_connections 2026-02-13T18:09:29.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:09:29.078+0000 7f8bf3e71640 1 -- 10.20.193.78:0/2665268037 wait complete. 2026-02-13T18:09:29.102 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:09:29.102 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:09:29.746 INFO:tasks.rados.rados.0.trial187.stdout:907: done (8 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:908: done (7 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:909: done (6 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:910: done (5 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:911: done (4 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:912: done (3 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:913: done (2 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:914: done (1 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:915: done (0 left) 2026-02-13T18:09:29.747 INFO:tasks.rados.rados.0.trial187.stdout:916: read oid 39 snap 90 2026-02-13T18:09:29.748 INFO:tasks.rados.rados.0.trial187.stdout:916: expect deleted 2026-02-13T18:09:29.748 INFO:tasks.rados.rados.0.trial187.stdout:917: read oid 13 snap 90 2026-02-13T18:09:29.748 INFO:tasks.rados.rados.0.trial187.stdout:917: expect (ObjNum 299 snap 86 seq_num 299) 2026-02-13T18:09:29.748 INFO:tasks.rados.rados.0.trial187.stdout:918: write (excl) oid 18 current snap is 93 2026-02-13T18:09:29.748 INFO:tasks.rados.rados.0.trial187.stdout:918: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2026-02-13T18:09:29.750 INFO:tasks.rados.rados.0.trial187.stdout:918: writing trial18717860-18 from 413538 to 949883 tid 1 2026-02-13T18:09:29.753 INFO:tasks.rados.rados.0.trial187.stdout:918: writing trial18717860-18 from 1395221 to 1979002 tid 2 2026-02-13T18:09:29.758 INFO:tasks.rados.rados.0.trial187.stdout:918: writing trial18717860-18 from 2556103 to 3214720 tid 3 2026-02-13T18:09:29.759 INFO:tasks.rados.rados.0.trial187.stdout:919: read oid 32 snap -1 2026-02-13T18:09:29.759 INFO:tasks.rados.rados.0.trial187.stdout:919: expect (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:09:29.759 INFO:tasks.rados.rados.0.trial187.stdout:920: write oid 31 current snap is 93 2026-02-13T18:09:29.759 INFO:tasks.rados.rados.0.trial187.stdout:920: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2026-02-13T18:09:29.763 INFO:tasks.rados.rados.0.trial187.stdout:920: writing trial18717860-31 from 430345 to 1158292 tid 1 2026-02-13T18:09:29.767 INFO:tasks.rados.rados.0.trial187.stdout:920: writing trial18717860-31 from 1570056 to 2297495 tid 2 2026-02-13T18:09:29.771 INFO:tasks.rados.rados.0.trial187.stdout:920: writing trial18717860-31 from 2699879 to 3169768 tid 3 2026-02-13T18:09:29.771 INFO:tasks.rados.rados.0.trial187.stdout:921: read oid 47 snap -1 2026-02-13T18:09:29.771 INFO:tasks.rados.rados.0.trial187.stdout:921: expect deleted 2026-02-13T18:09:29.771 INFO:tasks.rados.rados.0.trial187.stdout:922: snap_remove snap 87 2026-02-13T18:09:30.750 INFO:tasks.rados.rados.0.trial187.stdout:922: done (6 left) 2026-02-13T18:09:30.750 INFO:tasks.rados.rados.0.trial187.stdout:923: snap_create 2026-02-13T18:09:30.750 INFO:tasks.rados.rados.0.trial187.stdout:917: expect (ObjNum 299 snap 86 seq_num 299) 2026-02-13T18:09:30.751 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:30.824 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1806400 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2990150 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:918: finishing write tid 1 to trial18717860-18 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:918: finishing write tid 2 to trial18717860-18 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:918: finishing write tid 3 to trial18717860-18 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:918: finishing write tid 4 to trial18717860-18 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:918: finishing write tid 5 to trial18717860-18 2026-02-13T18:09:30.871 INFO:tasks.rados.rados.0.trial187.stdout:918: oid 18 updating version 0 to 220 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:918: oid 18 updating version 220 to 221 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:918: oid 18 version 221 is already newer than 218 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:918: oid 18 version 221 is already newer than 219 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 221 (ObjNum 334 snap 93 seq_num 334) dirty exists 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:918: left oid 18 (ObjNum 334 snap 93 seq_num 334) 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:919: expect (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:09:30.872 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 387136 2026-02-13T18:09:30.906 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:30.930 INFO:tasks.rados.rados.0.trial187.stdout:920: finishing write tid 1 to trial18717860-31 2026-02-13T18:09:30.930 INFO:tasks.rados.rados.0.trial187.stdout:920: finishing write tid 2 to trial18717860-31 2026-02-13T18:09:30.930 INFO:tasks.rados.rados.0.trial187.stdout:920: finishing write tid 3 to trial18717860-31 2026-02-13T18:09:30.930 INFO:tasks.rados.rados.0.trial187.stdout:920: finishing write tid 4 to trial18717860-31 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:920: finishing write tid 5 to trial18717860-31 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:920: oid 31 updating version 0 to 194 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:920: oid 31 version 194 is already newer than 191 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:920: oid 31 version 194 is already newer than 192 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:920: oid 31 version 194 is already newer than 193 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 194 (ObjNum 335 snap 93 seq_num 335) dirty exists 2026-02-13T18:09:30.931 INFO:tasks.rados.rados.0.trial187.stdout:920: left oid 31 (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:916: done (6 left) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:917: done (5 left) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:918: done (4 left) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:919: done (3 left) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:920: done (2 left) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:921: done (1 left) 2026-02-13T18:09:31.751 INFO:tasks.rados.rados.0.trial187.stdout:923: done (0 left) 2026-02-13T18:09:31.752 INFO:tasks.rados.rados.0.trial187.stdout:924: delete oid 25 current snap is 94 2026-02-13T18:09:31.754 INFO:tasks.rados.rados.0.trial187.stdout:924: done (0 left) 2026-02-13T18:09:31.755 INFO:tasks.rados.rados.0.trial187.stdout:925: read oid 46 snap -1 2026-02-13T18:09:31.755 INFO:tasks.rados.rados.0.trial187.stdout:925: expect (ObjNum 286 snap 85 seq_num 286) 2026-02-13T18:09:31.755 INFO:tasks.rados.rados.0.trial187.stdout:926: write oid 40 current snap is 94 2026-02-13T18:09:31.755 INFO:tasks.rados.rados.0.trial187.stdout:926: seq_num 337 ranges {463959=478445,1570667=731108,3038372=492433} 2026-02-13T18:09:31.760 INFO:tasks.rados.rados.0.trial187.stdout:926: writing trial18717860-40 from 463959 to 942404 tid 1 2026-02-13T18:09:31.770 INFO:tasks.rados.rados.0.trial187.stdout:926: writing trial18717860-40 from 1570667 to 2301775 tid 2 2026-02-13T18:09:31.778 INFO:tasks.rados.rados.0.trial187.stdout:926: writing trial18717860-40 from 3038372 to 3530805 tid 3 2026-02-13T18:09:31.778 INFO:tasks.rados.rados.0.trial187.stdout:927: write oid 21 current snap is 94 2026-02-13T18:09:31.778 INFO:tasks.rados.rados.0.trial187.stdout:927: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2026-02-13T18:09:31.785 INFO:tasks.rados.rados.0.trial187.stdout:927: writing trial18717860-21 from 480766 to 1034460 tid 1 2026-02-13T18:09:31.793 INFO:tasks.rados.rados.0.trial187.stdout:927: writing trial18717860-21 from 1629149 to 2220268 tid 2 2026-02-13T18:09:31.800 INFO:tasks.rados.rados.0.trial187.stdout:927: writing trial18717860-21 from 2782148 to 3202206 tid 3 2026-02-13T18:09:31.800 INFO:tasks.rados.rados.0.trial187.stdout:928: read oid 39 snap -1 2026-02-13T18:09:31.800 INFO:tasks.rados.rados.0.trial187.stdout:928: expect deleted 2026-02-13T18:09:31.800 INFO:tasks.rados.rados.0.trial187.stdout:929: copy_from oid 1 from oid 12 current snap is 94 2026-02-13T18:09:31.800 INFO:tasks.rados.rados.0.trial187.stdout:925: expect (ObjNum 286 snap 85 seq_num 286) 2026-02-13T18:09:31.813 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1062585 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: finishing write tid 1 to trial18717860-40 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: finishing write tid 2 to trial18717860-40 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: finishing write tid 3 to trial18717860-40 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: finishing write tid 4 to trial18717860-40 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: finishing write tid 5 to trial18717860-40 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: oid 40 updating version 0 to 285 2026-02-13T18:09:31.950 INFO:tasks.rados.rados.0.trial187.stdout:926: oid 40 updating version 285 to 286 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:926: oid 40 version 286 is already newer than 283 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:926: oid 40 version 286 is already newer than 284 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 286 (ObjNum 337 snap 94 seq_num 337) dirty exists 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:926: left oid 40 (ObjNum 337 snap 94 seq_num 337) 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:927: finishing write tid 1 to trial18717860-21 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:927: finishing write tid 2 to trial18717860-21 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:929: finishing copy_from to trial18717860-1 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:929: got expected ENOENT (src dne) 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:929: finishing copy_from racing read to trial18717860-1 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:927: finishing write tid 3 to trial18717860-21 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:927: finishing write tid 4 to trial18717860-21 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:927: finishing write tid 5 to trial18717860-21 2026-02-13T18:09:31.951 INFO:tasks.rados.rados.0.trial187.stdout:927: oid 21 updating version 0 to 306 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:927: oid 21 updating version 306 to 307 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:927: oid 21 version 307 is already newer than 304 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:927: oid 21 version 307 is already newer than 305 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 307 (ObjNum 338 snap 94 seq_num 338) dirty exists 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:927: left oid 21 (ObjNum 338 snap 94 seq_num 338) 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:925: done (4 left) 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:926: done (3 left) 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:927: done (2 left) 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:928: done (1 left) 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:929: done (0 left) 2026-02-13T18:09:31.952 INFO:tasks.rados.rados.0.trial187.stdout:930: delete oid 41 current snap is 94 2026-02-13T18:09:31.953 INFO:tasks.rados.rados.0.trial187.stdout:930: done (0 left) 2026-02-13T18:09:31.953 INFO:tasks.rados.rados.0.trial187.stdout:931: snap_remove snap 90 2026-02-13T18:09:32.756 INFO:tasks.rados.rados.0.trial187.stdout:931: done (0 left) 2026-02-13T18:09:32.756 INFO:tasks.rados.rados.0.trial187.stdout:932: read oid 22 snap -1 2026-02-13T18:09:32.757 INFO:tasks.rados.rados.0.trial187.stdout:932: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:09:32.757 INFO:tasks.rados.rados.0.trial187.stdout:933: rollback oid 19 current snap is 94 2026-02-13T18:09:32.757 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 92 2026-02-13T18:09:32.757 INFO:tasks.rados.rados.0.trial187.stdout:934: delete oid 30 current snap is 94 2026-02-13T18:09:32.758 INFO:tasks.rados.rados.0.trial187.stdout:933: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:09:32.759 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 0 (ObjNum 321 snap 0 seq_num 1685356048) dirty dne 2026-02-13T18:09:32.760 INFO:tasks.rados.rados.0.trial187.stdout:933: done (2 left) 2026-02-13T18:09:32.761 INFO:tasks.rados.rados.0.trial187.stdout:934: done (1 left) 2026-02-13T18:09:32.761 INFO:tasks.rados.rados.0.trial187.stdout:935: copy_from oid 26 from oid 16 current snap is 94 2026-02-13T18:09:32.761 INFO:tasks.rados.rados.0.trial187.stdout:936: write oid 36 current snap is 94 2026-02-13T18:09:32.761 INFO:tasks.rados.rados.0.trial187.stdout:936: seq_num 341 ranges {531187=779441,2088242=738446,3431711=299476} 2026-02-13T18:09:32.769 INFO:tasks.rados.rados.0.trial187.stdout:936: writing trial18717860-36 from 531187 to 1310628 tid 1 2026-02-13T18:09:32.780 INFO:tasks.rados.rados.0.trial187.stdout:936: writing trial18717860-36 from 2088242 to 2826688 tid 2 2026-02-13T18:09:32.786 INFO:tasks.rados.rados.0.trial187.stdout:936: writing trial18717860-36 from 3431711 to 3731187 tid 3 2026-02-13T18:09:32.786 INFO:tasks.rados.rados.0.trial187.stdout:937: read oid 48 snap -1 2026-02-13T18:09:32.786 INFO:tasks.rados.rados.0.trial187.stdout:937: expect (ObjNum 333 snap 92 seq_num 333) 2026-02-13T18:09:32.786 INFO:tasks.rados.rados.0.trial187.stdout:938: write (excl) oid 21 current snap is 94 2026-02-13T18:09:32.787 INFO:tasks.rados.rados.0.trial187.stdout:938: seq_num 342 ranges {547994=454690,1746724=482104,2659134=465146,3605976=142018} 2026-02-13T18:09:32.793 INFO:tasks.rados.rados.0.trial187.stdout:938: writing trial18717860-21 from 547994 to 1002684 tid 1 2026-02-13T18:09:32.801 INFO:tasks.rados.rados.0.trial187.stdout:938: writing trial18717860-21 from 1746724 to 2228828 tid 2 2026-02-13T18:09:32.806 INFO:tasks.rados.rados.0.trial187.stdout:938: writing trial18717860-21 from 2659134 to 3124280 tid 3 2026-02-13T18:09:32.808 INFO:tasks.rados.rados.0.trial187.stdout:938: writing trial18717860-21 from 3605976 to 3747994 tid 4 2026-02-13T18:09:32.809 INFO:tasks.rados.rados.0.trial187.stdout:939: copy_from oid 27 from oid 12 current snap is 94 2026-02-13T18:09:32.809 INFO:tasks.rados.rados.0.trial187.stdout:932: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:09:32.809 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 170606 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:935: finishing copy_from racing read to trial18717860-26 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:935: finishing copy_from to trial18717860-26 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 266 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:936: finishing write tid 1 to trial18717860-36 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:936: finishing write tid 2 to trial18717860-36 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:936: finishing write tid 3 to trial18717860-36 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:936: finishing write tid 4 to trial18717860-36 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:936: finishing write tid 5 to trial18717860-36 2026-02-13T18:09:32.912 INFO:tasks.rados.rados.0.trial187.stdout:936: oid 36 updating version 0 to 298 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:936: oid 36 updating version 298 to 300 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:936: oid 36 version 300 is already newer than 299 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:936: oid 36 version 300 is already newer than 297 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 300 (ObjNum 341 snap 94 seq_num 341) dirty exists 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:936: left oid 36 (ObjNum 341 snap 94 seq_num 341) 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:937: expect (ObjNum 333 snap 92 seq_num 333) 2026-02-13T18:09:32.913 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:33.010 INFO:tasks.rados.rados.0.trial187.stdout:938: finishing write tid 1 to trial18717860-21 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:938: finishing write tid 2 to trial18717860-21 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:938: finishing write tid 3 to trial18717860-21 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:932: done (5 left) 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:935: done (4 left) 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:936: done (3 left) 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:937: done (2 left) 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:940: read oid 5 snap -1 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:940: expect (ObjNum 313 snap 86 seq_num 313) 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:941: rollback oid 29 current snap is 94 2026-02-13T18:09:33.011 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 92 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: finishing write tid 4 to trial18717860-21 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: finishing write tid 5 to trial18717860-21 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: finishing write tid 6 to trial18717860-21 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: oid 21 updating version 0 to 313 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: oid 21 version 313 is already newer than 311 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: oid 21 updating version 313 to 314 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: oid 21 version 314 is already newer than 310 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: oid 21 version 314 is already newer than 312 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 314 (ObjNum 342 snap 94 seq_num 342) dirty exists 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:938: left oid 21 (ObjNum 342 snap 94 seq_num 342) 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:939: finishing copy_from to trial18717860-27 2026-02-13T18:09:33.012 INFO:tasks.rados.rados.0.trial187.stdout:939: got expected ENOENT (src dne) 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:939: finishing copy_from racing read to trial18717860-27 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:938: done (3 left) 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:939: done (2 left) 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:942: read oid 22 snap 92 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:942: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:943: copy_from oid 25 from oid 39 current snap is 94 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:944: rollback oid 20 current snap is 94 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 91 2026-02-13T18:09:33.013 INFO:tasks.rados.rados.0.trial187.stdout:945: snap_remove snap 93 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:945: done (5 left) 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:946: copy_from oid 50 from oid 31 current snap is 94 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:943: finishing copy_from to trial18717860-25 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:943: got expected ENOENT (src dne) 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:941: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 0 (ObjNum 129 snap 0 seq_num 3013738584) dirty dne 2026-02-13T18:09:34.282 INFO:tasks.rados.rados.0.trial187.stdout:943: finishing copy_from racing read to trial18717860-25 2026-02-13T18:09:34.283 INFO:tasks.rados.rados.0.trial187.stdout:944: finishing rollback tid 0 to trial18717860-20 2026-02-13T18:09:34.283 INFO:tasks.rados.rados.0.trial187.stdout:940: expect (ObjNum 313 snap 86 seq_num 313) 2026-02-13T18:09:34.398 INFO:tasks.rados.rados.0.trial187.stdout:944: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:09:34.398 INFO:tasks.rados.rados.0.trial187.stdout:944: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:09:34.399 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 273 (ObjNum 317 snap 86 seq_num 317) dirty exists 2026-02-13T18:09:34.399 INFO:tasks.rados.rados.0.trial187.stdout:942: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:09:34.409 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1597380 2026-02-13T18:09:34.426 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 571524 2026-02-13T18:09:34.451 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:34.482 INFO:tasks.rados.rados.0.trial187.stdout:946: finishing copy_from racing read to trial18717860-50 2026-02-13T18:09:34.482 INFO:tasks.rados.rados.0.trial187.stdout:946: finishing copy_from to trial18717860-50 2026-02-13T18:09:34.482 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 194 (ObjNum 335 snap 93 seq_num 335) dirty exists 2026-02-13T18:09:34.482 INFO:tasks.rados.rados.0.trial187.stdout:940: done (5 left) 2026-02-13T18:09:34.482 INFO:tasks.rados.rados.0.trial187.stdout:941: done (4 left) 2026-02-13T18:09:34.483 INFO:tasks.rados.rados.0.trial187.stdout:942: done (3 left) 2026-02-13T18:09:34.483 INFO:tasks.rados.rados.0.trial187.stdout:943: done (2 left) 2026-02-13T18:09:34.483 INFO:tasks.rados.rados.0.trial187.stdout:944: done (1 left) 2026-02-13T18:09:34.483 INFO:tasks.rados.rados.0.trial187.stdout:946: done (0 left) 2026-02-13T18:09:34.483 INFO:tasks.rados.rados.0.trial187.stdout:947: write (excl) oid 36 current snap is 94 2026-02-13T18:09:34.483 INFO:tasks.rados.rados.0.trial187.stdout:947: seq_num 343 ranges {564801=646292,1921559=742115,3202910=561891} 2026-02-13T18:09:34.490 INFO:tasks.rados.rados.0.trial187.stdout:947: writing trial18717860-36 from 564801 to 1211093 tid 1 2026-02-13T18:09:34.499 INFO:tasks.rados.rados.0.trial187.stdout:947: writing trial18717860-36 from 1921559 to 2663674 tid 2 2026-02-13T18:09:34.507 INFO:tasks.rados.rados.0.trial187.stdout:947: writing trial18717860-36 from 3202910 to 3764801 tid 3 2026-02-13T18:09:34.508 INFO:tasks.rados.rados.0.trial187.stdout:948: read oid 37 snap -1 2026-02-13T18:09:34.508 INFO:tasks.rados.rados.0.trial187.stdout:948: expect deleted 2026-02-13T18:09:34.508 INFO:tasks.rados.rados.0.trial187.stdout:949: snap_remove snap 91 2026-02-13T18:09:35.288 INFO:tasks.rados.rados.0.trial187.stdout:949: done (2 left) 2026-02-13T18:09:35.288 INFO:tasks.rados.rados.0.trial187.stdout:950: read oid 19 snap -1 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:950: expect deleted 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:951: read oid 29 snap -1 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:951: expect deleted 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:952: read oid 17 snap -1 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:952: expect deleted 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:953: rollback oid 49 current snap is 94 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:947: finishing write tid 1 to trial18717860-36 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:947: finishing write tid 2 to trial18717860-36 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 92 2026-02-13T18:09:35.289 INFO:tasks.rados.rados.0.trial187.stdout:947: finishing write tid 3 to trial18717860-36 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: finishing write tid 4 to trial18717860-36 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: finishing write tid 5 to trial18717860-36 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: oid 36 updating version 0 to 304 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: oid 36 version 304 is already newer than 302 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: oid 36 version 304 is already newer than 301 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: oid 36 version 304 is already newer than 303 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 304 (ObjNum 343 snap 94 seq_num 343) dirty exists 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: left oid 36 (ObjNum 343 snap 94 seq_num 343) 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:947: done (5 left) 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:948: done (4 left) 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:954: snap_create 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:953: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:09:35.290 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:09:36.290 INFO:tasks.rados.rados.0.trial187.stdout:950: done (4 left) 2026-02-13T18:09:36.290 INFO:tasks.rados.rados.0.trial187.stdout:951: done (3 left) 2026-02-13T18:09:36.290 INFO:tasks.rados.rados.0.trial187.stdout:952: done (2 left) 2026-02-13T18:09:36.290 INFO:tasks.rados.rados.0.trial187.stdout:953: done (1 left) 2026-02-13T18:09:36.290 INFO:tasks.rados.rados.0.trial187.stdout:954: done (0 left) 2026-02-13T18:09:36.291 INFO:tasks.rados.rados.0.trial187.stdout:955: write oid 46 current snap is 95 2026-02-13T18:09:36.291 INFO:tasks.rados.rados.0.trial187.stdout:955: seq_num 344 ranges {581608=721541,1863688=485773,3113980=604043} 2026-02-13T18:09:36.298 INFO:tasks.rados.rados.0.trial187.stdout:955: writing trial18717860-46 from 581608 to 1303149 tid 1 2026-02-13T18:09:36.305 INFO:tasks.rados.rados.0.trial187.stdout:955: writing trial18717860-46 from 1863688 to 2349461 tid 2 2026-02-13T18:09:36.315 INFO:tasks.rados.rados.0.trial187.stdout:955: writing trial18717860-46 from 3113980 to 3718023 tid 3 2026-02-13T18:09:36.315 INFO:tasks.rados.rados.0.trial187.stdout:956: snap_remove snap 94 2026-02-13T18:09:37.293 INFO:tasks.rados.rados.0.trial187.stdout:956: done (1 left) 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:957: copy_from oid 36 from oid 1 current snap is 95 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: finishing write tid 1 to trial18717860-46 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: finishing write tid 2 to trial18717860-46 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: finishing write tid 3 to trial18717860-46 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: finishing write tid 4 to trial18717860-46 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: finishing write tid 5 to trial18717860-46 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: oid 46 updating version 0 to 321 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: oid 46 updating version 321 to 323 2026-02-13T18:09:37.294 INFO:tasks.rados.rados.0.trial187.stdout:955: oid 46 version 323 is already newer than 322 2026-02-13T18:09:37.295 INFO:tasks.rados.rados.0.trial187.stdout:955: oid 46 version 323 is already newer than 320 2026-02-13T18:09:37.295 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 323 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:09:37.295 INFO:tasks.rados.rados.0.trial187.stdout:955: left oid 46 (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:09:37.295 INFO:tasks.rados.rados.0.trial187.stdout:955: done (1 left) 2026-02-13T18:09:37.295 INFO:tasks.rados.rados.0.trial187.stdout:958: write oid 19 current snap is 95 2026-02-13T18:09:37.295 INFO:tasks.rados.rados.0.trial187.stdout:958: seq_num 345 ranges {598415=796790,1922170=745784,3141403=415315} 2026-02-13T18:09:37.303 INFO:tasks.rados.rados.0.trial187.stdout:958: writing trial18717860-19 from 598415 to 1395205 tid 1 2026-02-13T18:09:37.311 INFO:tasks.rados.rados.0.trial187.stdout:958: writing trial18717860-19 from 1922170 to 2667954 tid 2 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:958: writing trial18717860-19 from 3141403 to 3556718 tid 3 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:959: read oid 10 snap 92 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:959: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:960: write oid 47 current snap is 95 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:957: finishing copy_from to trial18717860-36 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:957: got expected ENOENT (src dne) 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:957: finishing copy_from racing read to trial18717860-36 2026-02-13T18:09:37.318 INFO:tasks.rados.rados.0.trial187.stdout:960: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2026-02-13T18:09:37.324 INFO:tasks.rados.rados.0.trial187.stdout:960: writing trial18717860-47 from 615222 to 1087261 tid 1 2026-02-13T18:09:37.331 INFO:tasks.rados.rados.0.trial187.stdout:960: writing trial18717860-47 from 1580652 to 2070094 tid 2 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:960: writing trial18717860-47 from 2768826 to 3395413 tid 3 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:957: done (3 left) 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:961: snap_create 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:958: finishing write tid 1 to trial18717860-19 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:958: finishing write tid 2 to trial18717860-19 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:958: finishing write tid 3 to trial18717860-19 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:958: finishing write tid 4 to trial18717860-19 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:958: finishing write tid 5 to trial18717860-19 2026-02-13T18:09:37.341 INFO:tasks.rados.rados.0.trial187.stdout:958: oid 19 updating version 0 to 266 2026-02-13T18:09:37.342 INFO:tasks.rados.rados.0.trial187.stdout:958: oid 19 updating version 266 to 269 2026-02-13T18:09:37.342 INFO:tasks.rados.rados.0.trial187.stdout:958: oid 19 version 269 is already newer than 267 2026-02-13T18:09:37.342 INFO:tasks.rados.rados.0.trial187.stdout:958: oid 19 version 269 is already newer than 268 2026-02-13T18:09:37.342 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 269 (ObjNum 345 snap 95 seq_num 345) dirty exists 2026-02-13T18:09:37.342 INFO:tasks.rados.rados.0.trial187.stdout:958: left oid 19 (ObjNum 345 snap 95 seq_num 345) 2026-02-13T18:09:37.342 INFO:tasks.rados.rados.0.trial187.stdout:959: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:09:37.356 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1366570 2026-02-13T18:09:37.388 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1701699 2026-02-13T18:09:37.411 INFO:tasks.rados.rados.0.trial187.stdout:960: finishing write tid 1 to trial18717860-47 2026-02-13T18:09:37.411 INFO:tasks.rados.rados.0.trial187.stdout:960: finishing write tid 2 to trial18717860-47 2026-02-13T18:09:37.411 INFO:tasks.rados.rados.0.trial187.stdout:960: finishing write tid 3 to trial18717860-47 2026-02-13T18:09:37.411 INFO:tasks.rados.rados.0.trial187.stdout:960: finishing write tid 4 to trial18717860-47 2026-02-13T18:09:37.411 INFO:tasks.rados.rados.0.trial187.stdout:960: finishing write tid 5 to trial18717860-47 2026-02-13T18:09:37.412 INFO:tasks.rados.rados.0.trial187.stdout:960: oid 47 updating version 0 to 277 2026-02-13T18:09:37.412 INFO:tasks.rados.rados.0.trial187.stdout:960: oid 47 version 277 is already newer than 276 2026-02-13T18:09:37.412 INFO:tasks.rados.rados.0.trial187.stdout:960: oid 47 version 277 is already newer than 275 2026-02-13T18:09:37.412 INFO:tasks.rados.rados.0.trial187.stdout:960: oid 47 version 277 is already newer than 274 2026-02-13T18:09:37.412 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 277 (ObjNum 346 snap 95 seq_num 346) dirty exists 2026-02-13T18:09:37.412 INFO:tasks.rados.rados.0.trial187.stdout:960: left oid 47 (ObjNum 346 snap 95 seq_num 346) 2026-02-13T18:09:38.296 INFO:tasks.rados.rados.0.trial187.stdout:958: done (3 left) 2026-02-13T18:09:38.297 INFO:tasks.rados.rados.0.trial187.stdout:959: done (2 left) 2026-02-13T18:09:38.297 INFO:tasks.rados.rados.0.trial187.stdout:960: done (1 left) 2026-02-13T18:09:38.297 INFO:tasks.rados.rados.0.trial187.stdout:961: done (0 left) 2026-02-13T18:09:38.297 INFO:tasks.rados.rados.0.trial187.stdout:962: write oid 8 current snap is 96 2026-02-13T18:09:38.297 INFO:tasks.rados.rados.0.trial187.stdout:962: seq_num 347 ranges {632029=547288,1639134=749453,2796249=437859,3653524=178505} 2026-02-13T18:09:38.304 INFO:tasks.rados.rados.0.trial187.stdout:962: writing trial18717860-8 from 632029 to 1179317 tid 1 2026-02-13T18:09:38.312 INFO:tasks.rados.rados.0.trial187.stdout:962: writing trial18717860-8 from 1639134 to 2388587 tid 2 2026-02-13T18:09:38.318 INFO:tasks.rados.rados.0.trial187.stdout:962: writing trial18717860-8 from 2796249 to 3234108 tid 3 2026-02-13T18:09:38.322 INFO:tasks.rados.rados.0.trial187.stdout:962: writing trial18717860-8 from 3653524 to 3832029 tid 4 2026-02-13T18:09:38.322 INFO:tasks.rados.rados.0.trial187.stdout:963: read oid 15 snap -1 2026-02-13T18:09:38.322 INFO:tasks.rados.rados.0.trial187.stdout:963: expect deleted 2026-02-13T18:09:38.322 INFO:tasks.rados.rados.0.trial187.stdout:964: read oid 43 snap -1 2026-02-13T18:09:38.322 INFO:tasks.rados.rados.0.trial187.stdout:964: expect (ObjNum 292 snap 85 seq_num 292) 2026-02-13T18:09:38.322 INFO:tasks.rados.rados.0.trial187.stdout:965: snap_remove snap 95 2026-02-13T18:09:38.708 INFO:tasks.rados.rados.0.trial187.stdout:965: done (3 left) 2026-02-13T18:09:38.709 INFO:tasks.rados.rados.0.trial187.stdout:966: write oid 20 current snap is 96 2026-02-13T18:09:38.709 INFO:tasks.rados.rados.0.trial187.stdout:966: seq_num 348 ranges {648836=622537,1981263=493111,3107319=741517} 2026-02-13T18:09:38.716 INFO:tasks.rados.rados.0.trial187.stdout:966: writing trial18717860-20 from 648836 to 1271373 tid 1 2026-02-13T18:09:38.722 INFO:tasks.rados.rados.0.trial187.stdout:966: writing trial18717860-20 from 1981263 to 2474374 tid 2 2026-02-13T18:09:38.730 INFO:tasks.rados.rados.0.trial187.stdout:966: writing trial18717860-20 from 3107319 to 3848836 tid 3 2026-02-13T18:09:38.730 INFO:tasks.rados.rados.0.trial187.stdout:967: snap_remove snap 92 2026-02-13T18:09:39.712 INFO:tasks.rados.rados.0.trial187.stdout:967: done (4 left) 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:968: read oid 12 snap -1 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:968: expect deleted 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:969: read oid 13 snap -1 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:969: expect (ObjNum 299 snap 86 seq_num 299) 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:970: read oid 30 snap -1 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:970: expect deleted 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:971: read oid 21 snap -1 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:971: expect (ObjNum 342 snap 94 seq_num 342) 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:972: read oid 14 snap -1 2026-02-13T18:09:39.713 INFO:tasks.rados.rados.0.trial187.stdout:972: expect (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:973: delete oid 29 current snap is 96 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: finishing write tid 1 to trial18717860-8 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: finishing write tid 2 to trial18717860-8 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: finishing write tid 3 to trial18717860-8 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: finishing write tid 4 to trial18717860-8 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: finishing write tid 5 to trial18717860-8 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: finishing write tid 6 to trial18717860-8 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: oid 8 updating version 0 to 412 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: oid 8 version 412 is already newer than 410 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: oid 8 updating version 412 to 413 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: oid 8 version 413 is already newer than 411 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:962: oid 8 updating version 413 to 414 2026-02-13T18:09:39.714 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 414 (ObjNum 347 snap 96 seq_num 347) dirty exists 2026-02-13T18:09:39.715 INFO:tasks.rados.rados.0.trial187.stdout:962: left oid 8 (ObjNum 347 snap 96 seq_num 347) 2026-02-13T18:09:39.715 INFO:tasks.rados.rados.0.trial187.stdout:964: expect (ObjNum 292 snap 85 seq_num 292) 2026-02-13T18:09:39.724 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1536350 2026-02-13T18:09:39.758 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:39.822 INFO:tasks.rados.rados.0.trial187.stdout:966: finishing write tid 1 to trial18717860-20 2026-02-13T18:09:39.822 INFO:tasks.rados.rados.0.trial187.stdout:966: finishing write tid 2 to trial18717860-20 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: finishing write tid 3 to trial18717860-20 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: finishing write tid 4 to trial18717860-20 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: finishing write tid 5 to trial18717860-20 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: oid 20 updating version 0 to 281 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: oid 20 version 281 is already newer than 278 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: oid 20 version 281 is already newer than 279 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: oid 20 version 281 is already newer than 280 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 281 (ObjNum 348 snap 96 seq_num 348) dirty exists 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:966: left oid 20 (ObjNum 348 snap 96 seq_num 348) 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:962: done (9 left) 2026-02-13T18:09:39.823 INFO:tasks.rados.rados.0.trial187.stdout:963: done (8 left) 2026-02-13T18:09:39.824 INFO:tasks.rados.rados.0.trial187.stdout:964: done (7 left) 2026-02-13T18:09:39.824 INFO:tasks.rados.rados.0.trial187.stdout:966: done (6 left) 2026-02-13T18:09:39.824 INFO:tasks.rados.rados.0.trial187.stdout:968: done (5 left) 2026-02-13T18:09:39.824 INFO:tasks.rados.rados.0.trial187.stdout:973: done (4 left) 2026-02-13T18:09:39.824 INFO:tasks.rados.rados.0.trial187.stdout:974: write (excl) oid 33 current snap is 96 2026-02-13T18:09:39.824 INFO:tasks.rados.rados.0.trial187.stdout:974: seq_num 350 ranges {682450=489388,1814580=496780,2878518=788028} 2026-02-13T18:09:39.829 INFO:tasks.rados.rados.0.trial187.stdout:974: writing trial18717860-33 from 682450 to 1171838 tid 1 2026-02-13T18:09:39.837 INFO:tasks.rados.rados.0.trial187.stdout:974: writing trial18717860-33 from 1814580 to 2311360 tid 2 2026-02-13T18:09:39.847 INFO:tasks.rados.rados.0.trial187.stdout:974: writing trial18717860-33 from 2878518 to 3666546 tid 3 2026-02-13T18:09:39.847 INFO:tasks.rados.rados.0.trial187.stdout:975: read oid 32 snap -1 2026-02-13T18:09:39.847 INFO:tasks.rados.rados.0.trial187.stdout:975: expect (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:09:39.848 INFO:tasks.rados.rados.0.trial187.stdout:976: snap_create 2026-02-13T18:09:39.848 INFO:tasks.rados.rados.0.trial187.stdout:972: expect (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:39.848 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:39.950 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:40.002 INFO:tasks.rados.rados.0.trial187.stdout:969: expect (ObjNum 299 snap 86 seq_num 299) 2026-02-13T18:09:40.002 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:40.083 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 354995 2026-02-13T18:09:40.122 INFO:tasks.rados.rados.0.trial187.stdout:971: expect (ObjNum 342 snap 94 seq_num 342) 2026-02-13T18:09:40.160 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1770832 2026-02-13T18:09:40.348 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3678957 2026-02-13T18:09:40.348 INFO:tasks.rados.rados.0.trial187.stdout:974: finishing write tid 1 to trial18717860-33 2026-02-13T18:09:40.348 INFO:tasks.rados.rados.0.trial187.stdout:974: finishing write tid 2 to trial18717860-33 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: finishing write tid 3 to trial18717860-33 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: finishing write tid 4 to trial18717860-33 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: finishing write tid 5 to trial18717860-33 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: oid 33 updating version 0 to 520 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: oid 33 updating version 520 to 523 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: oid 33 version 523 is already newer than 521 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: oid 33 version 523 is already newer than 522 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 523 (ObjNum 350 snap 96 seq_num 350) dirty exists 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:974: left oid 33 (ObjNum 350 snap 96 seq_num 350) 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:975: expect (ObjNum 202 snap 56 seq_num 202) 2026-02-13T18:09:40.349 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:40.373 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:40.399 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:969: done (6 left) 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:970: done (5 left) 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:971: done (4 left) 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:972: done (3 left) 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:974: done (2 left) 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:975: done (1 left) 2026-02-13T18:09:41.470 INFO:tasks.rados.rados.0.trial187.stdout:976: done (0 left) 2026-02-13T18:09:41.471 INFO:tasks.rados.rados.0.trial187.stdout:977: write (excl) oid 27 current snap is 97 2026-02-13T18:09:41.471 INFO:tasks.rados.rados.0.trial187.stdout:977: seq_num 351 ranges {699257=564637,1873062=640438,3305941=593316} 2026-02-13T18:09:41.477 INFO:tasks.rados.rados.0.trial187.stdout:977: writing trial18717860-27 from 699257 to 1263894 tid 1 2026-02-13T18:09:41.486 INFO:tasks.rados.rados.0.trial187.stdout:977: writing trial18717860-27 from 1873062 to 2513500 tid 2 2026-02-13T18:09:41.495 INFO:tasks.rados.rados.0.trial187.stdout:977: writing trial18717860-27 from 3305941 to 3899257 tid 3 2026-02-13T18:09:41.496 INFO:tasks.rados.rados.0.trial187.stdout:978: snap_create 2026-02-13T18:09:41.496 INFO:tasks.rados.rados.0.trial187.stdout:977: finishing write tid 1 to trial18717860-27 2026-02-13T18:09:41.496 INFO:tasks.rados.rados.0.trial187.stdout:977: finishing write tid 2 to trial18717860-27 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: finishing write tid 3 to trial18717860-27 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: finishing write tid 4 to trial18717860-27 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: finishing write tid 5 to trial18717860-27 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: oid 27 updating version 0 to 294 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: oid 27 updating version 294 to 295 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: oid 27 updating version 295 to 296 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:977: oid 27 version 296 is already newer than 293 2026-02-13T18:09:41.498 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 296 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:09:41.499 INFO:tasks.rados.rados.0.trial187.stdout:977: left oid 27 (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:09:42.902 INFO:tasks.rados.rados.0.trial187.stdout:977: done (1 left) 2026-02-13T18:09:42.902 INFO:tasks.rados.rados.0.trial187.stdout:978: done (0 left) 2026-02-13T18:09:42.902 INFO:tasks.rados.rados.0.trial187.stdout:979: delete oid 42 current snap is 98 2026-02-13T18:09:42.905 INFO:tasks.rados.rados.0.trial187.stdout:979: done (0 left) 2026-02-13T18:09:42.905 INFO:tasks.rados.rados.0.trial187.stdout:980: read oid 4 snap -1 2026-02-13T18:09:42.905 INFO:tasks.rados.rados.0.trial187.stdout:980: expect (ObjNum 331 snap 92 seq_num 331) 2026-02-13T18:09:42.906 INFO:tasks.rados.rados.0.trial187.stdout:981: copy_from oid 11 from oid 1 current snap is 98 2026-02-13T18:09:42.906 INFO:tasks.rados.rados.0.trial187.stdout:982: snap_create 2026-02-13T18:09:42.906 INFO:tasks.rados.rados.0.trial187.stdout:981: finishing copy_from to trial18717860-11 2026-02-13T18:09:42.906 INFO:tasks.rados.rados.0.trial187.stdout:981: got expected ENOENT (src dne) 2026-02-13T18:09:42.906 INFO:tasks.rados.rados.0.trial187.stdout:981: finishing copy_from racing read to trial18717860-11 2026-02-13T18:09:42.911 INFO:tasks.rados.rados.0.trial187.stdout:980: expect (ObjNum 331 snap 92 seq_num 331) 2026-02-13T18:09:42.929 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2060864 2026-02-13T18:09:43.710 INFO:tasks.rados.rados.0.trial187.stdout:980: done (2 left) 2026-02-13T18:09:43.710 INFO:tasks.rados.rados.0.trial187.stdout:981: done (1 left) 2026-02-13T18:09:43.711 INFO:tasks.rados.rados.0.trial187.stdout:982: done (0 left) 2026-02-13T18:09:43.711 INFO:tasks.rados.rados.0.trial187.stdout:983: read oid 40 snap -1 2026-02-13T18:09:43.711 INFO:tasks.rados.rados.0.trial187.stdout:983: expect (ObjNum 337 snap 94 seq_num 337) 2026-02-13T18:09:43.711 INFO:tasks.rados.rados.0.trial187.stdout:984: rollback oid 17 current snap is 99 2026-02-13T18:09:43.711 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 97 2026-02-13T18:09:43.711 INFO:tasks.rados.rados.0.trial187.stdout:985: delete oid 45 current snap is 99 2026-02-13T18:09:43.712 INFO:tasks.rados.rados.0.trial187.stdout:984: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:09:43.712 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 0 (ObjNum 289 snap 0 seq_num 4015531884) dirty dne 2026-02-13T18:09:43.718 INFO:tasks.rados.rados.0.trial187.stdout:983: expect (ObjNum 337 snap 94 seq_num 337) 2026-02-13T18:09:43.754 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:43.802 INFO:tasks.rados.rados.0.trial187.stdout:983: done (2 left) 2026-02-13T18:09:43.802 INFO:tasks.rados.rados.0.trial187.stdout:984: done (1 left) 2026-02-13T18:09:43.802 INFO:tasks.rados.rados.0.trial187.stdout:985: done (0 left) 2026-02-13T18:09:43.802 INFO:tasks.rados.rados.0.trial187.stdout:986: write oid 13 current snap is 99 2026-02-13T18:09:43.802 INFO:tasks.rados.rados.0.trial187.stdout:986: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2026-02-13T18:09:43.812 INFO:tasks.rados.rados.0.trial187.stdout:986: writing trial18717860-13 from 749678 to 1540062 tid 1 2026-02-13T18:09:43.821 INFO:tasks.rados.rados.0.trial187.stdout:986: writing trial18717860-13 from 2332155 to 2836273 tid 2 2026-02-13T18:09:43.827 INFO:tasks.rados.rados.0.trial187.stdout:986: writing trial18717860-13 from 3271857 to 3821326 tid 3 2026-02-13T18:09:43.828 INFO:tasks.rados.rados.0.trial187.stdout:987: read oid 14 snap -1 2026-02-13T18:09:43.828 INFO:tasks.rados.rados.0.trial187.stdout:987: expect (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:43.828 INFO:tasks.rados.rados.0.trial187.stdout:988: snap_remove snap 98 2026-02-13T18:09:44.713 INFO:tasks.rados.rados.0.trial187.stdout:988: done (2 left) 2026-02-13T18:09:44.713 INFO:tasks.rados.rados.0.trial187.stdout:989: delete oid 43 current snap is 99 2026-02-13T18:09:44.713 INFO:tasks.rados.rados.0.trial187.stdout:986: finishing write tid 1 to trial18717860-13 2026-02-13T18:09:44.713 INFO:tasks.rados.rados.0.trial187.stdout:986: finishing write tid 2 to trial18717860-13 2026-02-13T18:09:44.713 INFO:tasks.rados.rados.0.trial187.stdout:986: finishing write tid 3 to trial18717860-13 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: finishing write tid 4 to trial18717860-13 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: finishing write tid 5 to trial18717860-13 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: oid 13 updating version 0 to 233 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: oid 13 version 233 is already newer than 231 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: oid 13 updating version 233 to 234 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: oid 13 version 234 is already newer than 232 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 234 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:986: left oid 13 (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:09:44.714 INFO:tasks.rados.rados.0.trial187.stdout:987: expect (ObjNum 314 snap 86 seq_num 314) 2026-02-13T18:09:44.883 INFO:tasks.rados.rados.0.trial187.stdout:986: done (2 left) 2026-02-13T18:09:44.883 INFO:tasks.rados.rados.0.trial187.stdout:987: done (1 left) 2026-02-13T18:09:44.884 INFO:tasks.rados.rados.0.trial187.stdout:989: done (0 left) 2026-02-13T18:09:44.884 INFO:tasks.rados.rados.0.trial187.stdout:990: copy_from oid 44 from oid 27 current snap is 99 2026-02-13T18:09:44.884 INFO:tasks.rados.rados.0.trial187.stdout:991: write oid 3 current snap is 99 2026-02-13T18:09:44.884 INFO:tasks.rados.rados.0.trial187.stdout:991: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2026-02-13T18:09:44.892 INFO:tasks.rados.rados.0.trial187.stdout:991: writing trial18717860-3 from 783292 to 1324174 tid 1 2026-02-13T18:09:44.900 INFO:tasks.rados.rados.0.trial187.stdout:991: writing trial18717860-3 from 1932766 to 2440553 tid 2 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:991: writing trial18717860-3 from 3210350 to 3782363 tid 3 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:992: read oid 41 snap -1 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:992: expect deleted 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:993: delete oid 34 current snap is 99 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:991: finishing write tid 1 to trial18717860-3 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:990: finishing copy_from racing read to trial18717860-44 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:990: finishing copy_from to trial18717860-44 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 296 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:09:44.910 INFO:tasks.rados.rados.0.trial187.stdout:991: finishing write tid 2 to trial18717860-3 2026-02-13T18:09:44.912 INFO:tasks.rados.rados.0.trial187.stdout:991: finishing write tid 3 to trial18717860-3 2026-02-13T18:09:44.912 INFO:tasks.rados.rados.0.trial187.stdout:990: done (3 left) 2026-02-13T18:09:44.912 INFO:tasks.rados.rados.0.trial187.stdout:992: done (2 left) 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:993: done (1 left) 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:994: delete oid 12 current snap is 99 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: finishing write tid 4 to trial18717860-3 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: finishing write tid 5 to trial18717860-3 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: oid 3 updating version 0 to 478 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: oid 3 updating version 478 to 480 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: oid 3 version 480 is already newer than 477 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: oid 3 version 480 is already newer than 479 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 480 (ObjNum 356 snap 99 seq_num 356) dirty exists 2026-02-13T18:09:44.913 INFO:tasks.rados.rados.0.trial187.stdout:991: left oid 3 (ObjNum 356 snap 99 seq_num 356) 2026-02-13T18:09:44.914 INFO:tasks.rados.rados.0.trial187.stdout:991: done (1 left) 2026-02-13T18:09:44.914 INFO:tasks.rados.rados.0.trial187.stdout:994: done (0 left) 2026-02-13T18:09:44.914 INFO:tasks.rados.rados.0.trial187.stdout:995: rollback oid 26 current snap is 99 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 96 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:996: rollback oid 37 current snap is 99 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 96 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:997: read oid 10 snap 97 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:997: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:998: read oid 47 snap 96 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:998: expect (ObjNum 346 snap 95 seq_num 346) 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:999: snap_create 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:996: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:09:44.915 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:09:44.916 INFO:tasks.rados.rados.0.trial187.stdout:995: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:09:44.916 INFO:tasks.rados.rados.0.trial187.stdout:995: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:09:44.916 INFO:tasks.rados.rados.0.trial187.stdout:995: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:09:44.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 484 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:09:44.917 INFO:tasks.rados.rados.0.trial187.stdout:997: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:09:44.933 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:44.974 INFO:tasks.rados.rados.0.trial187.stdout:998: expect (ObjNum 346 snap 95 seq_num 346) 2026-02-13T18:09:45.002 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:45.030 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:995: done (4 left) 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:996: done (3 left) 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:997: done (2 left) 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:998: done (1 left) 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:999: done (0 left) 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:1000: rollback oid 49 current snap is 100 2026-02-13T18:09:45.909 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 97 2026-02-13T18:09:45.910 INFO:tasks.rados.rados.0.trial187.stdout:1001: write (excl) oid 37 current snap is 100 2026-02-13T18:09:45.910 INFO:tasks.rados.rados.0.trial187.stdout:1001: seq_num 359 ranges {433713=482982,1424565=609148} 2026-02-13T18:09:45.914 INFO:tasks.rados.rados.0.trial187.stdout:1001: writing trial18717860-37 from 433713 to 916695 tid 1 2026-02-13T18:09:45.922 INFO:tasks.rados.rados.0.trial187.stdout:1001: writing trial18717860-37 from 1424565 to 2033713 tid 2 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1002: read oid 27 snap 99 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1002: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1003: read oid 44 snap 99 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1003: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1004: snap_create 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1000: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 0 (ObjNum 97 snap 0 seq_num 4016583522) dirty dne 2026-02-13T18:09:45.923 INFO:tasks.rados.rados.0.trial187.stdout:1001: finishing write tid 1 to trial18717860-37 2026-02-13T18:09:45.932 INFO:tasks.rados.rados.0.trial187.stdout:1002: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:09:45.932 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:46.059 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:46.120 INFO:tasks.rados.rados.0.trial187.stdout:1001: finishing write tid 2 to trial18717860-37 2026-02-13T18:09:46.121 INFO:tasks.rados.rados.0.trial187.stdout:1003: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:09:46.121 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:46.286 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3239660 2026-02-13T18:09:46.295 INFO:tasks.rados.rados.0.trial187.stdout:1001: finishing write tid 3 to trial18717860-37 2026-02-13T18:09:46.295 INFO:tasks.rados.rados.0.trial187.stdout:1001: finishing write tid 4 to trial18717860-37 2026-02-13T18:09:46.295 INFO:tasks.rados.rados.0.trial187.stdout:1001: oid 37 updating version 0 to 530 2026-02-13T18:09:46.296 INFO:tasks.rados.rados.0.trial187.stdout:1001: oid 37 version 530 is already newer than 528 2026-02-13T18:09:46.296 INFO:tasks.rados.rados.0.trial187.stdout:1001: oid 37 version 530 is already newer than 529 2026-02-13T18:09:46.296 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 530 (ObjNum 359 snap 100 seq_num 359) dirty exists 2026-02-13T18:09:46.296 INFO:tasks.rados.rados.0.trial187.stdout:1001: left oid 37 (ObjNum 359 snap 100 seq_num 359) 2026-02-13T18:09:46.910 INFO:tasks.rados.rados.0.trial187.stdout:1000: done (4 left) 2026-02-13T18:09:46.910 INFO:tasks.rados.rados.0.trial187.stdout:1001: done (3 left) 2026-02-13T18:09:46.910 INFO:tasks.rados.rados.0.trial187.stdout:1002: done (2 left) 2026-02-13T18:09:46.910 INFO:tasks.rados.rados.0.trial187.stdout:1003: done (1 left) 2026-02-13T18:09:46.910 INFO:tasks.rados.rados.0.trial187.stdout:1004: done (0 left) 2026-02-13T18:09:46.911 INFO:tasks.rados.rados.0.trial187.stdout:1005: rollback oid 45 current snap is 101 2026-02-13T18:09:46.911 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 100 2026-02-13T18:09:46.911 INFO:tasks.rados.rados.0.trial187.stdout:1006: write (excl) oid 48 current snap is 101 2026-02-13T18:09:46.911 INFO:tasks.rados.rados.0.trial187.stdout:1006: seq_num 360 ranges {450520=558231,1483047=515125} 2026-02-13T18:09:46.916 INFO:tasks.rados.rados.0.trial187.stdout:1006: writing trial18717860-48 from 450520 to 1008751 tid 1 2026-02-13T18:09:46.923 INFO:tasks.rados.rados.0.trial187.stdout:1006: writing trial18717860-48 from 1483047 to 1998172 tid 2 2026-02-13T18:09:46.923 INFO:tasks.rados.rados.0.trial187.stdout:1007: snap_create 2026-02-13T18:09:46.923 INFO:tasks.rados.rados.0.trial187.stdout:1005: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:09:46.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:09:46.923 INFO:tasks.rados.rados.0.trial187.stdout:1006: finishing write tid 1 to trial18717860-48 2026-02-13T18:09:46.925 INFO:tasks.rados.rados.0.trial187.stdout:1006: finishing write tid 2 to trial18717860-48 2026-02-13T18:09:46.925 INFO:tasks.rados.rados.0.trial187.stdout:1006: finishing write tid 3 to trial18717860-48 2026-02-13T18:09:46.925 INFO:tasks.rados.rados.0.trial187.stdout:1006: finishing write tid 4 to trial18717860-48 2026-02-13T18:09:46.925 INFO:tasks.rados.rados.0.trial187.stdout:1006: oid 48 updating version 0 to 533 2026-02-13T18:09:46.925 INFO:tasks.rados.rados.0.trial187.stdout:1006: oid 48 version 533 is already newer than 532 2026-02-13T18:09:46.926 INFO:tasks.rados.rados.0.trial187.stdout:1006: oid 48 updating version 533 to 534 2026-02-13T18:09:46.926 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 534 (ObjNum 360 snap 101 seq_num 360) dirty exists 2026-02-13T18:09:46.926 INFO:tasks.rados.rados.0.trial187.stdout:1006: left oid 48 (ObjNum 360 snap 101 seq_num 360) 2026-02-13T18:09:47.915 INFO:tasks.rados.rados.0.trial187.stdout:1005: done (2 left) 2026-02-13T18:09:47.915 INFO:tasks.rados.rados.0.trial187.stdout:1006: done (1 left) 2026-02-13T18:09:47.916 INFO:tasks.rados.rados.0.trial187.stdout:1007: done (0 left) 2026-02-13T18:09:47.916 INFO:tasks.rados.rados.0.trial187.stdout:1008: write (excl) oid 49 current snap is 102 2026-02-13T18:09:47.916 INFO:tasks.rados.rados.0.trial187.stdout:1008: seq_num 361 ranges {467327=633480,1825176=242151} 2026-02-13T18:09:47.922 INFO:tasks.rados.rados.0.trial187.stdout:1008: writing trial18717860-49 from 467327 to 1100807 tid 1 2026-02-13T18:09:47.929 INFO:tasks.rados.rados.0.trial187.stdout:1008: writing trial18717860-49 from 1825176 to 2067327 tid 2 2026-02-13T18:09:47.929 INFO:tasks.rados.rados.0.trial187.stdout:1009: write oid 9 current snap is 102 2026-02-13T18:09:47.929 INFO:tasks.rados.rados.0.trial187.stdout:1008: finishing write tid 1 to trial18717860-49 2026-02-13T18:09:47.929 INFO:tasks.rados.rados.0.trial187.stdout:1009: seq_num 362 ranges {484134=708729,1883658=200476} 2026-02-13T18:09:47.937 INFO:tasks.rados.rados.0.trial187.stdout:1009: writing trial18717860-9 from 484134 to 1192863 tid 1 2026-02-13T18:09:47.943 INFO:tasks.rados.rados.0.trial187.stdout:1009: writing trial18717860-9 from 1883658 to 2084134 tid 2 2026-02-13T18:09:47.943 INFO:tasks.rados.rados.0.trial187.stdout:1010: read oid 50 snap -1 2026-02-13T18:09:47.943 INFO:tasks.rados.rados.0.trial187.stdout:1010: expect (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:09:47.943 INFO:tasks.rados.rados.0.trial187.stdout:1011: snap_create 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: finishing write tid 2 to trial18717860-49 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: finishing write tid 3 to trial18717860-49 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: finishing write tid 4 to trial18717860-49 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: oid 49 updating version 0 to 229 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: oid 49 version 229 is already newer than 228 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: oid 49 updating version 229 to 230 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 230 (ObjNum 361 snap 102 seq_num 361) dirty exists 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1008: left oid 49 (ObjNum 361 snap 102 seq_num 361) 2026-02-13T18:09:47.944 INFO:tasks.rados.rados.0.trial187.stdout:1009: finishing write tid 1 to trial18717860-9 2026-02-13T18:09:47.945 INFO:tasks.rados.rados.0.trial187.stdout:1009: finishing write tid 2 to trial18717860-9 2026-02-13T18:09:47.945 INFO:tasks.rados.rados.0.trial187.stdout:1009: finishing write tid 3 to trial18717860-9 2026-02-13T18:09:47.945 INFO:tasks.rados.rados.0.trial187.stdout:1009: finishing write tid 4 to trial18717860-9 2026-02-13T18:09:47.945 INFO:tasks.rados.rados.0.trial187.stdout:1009: oid 9 updating version 0 to 485 2026-02-13T18:09:47.945 INFO:tasks.rados.rados.0.trial187.stdout:1009: oid 9 updating version 485 to 486 2026-02-13T18:09:47.946 INFO:tasks.rados.rados.0.trial187.stdout:1009: oid 9 updating version 486 to 487 2026-02-13T18:09:47.946 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 487 (ObjNum 362 snap 102 seq_num 362) dirty exists 2026-02-13T18:09:47.946 INFO:tasks.rados.rados.0.trial187.stdout:1009: left oid 9 (ObjNum 362 snap 102 seq_num 362) 2026-02-13T18:09:47.946 INFO:tasks.rados.rados.0.trial187.stdout:1010: expect (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:09:48.015 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2938157 2026-02-13T18:09:48.711 INFO:tasks.rados.rados.0.trial187.stdout:1008: done (3 left) 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1009: done (2 left) 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1010: done (1 left) 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1011: done (0 left) 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1012: read oid 34 snap -1 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1012: expect deleted 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1013: rollback oid 21 current snap is 103 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 99 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1014: read oid 10 snap -1 2026-02-13T18:09:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1014: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:09:48.713 INFO:tasks.rados.rados.0.trial187.stdout:1015: copy_from oid 25 from oid 20 current snap is 103 2026-02-13T18:09:48.713 INFO:tasks.rados.rados.0.trial187.stdout:1016: snap_create 2026-02-13T18:09:48.719 INFO:tasks.rados.rados.0.trial187.stdout:1013: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:09:48.719 INFO:tasks.rados.rados.0.trial187.stdout:1013: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:09:48.719 INFO:tasks.rados.rados.0.trial187.stdout:1013: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:09:48.719 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 333 (ObjNum 342 snap 94 seq_num 342) dirty exists 2026-02-13T18:09:48.720 INFO:tasks.rados.rados.0.trial187.stdout:1014: expect (ObjNum 242 snap 72 seq_num 242) 2026-02-13T18:09:48.720 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:48.768 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1059144 2026-02-13T18:09:48.780 INFO:tasks.rados.rados.0.trial187.stdout:1015: finishing copy_from racing read to trial18717860-25 2026-02-13T18:09:48.780 INFO:tasks.rados.rados.0.trial187.stdout:1015: finishing copy_from to trial18717860-25 2026-02-13T18:09:48.780 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 281 (ObjNum 348 snap 96 seq_num 348) dirty exists 2026-02-13T18:09:49.711 INFO:tasks.rados.rados.0.trial187.stdout:1012: done (4 left) 2026-02-13T18:09:49.711 INFO:tasks.rados.rados.0.trial187.stdout:1013: done (3 left) 2026-02-13T18:09:49.712 INFO:tasks.rados.rados.0.trial187.stdout:1014: done (2 left) 2026-02-13T18:09:49.712 INFO:tasks.rados.rados.0.trial187.stdout:1015: done (1 left) 2026-02-13T18:09:49.712 INFO:tasks.rados.rados.0.trial187.stdout:1016: done (0 left) 2026-02-13T18:09:49.712 INFO:tasks.rados.rados.0.trial187.stdout:1017: delete oid 20 current snap is 104 2026-02-13T18:09:49.716 INFO:tasks.rados.rados.0.trial187.stdout:1017: done (0 left) 2026-02-13T18:09:49.716 INFO:tasks.rados.rados.0.trial187.stdout:1018: write oid 2 current snap is 104 2026-02-13T18:09:49.717 INFO:tasks.rados.rados.0.trial187.stdout:1018: seq_num 364 ranges {517748=459227,1600622=406110} 2026-02-13T18:09:49.723 INFO:tasks.rados.rados.0.trial187.stdout:1018: writing trial18717860-2 from 517748 to 976975 tid 1 2026-02-13T18:09:49.730 INFO:tasks.rados.rados.0.trial187.stdout:1018: writing trial18717860-2 from 1600622 to 2006732 tid 2 2026-02-13T18:09:49.730 INFO:tasks.rados.rados.0.trial187.stdout:1019: delete oid 1 current snap is 104 2026-02-13T18:09:49.730 INFO:tasks.rados.rados.0.trial187.stdout:1018: finishing write tid 1 to trial18717860-2 2026-02-13T18:09:49.731 INFO:tasks.rados.rados.0.trial187.stdout:1019: done (1 left) 2026-02-13T18:09:49.731 INFO:tasks.rados.rados.0.trial187.stdout:1020: write (excl) oid 18 current snap is 104 2026-02-13T18:09:49.731 INFO:tasks.rados.rados.0.trial187.stdout:1020: seq_num 366 ranges {551362=726078,1717586=409779} 2026-02-13T18:09:49.740 INFO:tasks.rados.rados.0.trial187.stdout:1020: writing trial18717860-18 from 551362 to 1277440 tid 1 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1020: writing trial18717860-18 from 1717586 to 2127365 tid 2 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1021: snap_create 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: finishing write tid 2 to trial18717860-2 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: finishing write tid 3 to trial18717860-2 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: finishing write tid 4 to trial18717860-2 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: oid 2 updating version 0 to 240 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: oid 2 version 240 is already newer than 238 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: oid 2 version 240 is already newer than 239 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 240 (ObjNum 364 snap 104 seq_num 364) dirty exists 2026-02-13T18:09:49.746 INFO:tasks.rados.rados.0.trial187.stdout:1018: left oid 2 (ObjNum 364 snap 104 seq_num 364) 2026-02-13T18:09:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1020: finishing write tid 1 to trial18717860-18 2026-02-13T18:09:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1020: finishing write tid 2 to trial18717860-18 2026-02-13T18:09:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1020: finishing write tid 3 to trial18717860-18 2026-02-13T18:09:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1020: finishing write tid 4 to trial18717860-18 2026-02-13T18:09:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1020: oid 18 updating version 0 to 243 2026-02-13T18:09:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1020: oid 18 version 243 is already newer than 242 2026-02-13T18:09:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1020: oid 18 updating version 243 to 244 2026-02-13T18:09:49.749 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 244 (ObjNum 366 snap 104 seq_num 366) dirty exists 2026-02-13T18:09:49.749 INFO:tasks.rados.rados.0.trial187.stdout:1020: left oid 18 (ObjNum 366 snap 104 seq_num 366) 2026-02-13T18:09:50.715 INFO:tasks.rados.rados.0.trial187.stdout:1018: done (2 left) 2026-02-13T18:09:50.715 INFO:tasks.rados.rados.0.trial187.stdout:1020: done (1 left) 2026-02-13T18:09:50.716 INFO:tasks.rados.rados.0.trial187.stdout:1021: done (0 left) 2026-02-13T18:09:50.716 INFO:tasks.rados.rados.0.trial187.stdout:1022: read oid 17 snap -1 2026-02-13T18:09:50.716 INFO:tasks.rados.rados.0.trial187.stdout:1022: expect deleted 2026-02-13T18:09:50.716 INFO:tasks.rados.rados.0.trial187.stdout:1023: delete oid 48 current snap is 105 2026-02-13T18:09:50.717 INFO:tasks.rados.rados.0.trial187.stdout:1022: done (1 left) 2026-02-13T18:09:50.717 INFO:tasks.rados.rados.0.trial187.stdout:1023: done (0 left) 2026-02-13T18:09:50.717 INFO:tasks.rados.rados.0.trial187.stdout:1024: delete oid 26 current snap is 105 2026-02-13T18:09:50.719 INFO:tasks.rados.rados.0.trial187.stdout:1024: done (0 left) 2026-02-13T18:09:50.719 INFO:tasks.rados.rados.0.trial187.stdout:1025: copy_from oid 21 from oid 32 current snap is 105 2026-02-13T18:09:50.719 INFO:tasks.rados.rados.0.trial187.stdout:1026: snap_create 2026-02-13T18:09:50.730 INFO:tasks.rados.rados.0.trial187.stdout:1025: finishing copy_from racing read to trial18717860-21 2026-02-13T18:09:50.730 INFO:tasks.rados.rados.0.trial187.stdout:1025: finishing copy_from to trial18717860-21 2026-02-13T18:09:50.730 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 202 (ObjNum 202 snap 56 seq_num 202) dirty exists 2026-02-13T18:09:51.715 INFO:tasks.rados.rados.0.trial187.stdout:1025: done (1 left) 2026-02-13T18:09:51.716 INFO:tasks.rados.rados.0.trial187.stdout:1026: done (0 left) 2026-02-13T18:09:51.716 INFO:tasks.rados.rados.0.trial187.stdout:1027: delete oid 48 current snap is 106 2026-02-13T18:09:51.719 INFO:tasks.rados.rados.0.trial187.stdout:1027: done (0 left) 2026-02-13T18:09:51.719 INFO:tasks.rados.rados.0.trial187.stdout:1028: delete oid 32 current snap is 106 2026-02-13T18:09:51.721 INFO:tasks.rados.rados.0.trial187.stdout:1028: done (0 left) 2026-02-13T18:09:51.721 INFO:tasks.rados.rados.0.trial187.stdout:1029: read oid 21 snap 101 2026-02-13T18:09:51.722 INFO:tasks.rados.rados.0.trial187.stdout:1029: expect (ObjNum 342 snap 94 seq_num 342) 2026-02-13T18:09:51.722 INFO:tasks.rados.rados.0.trial187.stdout:1030: copy_from oid 18 from oid 44 current snap is 106 2026-02-13T18:09:51.722 INFO:tasks.rados.rados.0.trial187.stdout:1031: read oid 11 snap -1 2026-02-13T18:09:51.722 INFO:tasks.rados.rados.0.trial187.stdout:1031: expect deleted 2026-02-13T18:09:51.722 INFO:tasks.rados.rados.0.trial187.stdout:1032: snap_remove snap 97 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:1032: done (3 left) 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:1033: read oid 25 snap -1 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:1033: expect (ObjNum 348 snap 96 seq_num 348) 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:1034: rollback oid 38 current snap is 106 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 100 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:1029: expect (ObjNum 342 snap 94 seq_num 342) 2026-02-13T18:09:52.722 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:52.824 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:52.941 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1819248 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:1030: finishing copy_from racing read to trial18717860-18 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:1030: finishing copy_from to trial18717860-18 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 296 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:1034: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:1034: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:1034: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 196 (ObjNum 329 snap 92 seq_num 329) dirty exists 2026-02-13T18:09:52.979 INFO:tasks.rados.rados.0.trial187.stdout:1033: expect (ObjNum 348 snap 96 seq_num 348) 2026-02-13T18:09:53.102 INFO:tasks.rados.rados.0.trial187.stdout:1029: done (4 left) 2026-02-13T18:09:53.102 INFO:tasks.rados.rados.0.trial187.stdout:1030: done (3 left) 2026-02-13T18:09:53.102 INFO:tasks.rados.rados.0.trial187.stdout:1031: done (2 left) 2026-02-13T18:09:53.102 INFO:tasks.rados.rados.0.trial187.stdout:1033: done (1 left) 2026-02-13T18:09:53.102 INFO:tasks.rados.rados.0.trial187.stdout:1034: done (0 left) 2026-02-13T18:09:53.102 INFO:tasks.rados.rados.0.trial187.stdout:1035: delete oid 5 current snap is 106 2026-02-13T18:09:53.104 INFO:tasks.rados.rados.0.trial187.stdout:1035: done (0 left) 2026-02-13T18:09:53.104 INFO:tasks.rados.rados.0.trial187.stdout:1036: snap_remove snap 104 2026-02-13T18:09:53.723 INFO:tasks.rados.rados.0.trial187.stdout:1036: done (0 left) 2026-02-13T18:09:53.723 INFO:tasks.rados.rados.0.trial187.stdout:1037: rollback oid 39 current snap is 106 2026-02-13T18:09:53.723 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 103 2026-02-13T18:09:53.724 INFO:tasks.rados.rados.0.trial187.stdout:1038: write (excl) oid 50 current snap is 106 2026-02-13T18:09:53.724 INFO:tasks.rados.rados.0.trial187.stdout:1038: seq_num 372 ranges {652204=777572,1952125=300079} 2026-02-13T18:09:53.733 INFO:tasks.rados.rados.0.trial187.stdout:1038: writing trial18717860-50 from 652204 to 1429776 tid 1 2026-02-13T18:09:53.738 INFO:tasks.rados.rados.0.trial187.stdout:1038: writing trial18717860-50 from 1952125 to 2252204 tid 2 2026-02-13T18:09:53.738 INFO:tasks.rados.rados.0.trial187.stdout:1039: write (excl) oid 15 current snap is 106 2026-02-13T18:09:53.738 INFO:tasks.rados.rados.0.trial187.stdout:1039: seq_num 373 ranges {669011=569174,2010607=258404} 2026-02-13T18:09:53.747 INFO:tasks.rados.rados.0.trial187.stdout:1039: writing trial18717860-15 from 669011 to 1238185 tid 1 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1039: writing trial18717860-15 from 2010607 to 2269011 tid 2 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1040: write (excl) oid 6 current snap is 106 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1037: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 0 (ObjNum 209 snap 0 seq_num 3013843024) dirty dne 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: finishing write tid 1 to trial18717860-50 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: finishing write tid 2 to trial18717860-50 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: finishing write tid 3 to trial18717860-50 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: finishing write tid 4 to trial18717860-50 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: oid 50 updating version 0 to 262 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: oid 50 updating version 262 to 263 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: oid 50 version 263 is already newer than 261 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 263 (ObjNum 372 snap 106 seq_num 372) dirty exists 2026-02-13T18:09:53.754 INFO:tasks.rados.rados.0.trial187.stdout:1038: left oid 50 (ObjNum 372 snap 106 seq_num 372) 2026-02-13T18:09:53.755 INFO:tasks.rados.rados.0.trial187.stdout:1039: finishing write tid 1 to trial18717860-15 2026-02-13T18:09:53.755 INFO:tasks.rados.rados.0.trial187.stdout:1040: seq_num 374 ranges {685818=644423,2069089=216729} 2026-02-13T18:09:53.763 INFO:tasks.rados.rados.0.trial187.stdout:1040: writing trial18717860-6 from 685818 to 1330241 tid 1 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1040: writing trial18717860-6 from 2069089 to 2285818 tid 2 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1037: done (3 left) 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1038: done (2 left) 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1041: delete oid 10 current snap is 106 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: finishing write tid 2 to trial18717860-15 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: finishing write tid 3 to trial18717860-15 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: finishing write tid 4 to trial18717860-15 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: oid 15 updating version 0 to 272 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: oid 15 updating version 272 to 273 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: oid 15 updating version 273 to 274 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 274 (ObjNum 373 snap 106 seq_num 373) dirty exists 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1039: left oid 15 (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:09:53.770 INFO:tasks.rados.rados.0.trial187.stdout:1040: finishing write tid 1 to trial18717860-6 2026-02-13T18:09:53.771 INFO:tasks.rados.rados.0.trial187.stdout:1040: finishing write tid 2 to trial18717860-6 2026-02-13T18:09:53.771 INFO:tasks.rados.rados.0.trial187.stdout:1040: finishing write tid 3 to trial18717860-6 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1040: finishing write tid 4 to trial18717860-6 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1040: oid 6 updating version 0 to 401 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1040: oid 6 updating version 401 to 402 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1040: oid 6 updating version 402 to 403 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 403 (ObjNum 374 snap 106 seq_num 374) dirty exists 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1040: left oid 6 (ObjNum 374 snap 106 seq_num 374) 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1039: done (2 left) 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1040: done (1 left) 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1041: done (0 left) 2026-02-13T18:09:53.772 INFO:tasks.rados.rados.0.trial187.stdout:1042: delete oid 49 current snap is 106 2026-02-13T18:09:53.774 INFO:tasks.rados.rados.0.trial187.stdout:1042: done (0 left) 2026-02-13T18:09:53.774 INFO:tasks.rados.rados.0.trial187.stdout:1043: rollback oid 37 current snap is 106 2026-02-13T18:09:53.774 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 96 2026-02-13T18:09:53.774 INFO:tasks.rados.rados.0.trial187.stdout:1044: snap_create 2026-02-13T18:09:53.775 INFO:tasks.rados.rados.0.trial187.stdout:1043: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:09:53.775 INFO:tasks.rados.rados.0.trial187.stdout:1043: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:09:53.776 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 548 (ObjNum 193 snap 0 seq_num 3013671664) dirty dne 2026-02-13T18:09:54.731 INFO:tasks.rados.rados.0.trial187.stdout:1043: done (1 left) 2026-02-13T18:09:54.731 INFO:tasks.rados.rados.0.trial187.stdout:1044: done (0 left) 2026-02-13T18:09:54.731 INFO:tasks.rados.rados.0.trial187.stdout:1045: delete oid 9 current snap is 107 2026-02-13T18:09:54.732 INFO:tasks.rados.rados.0.trial187.stdout:1045: done (0 left) 2026-02-13T18:09:54.732 INFO:tasks.rados.rados.0.trial187.stdout:1046: delete oid 24 current snap is 107 2026-02-13T18:09:54.734 INFO:tasks.rados.rados.0.trial187.stdout:1046: done (0 left) 2026-02-13T18:09:54.734 INFO:tasks.rados.rados.0.trial187.stdout:1047: read oid 39 snap -1 2026-02-13T18:09:54.734 INFO:tasks.rados.rados.0.trial187.stdout:1047: expect deleted 2026-02-13T18:09:54.734 INFO:tasks.rados.rados.0.trial187.stdout:1048: snap_create 2026-02-13T18:09:55.732 INFO:tasks.rados.rados.0.trial187.stdout:1047: done (1 left) 2026-02-13T18:09:55.732 INFO:tasks.rados.rados.0.trial187.stdout:1048: done (0 left) 2026-02-13T18:09:55.732 INFO:tasks.rados.rados.0.trial187.stdout:1049: snap_remove snap 106 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1049: done (0 left) 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1050: copy_from oid 20 from oid 49 current snap is 108 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1051: read oid 7 snap -1 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1051: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1052: rollback oid 10 current snap is 108 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 10 to 101 2026-02-13T18:09:56.734 INFO:tasks.rados.rados.0.trial187.stdout:1053: snap_create 2026-02-13T18:09:56.741 INFO:tasks.rados.rados.0.trial187.stdout:1050: finishing copy_from to trial18717860-20 2026-02-13T18:09:56.741 INFO:tasks.rados.rados.0.trial187.stdout:1050: got expected ENOENT (src dne) 2026-02-13T18:09:56.741 INFO:tasks.rados.rados.0.trial187.stdout:1050: finishing copy_from racing read to trial18717860-20 2026-02-13T18:09:56.742 INFO:tasks.rados.rados.0.trial187.stdout:1051: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:09:56.838 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:09:56.877 INFO:tasks.rados.rados.0.trial187.stdout:1052: finishing rollback tid 1 to trial18717860-10 2026-02-13T18:09:56.877 INFO:tasks.rados.rados.0.trial187.stdout:1052: finishing rollback tid 2 to trial18717860-10 2026-02-13T18:09:56.877 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 210 (ObjNum 242 snap 72 seq_num 242) dirty exists 2026-02-13T18:09:57.734 INFO:tasks.rados.rados.0.trial187.stdout:1050: done (3 left) 2026-02-13T18:09:57.734 INFO:tasks.rados.rados.0.trial187.stdout:1051: done (2 left) 2026-02-13T18:09:57.734 INFO:tasks.rados.rados.0.trial187.stdout:1052: done (1 left) 2026-02-13T18:09:57.734 INFO:tasks.rados.rados.0.trial187.stdout:1053: done (0 left) 2026-02-13T18:09:57.734 INFO:tasks.rados.rados.0.trial187.stdout:1054: write (excl) oid 29 current snap is 109 2026-02-13T18:09:57.734 INFO:tasks.rados.rados.0.trial187.stdout:1054: seq_num 379 ranges {769853=620668,1845146=524707} 2026-02-13T18:09:57.744 INFO:tasks.rados.rados.0.trial187.stdout:1054: writing trial18717860-29 from 769853 to 1390521 tid 1 2026-02-13T18:09:57.750 INFO:tasks.rados.rados.0.trial187.stdout:1054: writing trial18717860-29 from 1845146 to 2369853 tid 2 2026-02-13T18:09:57.750 INFO:tasks.rados.rados.0.trial187.stdout:1055: read oid 35 snap 108 2026-02-13T18:09:57.751 INFO:tasks.rados.rados.0.trial187.stdout:1055: expect (ObjNum 330 snap 92 seq_num 330) 2026-02-13T18:09:57.751 INFO:tasks.rados.rados.0.trial187.stdout:1056: delete oid 40 current snap is 109 2026-02-13T18:09:57.751 INFO:tasks.rados.rados.0.trial187.stdout:1054: finishing write tid 1 to trial18717860-29 2026-02-13T18:09:57.754 INFO:tasks.rados.rados.0.trial187.stdout:1054: finishing write tid 2 to trial18717860-29 2026-02-13T18:09:57.755 INFO:tasks.rados.rados.0.trial187.stdout:1054: finishing write tid 3 to trial18717860-29 2026-02-13T18:09:57.755 INFO:tasks.rados.rados.0.trial187.stdout:1054: finishing write tid 4 to trial18717860-29 2026-02-13T18:09:57.755 INFO:tasks.rados.rados.0.trial187.stdout:1054: oid 29 updating version 0 to 277 2026-02-13T18:09:57.755 INFO:tasks.rados.rados.0.trial187.stdout:1054: oid 29 version 277 is already newer than 276 2026-02-13T18:09:57.755 INFO:tasks.rados.rados.0.trial187.stdout:1054: oid 29 version 277 is already newer than 275 2026-02-13T18:09:57.755 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 277 (ObjNum 379 snap 109 seq_num 379) dirty exists 2026-02-13T18:09:57.756 INFO:tasks.rados.rados.0.trial187.stdout:1054: left oid 29 (ObjNum 379 snap 109 seq_num 379) 2026-02-13T18:09:57.756 INFO:tasks.rados.rados.0.trial187.stdout:1055: expect (ObjNum 330 snap 92 seq_num 330) 2026-02-13T18:09:57.818 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 542509 2026-02-13T18:09:57.843 INFO:tasks.rados.rados.0.trial187.stdout:1054: done (2 left) 2026-02-13T18:09:57.843 INFO:tasks.rados.rados.0.trial187.stdout:1055: done (1 left) 2026-02-13T18:09:57.843 INFO:tasks.rados.rados.0.trial187.stdout:1056: done (0 left) 2026-02-13T18:09:57.843 INFO:tasks.rados.rados.0.trial187.stdout:1057: copy_from oid 45 from oid 38 current snap is 109 2026-02-13T18:09:57.843 INFO:tasks.rados.rados.0.trial187.stdout:1058: write (excl) oid 33 current snap is 109 2026-02-13T18:09:57.843 INFO:tasks.rados.rados.0.trial187.stdout:1058: seq_num 381 ranges {403467=487519,1562110=579120} 2026-02-13T18:09:57.848 INFO:tasks.rados.rados.0.trial187.stdout:1058: writing trial18717860-33 from 403467 to 890986 tid 1 2026-02-13T18:09:57.857 INFO:tasks.rados.rados.0.trial187.stdout:1058: writing trial18717860-33 from 1562110 to 2141230 tid 2 2026-02-13T18:09:57.857 INFO:tasks.rados.rados.0.trial187.stdout:1059: write oid 11 current snap is 109 2026-02-13T18:09:57.858 INFO:tasks.rados.rados.0.trial187.stdout:1058: finishing write tid 1 to trial18717860-33 2026-02-13T18:09:57.858 INFO:tasks.rados.rados.0.trial187.stdout:1057: finishing copy_from racing read to trial18717860-45 2026-02-13T18:09:57.858 INFO:tasks.rados.rados.0.trial187.stdout:1057: finishing copy_from to trial18717860-45 2026-02-13T18:09:57.858 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 196 (ObjNum 329 snap 92 seq_num 329) dirty exists 2026-02-13T18:09:57.858 INFO:tasks.rados.rados.0.trial187.stdout:1059: seq_num 382 ranges {420274=562768,1620592=439131} 2026-02-13T18:09:57.863 INFO:tasks.rados.rados.0.trial187.stdout:1059: writing trial18717860-11 from 420274 to 983042 tid 1 2026-02-13T18:09:57.871 INFO:tasks.rados.rados.0.trial187.stdout:1059: writing trial18717860-11 from 1620592 to 2059723 tid 2 2026-02-13T18:09:57.871 INFO:tasks.rados.rados.0.trial187.stdout:1057: done (2 left) 2026-02-13T18:09:57.871 INFO:tasks.rados.rados.0.trial187.stdout:1060: delete oid 28 current snap is 109 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: finishing write tid 2 to trial18717860-33 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: finishing write tid 3 to trial18717860-33 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: finishing write tid 4 to trial18717860-33 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: oid 33 updating version 0 to 551 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: oid 33 updating version 551 to 552 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: oid 33 version 552 is already newer than 550 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 552 (ObjNum 381 snap 109 seq_num 381) dirty exists 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1058: left oid 33 (ObjNum 381 snap 109 seq_num 381) 2026-02-13T18:09:57.872 INFO:tasks.rados.rados.0.trial187.stdout:1059: finishing write tid 1 to trial18717860-11 2026-02-13T18:09:57.873 INFO:tasks.rados.rados.0.trial187.stdout:1059: finishing write tid 2 to trial18717860-11 2026-02-13T18:09:57.873 INFO:tasks.rados.rados.0.trial187.stdout:1059: finishing write tid 3 to trial18717860-11 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1059: finishing write tid 4 to trial18717860-11 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1059: oid 11 updating version 0 to 236 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1059: oid 11 updating version 236 to 237 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1059: oid 11 version 237 is already newer than 235 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 237 (ObjNum 382 snap 109 seq_num 382) dirty exists 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1059: left oid 11 (ObjNum 382 snap 109 seq_num 382) 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1058: done (2 left) 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1059: done (1 left) 2026-02-13T18:09:57.874 INFO:tasks.rados.rados.0.trial187.stdout:1060: done (0 left) 2026-02-13T18:09:57.875 INFO:tasks.rados.rados.0.trial187.stdout:1061: write oid 18 current snap is 109 2026-02-13T18:09:57.875 INFO:tasks.rados.rados.0.trial187.stdout:1061: seq_num 384 ranges {453888=713266,1737556=442800} 2026-02-13T18:09:57.881 INFO:tasks.rados.rados.0.trial187.stdout:1061: writing trial18717860-18 from 453888 to 1167154 tid 1 2026-02-13T18:09:57.887 INFO:tasks.rados.rados.0.trial187.stdout:1061: writing trial18717860-18 from 1737556 to 2180356 tid 2 2026-02-13T18:09:57.888 INFO:tasks.rados.rados.0.trial187.stdout:1062: snap_create 2026-02-13T18:09:57.888 INFO:tasks.rados.rados.0.trial187.stdout:1061: finishing write tid 1 to trial18717860-18 2026-02-13T18:09:57.889 INFO:tasks.rados.rados.0.trial187.stdout:1061: finishing write tid 2 to trial18717860-18 2026-02-13T18:09:57.890 INFO:tasks.rados.rados.0.trial187.stdout:1061: finishing write tid 3 to trial18717860-18 2026-02-13T18:09:57.890 INFO:tasks.rados.rados.0.trial187.stdout:1061: finishing write tid 4 to trial18717860-18 2026-02-13T18:09:57.890 INFO:tasks.rados.rados.0.trial187.stdout:1061: oid 18 updating version 0 to 297 2026-02-13T18:09:57.890 INFO:tasks.rados.rados.0.trial187.stdout:1061: oid 18 updating version 297 to 298 2026-02-13T18:09:57.890 INFO:tasks.rados.rados.0.trial187.stdout:1061: oid 18 updating version 298 to 299 2026-02-13T18:09:57.891 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 299 (ObjNum 384 snap 109 seq_num 384) dirty exists 2026-02-13T18:09:57.891 INFO:tasks.rados.rados.0.trial187.stdout:1061: left oid 18 (ObjNum 384 snap 109 seq_num 384) 2026-02-13T18:09:58.712 INFO:tasks.rados.rados.0.trial187.stdout:1061: done (1 left) 2026-02-13T18:09:58.713 INFO:tasks.rados.rados.0.trial187.stdout:1062: done (0 left) 2026-02-13T18:09:58.713 INFO:tasks.rados.rados.0.trial187.stdout:1063: write oid 11 current snap is 110 2026-02-13T18:09:58.713 INFO:tasks.rados.rados.0.trial187.stdout:1063: seq_num 385 ranges {470695=788515,1679685=586458} 2026-02-13T18:09:58.720 INFO:tasks.rados.rados.0.trial187.stdout:1063: writing trial18717860-11 from 470695 to 1259210 tid 1 2026-02-13T18:09:58.727 INFO:tasks.rados.rados.0.trial187.stdout:1063: writing trial18717860-11 from 1679685 to 2266143 tid 2 2026-02-13T18:09:58.727 INFO:tasks.rados.rados.0.trial187.stdout:1064: write (excl) oid 32 current snap is 110 2026-02-13T18:09:58.728 INFO:tasks.rados.rados.0.trial187.stdout:1064: seq_num 386 ranges {487502=463764,1738167=446469} 2026-02-13T18:09:58.733 INFO:tasks.rados.rados.0.trial187.stdout:1064: writing trial18717860-32 from 487502 to 951266 tid 1 2026-02-13T18:09:58.742 INFO:tasks.rados.rados.0.trial187.stdout:1064: writing trial18717860-32 from 1738167 to 2184636 tid 2 2026-02-13T18:09:58.742 INFO:tasks.rados.rados.0.trial187.stdout:1065: write (excl) oid 17 current snap is 110 2026-02-13T18:09:58.742 INFO:tasks.rados.rados.0.trial187.stdout:1065: seq_num 387 ranges {504309=539013,1796649=590127} 2026-02-13T18:09:58.749 INFO:tasks.rados.rados.0.trial187.stdout:1065: writing trial18717860-17 from 504309 to 1043322 tid 1 2026-02-13T18:09:58.757 INFO:tasks.rados.rados.0.trial187.stdout:1065: writing trial18717860-17 from 1796649 to 2386776 tid 2 2026-02-13T18:09:58.758 INFO:tasks.rados.rados.0.trial187.stdout:1066: write (excl) oid 3 current snap is 110 2026-02-13T18:09:58.758 INFO:tasks.rados.rados.0.trial187.stdout:1066: seq_num 388 ranges {521116=730615,1971484=549632} 2026-02-13T18:09:58.762 INFO:tasks.rados.rados.0.trial187.stdout:1066: writing trial18717860-3 from 521116 to 1251731 tid 1 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1066: writing trial18717860-3 from 1971484 to 2521116 tid 2 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1067: rollback oid 2 current snap is 110 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 99 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: finishing write tid 1 to trial18717860-11 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: finishing write tid 2 to trial18717860-11 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: finishing write tid 3 to trial18717860-11 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: finishing write tid 4 to trial18717860-11 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: oid 11 updating version 0 to 240 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: oid 11 updating version 240 to 241 2026-02-13T18:09:58.768 INFO:tasks.rados.rados.0.trial187.stdout:1063: oid 11 version 241 is already newer than 239 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 241 (ObjNum 385 snap 110 seq_num 385) dirty exists 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1063: left oid 11 (ObjNum 385 snap 110 seq_num 385) 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: finishing write tid 1 to trial18717860-32 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: finishing write tid 2 to trial18717860-32 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: finishing write tid 3 to trial18717860-32 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: finishing write tid 4 to trial18717860-32 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: oid 32 updating version 0 to 417 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: oid 32 version 417 is already newer than 416 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: oid 32 updating version 417 to 418 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 418 (ObjNum 386 snap 110 seq_num 386) dirty exists 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1064: left oid 32 (ObjNum 386 snap 110 seq_num 386) 2026-02-13T18:09:58.769 INFO:tasks.rados.rados.0.trial187.stdout:1065: finishing write tid 1 to trial18717860-17 2026-02-13T18:09:58.770 INFO:tasks.rados.rados.0.trial187.stdout:1063: done (4 left) 2026-02-13T18:09:58.770 INFO:tasks.rados.rados.0.trial187.stdout:1064: done (3 left) 2026-02-13T18:09:58.770 INFO:tasks.rados.rados.0.trial187.stdout:1068: snap_create 2026-02-13T18:09:58.770 INFO:tasks.rados.rados.0.trial187.stdout:1065: finishing write tid 2 to trial18717860-17 2026-02-13T18:09:58.770 INFO:tasks.rados.rados.0.trial187.stdout:1067: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:09:58.771 INFO:tasks.rados.rados.0.trial187.stdout:1067: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:09:58.771 INFO:tasks.rados.rados.0.trial187.stdout:1067: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:09:58.771 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 302 (ObjNum 274 snap 83 seq_num 274) dirty exists 2026-02-13T18:09:58.772 INFO:tasks.rados.rados.0.trial187.stdout:1065: finishing write tid 3 to trial18717860-17 2026-02-13T18:09:58.772 INFO:tasks.rados.rados.0.trial187.stdout:1065: finishing write tid 4 to trial18717860-17 2026-02-13T18:09:58.772 INFO:tasks.rados.rados.0.trial187.stdout:1065: oid 17 updating version 0 to 501 2026-02-13T18:09:58.772 INFO:tasks.rados.rados.0.trial187.stdout:1065: oid 17 version 501 is already newer than 500 2026-02-13T18:09:58.773 INFO:tasks.rados.rados.0.trial187.stdout:1065: oid 17 updating version 501 to 502 2026-02-13T18:09:58.773 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 502 (ObjNum 387 snap 110 seq_num 387) dirty exists 2026-02-13T18:09:58.773 INFO:tasks.rados.rados.0.trial187.stdout:1065: left oid 17 (ObjNum 387 snap 110 seq_num 387) 2026-02-13T18:09:58.774 INFO:tasks.rados.rados.0.trial187.stdout:1066: finishing write tid 1 to trial18717860-3 2026-02-13T18:09:58.774 INFO:tasks.rados.rados.0.trial187.stdout:1066: finishing write tid 2 to trial18717860-3 2026-02-13T18:09:58.774 INFO:tasks.rados.rados.0.trial187.stdout:1066: finishing write tid 3 to trial18717860-3 2026-02-13T18:09:58.774 INFO:tasks.rados.rados.0.trial187.stdout:1066: finishing write tid 4 to trial18717860-3 2026-02-13T18:09:58.775 INFO:tasks.rados.rados.0.trial187.stdout:1066: oid 3 updating version 0 to 505 2026-02-13T18:09:58.775 INFO:tasks.rados.rados.0.trial187.stdout:1066: oid 3 version 505 is already newer than 504 2026-02-13T18:09:58.775 INFO:tasks.rados.rados.0.trial187.stdout:1066: oid 3 updating version 505 to 506 2026-02-13T18:09:58.775 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 506 (ObjNum 388 snap 110 seq_num 388) dirty exists 2026-02-13T18:09:58.775 INFO:tasks.rados.rados.0.trial187.stdout:1066: left oid 3 (ObjNum 388 snap 110 seq_num 388) 2026-02-13T18:09:59.886 INFO:tasks.rados.rados.0.trial187.stdout:1065: done (3 left) 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1066: done (2 left) 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1067: done (1 left) 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1068: done (0 left) 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1069: read oid 31 snap -1 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1069: expect (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1070: rollback oid 35 current snap is 111 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 35 to 110 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1071: rollback oid 26 current snap is 111 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 102 2026-02-13T18:09:59.887 INFO:tasks.rados.rados.0.trial187.stdout:1072: copy_from oid 38 from oid 40 current snap is 111 2026-02-13T18:09:59.888 INFO:tasks.rados.rados.0.trial187.stdout:1073: read oid 6 snap 110 2026-02-13T18:09:59.888 INFO:tasks.rados.rados.0.trial187.stdout:1073: expect (ObjNum 374 snap 106 seq_num 374) 2026-02-13T18:09:59.888 INFO:tasks.rados.rados.0.trial187.stdout:1074: snap_remove snap 96 2026-02-13T18:10:00.887 INFO:tasks.rados.rados.0.trial187.stdout:1074: done (5 left) 2026-02-13T18:10:00.887 INFO:tasks.rados.rados.0.trial187.stdout:1075: snap_create 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1071: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1071: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 508 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1070: finishing rollback tid 0 to trial18717860-35 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1070: finishing rollback tid 1 to trial18717860-35 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1070: finishing rollback tid 2 to trial18717860-35 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 202 (ObjNum 330 snap 92 seq_num 330) dirty exists 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1072: finishing copy_from to trial18717860-38 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1072: got expected ENOENT (src dne) 2026-02-13T18:10:00.888 INFO:tasks.rados.rados.0.trial187.stdout:1072: finishing copy_from racing read to trial18717860-38 2026-02-13T18:10:00.889 INFO:tasks.rados.rados.0.trial187.stdout:1073: expect (ObjNum 374 snap 106 seq_num 374) 2026-02-13T18:10:00.952 INFO:tasks.rados.rados.0.trial187.stdout:1069: expect (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:10:01.888 INFO:tasks.rados.rados.0.trial187.stdout:1069: done (5 left) 2026-02-13T18:10:01.889 INFO:tasks.rados.rados.0.trial187.stdout:1070: done (4 left) 2026-02-13T18:10:01.889 INFO:tasks.rados.rados.0.trial187.stdout:1071: done (3 left) 2026-02-13T18:10:01.889 INFO:tasks.rados.rados.0.trial187.stdout:1072: done (2 left) 2026-02-13T18:10:01.889 INFO:tasks.rados.rados.0.trial187.stdout:1073: done (1 left) 2026-02-13T18:10:01.889 INFO:tasks.rados.rados.0.trial187.stdout:1075: done (0 left) 2026-02-13T18:10:01.889 INFO:tasks.rados.rados.0.trial187.stdout:1076: snap_create 2026-02-13T18:10:02.889 INFO:tasks.rados.rados.0.trial187.stdout:1076: done (0 left) 2026-02-13T18:10:02.890 INFO:tasks.rados.rados.0.trial187.stdout:1077: rollback oid 46 current snap is 113 2026-02-13T18:10:02.890 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 99 2026-02-13T18:10:02.890 INFO:tasks.rados.rados.0.trial187.stdout:1078: read oid 22 snap -1 2026-02-13T18:10:02.890 INFO:tasks.rados.rados.0.trial187.stdout:1078: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:10:02.890 INFO:tasks.rados.rados.0.trial187.stdout:1079: write (excl) oid 1 current snap is 113 2026-02-13T18:10:02.890 INFO:tasks.rados.rados.0.trial187.stdout:1079: seq_num 389 ranges {537923=405864,1513613=593796} 2026-02-13T18:10:02.895 INFO:tasks.rados.rados.0.trial187.stdout:1079: writing trial18717860-1 from 537923 to 943787 tid 1 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:1079: writing trial18717860-1 from 1513613 to 2107409 tid 2 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:1080: rollback oid 32 current snap is 113 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 108 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:1077: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:1077: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:1077: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:10:02.904 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 345 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:10:02.905 INFO:tasks.rados.rados.0.trial187.stdout:1078: expect (ObjNum 142 snap 26 seq_num 142) 2026-02-13T18:10:02.949 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:03.008 INFO:tasks.rados.rados.0.trial187.stdout:1079: finishing write tid 1 to trial18717860-1 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: finishing write tid 2 to trial18717860-1 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: finishing write tid 3 to trial18717860-1 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: finishing write tid 4 to trial18717860-1 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: oid 1 updating version 0 to 279 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: oid 1 version 279 is already newer than 278 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: oid 1 updating version 279 to 280 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 280 (ObjNum 389 snap 113 seq_num 389) dirty exists 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1079: left oid 1 (ObjNum 389 snap 113 seq_num 389) 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1080: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:10:03.009 INFO:tasks.rados.rados.0.trial187.stdout:1080: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 420 (ObjNum 497 snap 0 seq_num 485347548) dirty dne 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1077: done (3 left) 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1078: done (2 left) 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1079: done (1 left) 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1080: done (0 left) 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1081: read oid 37 snap -1 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1081: expect deleted 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1082: write (excl) oid 21 current snap is 113 2026-02-13T18:10:03.010 INFO:tasks.rados.rados.0.trial187.stdout:1082: seq_num 390 ranges {554730=481113,1572095=737454} 2026-02-13T18:10:03.015 INFO:tasks.rados.rados.0.trial187.stdout:1082: writing trial18717860-21 from 554730 to 1035843 tid 1 2026-02-13T18:10:03.024 INFO:tasks.rados.rados.0.trial187.stdout:1082: writing trial18717860-21 from 1572095 to 2309549 tid 2 2026-02-13T18:10:03.024 INFO:tasks.rados.rados.0.trial187.stdout:1083: snap_remove snap 108 2026-02-13T18:10:03.713 INFO:tasks.rados.rados.0.trial187.stdout:1083: done (2 left) 2026-02-13T18:10:03.713 INFO:tasks.rados.rados.0.trial187.stdout:1084: read oid 31 snap -1 2026-02-13T18:10:03.713 INFO:tasks.rados.rados.0.trial187.stdout:1084: expect (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:10:03.713 INFO:tasks.rados.rados.0.trial187.stdout:1085: delete oid 39 current snap is 113 2026-02-13T18:10:03.713 INFO:tasks.rados.rados.0.trial187.stdout:1082: finishing write tid 1 to trial18717860-21 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: finishing write tid 2 to trial18717860-21 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: finishing write tid 3 to trial18717860-21 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: finishing write tid 4 to trial18717860-21 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: oid 21 updating version 0 to 347 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: oid 21 updating version 347 to 348 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: oid 21 updating version 348 to 349 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 349 (ObjNum 390 snap 113 seq_num 390) dirty exists 2026-02-13T18:10:03.714 INFO:tasks.rados.rados.0.trial187.stdout:1082: left oid 21 (ObjNum 390 snap 113 seq_num 390) 2026-02-13T18:10:03.717 INFO:tasks.rados.rados.0.trial187.stdout:1081: done (3 left) 2026-02-13T18:10:03.717 INFO:tasks.rados.rados.0.trial187.stdout:1082: done (2 left) 2026-02-13T18:10:03.717 INFO:tasks.rados.rados.0.trial187.stdout:1085: done (1 left) 2026-02-13T18:10:03.717 INFO:tasks.rados.rados.0.trial187.stdout:1086: write oid 19 current snap is 113 2026-02-13T18:10:03.717 INFO:tasks.rados.rados.0.trial187.stdout:1086: seq_num 392 ranges {588344=631611,1689059=741123} 2026-02-13T18:10:03.725 INFO:tasks.rados.rados.0.trial187.stdout:1086: writing trial18717860-19 from 588344 to 1219955 tid 1 2026-02-13T18:10:03.733 INFO:tasks.rados.rados.0.trial187.stdout:1086: writing trial18717860-19 from 1689059 to 2430182 tid 2 2026-02-13T18:10:03.733 INFO:tasks.rados.rados.0.trial187.stdout:1087: write oid 10 current snap is 113 2026-02-13T18:10:03.733 INFO:tasks.rados.rados.0.trial187.stdout:1087: seq_num 393 ranges {605151=706860,2031188=573963} 2026-02-13T18:10:03.742 INFO:tasks.rados.rados.0.trial187.stdout:1087: writing trial18717860-10 from 605151 to 1312011 tid 1 2026-02-13T18:10:03.751 INFO:tasks.rados.rados.0.trial187.stdout:1087: writing trial18717860-10 from 2031188 to 2605151 tid 2 2026-02-13T18:10:03.751 INFO:tasks.rados.rados.0.trial187.stdout:1088: rollback oid 33 current snap is 113 2026-02-13T18:10:03.751 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 33 to 99 2026-02-13T18:10:03.751 INFO:tasks.rados.rados.0.trial187.stdout:1084: expect (ObjNum 335 snap 93 seq_num 335) 2026-02-13T18:10:03.805 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 747285 2026-02-13T18:10:03.869 INFO:tasks.rados.rados.0.trial187.stdout:1086: finishing write tid 1 to trial18717860-19 2026-02-13T18:10:03.869 INFO:tasks.rados.rados.0.trial187.stdout:1086: finishing write tid 2 to trial18717860-19 2026-02-13T18:10:03.869 INFO:tasks.rados.rados.0.trial187.stdout:1086: finishing write tid 3 to trial18717860-19 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1086: finishing write tid 4 to trial18717860-19 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1086: oid 19 updating version 0 to 282 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1086: oid 19 updating version 282 to 284 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1086: oid 19 version 284 is already newer than 283 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 284 (ObjNum 392 snap 113 seq_num 392) dirty exists 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1086: left oid 19 (ObjNum 392 snap 113 seq_num 392) 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1087: finishing write tid 1 to trial18717860-10 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1087: finishing write tid 2 to trial18717860-10 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1087: finishing write tid 3 to trial18717860-10 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1087: finishing write tid 4 to trial18717860-10 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1087: oid 10 updating version 0 to 216 2026-02-13T18:10:03.870 INFO:tasks.rados.rados.0.trial187.stdout:1087: oid 10 version 216 is already newer than 215 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1087: oid 10 version 216 is already newer than 214 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 216 (ObjNum 393 snap 113 seq_num 393) dirty exists 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1087: left oid 10 (ObjNum 393 snap 113 seq_num 393) 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1088: finishing rollback tid 0 to trial18717860-33 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1088: finishing rollback tid 1 to trial18717860-33 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1088: finishing rollback tid 2 to trial18717860-33 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 566 (ObjNum 350 snap 96 seq_num 350) dirty exists 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1084: done (3 left) 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1086: done (2 left) 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1087: done (1 left) 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1088: done (0 left) 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1089: read oid 9 snap -1 2026-02-13T18:10:03.871 INFO:tasks.rados.rados.0.trial187.stdout:1089: expect deleted 2026-02-13T18:10:03.872 INFO:tasks.rados.rados.0.trial187.stdout:1090: write oid 43 current snap is 113 2026-02-13T18:10:03.872 INFO:tasks.rados.rados.0.trial187.stdout:1090: seq_num 394 ranges {621958=782109,2089670=532288} 2026-02-13T18:10:03.879 INFO:tasks.rados.rados.0.trial187.stdout:1090: writing trial18717860-43 from 621958 to 1404067 tid 1 2026-02-13T18:10:03.888 INFO:tasks.rados.rados.0.trial187.stdout:1090: writing trial18717860-43 from 2089670 to 2621958 tid 2 2026-02-13T18:10:03.888 INFO:tasks.rados.rados.0.trial187.stdout:1091: write (excl) oid 42 current snap is 113 2026-02-13T18:10:03.888 INFO:tasks.rados.rados.0.trial187.stdout:1091: seq_num 395 ranges {638765=457358,1748152=604803} 2026-02-13T18:10:03.895 INFO:tasks.rados.rados.0.trial187.stdout:1091: writing trial18717860-42 from 638765 to 1096123 tid 1 2026-02-13T18:10:03.904 INFO:tasks.rados.rados.0.trial187.stdout:1091: writing trial18717860-42 from 1748152 to 2352955 tid 2 2026-02-13T18:10:03.904 INFO:tasks.rados.rados.0.trial187.stdout:1092: snap_create 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: finishing write tid 1 to trial18717860-43 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1091: finishing write tid 1 to trial18717860-42 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: finishing write tid 2 to trial18717860-43 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: finishing write tid 3 to trial18717860-43 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: finishing write tid 4 to trial18717860-43 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: oid 43 updating version 0 to 567 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: oid 43 updating version 567 to 569 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: oid 43 version 569 is already newer than 568 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 569 (ObjNum 394 snap 113 seq_num 394) dirty exists 2026-02-13T18:10:03.905 INFO:tasks.rados.rados.0.trial187.stdout:1090: left oid 43 (ObjNum 394 snap 113 seq_num 394) 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: finishing write tid 2 to trial18717860-42 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: finishing write tid 3 to trial18717860-42 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: finishing write tid 4 to trial18717860-42 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: oid 42 updating version 0 to 265 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: oid 42 version 265 is already newer than 264 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: oid 42 updating version 265 to 266 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 266 (ObjNum 395 snap 113 seq_num 395) dirty exists 2026-02-13T18:10:03.907 INFO:tasks.rados.rados.0.trial187.stdout:1091: left oid 42 (ObjNum 395 snap 113 seq_num 395) 2026-02-13T18:10:04.718 INFO:tasks.rados.rados.0.trial187.stdout:1089: done (3 left) 2026-02-13T18:10:04.718 INFO:tasks.rados.rados.0.trial187.stdout:1090: done (2 left) 2026-02-13T18:10:04.718 INFO:tasks.rados.rados.0.trial187.stdout:1091: done (1 left) 2026-02-13T18:10:04.718 INFO:tasks.rados.rados.0.trial187.stdout:1092: done (0 left) 2026-02-13T18:10:04.718 INFO:tasks.rados.rados.0.trial187.stdout:1093: write oid 34 current snap is 114 2026-02-13T18:10:04.719 INFO:tasks.rados.rados.0.trial187.stdout:1093: seq_num 396 ranges {655572=648960,1922987=732585} 2026-02-13T18:10:04.726 INFO:tasks.rados.rados.0.trial187.stdout:1093: writing trial18717860-34 from 655572 to 1304532 tid 1 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:1093: writing trial18717860-34 from 1922987 to 2655572 tid 2 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:1094: rollback oid 27 current snap is 114 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 107 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:1093: finishing write tid 1 to trial18717860-34 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:1095: read oid 9 snap -1 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:1095: expect deleted 2026-02-13T18:10:04.736 INFO:tasks.rados.rados.0.trial187.stdout:1096: snap_remove snap 110 2026-02-13T18:10:05.719 INFO:tasks.rados.rados.0.trial187.stdout:1096: done (3 left) 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1097: delete oid 31 current snap is 114 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: finishing write tid 2 to trial18717860-34 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: finishing write tid 3 to trial18717860-34 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: finishing write tid 4 to trial18717860-34 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: oid 34 updating version 0 to 244 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: oid 34 updating version 244 to 245 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: oid 34 updating version 245 to 246 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 246 (ObjNum 396 snap 114 seq_num 396) dirty exists 2026-02-13T18:10:05.720 INFO:tasks.rados.rados.0.trial187.stdout:1093: left oid 34 (ObjNum 396 snap 114 seq_num 396) 2026-02-13T18:10:05.721 INFO:tasks.rados.rados.0.trial187.stdout:1094: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:10:05.721 INFO:tasks.rados.rados.0.trial187.stdout:1094: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:10:05.721 INFO:tasks.rados.rados.0.trial187.stdout:1094: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:10:05.721 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 299 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1093: done (3 left) 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1094: done (2 left) 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1095: done (1 left) 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1097: done (0 left) 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1098: read oid 40 snap -1 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1098: expect deleted 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1099: rollback oid 41 current snap is 114 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 109 2026-02-13T18:10:05.725 INFO:tasks.rados.rados.0.trial187.stdout:1100: rollback oid 45 current snap is 114 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 102 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1101: copy_from oid 2 from oid 48 current snap is 114 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1102: read oid 15 snap 111 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1102: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1103: rollback oid 1 current snap is 114 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 1 to 103 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1104: copy_from oid 16 from oid 44 current snap is 114 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1105: delete oid 14 current snap is 114 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1099: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1101: finishing copy_from to trial18717860-2 2026-02-13T18:10:05.726 INFO:tasks.rados.rados.0.trial187.stdout:1101: got expected ENOENT (src dne) 2026-02-13T18:10:05.727 INFO:tasks.rados.rados.0.trial187.stdout:1101: finishing copy_from racing read to trial18717860-2 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1098: done (7 left) 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1099: done (6 left) 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1101: done (5 left) 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1105: done (4 left) 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1106: read oid 46 snap -1 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1106: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1107: rollback oid 17 current snap is 114 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 107 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1108: write (excl) oid 35 current snap is 114 2026-02-13T18:10:05.728 INFO:tasks.rados.rados.0.trial187.stdout:1108: seq_num 399 ranges {705993=474707,1582080=612141} 2026-02-13T18:10:05.735 INFO:tasks.rados.rados.0.trial187.stdout:1108: writing trial18717860-35 from 705993 to 1180700 tid 1 2026-02-13T18:10:05.743 INFO:tasks.rados.rados.0.trial187.stdout:1108: writing trial18717860-35 from 1582080 to 2194221 tid 2 2026-02-13T18:10:05.743 INFO:tasks.rados.rados.0.trial187.stdout:1109: read oid 49 snap -1 2026-02-13T18:10:05.743 INFO:tasks.rados.rados.0.trial187.stdout:1109: expect deleted 2026-02-13T18:10:05.743 INFO:tasks.rados.rados.0.trial187.stdout:1110: read oid 18 snap -1 2026-02-13T18:10:05.743 INFO:tasks.rados.rados.0.trial187.stdout:1110: expect (ObjNum 384 snap 109 seq_num 384) 2026-02-13T18:10:05.743 INFO:tasks.rados.rados.0.trial187.stdout:1111: read oid 38 snap -1 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:1111: expect (ObjNum 329 snap 92 seq_num 329) 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:1112: delete oid 43 current snap is 114 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:1100: finishing rollback tid 0 to trial18717860-45 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:1100: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 304 (ObjNum 65 snap 0 seq_num 0) dirty dne 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:1102: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:10:05.744 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:05.810 INFO:tasks.rados.rados.0.trial187.stdout:1103: finishing rollback tid 0 to trial18717860-1 2026-02-13T18:10:05.810 INFO:tasks.rados.rados.0.trial187.stdout:1103: finishing rollback tid 1 to trial18717860-1 2026-02-13T18:10:05.810 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 287 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:10:05.811 INFO:tasks.rados.rados.0.trial187.stdout:1107: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:10:05.811 INFO:tasks.rados.rados.0.trial187.stdout:1107: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:10:05.811 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 518 (ObjNum 129 snap 0 seq_num 3013755760) dirty dne 2026-02-13T18:10:05.811 INFO:tasks.rados.rados.0.trial187.stdout:1106: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:10:05.946 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 975124 2026-02-13T18:10:06.007 INFO:tasks.rados.rados.0.trial187.stdout:1108: finishing write tid 1 to trial18717860-35 2026-02-13T18:10:06.007 INFO:tasks.rados.rados.0.trial187.stdout:1104: finishing copy_from racing read to trial18717860-16 2026-02-13T18:10:06.007 INFO:tasks.rados.rados.0.trial187.stdout:1104: finishing copy_from to trial18717860-16 2026-02-13T18:10:06.008 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 296 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:10:06.008 INFO:tasks.rados.rados.0.trial187.stdout:1110: expect (ObjNum 384 snap 109 seq_num 384) 2026-02-13T18:10:06.039 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2450983 2026-02-13T18:10:06.109 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1754796 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: finishing write tid 2 to trial18717860-35 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: finishing write tid 3 to trial18717860-35 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: finishing write tid 4 to trial18717860-35 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: oid 35 updating version 0 to 214 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: oid 35 version 214 is already newer than 212 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: oid 35 version 214 is already newer than 213 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 214 (ObjNum 399 snap 114 seq_num 399) dirty exists 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1108: left oid 35 (ObjNum 399 snap 114 seq_num 399) 2026-02-13T18:10:06.119 INFO:tasks.rados.rados.0.trial187.stdout:1111: expect (ObjNum 329 snap 92 seq_num 329) 2026-02-13T18:10:06.143 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2210745 2026-02-13T18:10:06.177 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1766574 2026-02-13T18:10:06.244 INFO:tasks.rados.rados.0.trial187.stdout:1100: done (10 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1102: done (9 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1103: done (8 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1104: done (7 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1106: done (6 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1107: done (5 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1108: done (4 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1109: done (3 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1110: done (2 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1111: done (1 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1112: done (0 left) 2026-02-13T18:10:06.245 INFO:tasks.rados.rados.0.trial187.stdout:1113: read oid 26 snap -1 2026-02-13T18:10:06.246 INFO:tasks.rados.rados.0.trial187.stdout:1113: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:06.246 INFO:tasks.rados.rados.0.trial187.stdout:1114: snap_remove snap 105 2026-02-13T18:10:06.727 INFO:tasks.rados.rados.0.trial187.stdout:1114: done (1 left) 2026-02-13T18:10:06.727 INFO:tasks.rados.rados.0.trial187.stdout:1115: read oid 40 snap -1 2026-02-13T18:10:06.727 INFO:tasks.rados.rados.0.trial187.stdout:1115: expect deleted 2026-02-13T18:10:06.727 INFO:tasks.rados.rados.0.trial187.stdout:1116: rollback oid 12 current snap is 114 2026-02-13T18:10:06.728 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 102 2026-02-13T18:10:06.728 INFO:tasks.rados.rados.0.trial187.stdout:1113: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:06.728 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1116: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 0 (ObjNum 129 snap 0 seq_num 3013789136) dirty dne 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1113: done (2 left) 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1115: done (1 left) 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1116: done (0 left) 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1117: read oid 23 snap -1 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1117: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1118: copy_from oid 2 from oid 46 current snap is 114 2026-02-13T18:10:06.820 INFO:tasks.rados.rados.0.trial187.stdout:1119: delete oid 33 current snap is 114 2026-02-13T18:10:06.821 INFO:tasks.rados.rados.0.trial187.stdout:1119: done (2 left) 2026-02-13T18:10:06.821 INFO:tasks.rados.rados.0.trial187.stdout:1120: rollback oid 42 current snap is 114 2026-02-13T18:10:06.821 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 42 to 99 2026-02-13T18:10:06.822 INFO:tasks.rados.rados.0.trial187.stdout:1121: read oid 14 snap -1 2026-02-13T18:10:06.822 INFO:tasks.rados.rados.0.trial187.stdout:1121: expect deleted 2026-02-13T18:10:06.822 INFO:tasks.rados.rados.0.trial187.stdout:1122: write oid 27 current snap is 114 2026-02-13T18:10:06.822 INFO:tasks.rados.rados.0.trial187.stdout:1122: seq_num 402 ranges {756414=700454,2041173=715241} 2026-02-13T18:10:06.831 INFO:tasks.rados.rados.0.trial187.stdout:1122: writing trial18717860-27 from 756414 to 1456868 tid 1 2026-02-13T18:10:06.840 INFO:tasks.rados.rados.0.trial187.stdout:1122: writing trial18717860-27 from 2041173 to 2756414 tid 2 2026-02-13T18:10:06.840 INFO:tasks.rados.rados.0.trial187.stdout:1123: rollback oid 38 current snap is 114 2026-02-13T18:10:06.840 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 113 2026-02-13T18:10:06.840 INFO:tasks.rados.rados.0.trial187.stdout:1120: finishing rollback tid 0 to trial18717860-42 2026-02-13T18:10:06.840 INFO:tasks.rados.rados.0.trial187.stdout:1120: finishing rollback tid 1 to trial18717860-42 2026-02-13T18:10:06.840 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 268 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:10:06.841 INFO:tasks.rados.rados.0.trial187.stdout:1117: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:06.867 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:06.895 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 705522 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:1118: finishing copy_from racing read to trial18717860-2 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:1118: finishing copy_from to trial18717860-2 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 345 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:1122: finishing write tid 1 to trial18717860-27 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:1122: finishing write tid 2 to trial18717860-27 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:1122: finishing write tid 3 to trial18717860-27 2026-02-13T18:10:06.916 INFO:tasks.rados.rados.0.trial187.stdout:1123: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1123: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1122: finishing write tid 4 to trial18717860-27 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1122: oid 27 updating version 0 to 300 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1122: oid 27 updating version 300 to 301 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1122: oid 27 updating version 301 to 302 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 302 (ObjNum 402 snap 114 seq_num 402) dirty exists 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1122: left oid 27 (ObjNum 402 snap 114 seq_num 402) 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1123: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 222 (ObjNum 329 snap 92 seq_num 329) dirty exists 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1117: done (5 left) 2026-02-13T18:10:06.917 INFO:tasks.rados.rados.0.trial187.stdout:1118: done (4 left) 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1120: done (3 left) 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1121: done (2 left) 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1122: done (1 left) 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1123: done (0 left) 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1124: copy_from oid 14 from oid 3 current snap is 114 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1125: read oid 26 snap 112 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1125: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1126: write (excl) oid 9 current snap is 114 2026-02-13T18:10:06.918 INFO:tasks.rados.rados.0.trial187.stdout:1126: seq_num 403 ranges {773221=492056,1816008=503126} 2026-02-13T18:10:06.924 INFO:tasks.rados.rados.0.trial187.stdout:1126: writing trial18717860-9 from 773221 to 1265277 tid 1 2026-02-13T18:10:06.931 INFO:tasks.rados.rados.0.trial187.stdout:1126: writing trial18717860-9 from 1816008 to 2319134 tid 2 2026-02-13T18:10:06.931 INFO:tasks.rados.rados.0.trial187.stdout:1127: snap_create 2026-02-13T18:10:06.931 INFO:tasks.rados.rados.0.trial187.stdout:1125: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:06.931 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:06.973 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:06.998 INFO:tasks.rados.rados.0.trial187.stdout:1124: finishing copy_from racing read to trial18717860-14 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1124: finishing copy_from to trial18717860-14 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 506 (ObjNum 388 snap 110 seq_num 388) dirty exists 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: finishing write tid 1 to trial18717860-9 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: finishing write tid 2 to trial18717860-9 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: finishing write tid 3 to trial18717860-9 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: finishing write tid 4 to trial18717860-9 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: oid 9 updating version 0 to 524 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: oid 9 version 524 is already newer than 523 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: oid 9 updating version 524 to 525 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 525 (ObjNum 403 snap 114 seq_num 403) dirty exists 2026-02-13T18:10:06.999 INFO:tasks.rados.rados.0.trial187.stdout:1126: left oid 9 (ObjNum 403 snap 114 seq_num 403) 2026-02-13T18:10:07.730 INFO:tasks.rados.rados.0.trial187.stdout:1124: done (3 left) 2026-02-13T18:10:07.730 INFO:tasks.rados.rados.0.trial187.stdout:1125: done (2 left) 2026-02-13T18:10:07.730 INFO:tasks.rados.rados.0.trial187.stdout:1126: done (1 left) 2026-02-13T18:10:07.730 INFO:tasks.rados.rados.0.trial187.stdout:1127: done (0 left) 2026-02-13T18:10:07.731 INFO:tasks.rados.rados.0.trial187.stdout:1128: write oid 30 current snap is 115 2026-02-13T18:10:07.731 INFO:tasks.rados.rados.0.trial187.stdout:1128: seq_num 404 ranges {790028=567305,1874490=763137} 2026-02-13T18:10:07.738 INFO:tasks.rados.rados.0.trial187.stdout:1128: writing trial18717860-30 from 790028 to 1357333 tid 1 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1128: writing trial18717860-30 from 1874490 to 2637627 tid 2 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1129: read oid 2 snap -1 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1129: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1130: copy_from oid 12 from oid 40 current snap is 115 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1128: finishing write tid 1 to trial18717860-30 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1131: copy_from oid 39 from oid 7 current snap is 115 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1132: write oid 24 current snap is 115 2026-02-13T18:10:07.748 INFO:tasks.rados.rados.0.trial187.stdout:1132: seq_num 405 ranges {406835=642554,1532972=506795,2772312=34523} 2026-02-13T18:10:07.754 INFO:tasks.rados.rados.0.trial187.stdout:1132: writing trial18717860-24 from 406835 to 1049389 tid 1 2026-02-13T18:10:07.761 INFO:tasks.rados.rados.0.trial187.stdout:1132: writing trial18717860-24 from 1532972 to 2039767 tid 2 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1132: writing trial18717860-24 from 2772312 to 2806835 tid 3 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1133: snap_create 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: finishing write tid 2 to trial18717860-30 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: finishing write tid 3 to trial18717860-30 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: finishing write tid 4 to trial18717860-30 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: oid 30 updating version 0 to 423 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: oid 30 version 423 is already newer than 422 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: oid 30 version 423 is already newer than 421 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 423 (ObjNum 404 snap 115 seq_num 404) dirty exists 2026-02-13T18:10:07.767 INFO:tasks.rados.rados.0.trial187.stdout:1128: left oid 30 (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:07.768 INFO:tasks.rados.rados.0.trial187.stdout:1130: finishing copy_from to trial18717860-12 2026-02-13T18:10:07.768 INFO:tasks.rados.rados.0.trial187.stdout:1130: got expected ENOENT (src dne) 2026-02-13T18:10:07.768 INFO:tasks.rados.rados.0.trial187.stdout:1130: finishing copy_from racing read to trial18717860-12 2026-02-13T18:10:07.768 INFO:tasks.rados.rados.0.trial187.stdout:1129: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:10:07.914 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1646894 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1132: finishing write tid 1 to trial18717860-24 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1131: finishing copy_from racing read to trial18717860-39 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1131: finishing copy_from to trial18717860-39 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 295 (ObjNum 319 snap 87 seq_num 319) dirty exists 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1132: finishing write tid 2 to trial18717860-24 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1132: finishing write tid 3 to trial18717860-24 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1132: finishing write tid 4 to trial18717860-24 2026-02-13T18:10:07.964 INFO:tasks.rados.rados.0.trial187.stdout:1132: finishing write tid 5 to trial18717860-24 2026-02-13T18:10:07.965 INFO:tasks.rados.rados.0.trial187.stdout:1132: oid 24 updating version 0 to 407 2026-02-13T18:10:07.965 INFO:tasks.rados.rados.0.trial187.stdout:1132: oid 24 updating version 407 to 409 2026-02-13T18:10:07.965 INFO:tasks.rados.rados.0.trial187.stdout:1132: oid 24 version 409 is already newer than 408 2026-02-13T18:10:07.965 INFO:tasks.rados.rados.0.trial187.stdout:1132: oid 24 version 409 is already newer than 406 2026-02-13T18:10:07.965 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 409 (ObjNum 405 snap 115 seq_num 405) dirty exists 2026-02-13T18:10:07.965 INFO:tasks.rados.rados.0.trial187.stdout:1132: left oid 24 (ObjNum 405 snap 115 seq_num 405) 2026-02-13T18:10:08.714 INFO:tasks.rados.rados.0.trial187.stdout:1128: done (5 left) 2026-02-13T18:10:08.714 INFO:tasks.rados.rados.0.trial187.stdout:1129: done (4 left) 2026-02-13T18:10:08.715 INFO:tasks.rados.rados.0.trial187.stdout:1130: done (3 left) 2026-02-13T18:10:08.715 INFO:tasks.rados.rados.0.trial187.stdout:1131: done (2 left) 2026-02-13T18:10:08.715 INFO:tasks.rados.rados.0.trial187.stdout:1132: done (1 left) 2026-02-13T18:10:08.715 INFO:tasks.rados.rados.0.trial187.stdout:1133: done (0 left) 2026-02-13T18:10:08.715 INFO:tasks.rados.rados.0.trial187.stdout:1134: write (excl) oid 39 current snap is 116 2026-02-13T18:10:08.715 INFO:tasks.rados.rados.0.trial187.stdout:1134: seq_num 406 ranges {423642=717803,1875101=766806} 2026-02-13T18:10:08.721 INFO:tasks.rados.rados.0.trial187.stdout:1134: writing trial18717860-39 from 423642 to 1141445 tid 1 2026-02-13T18:10:08.732 INFO:tasks.rados.rados.0.trial187.stdout:1134: writing trial18717860-39 from 1875101 to 2641907 tid 2 2026-02-13T18:10:08.732 INFO:tasks.rados.rados.0.trial187.stdout:1135: delete oid 22 current snap is 116 2026-02-13T18:10:08.732 INFO:tasks.rados.rados.0.trial187.stdout:1134: finishing write tid 1 to trial18717860-39 2026-02-13T18:10:08.734 INFO:tasks.rados.rados.0.trial187.stdout:1135: done (1 left) 2026-02-13T18:10:08.734 INFO:tasks.rados.rados.0.trial187.stdout:1136: read oid 31 snap -1 2026-02-13T18:10:08.734 INFO:tasks.rados.rados.0.trial187.stdout:1136: expect deleted 2026-02-13T18:10:08.734 INFO:tasks.rados.rados.0.trial187.stdout:1137: read oid 29 snap -1 2026-02-13T18:10:08.735 INFO:tasks.rados.rados.0.trial187.stdout:1137: expect (ObjNum 379 snap 109 seq_num 379) 2026-02-13T18:10:08.735 INFO:tasks.rados.rados.0.trial187.stdout:1138: delete oid 16 current snap is 116 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: finishing write tid 2 to trial18717860-39 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: finishing write tid 3 to trial18717860-39 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: finishing write tid 4 to trial18717860-39 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: oid 39 updating version 0 to 530 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: oid 39 version 530 is already newer than 529 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: oid 39 version 530 is already newer than 528 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 530 (ObjNum 406 snap 116 seq_num 406) dirty exists 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: left oid 39 (ObjNum 406 snap 116 seq_num 406) 2026-02-13T18:10:08.738 INFO:tasks.rados.rados.0.trial187.stdout:1134: done (3 left) 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1136: done (2 left) 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1138: done (1 left) 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1139: read oid 47 snap 103 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1139: expect (ObjNum 346 snap 95 seq_num 346) 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1140: read oid 16 snap 111 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1140: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1141: rollback oid 34 current snap is 116 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 34 to 115 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1142: snap_create 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:1137: expect (ObjNum 379 snap 109 seq_num 379) 2026-02-13T18:10:08.739 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:08.769 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:08.801 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2092160 2026-02-13T18:10:08.803 INFO:tasks.rados.rados.0.trial187.stdout:1141: finishing rollback tid 0 to trial18717860-34 2026-02-13T18:10:08.803 INFO:tasks.rados.rados.0.trial187.stdout:1141: finishing rollback tid 1 to trial18717860-34 2026-02-13T18:10:08.803 INFO:tasks.rados.rados.0.trial187.stdout:1141: finishing rollback tid 2 to trial18717860-34 2026-02-13T18:10:08.803 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 252 (ObjNum 396 snap 114 seq_num 396) dirty exists 2026-02-13T18:10:08.803 INFO:tasks.rados.rados.0.trial187.stdout:1139: expect (ObjNum 346 snap 95 seq_num 346) 2026-02-13T18:10:08.803 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 47152 2026-02-13T18:10:08.865 INFO:tasks.rados.rados.0.trial187.stdout:1140: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:08.865 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:08.894 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1067116 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1137: done (4 left) 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1139: done (3 left) 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1140: done (2 left) 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1141: done (1 left) 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1142: done (0 left) 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1143: read oid 17 snap -1 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1143: expect deleted 2026-02-13T18:10:09.736 INFO:tasks.rados.rados.0.trial187.stdout:1144: write oid 22 current snap is 117 2026-02-13T18:10:09.737 INFO:tasks.rados.rados.0.trial187.stdout:1144: seq_num 409 ranges {474063=543550,1650547=514133,2765651=108412} 2026-02-13T18:10:09.742 INFO:tasks.rados.rados.0.trial187.stdout:1144: writing trial18717860-22 from 474063 to 1017613 tid 1 2026-02-13T18:10:09.749 INFO:tasks.rados.rados.0.trial187.stdout:1144: writing trial18717860-22 from 1650547 to 2164680 tid 2 2026-02-13T18:10:09.754 INFO:tasks.rados.rados.0.trial187.stdout:1144: writing trial18717860-22 from 2765651 to 2874063 tid 3 2026-02-13T18:10:09.755 INFO:tasks.rados.rados.0.trial187.stdout:1145: snap_remove snap 102 2026-02-13T18:10:10.737 INFO:tasks.rados.rados.0.trial187.stdout:1145: done (2 left) 2026-02-13T18:10:10.737 INFO:tasks.rados.rados.0.trial187.stdout:1146: snap_create 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: finishing write tid 1 to trial18717860-22 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: finishing write tid 2 to trial18717860-22 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: finishing write tid 3 to trial18717860-22 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: finishing write tid 4 to trial18717860-22 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: finishing write tid 5 to trial18717860-22 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: oid 22 updating version 0 to 584 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: oid 22 updating version 584 to 585 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: oid 22 version 585 is already newer than 583 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: oid 22 version 585 is already newer than 582 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 585 (ObjNum 409 snap 117 seq_num 409) dirty exists 2026-02-13T18:10:10.738 INFO:tasks.rados.rados.0.trial187.stdout:1144: left oid 22 (ObjNum 409 snap 117 seq_num 409) 2026-02-13T18:10:11.738 INFO:tasks.rados.rados.0.trial187.stdout:1143: done (2 left) 2026-02-13T18:10:11.739 INFO:tasks.rados.rados.0.trial187.stdout:1144: done (1 left) 2026-02-13T18:10:11.739 INFO:tasks.rados.rados.0.trial187.stdout:1146: done (0 left) 2026-02-13T18:10:11.739 INFO:tasks.rados.rados.0.trial187.stdout:1147: copy_from oid 11 from oid 19 current snap is 118 2026-02-13T18:10:11.739 INFO:tasks.rados.rados.0.trial187.stdout:1148: delete oid 39 current snap is 118 2026-02-13T18:10:11.742 INFO:tasks.rados.rados.0.trial187.stdout:1148: done (1 left) 2026-02-13T18:10:11.742 INFO:tasks.rados.rados.0.trial187.stdout:1149: copy_from oid 18 from oid 8 current snap is 118 2026-02-13T18:10:11.742 INFO:tasks.rados.rados.0.trial187.stdout:1150: delete oid 38 current snap is 118 2026-02-13T18:10:11.744 INFO:tasks.rados.rados.0.trial187.stdout:1150: done (2 left) 2026-02-13T18:10:11.744 INFO:tasks.rados.rados.0.trial187.stdout:1151: snap_create 2026-02-13T18:10:11.751 INFO:tasks.rados.rados.0.trial187.stdout:1147: finishing copy_from racing read to trial18717860-11 2026-02-13T18:10:11.752 INFO:tasks.rados.rados.0.trial187.stdout:1147: finishing copy_from to trial18717860-11 2026-02-13T18:10:11.752 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 284 (ObjNum 392 snap 113 seq_num 392) dirty exists 2026-02-13T18:10:11.757 INFO:tasks.rados.rados.0.trial187.stdout:1149: finishing copy_from racing read to trial18717860-18 2026-02-13T18:10:11.758 INFO:tasks.rados.rados.0.trial187.stdout:1149: finishing copy_from to trial18717860-18 2026-02-13T18:10:11.758 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 414 (ObjNum 347 snap 96 seq_num 347) dirty exists 2026-02-13T18:10:12.746 INFO:tasks.rados.rados.0.trial187.stdout:1147: done (2 left) 2026-02-13T18:10:12.747 INFO:tasks.rados.rados.0.trial187.stdout:1149: done (1 left) 2026-02-13T18:10:12.747 INFO:tasks.rados.rados.0.trial187.stdout:1151: done (0 left) 2026-02-13T18:10:12.747 INFO:tasks.rados.rados.0.trial187.stdout:1152: snap_create 2026-02-13T18:10:13.714 INFO:tasks.rados.rados.0.trial187.stdout:1152: done (0 left) 2026-02-13T18:10:13.715 INFO:tasks.rados.rados.0.trial187.stdout:1153: write (excl) oid 16 current snap is 120 2026-02-13T18:10:13.715 INFO:tasks.rados.rados.0.trial187.stdout:1153: seq_num 412 ranges {524484=485650,1425993=661460,2847920=76564} 2026-02-13T18:10:13.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: writing trial18717860-16 from 524484 to 1010134 tid 1 2026-02-13T18:10:13.728 INFO:tasks.rados.rados.0.trial187.stdout:1153: writing trial18717860-16 from 1425993 to 2087453 tid 2 2026-02-13T18:10:13.734 INFO:tasks.rados.rados.0.trial187.stdout:1153: writing trial18717860-16 from 2847920 to 2924484 tid 3 2026-02-13T18:10:13.734 INFO:tasks.rados.rados.0.trial187.stdout:1154: snap_remove snap 107 2026-02-13T18:10:14.717 INFO:tasks.rados.rados.0.trial187.stdout:1154: done (1 left) 2026-02-13T18:10:14.718 INFO:tasks.rados.rados.0.trial187.stdout:1155: write (excl) oid 45 current snap is 120 2026-02-13T18:10:14.718 INFO:tasks.rados.rados.0.trial187.stdout:1155: seq_num 413 ranges {541291=560899,1884475=521471} 2026-02-13T18:10:14.725 INFO:tasks.rados.rados.0.trial187.stdout:1155: writing trial18717860-45 from 541291 to 1102190 tid 1 2026-02-13T18:10:14.734 INFO:tasks.rados.rados.0.trial187.stdout:1155: writing trial18717860-45 from 1884475 to 2405946 tid 2 2026-02-13T18:10:14.734 INFO:tasks.rados.rados.0.trial187.stdout:1156: read oid 40 snap -1 2026-02-13T18:10:14.734 INFO:tasks.rados.rados.0.trial187.stdout:1156: expect deleted 2026-02-13T18:10:14.734 INFO:tasks.rados.rados.0.trial187.stdout:1157: snap_remove snap 116 2026-02-13T18:10:15.720 INFO:tasks.rados.rados.0.trial187.stdout:1157: done (3 left) 2026-02-13T18:10:15.720 INFO:tasks.rados.rados.0.trial187.stdout:1158: read oid 15 snap -1 2026-02-13T18:10:15.720 INFO:tasks.rados.rados.0.trial187.stdout:1158: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:10:15.720 INFO:tasks.rados.rados.0.trial187.stdout:1159: copy_from oid 29 from oid 22 current snap is 120 2026-02-13T18:10:15.720 INFO:tasks.rados.rados.0.trial187.stdout:1153: finishing write tid 1 to trial18717860-16 2026-02-13T18:10:15.720 INFO:tasks.rados.rados.0.trial187.stdout:1153: finishing write tid 2 to trial18717860-16 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: finishing write tid 3 to trial18717860-16 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: finishing write tid 4 to trial18717860-16 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: finishing write tid 5 to trial18717860-16 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: oid 16 updating version 0 to 301 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: oid 16 version 301 is already newer than 300 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: oid 16 version 301 is already newer than 299 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: oid 16 version 301 is already newer than 298 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 301 (ObjNum 412 snap 120 seq_num 412) dirty exists 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1153: left oid 16 (ObjNum 412 snap 120 seq_num 412) 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1155: finishing write tid 1 to trial18717860-45 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1155: finishing write tid 2 to trial18717860-45 2026-02-13T18:10:15.721 INFO:tasks.rados.rados.0.trial187.stdout:1155: finishing write tid 3 to trial18717860-45 2026-02-13T18:10:15.722 INFO:tasks.rados.rados.0.trial187.stdout:1153: done (4 left) 2026-02-13T18:10:15.722 INFO:tasks.rados.rados.0.trial187.stdout:1156: done (3 left) 2026-02-13T18:10:15.722 INFO:tasks.rados.rados.0.trial187.stdout:1160: write oid 40 current snap is 120 2026-02-13T18:10:15.722 INFO:tasks.rados.rados.0.trial187.stdout:1160: seq_num 414 ranges {558098=636148,1826604=665129} 2026-02-13T18:10:15.727 INFO:tasks.rados.rados.0.trial187.stdout:1160: writing trial18717860-40 from 558098 to 1194246 tid 1 2026-02-13T18:10:15.736 INFO:tasks.rados.rados.0.trial187.stdout:1160: writing trial18717860-40 from 1826604 to 2491733 tid 2 2026-02-13T18:10:15.736 INFO:tasks.rados.rados.0.trial187.stdout:1161: write (excl) oid 21 current snap is 120 2026-02-13T18:10:15.736 INFO:tasks.rados.rados.0.trial187.stdout:1161: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2026-02-13T18:10:15.744 INFO:tasks.rados.rados.0.trial187.stdout:1161: writing trial18717860-21 from 574905 to 1286302 tid 1 2026-02-13T18:10:15.751 INFO:tasks.rados.rados.0.trial187.stdout:1161: writing trial18717860-21 from 1885086 to 2410226 tid 2 2026-02-13T18:10:15.755 INFO:tasks.rados.rados.0.trial187.stdout:1161: writing trial18717860-21 from 2930189 to 2974905 tid 3 2026-02-13T18:10:15.756 INFO:tasks.rados.rados.0.trial187.stdout:1162: read oid 14 snap -1 2026-02-13T18:10:15.756 INFO:tasks.rados.rados.0.trial187.stdout:1162: expect (ObjNum 388 snap 110 seq_num 388) 2026-02-13T18:10:15.756 INFO:tasks.rados.rados.0.trial187.stdout:1163: write oid 34 current snap is 120 2026-02-13T18:10:15.756 INFO:tasks.rados.rados.0.trial187.stdout:1163: seq_num 416 ranges {591712=786646,1943568=668798} 2026-02-13T18:10:15.764 INFO:tasks.rados.rados.0.trial187.stdout:1163: writing trial18717860-34 from 591712 to 1378358 tid 1 2026-02-13T18:10:15.769 INFO:tasks.rados.rados.0.trial187.stdout:1163: writing trial18717860-34 from 1943568 to 2612366 tid 2 2026-02-13T18:10:15.769 INFO:tasks.rados.rados.0.trial187.stdout:1164: snap_create 2026-02-13T18:10:15.769 INFO:tasks.rados.rados.0.trial187.stdout:1155: finishing write tid 4 to trial18717860-45 2026-02-13T18:10:15.769 INFO:tasks.rados.rados.0.trial187.stdout:1155: oid 45 updating version 0 to 317 2026-02-13T18:10:15.769 INFO:tasks.rados.rados.0.trial187.stdout:1155: oid 45 version 317 is already newer than 315 2026-02-13T18:10:15.770 INFO:tasks.rados.rados.0.trial187.stdout:1155: oid 45 version 317 is already newer than 316 2026-02-13T18:10:15.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 317 (ObjNum 413 snap 120 seq_num 413) dirty exists 2026-02-13T18:10:15.770 INFO:tasks.rados.rados.0.trial187.stdout:1155: left oid 45 (ObjNum 413 snap 120 seq_num 413) 2026-02-13T18:10:15.770 INFO:tasks.rados.rados.0.trial187.stdout:1158: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:10:15.787 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: finishing write tid 1 to trial18717860-40 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1159: finishing copy_from racing read to trial18717860-29 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1159: finishing copy_from to trial18717860-29 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 585 (ObjNum 409 snap 117 seq_num 409) dirty exists 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: finishing write tid 2 to trial18717860-40 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: finishing write tid 3 to trial18717860-40 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: finishing write tid 4 to trial18717860-40 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: oid 40 updating version 0 to 319 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: oid 40 version 319 is already newer than 318 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: oid 40 updating version 319 to 320 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 320 (ObjNum 414 snap 120 seq_num 414) dirty exists 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1160: left oid 40 (ObjNum 414 snap 120 seq_num 414) 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: finishing write tid 1 to trial18717860-21 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: finishing write tid 2 to trial18717860-21 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: finishing write tid 3 to trial18717860-21 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: finishing write tid 4 to trial18717860-21 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: finishing write tid 5 to trial18717860-21 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: oid 21 updating version 0 to 372 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: oid 21 updating version 372 to 373 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: oid 21 version 373 is already newer than 371 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: oid 21 updating version 373 to 374 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 374 (ObjNum 415 snap 120 seq_num 415) dirty exists 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1161: left oid 21 (ObjNum 415 snap 120 seq_num 415) 2026-02-13T18:10:15.835 INFO:tasks.rados.rados.0.trial187.stdout:1162: expect (ObjNum 388 snap 110 seq_num 388) 2026-02-13T18:10:15.940 INFO:tasks.rados.rados.0.trial187.stdout:1163: finishing write tid 1 to trial18717860-34 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: finishing write tid 2 to trial18717860-34 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: finishing write tid 3 to trial18717860-34 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: finishing write tid 4 to trial18717860-34 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: oid 34 updating version 0 to 285 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: oid 34 updating version 285 to 287 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: oid 34 version 287 is already newer than 286 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 287 (ObjNum 416 snap 120 seq_num 416) dirty exists 2026-02-13T18:10:15.941 INFO:tasks.rados.rados.0.trial187.stdout:1163: left oid 34 (ObjNum 416 snap 120 seq_num 416) 2026-02-13T18:10:16.726 INFO:tasks.rados.rados.0.trial187.stdout:1155: done (7 left) 2026-02-13T18:10:16.726 INFO:tasks.rados.rados.0.trial187.stdout:1158: done (6 left) 2026-02-13T18:10:16.726 INFO:tasks.rados.rados.0.trial187.stdout:1159: done (5 left) 2026-02-13T18:10:16.726 INFO:tasks.rados.rados.0.trial187.stdout:1160: done (4 left) 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1161: done (3 left) 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1162: done (2 left) 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1163: done (1 left) 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1164: done (0 left) 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1165: read oid 31 snap -1 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1165: expect deleted 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1166: rollback oid 21 current snap is 121 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 100 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1167: read oid 50 snap -1 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1167: expect (ObjNum 372 snap 106 seq_num 372) 2026-02-13T18:10:16.727 INFO:tasks.rados.rados.0.trial187.stdout:1168: write oid 33 current snap is 121 2026-02-13T18:10:16.728 INFO:tasks.rados.rados.0.trial187.stdout:1168: seq_num 417 ranges {608519=461895,1602050=528809,2585035=423484} 2026-02-13T18:10:16.730 INFO:tasks.rados.rados.0.trial187.stdout:1168: writing trial18717860-33 from 608519 to 1070414 tid 1 2026-02-13T18:10:16.734 INFO:tasks.rados.rados.0.trial187.stdout:1168: writing trial18717860-33 from 1602050 to 2130859 tid 2 2026-02-13T18:10:16.738 INFO:tasks.rados.rados.0.trial187.stdout:1168: writing trial18717860-33 from 2585035 to 3008519 tid 3 2026-02-13T18:10:16.738 INFO:tasks.rados.rados.0.trial187.stdout:1169: write (excl) oid 25 current snap is 121 2026-02-13T18:10:16.738 INFO:tasks.rados.rados.0.trial187.stdout:1169: seq_num 418 ranges {625326=537144,1944179=672467} 2026-02-13T18:10:16.742 INFO:tasks.rados.rados.0.trial187.stdout:1169: writing trial18717860-25 from 625326 to 1162470 tid 1 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:1169: writing trial18717860-25 from 1944179 to 2616646 tid 2 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:1170: rollback oid 44 current snap is 121 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 120 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:1166: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:1166: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:1166: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:10:16.748 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 378 (ObjNum 342 snap 94 seq_num 342) dirty exists 2026-02-13T18:10:16.749 INFO:tasks.rados.rados.0.trial187.stdout:1167: expect (ObjNum 372 snap 106 seq_num 372) 2026-02-13T18:10:16.749 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:16.846 INFO:tasks.rados.rados.0.trial187.stdout:1168: finishing write tid 1 to trial18717860-33 2026-02-13T18:10:16.846 INFO:tasks.rados.rados.0.trial187.stdout:1168: finishing write tid 2 to trial18717860-33 2026-02-13T18:10:16.846 INFO:tasks.rados.rados.0.trial187.stdout:1168: finishing write tid 3 to trial18717860-33 2026-02-13T18:10:16.846 INFO:tasks.rados.rados.0.trial187.stdout:1168: finishing write tid 4 to trial18717860-33 2026-02-13T18:10:16.847 INFO:tasks.rados.rados.0.trial187.stdout:1165: done (5 left) 2026-02-13T18:10:16.847 INFO:tasks.rados.rados.0.trial187.stdout:1166: done (4 left) 2026-02-13T18:10:16.847 INFO:tasks.rados.rados.0.trial187.stdout:1167: done (3 left) 2026-02-13T18:10:16.847 INFO:tasks.rados.rados.0.trial187.stdout:1171: write (excl) oid 17 current snap is 121 2026-02-13T18:10:16.847 INFO:tasks.rados.rados.0.trial187.stdout:1171: seq_num 419 ranges {642133=728746,2119014=532478} 2026-02-13T18:10:16.851 INFO:tasks.rados.rados.0.trial187.stdout:1171: writing trial18717860-17 from 642133 to 1370879 tid 1 2026-02-13T18:10:16.856 INFO:tasks.rados.rados.0.trial187.stdout:1171: writing trial18717860-17 from 2119014 to 2651492 tid 2 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1172: snap_create 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1168: finishing write tid 5 to trial18717860-33 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1168: oid 33 updating version 0 to 601 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1168: oid 33 version 601 is already newer than 600 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1168: oid 33 version 601 is already newer than 599 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1168: oid 33 version 601 is already newer than 598 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 601 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1168: left oid 33 (ObjNum 417 snap 121 seq_num 417) 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1169: finishing write tid 1 to trial18717860-25 2026-02-13T18:10:16.857 INFO:tasks.rados.rados.0.trial187.stdout:1169: finishing write tid 2 to trial18717860-25 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1170: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1170: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1169: finishing write tid 3 to trial18717860-25 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1169: finishing write tid 4 to trial18717860-25 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1169: oid 25 updating version 0 to 305 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1169: oid 25 version 305 is already newer than 303 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1169: oid 25 version 305 is already newer than 304 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 305 (ObjNum 418 snap 121 seq_num 418) dirty exists 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1169: left oid 25 (ObjNum 418 snap 121 seq_num 418) 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1170: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 605 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:10:16.858 INFO:tasks.rados.rados.0.trial187.stdout:1171: finishing write tid 1 to trial18717860-17 2026-02-13T18:10:16.861 INFO:tasks.rados.rados.0.trial187.stdout:1171: finishing write tid 2 to trial18717860-17 2026-02-13T18:10:16.862 INFO:tasks.rados.rados.0.trial187.stdout:1171: finishing write tid 3 to trial18717860-17 2026-02-13T18:10:16.862 INFO:tasks.rados.rados.0.trial187.stdout:1171: finishing write tid 4 to trial18717860-17 2026-02-13T18:10:16.862 INFO:tasks.rados.rados.0.trial187.stdout:1171: oid 17 updating version 0 to 544 2026-02-13T18:10:16.862 INFO:tasks.rados.rados.0.trial187.stdout:1171: oid 17 updating version 544 to 545 2026-02-13T18:10:16.862 INFO:tasks.rados.rados.0.trial187.stdout:1171: oid 17 version 545 is already newer than 543 2026-02-13T18:10:16.862 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 545 (ObjNum 419 snap 121 seq_num 419) dirty exists 2026-02-13T18:10:16.863 INFO:tasks.rados.rados.0.trial187.stdout:1171: left oid 17 (ObjNum 419 snap 121 seq_num 419) 2026-02-13T18:10:17.727 INFO:tasks.rados.rados.0.trial187.stdout:1168: done (4 left) 2026-02-13T18:10:17.727 INFO:tasks.rados.rados.0.trial187.stdout:1169: done (3 left) 2026-02-13T18:10:17.727 INFO:tasks.rados.rados.0.trial187.stdout:1170: done (2 left) 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:1171: done (1 left) 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:1172: done (0 left) 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:1173: rollback oid 27 current snap is 122 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 111 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:1174: copy_from oid 10 from oid 26 current snap is 122 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:1175: copy_from oid 36 from oid 28 current snap is 122 2026-02-13T18:10:17.728 INFO:tasks.rados.rados.0.trial187.stdout:1176: snap_remove snap 119 2026-02-13T18:10:18.716 INFO:tasks.rados.rados.0.trial187.stdout:1176: done (3 left) 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1177: read oid 50 snap 113 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1177: expect (ObjNum 372 snap 106 seq_num 372) 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1178: read oid 30 snap -1 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1178: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1179: write (excl) oid 5 current snap is 122 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1175: finishing copy_from to trial18717860-36 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1175: got expected ENOENT (src dne) 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1175: finishing copy_from racing read to trial18717860-36 2026-02-13T18:10:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1173: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:1173: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:1173: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 308 (ObjNum 351 snap 97 seq_num 351) dirty exists 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:1174: finishing copy_from racing read to trial18717860-10 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:1174: finishing copy_from to trial18717860-10 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 508 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:10:18.718 INFO:tasks.rados.rados.0.trial187.stdout:1179: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2026-02-13T18:10:18.723 INFO:tasks.rados.rados.0.trial187.stdout:1179: writing trial18717860-5 from 658940 to 1062935 tid 1 2026-02-13T18:10:18.732 INFO:tasks.rados.rados.0.trial187.stdout:1179: writing trial18717860-5 from 1777496 to 2453632 tid 2 2026-02-13T18:10:18.736 INFO:tasks.rados.rados.0.trial187.stdout:1179: writing trial18717860-5 from 2950951 to 3058940 tid 3 2026-02-13T18:10:18.737 INFO:tasks.rados.rados.0.trial187.stdout:1173: done (5 left) 2026-02-13T18:10:18.737 INFO:tasks.rados.rados.0.trial187.stdout:1174: done (4 left) 2026-02-13T18:10:18.737 INFO:tasks.rados.rados.0.trial187.stdout:1175: done (3 left) 2026-02-13T18:10:18.737 INFO:tasks.rados.rados.0.trial187.stdout:1180: write oid 47 current snap is 122 2026-02-13T18:10:18.737 INFO:tasks.rados.rados.0.trial187.stdout:1180: seq_num 421 ranges {675747=479244,1835978=536147} 2026-02-13T18:10:18.744 INFO:tasks.rados.rados.0.trial187.stdout:1180: writing trial18717860-47 from 675747 to 1154991 tid 1 2026-02-13T18:10:18.753 INFO:tasks.rados.rados.0.trial187.stdout:1180: writing trial18717860-47 from 1835978 to 2372125 tid 2 2026-02-13T18:10:18.753 INFO:tasks.rados.rados.0.trial187.stdout:1181: read oid 32 snap -1 2026-02-13T18:10:18.753 INFO:tasks.rados.rados.0.trial187.stdout:1181: expect deleted 2026-02-13T18:10:18.753 INFO:tasks.rados.rados.0.trial187.stdout:1182: read oid 31 snap -1 2026-02-13T18:10:18.753 INFO:tasks.rados.rados.0.trial187.stdout:1182: expect deleted 2026-02-13T18:10:18.753 INFO:tasks.rados.rados.0.trial187.stdout:1183: snap_remove snap 120 2026-02-13T18:10:19.733 INFO:tasks.rados.rados.0.trial187.stdout:1183: done (6 left) 2026-02-13T18:10:19.734 INFO:tasks.rados.rados.0.trial187.stdout:1184: write (excl) oid 4 current snap is 122 2026-02-13T18:10:19.734 INFO:tasks.rados.rados.0.trial187.stdout:1184: seq_num 422 ranges {692554=554493,1778107=679805,2889444=203110} 2026-02-13T18:10:19.741 INFO:tasks.rados.rados.0.trial187.stdout:1184: writing trial18717860-4 from 692554 to 1247047 tid 1 2026-02-13T18:10:19.750 INFO:tasks.rados.rados.0.trial187.stdout:1184: writing trial18717860-4 from 1778107 to 2457912 tid 2 2026-02-13T18:10:19.754 INFO:tasks.rados.rados.0.trial187.stdout:1184: writing trial18717860-4 from 2889444 to 3092554 tid 3 2026-02-13T18:10:19.754 INFO:tasks.rados.rados.0.trial187.stdout:1185: rollback oid 46 current snap is 122 2026-02-13T18:10:19.754 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 103 2026-02-13T18:10:19.754 INFO:tasks.rados.rados.0.trial187.stdout:1178: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:19.818 INFO:tasks.rados.rados.0.trial187.stdout:1177: expect (ObjNum 372 snap 106 seq_num 372) 2026-02-13T18:10:19.901 INFO:tasks.rados.rados.0.trial187.stdout:1179: finishing write tid 1 to trial18717860-5 2026-02-13T18:10:19.901 INFO:tasks.rados.rados.0.trial187.stdout:1179: finishing write tid 2 to trial18717860-5 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1179: finishing write tid 3 to trial18717860-5 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1177: done (7 left) 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1178: done (6 left) 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1186: read oid 30 snap -1 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1186: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1187: read oid 15 snap -1 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1187: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1188: rollback oid 45 current snap is 122 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 103 2026-02-13T18:10:19.902 INFO:tasks.rados.rados.0.trial187.stdout:1179: finishing write tid 4 to trial18717860-5 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: finishing write tid 5 to trial18717860-5 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: oid 5 updating version 0 to 323 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: oid 5 updating version 323 to 324 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: oid 5 version 324 is already newer than 321 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: oid 5 version 324 is already newer than 322 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 324 (ObjNum 420 snap 122 seq_num 420) dirty exists 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: left oid 5 (ObjNum 420 snap 122 seq_num 420) 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1180: finishing write tid 1 to trial18717860-47 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1179: done (8 left) 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1189: write oid 25 current snap is 122 2026-02-13T18:10:19.903 INFO:tasks.rados.rados.0.trial187.stdout:1189: seq_num 423 ranges {709361=629742,1836589=539816,3033220=76141} 2026-02-13T18:10:19.909 INFO:tasks.rados.rados.0.trial187.stdout:1189: writing trial18717860-25 from 709361 to 1339103 tid 1 2026-02-13T18:10:19.916 INFO:tasks.rados.rados.0.trial187.stdout:1189: writing trial18717860-25 from 1836589 to 2376405 tid 2 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1189: writing trial18717860-25 from 3033220 to 3109361 tid 3 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1190: snap_create 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1180: finishing write tid 2 to trial18717860-47 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1180: finishing write tid 3 to trial18717860-47 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1180: finishing write tid 4 to trial18717860-47 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1180: oid 47 updating version 0 to 303 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1180: oid 47 version 303 is already newer than 302 2026-02-13T18:10:19.922 INFO:tasks.rados.rados.0.trial187.stdout:1180: oid 47 updating version 303 to 304 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 304 (ObjNum 421 snap 122 seq_num 421) dirty exists 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1180: left oid 47 (ObjNum 421 snap 122 seq_num 421) 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: finishing write tid 1 to trial18717860-4 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: finishing write tid 2 to trial18717860-4 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: finishing write tid 3 to trial18717860-4 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: finishing write tid 4 to trial18717860-4 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: finishing write tid 5 to trial18717860-4 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: oid 4 updating version 0 to 219 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: oid 4 version 219 is already newer than 218 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: oid 4 updating version 219 to 220 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:1184: oid 4 updating version 220 to 221 2026-02-13T18:10:19.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 221 (ObjNum 422 snap 122 seq_num 422) dirty exists 2026-02-13T18:10:19.924 INFO:tasks.rados.rados.0.trial187.stdout:1184: left oid 4 (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:10:19.924 INFO:tasks.rados.rados.0.trial187.stdout:1185: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:10:19.924 INFO:tasks.rados.rados.0.trial187.stdout:1185: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:10:19.924 INFO:tasks.rados.rados.0.trial187.stdout:1185: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:10:19.924 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 386 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:10:19.924 INFO:tasks.rados.rados.0.trial187.stdout:1186: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:19.926 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1268920 2026-02-13T18:10:19.979 INFO:tasks.rados.rados.0.trial187.stdout:1187: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:10:20.024 INFO:tasks.rados.rados.0.trial187.stdout:1188: finishing rollback tid 0 to trial18717860-45 2026-02-13T18:10:20.024 INFO:tasks.rados.rados.0.trial187.stdout:1188: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:10:20.024 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 327 (ObjNum 801 snap 0 seq_num 4015649384) dirty dne 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: finishing write tid 1 to trial18717860-25 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: finishing write tid 2 to trial18717860-25 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: finishing write tid 3 to trial18717860-25 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: finishing write tid 4 to trial18717860-25 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: finishing write tid 5 to trial18717860-25 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: oid 25 updating version 0 to 310 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: oid 25 version 310 is already newer than 309 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: oid 25 updating version 310 to 311 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: oid 25 updating version 311 to 312 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 312 (ObjNum 423 snap 122 seq_num 423) dirty exists 2026-02-13T18:10:20.025 INFO:tasks.rados.rados.0.trial187.stdout:1189: left oid 25 (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:10:20.737 INFO:tasks.rados.rados.0.trial187.stdout:1180: done (9 left) 2026-02-13T18:10:20.738 INFO:tasks.rados.rados.0.trial187.stdout:1181: done (8 left) 2026-02-13T18:10:20.738 INFO:tasks.rados.rados.0.trial187.stdout:1182: done (7 left) 2026-02-13T18:10:20.738 INFO:tasks.rados.rados.0.trial187.stdout:1184: done (6 left) 2026-02-13T18:10:20.738 INFO:tasks.rados.rados.0.trial187.stdout:1185: done (5 left) 2026-02-13T18:10:20.738 INFO:tasks.rados.rados.0.trial187.stdout:1186: done (4 left) 2026-02-13T18:10:20.738 INFO:tasks.rados.rados.0.trial187.stdout:1187: done (3 left) 2026-02-13T18:10:20.739 INFO:tasks.rados.rados.0.trial187.stdout:1188: done (2 left) 2026-02-13T18:10:20.739 INFO:tasks.rados.rados.0.trial187.stdout:1189: done (1 left) 2026-02-13T18:10:20.739 INFO:tasks.rados.rados.0.trial187.stdout:1190: done (0 left) 2026-02-13T18:10:20.739 INFO:tasks.rados.rados.0.trial187.stdout:1191: copy_from oid 35 from oid 10 current snap is 123 2026-02-13T18:10:20.739 INFO:tasks.rados.rados.0.trial187.stdout:1192: snap_create 2026-02-13T18:10:20.750 INFO:tasks.rados.rados.0.trial187.stdout:1191: finishing copy_from racing read to trial18717860-35 2026-02-13T18:10:20.751 INFO:tasks.rados.rados.0.trial187.stdout:1191: finishing copy_from to trial18717860-35 2026-02-13T18:10:20.751 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 508 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:10:21.738 INFO:tasks.rados.rados.0.trial187.stdout:1191: done (1 left) 2026-02-13T18:10:21.739 INFO:tasks.rados.rados.0.trial187.stdout:1192: done (0 left) 2026-02-13T18:10:21.739 INFO:tasks.rados.rados.0.trial187.stdout:1193: read oid 3 snap -1 2026-02-13T18:10:21.739 INFO:tasks.rados.rados.0.trial187.stdout:1193: expect (ObjNum 388 snap 110 seq_num 388) 2026-02-13T18:10:21.739 INFO:tasks.rados.rados.0.trial187.stdout:1194: write oid 29 current snap is 124 2026-02-13T18:10:21.739 INFO:tasks.rados.rados.0.trial187.stdout:1194: seq_num 424 ranges {726168=704991,1895071=683474} 2026-02-13T18:10:21.747 INFO:tasks.rados.rados.0.trial187.stdout:1194: writing trial18717860-29 from 726168 to 1431159 tid 1 2026-02-13T18:10:21.755 INFO:tasks.rados.rados.0.trial187.stdout:1194: writing trial18717860-29 from 1895071 to 2578545 tid 2 2026-02-13T18:10:21.755 INFO:tasks.rados.rados.0.trial187.stdout:1195: write oid 11 current snap is 124 2026-02-13T18:10:21.756 INFO:tasks.rados.rados.0.trial187.stdout:1195: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2026-02-13T18:10:21.765 INFO:tasks.rados.rados.0.trial187.stdout:1195: writing trial18717860-11 from 742975 to 1523215 tid 1 2026-02-13T18:10:21.771 INFO:tasks.rados.rados.0.trial187.stdout:1195: writing trial18717860-11 from 1953553 to 2380685 tid 2 2026-02-13T18:10:21.777 INFO:tasks.rados.rados.0.trial187.stdout:1195: writing trial18717860-11 from 2971713 to 3142975 tid 3 2026-02-13T18:10:21.777 INFO:tasks.rados.rados.0.trial187.stdout:1196: delete oid 16 current snap is 124 2026-02-13T18:10:21.777 INFO:tasks.rados.rados.0.trial187.stdout:1193: expect (ObjNum 388 snap 110 seq_num 388) 2026-02-13T18:10:21.777 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:21.874 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 527079 2026-02-13T18:10:21.907 INFO:tasks.rados.rados.0.trial187.stdout:1194: finishing write tid 1 to trial18717860-29 2026-02-13T18:10:21.907 INFO:tasks.rados.rados.0.trial187.stdout:1194: finishing write tid 2 to trial18717860-29 2026-02-13T18:10:21.907 INFO:tasks.rados.rados.0.trial187.stdout:1194: finishing write tid 3 to trial18717860-29 2026-02-13T18:10:21.907 INFO:tasks.rados.rados.0.trial187.stdout:1193: done (3 left) 2026-02-13T18:10:21.907 INFO:tasks.rados.rados.0.trial187.stdout:1196: done (2 left) 2026-02-13T18:10:21.907 INFO:tasks.rados.rados.0.trial187.stdout:1197: snap_remove snap 118 2026-02-13T18:10:22.743 INFO:tasks.rados.rados.0.trial187.stdout:1197: done (2 left) 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1198: snap_create 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1194: finishing write tid 4 to trial18717860-29 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1194: oid 29 updating version 0 to 588 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1194: oid 29 version 588 is already newer than 586 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1194: oid 29 version 588 is already newer than 587 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 588 (ObjNum 424 snap 124 seq_num 424) dirty exists 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1194: left oid 29 (ObjNum 424 snap 124 seq_num 424) 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1195: finishing write tid 1 to trial18717860-11 2026-02-13T18:10:22.744 INFO:tasks.rados.rados.0.trial187.stdout:1195: finishing write tid 2 to trial18717860-11 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: finishing write tid 3 to trial18717860-11 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: finishing write tid 4 to trial18717860-11 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: finishing write tid 5 to trial18717860-11 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: oid 11 updating version 0 to 291 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: oid 11 version 291 is already newer than 290 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: oid 11 version 291 is already newer than 289 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: oid 11 version 291 is already newer than 288 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 291 (ObjNum 425 snap 124 seq_num 425) dirty exists 2026-02-13T18:10:22.745 INFO:tasks.rados.rados.0.trial187.stdout:1195: left oid 11 (ObjNum 425 snap 124 seq_num 425) 2026-02-13T18:10:23.717 INFO:tasks.rados.rados.0.trial187.stdout:1194: done (2 left) 2026-02-13T18:10:23.717 INFO:tasks.rados.rados.0.trial187.stdout:1195: done (1 left) 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:1198: done (0 left) 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:1199: rollback oid 24 current snap is 125 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 99 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:1200: read oid 13 snap -1 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:1200: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:1201: write oid 31 current snap is 125 2026-02-13T18:10:23.718 INFO:tasks.rados.rados.0.trial187.stdout:1201: seq_num 427 ranges {776589=647091,2070517=430801,3026559=150030} 2026-02-13T18:10:23.726 INFO:tasks.rados.rados.0.trial187.stdout:1201: writing trial18717860-31 from 776589 to 1423680 tid 1 2026-02-13T18:10:23.733 INFO:tasks.rados.rados.0.trial187.stdout:1201: writing trial18717860-31 from 2070517 to 2501318 tid 2 2026-02-13T18:10:23.738 INFO:tasks.rados.rados.0.trial187.stdout:1201: writing trial18717860-31 from 3026559 to 3176589 tid 3 2026-02-13T18:10:23.738 INFO:tasks.rados.rados.0.trial187.stdout:1202: write oid 20 current snap is 125 2026-02-13T18:10:23.738 INFO:tasks.rados.rados.0.trial187.stdout:1202: seq_num 428 ranges {793396=722340,2128999=690812} 2026-02-13T18:10:23.748 INFO:tasks.rados.rados.0.trial187.stdout:1202: writing trial18717860-20 from 793396 to 1515736 tid 1 2026-02-13T18:10:23.757 INFO:tasks.rados.rados.0.trial187.stdout:1202: writing trial18717860-20 from 2128999 to 2819811 tid 2 2026-02-13T18:10:23.757 INFO:tasks.rados.rados.0.trial187.stdout:1203: snap_remove snap 111 2026-02-13T18:10:24.747 INFO:tasks.rados.rados.0.trial187.stdout:1203: done (4 left) 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1204: copy_from oid 8 from oid 39 current snap is 125 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1199: finishing rollback tid 0 to trial18717860-24 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1199: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1199: finishing rollback tid 2 to trial18717860-24 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 412 (ObjNum 264 snap 82 seq_num 264) dirty exists 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1199: done (4 left) 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1205: write oid 17 current snap is 125 2026-02-13T18:10:24.748 INFO:tasks.rados.rados.0.trial187.stdout:1205: seq_num 429 ranges {410203=797589,1787481=434470,2681405=528798} 2026-02-13T18:10:24.755 INFO:tasks.rados.rados.0.trial187.stdout:1205: writing trial18717860-17 from 410203 to 1207792 tid 1 2026-02-13T18:10:24.762 INFO:tasks.rados.rados.0.trial187.stdout:1205: writing trial18717860-17 from 1787481 to 2221951 tid 2 2026-02-13T18:10:24.769 INFO:tasks.rados.rados.0.trial187.stdout:1205: writing trial18717860-17 from 2681405 to 3210203 tid 3 2026-02-13T18:10:24.769 INFO:tasks.rados.rados.0.trial187.stdout:1206: write (excl) oid 4 current snap is 125 2026-02-13T18:10:24.769 INFO:tasks.rados.rados.0.trial187.stdout:1206: seq_num 430 ranges {427010=472838,1329610=694481,2708828=518182} 2026-02-13T18:10:24.775 INFO:tasks.rados.rados.0.trial187.stdout:1206: writing trial18717860-4 from 427010 to 899848 tid 1 2026-02-13T18:10:24.782 INFO:tasks.rados.rados.0.trial187.stdout:1206: writing trial18717860-4 from 1329610 to 2024091 tid 2 2026-02-13T18:10:24.790 INFO:tasks.rados.rados.0.trial187.stdout:1206: writing trial18717860-4 from 2708828 to 3227010 tid 3 2026-02-13T18:10:24.791 INFO:tasks.rados.rados.0.trial187.stdout:1207: copy_from oid 14 from oid 38 current snap is 125 2026-02-13T18:10:24.791 INFO:tasks.rados.rados.0.trial187.stdout:1200: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:10:24.925 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:24.987 INFO:tasks.rados.rados.0.trial187.stdout:1201: finishing write tid 1 to trial18717860-31 2026-02-13T18:10:24.987 INFO:tasks.rados.rados.0.trial187.stdout:1201: finishing write tid 2 to trial18717860-31 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: finishing write tid 3 to trial18717860-31 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: finishing write tid 4 to trial18717860-31 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: finishing write tid 5 to trial18717860-31 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: oid 31 updating version 0 to 224 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: oid 31 updating version 224 to 225 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: oid 31 updating version 225 to 227 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: oid 31 version 227 is already newer than 226 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 227 (ObjNum 427 snap 125 seq_num 427) dirty exists 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1201: left oid 31 (ObjNum 427 snap 125 seq_num 427) 2026-02-13T18:10:24.988 INFO:tasks.rados.rados.0.trial187.stdout:1202: finishing write tid 1 to trial18717860-20 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: finishing write tid 2 to trial18717860-20 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: finishing write tid 3 to trial18717860-20 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: finishing write tid 4 to trial18717860-20 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: oid 20 updating version 0 to 306 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: oid 20 updating version 306 to 308 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: oid 20 version 308 is already newer than 307 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 308 (ObjNum 428 snap 125 seq_num 428) dirty exists 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1202: left oid 20 (ObjNum 428 snap 125 seq_num 428) 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1204: finishing copy_from to trial18717860-8 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1204: got expected ENOENT (src dne) 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1200: done (6 left) 2026-02-13T18:10:24.989 INFO:tasks.rados.rados.0.trial187.stdout:1201: done (5 left) 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1202: done (4 left) 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1208: rollback oid 24 current snap is 125 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 99 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1204: finishing copy_from racing read to trial18717860-8 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: finishing write tid 1 to trial18717860-17 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: finishing write tid 2 to trial18717860-17 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: finishing write tid 3 to trial18717860-17 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: finishing write tid 4 to trial18717860-17 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: finishing write tid 5 to trial18717860-17 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: oid 17 updating version 0 to 552 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: oid 17 version 552 is already newer than 551 2026-02-13T18:10:24.990 INFO:tasks.rados.rados.0.trial187.stdout:1205: oid 17 version 552 is already newer than 550 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1205: oid 17 version 552 is already newer than 549 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 552 (ObjNum 429 snap 125 seq_num 429) dirty exists 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1205: left oid 17 (ObjNum 429 snap 125 seq_num 429) 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1206: finishing write tid 1 to trial18717860-4 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1206: finishing write tid 2 to trial18717860-4 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1207: finishing copy_from to trial18717860-14 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1207: got expected ENOENT (src dne) 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1207: finishing copy_from racing read to trial18717860-14 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1206: finishing write tid 3 to trial18717860-4 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1206: finishing write tid 4 to trial18717860-4 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1206: finishing write tid 5 to trial18717860-4 2026-02-13T18:10:24.991 INFO:tasks.rados.rados.0.trial187.stdout:1206: oid 4 updating version 0 to 235 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1206: oid 4 updating version 235 to 236 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1206: oid 4 version 236 is already newer than 234 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1206: oid 4 version 236 is already newer than 233 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 236 (ObjNum 430 snap 125 seq_num 430) dirty exists 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1206: left oid 4 (ObjNum 430 snap 125 seq_num 430) 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1204: done (4 left) 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1205: done (3 left) 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1206: done (2 left) 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1207: done (1 left) 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1209: rollback oid 49 current snap is 125 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 103 2026-02-13T18:10:24.992 INFO:tasks.rados.rados.0.trial187.stdout:1210: write oid 41 current snap is 125 2026-02-13T18:10:24.993 INFO:tasks.rados.rados.0.trial187.stdout:1210: seq_num 431 ranges {443817=548087,1788092=438139,3019898=223919} 2026-02-13T18:10:24.993 INFO:tasks.rados.rados.0.trial187.stdout:1210: writing trial18717860-41 from 443817 to 991904 tid 1 2026-02-13T18:10:24.997 INFO:tasks.rados.rados.0.trial187.stdout:1210: writing trial18717860-41 from 1788092 to 2226231 tid 2 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:1210: writing trial18717860-41 from 3019898 to 3243817 tid 3 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:1211: read oid 9 snap 99 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:1211: expect deleted 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:1212: rollback oid 37 current snap is 125 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 115 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:1209: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:10:25.005 INFO:tasks.rados.rados.0.trial187.stdout:1209: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 293 (ObjNum 361 snap 102 seq_num 361) dirty exists 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:1208: finishing rollback tid 0 to trial18717860-24 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:1208: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:1208: finishing rollback tid 2 to trial18717860-24 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 415 (ObjNum 264 snap 82 seq_num 264) dirty exists 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:1208: done (4 left) 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:1209: done (3 left) 2026-02-13T18:10:25.006 INFO:tasks.rados.rados.0.trial187.stdout:1213: snap_remove snap 100 2026-02-13T18:10:25.751 INFO:tasks.rados.rados.0.trial187.stdout:1213: done (3 left) 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1214: copy_from oid 24 from oid 31 current snap is 125 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: finishing write tid 1 to trial18717860-41 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: finishing write tid 2 to trial18717860-41 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: finishing write tid 3 to trial18717860-41 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: finishing write tid 4 to trial18717860-41 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: finishing write tid 5 to trial18717860-41 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: oid 41 updating version 0 to 272 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: oid 41 version 272 is already newer than 269 2026-02-13T18:10:25.752 INFO:tasks.rados.rados.0.trial187.stdout:1210: oid 41 version 272 is already newer than 271 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1210: oid 41 version 272 is already newer than 270 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 272 (ObjNum 431 snap 125 seq_num 431) dirty exists 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1210: left oid 41 (ObjNum 431 snap 125 seq_num 431) 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1212: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 548 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1210: done (3 left) 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1211: done (2 left) 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1212: done (1 left) 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1215: rollback oid 19 current snap is 125 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 121 2026-02-13T18:10:25.753 INFO:tasks.rados.rados.0.trial187.stdout:1216: write (excl) oid 28 current snap is 125 2026-02-13T18:10:25.754 INFO:tasks.rados.rados.0.trial187.stdout:1216: seq_num 432 ranges {460624=623336,1846574=698150,3163674=96950} 2026-02-13T18:10:25.758 INFO:tasks.rados.rados.0.trial187.stdout:1216: writing trial18717860-28 from 460624 to 1083960 tid 1 2026-02-13T18:10:25.768 INFO:tasks.rados.rados.0.trial187.stdout:1216: writing trial18717860-28 from 1846574 to 2544724 tid 2 2026-02-13T18:10:25.773 INFO:tasks.rados.rados.0.trial187.stdout:1216: writing trial18717860-28 from 3163674 to 3260624 tid 3 2026-02-13T18:10:25.773 INFO:tasks.rados.rados.0.trial187.stdout:1217: copy_from oid 38 from oid 16 current snap is 125 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1215: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1215: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1215: finishing rollback tid 2 to trial18717860-19 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 591 (ObjNum 392 snap 113 seq_num 392) dirty exists 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1214: finishing copy_from racing read to trial18717860-24 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1214: finishing copy_from to trial18717860-24 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 227 (ObjNum 427 snap 125 seq_num 427) dirty exists 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1216: finishing write tid 1 to trial18717860-28 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1216: finishing write tid 2 to trial18717860-28 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1214: done (3 left) 2026-02-13T18:10:25.774 INFO:tasks.rados.rados.0.trial187.stdout:1215: done (2 left) 2026-02-13T18:10:25.775 INFO:tasks.rados.rados.0.trial187.stdout:1218: delete oid 40 current snap is 125 2026-02-13T18:10:25.775 INFO:tasks.rados.rados.0.trial187.stdout:1217: finishing copy_from to trial18717860-38 2026-02-13T18:10:25.775 INFO:tasks.rados.rados.0.trial187.stdout:1217: got expected ENOENT (src dne) 2026-02-13T18:10:25.775 INFO:tasks.rados.rados.0.trial187.stdout:1217: finishing copy_from racing read to trial18717860-38 2026-02-13T18:10:25.776 INFO:tasks.rados.rados.0.trial187.stdout:1216: finishing write tid 3 to trial18717860-28 2026-02-13T18:10:25.776 INFO:tasks.rados.rados.0.trial187.stdout:1216: finishing write tid 4 to trial18717860-28 2026-02-13T18:10:25.776 INFO:tasks.rados.rados.0.trial187.stdout:1216: finishing write tid 5 to trial18717860-28 2026-02-13T18:10:25.776 INFO:tasks.rados.rados.0.trial187.stdout:1216: oid 28 updating version 0 to 419 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1216: oid 28 version 419 is already newer than 416 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1216: oid 28 version 419 is already newer than 418 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1216: oid 28 version 419 is already newer than 417 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 419 (ObjNum 432 snap 125 seq_num 432) dirty exists 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1216: left oid 28 (ObjNum 432 snap 125 seq_num 432) 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1216: done (2 left) 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1217: done (1 left) 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1218: done (0 left) 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1219: copy_from oid 16 from oid 28 current snap is 125 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1220: read oid 31 snap -1 2026-02-13T18:10:25.777 INFO:tasks.rados.rados.0.trial187.stdout:1220: expect (ObjNum 427 snap 125 seq_num 427) 2026-02-13T18:10:25.778 INFO:tasks.rados.rados.0.trial187.stdout:1221: read oid 30 snap -1 2026-02-13T18:10:25.778 INFO:tasks.rados.rados.0.trial187.stdout:1221: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:25.778 INFO:tasks.rados.rados.0.trial187.stdout:1222: write (excl) oid 10 current snap is 125 2026-02-13T18:10:25.778 INFO:tasks.rados.rados.0.trial187.stdout:1222: seq_num 434 ranges {494238=490187,1563538=701819,2818520=475718} 2026-02-13T18:10:25.781 INFO:tasks.rados.rados.0.trial187.stdout:1222: writing trial18717860-10 from 494238 to 984425 tid 1 2026-02-13T18:10:25.790 INFO:tasks.rados.rados.0.trial187.stdout:1222: writing trial18717860-10 from 1563538 to 2265357 tid 2 2026-02-13T18:10:25.797 INFO:tasks.rados.rados.0.trial187.stdout:1222: writing trial18717860-10 from 2818520 to 3294238 tid 3 2026-02-13T18:10:25.797 INFO:tasks.rados.rados.0.trial187.stdout:1223: rollback oid 4 current snap is 125 2026-02-13T18:10:25.797 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 123 2026-02-13T18:10:25.797 INFO:tasks.rados.rados.0.trial187.stdout:1221: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:25.802 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 812968 2026-02-13T18:10:25.863 INFO:tasks.rados.rados.0.trial187.stdout:1220: expect (ObjNum 427 snap 125 seq_num 427) 2026-02-13T18:10:25.866 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1565419 2026-02-13T18:10:25.906 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1222: finishing write tid 1 to trial18717860-10 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1219: finishing copy_from racing read to trial18717860-16 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1219: finishing copy_from to trial18717860-16 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 419 (ObjNum 432 snap 125 seq_num 432) dirty exists 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1222: finishing write tid 2 to trial18717860-10 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1222: finishing write tid 3 to trial18717860-10 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1222: finishing write tid 4 to trial18717860-10 2026-02-13T18:10:25.932 INFO:tasks.rados.rados.0.trial187.stdout:1219: done (4 left) 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1220: done (3 left) 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1221: done (2 left) 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1224: copy_from oid 3 from oid 26 current snap is 125 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1222: finishing write tid 5 to trial18717860-10 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1222: oid 10 updating version 0 to 510 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1222: oid 10 updating version 510 to 512 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1222: oid 10 version 512 is already newer than 511 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1222: oid 10 version 512 is already newer than 509 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 512 (ObjNum 434 snap 125 seq_num 434) dirty exists 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1222: left oid 10 (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:10:25.933 INFO:tasks.rados.rados.0.trial187.stdout:1223: finishing rollback tid 0 to trial18717860-4 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:1223: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:1223: finishing rollback tid 2 to trial18717860-4 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 243 (ObjNum 422 snap 122 seq_num 422) dirty exists 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:1222: done (2 left) 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:1223: done (1 left) 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:1225: copy_from oid 12 from oid 11 current snap is 125 2026-02-13T18:10:25.934 INFO:tasks.rados.rados.0.trial187.stdout:1226: snap_create 2026-02-13T18:10:25.942 INFO:tasks.rados.rados.0.trial187.stdout:1224: finishing copy_from racing read to trial18717860-3 2026-02-13T18:10:25.942 INFO:tasks.rados.rados.0.trial187.stdout:1224: finishing copy_from to trial18717860-3 2026-02-13T18:10:25.942 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 508 (ObjNum 194 snap 52 seq_num 194) dirty exists 2026-02-13T18:10:25.945 INFO:tasks.rados.rados.0.trial187.stdout:1225: finishing copy_from racing read to trial18717860-12 2026-02-13T18:10:25.945 INFO:tasks.rados.rados.0.trial187.stdout:1225: finishing copy_from to trial18717860-12 2026-02-13T18:10:25.945 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 291 (ObjNum 425 snap 124 seq_num 425) dirty exists 2026-02-13T18:10:26.755 INFO:tasks.rados.rados.0.trial187.stdout:1224: done (2 left) 2026-02-13T18:10:26.755 INFO:tasks.rados.rados.0.trial187.stdout:1225: done (1 left) 2026-02-13T18:10:26.755 INFO:tasks.rados.rados.0.trial187.stdout:1226: done (0 left) 2026-02-13T18:10:26.755 INFO:tasks.rados.rados.0.trial187.stdout:1227: write (excl) oid 41 current snap is 126 2026-02-13T18:10:26.756 INFO:tasks.rados.rados.0.trial187.stdout:1227: seq_num 435 ranges {511045=565436,1622020=445477,2729590=556855} 2026-02-13T18:10:26.762 INFO:tasks.rados.rados.0.trial187.stdout:1227: writing trial18717860-41 from 511045 to 1076481 tid 1 2026-02-13T18:10:26.768 INFO:tasks.rados.rados.0.trial187.stdout:1227: writing trial18717860-41 from 1622020 to 2067497 tid 2 2026-02-13T18:10:26.777 INFO:tasks.rados.rados.0.trial187.stdout:1227: writing trial18717860-41 from 2729590 to 3286445 tid 3 2026-02-13T18:10:26.777 INFO:tasks.rados.rados.0.trial187.stdout:1228: snap_remove snap 115 2026-02-13T18:10:27.759 INFO:tasks.rados.rados.0.trial187.stdout:1228: done (1 left) 2026-02-13T18:10:27.759 INFO:tasks.rados.rados.0.trial187.stdout:1229: write oid 18 current snap is 126 2026-02-13T18:10:27.759 INFO:tasks.rados.rados.0.trial187.stdout:1229: seq_num 436 ranges {527852=640685,1680502=589135,2757013=570839} 2026-02-13T18:10:27.766 INFO:tasks.rados.rados.0.trial187.stdout:1229: writing trial18717860-18 from 527852 to 1168537 tid 1 2026-02-13T18:10:27.774 INFO:tasks.rados.rados.0.trial187.stdout:1229: writing trial18717860-18 from 1680502 to 2269637 tid 2 2026-02-13T18:10:27.781 INFO:tasks.rados.rados.0.trial187.stdout:1229: writing trial18717860-18 from 2757013 to 3327852 tid 3 2026-02-13T18:10:27.781 INFO:tasks.rados.rados.0.trial187.stdout:1230: rollback oid 7 current snap is 126 2026-02-13T18:10:27.781 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 103 2026-02-13T18:10:27.781 INFO:tasks.rados.rados.0.trial187.stdout:1227: finishing write tid 1 to trial18717860-41 2026-02-13T18:10:27.781 INFO:tasks.rados.rados.0.trial187.stdout:1231: read oid 23 snap 125 2026-02-13T18:10:27.781 INFO:tasks.rados.rados.0.trial187.stdout:1231: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:27.782 INFO:tasks.rados.rados.0.trial187.stdout:1232: write (excl) oid 49 current snap is 126 2026-02-13T18:10:27.782 INFO:tasks.rados.rados.0.trial187.stdout:1232: seq_num 437 ranges {544659=715934,1738984=449146,2784436=560223} 2026-02-13T18:10:27.789 INFO:tasks.rados.rados.0.trial187.stdout:1232: writing trial18717860-49 from 544659 to 1260593 tid 1 2026-02-13T18:10:27.796 INFO:tasks.rados.rados.0.trial187.stdout:1232: writing trial18717860-49 from 1738984 to 2188130 tid 2 2026-02-13T18:10:27.804 INFO:tasks.rados.rados.0.trial187.stdout:1232: writing trial18717860-49 from 2784436 to 3344659 tid 3 2026-02-13T18:10:27.804 INFO:tasks.rados.rados.0.trial187.stdout:1233: snap_create 2026-02-13T18:10:27.804 INFO:tasks.rados.rados.0.trial187.stdout:1227: finishing write tid 2 to trial18717860-41 2026-02-13T18:10:27.804 INFO:tasks.rados.rados.0.trial187.stdout:1227: finishing write tid 3 to trial18717860-41 2026-02-13T18:10:27.804 INFO:tasks.rados.rados.0.trial187.stdout:1227: finishing write tid 4 to trial18717860-41 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1227: finishing write tid 5 to trial18717860-41 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1227: oid 41 updating version 0 to 273 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1227: oid 41 updating version 273 to 276 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1227: oid 41 version 276 is already newer than 274 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1227: oid 41 version 276 is already newer than 275 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 276 (ObjNum 435 snap 126 seq_num 435) dirty exists 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1227: left oid 41 (ObjNum 435 snap 126 seq_num 435) 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1229: finishing write tid 1 to trial18717860-18 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1229: finishing write tid 2 to trial18717860-18 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1229: finishing write tid 3 to trial18717860-18 2026-02-13T18:10:27.805 INFO:tasks.rados.rados.0.trial187.stdout:1231: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:27.824 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3100470 2026-02-13T18:10:27.831 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 727129 2026-02-13T18:10:27.874 INFO:tasks.rados.rados.0.trial187.stdout:1229: finishing write tid 4 to trial18717860-18 2026-02-13T18:10:27.874 INFO:tasks.rados.rados.0.trial187.stdout:1229: finishing write tid 5 to trial18717860-18 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1229: oid 18 updating version 0 to 417 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1229: oid 18 version 417 is already newer than 416 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1229: oid 18 updating version 417 to 418 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1229: oid 18 version 418 is already newer than 415 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 418 (ObjNum 436 snap 126 seq_num 436) dirty exists 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1229: left oid 18 (ObjNum 436 snap 126 seq_num 436) 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1230: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1230: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:1230: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:10:27.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 406 (ObjNum 319 snap 87 seq_num 319) dirty exists 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: finishing write tid 1 to trial18717860-49 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: finishing write tid 2 to trial18717860-49 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: finishing write tid 3 to trial18717860-49 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: finishing write tid 4 to trial18717860-49 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: finishing write tid 5 to trial18717860-49 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: oid 49 updating version 0 to 297 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: oid 49 version 297 is already newer than 295 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: oid 49 version 297 is already newer than 296 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: oid 49 version 297 is already newer than 294 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 297 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:10:27.876 INFO:tasks.rados.rados.0.trial187.stdout:1232: left oid 49 (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1227: done (5 left) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1229: done (4 left) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1230: done (3 left) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1231: done (2 left) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1232: done (1 left) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1233: done (0 left) 2026-02-13T18:10:28.718 INFO:tasks.rados.rados.0.trial187.stdout:1234: snap_remove snap 117 2026-02-13T18:10:29.719 INFO:tasks.rados.rados.0.trial187.stdout:1234: done (0 left) 2026-02-13T18:10:29.719 INFO:tasks.rados.rados.0.trial187.stdout:1235: rollback oid 18 current snap is 127 2026-02-13T18:10:29.719 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 101 2026-02-13T18:10:29.719 INFO:tasks.rados.rados.0.trial187.stdout:1236: snap_remove snap 122 2026-02-13T18:10:30.720 INFO:tasks.rados.rados.0.trial187.stdout:1236: done (1 left) 2026-02-13T18:10:30.720 INFO:tasks.rados.rados.0.trial187.stdout:1237: snap_remove snap 99 2026-02-13T18:10:31.722 INFO:tasks.rados.rados.0.trial187.stdout:1237: done (1 left) 2026-02-13T18:10:31.722 INFO:tasks.rados.rados.0.trial187.stdout:1238: write oid 19 current snap is 127 2026-02-13T18:10:31.722 INFO:tasks.rados.rados.0.trial187.stdout:1238: seq_num 438 ranges {561466=791183,2081113=592804,3095506=265960} 2026-02-13T18:10:31.731 INFO:tasks.rados.rados.0.trial187.stdout:1238: writing trial18717860-19 from 561466 to 1352649 tid 1 2026-02-13T18:10:31.739 INFO:tasks.rados.rados.0.trial187.stdout:1238: writing trial18717860-19 from 2081113 to 2673917 tid 2 2026-02-13T18:10:31.744 INFO:tasks.rados.rados.0.trial187.stdout:1238: writing trial18717860-19 from 3095506 to 3361466 tid 3 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:1239: delete oid 50 current snap is 127 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:1235: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:1235: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:1235: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 421 (ObjNum 334 snap 93 seq_num 334) dirty exists 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:1238: finishing write tid 1 to trial18717860-19 2026-02-13T18:10:31.745 INFO:tasks.rados.rados.0.trial187.stdout:1238: finishing write tid 2 to trial18717860-19 2026-02-13T18:10:31.746 INFO:tasks.rados.rados.0.trial187.stdout:1238: finishing write tid 3 to trial18717860-19 2026-02-13T18:10:31.746 INFO:tasks.rados.rados.0.trial187.stdout:1238: finishing write tid 4 to trial18717860-19 2026-02-13T18:10:31.746 INFO:tasks.rados.rados.0.trial187.stdout:1238: finishing write tid 5 to trial18717860-19 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1238: oid 19 updating version 0 to 594 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1238: oid 19 version 594 is already newer than 592 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1238: oid 19 version 594 is already newer than 593 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1238: oid 19 updating version 594 to 595 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 595 (ObjNum 438 snap 127 seq_num 438) dirty exists 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1238: left oid 19 (ObjNum 438 snap 127 seq_num 438) 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1235: done (2 left) 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1238: done (1 left) 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1239: done (0 left) 2026-02-13T18:10:31.747 INFO:tasks.rados.rados.0.trial187.stdout:1240: snap_create 2026-02-13T18:10:32.727 INFO:tasks.rados.rados.0.trial187.stdout:1240: done (0 left) 2026-02-13T18:10:32.727 INFO:tasks.rados.rados.0.trial187.stdout:1241: snap_create 2026-02-13T18:10:33.719 INFO:tasks.rados.rados.0.trial187.stdout:1241: done (0 left) 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1242: rollback oid 15 current snap is 129 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 124 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1243: read oid 3 snap -1 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1243: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1244: read oid 29 snap 101 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1244: expect deleted 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1245: write (excl) oid 34 current snap is 129 2026-02-13T18:10:33.720 INFO:tasks.rados.rados.0.trial187.stdout:1245: seq_num 440 ranges {595080=541681,1798077=596473,3150352=244728} 2026-02-13T18:10:33.727 INFO:tasks.rados.rados.0.trial187.stdout:1245: writing trial18717860-34 from 595080 to 1136761 tid 1 2026-02-13T18:10:33.735 INFO:tasks.rados.rados.0.trial187.stdout:1245: writing trial18717860-34 from 1798077 to 2394550 tid 2 2026-02-13T18:10:33.742 INFO:tasks.rados.rados.0.trial187.stdout:1245: writing trial18717860-34 from 3150352 to 3395080 tid 3 2026-02-13T18:10:33.742 INFO:tasks.rados.rados.0.trial187.stdout:1246: snap_remove snap 112 2026-02-13T18:10:34.724 INFO:tasks.rados.rados.0.trial187.stdout:1246: done (4 left) 2026-02-13T18:10:34.725 INFO:tasks.rados.rados.0.trial187.stdout:1247: write oid 14 current snap is 129 2026-02-13T18:10:34.725 INFO:tasks.rados.rados.0.trial187.stdout:1247: seq_num 441 ranges {611887=733283,1972912=456484,2894128=517759} 2026-02-13T18:10:34.733 INFO:tasks.rados.rados.0.trial187.stdout:1247: writing trial18717860-14 from 611887 to 1345170 tid 1 2026-02-13T18:10:34.741 INFO:tasks.rados.rados.0.trial187.stdout:1247: writing trial18717860-14 from 1972912 to 2429396 tid 2 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:1247: writing trial18717860-14 from 2894128 to 3411887 tid 3 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:1248: delete oid 7 current snap is 129 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:1242: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:1242: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:1242: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 598 (ObjNum 373 snap 106 seq_num 373) dirty exists 2026-02-13T18:10:34.748 INFO:tasks.rados.rados.0.trial187.stdout:1243: expect (ObjNum 194 snap 52 seq_num 194) 2026-02-13T18:10:34.790 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:34.816 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:34.841 INFO:tasks.rados.rados.0.trial187.stdout:1245: finishing write tid 1 to trial18717860-34 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1245: finishing write tid 2 to trial18717860-34 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1245: finishing write tid 3 to trial18717860-34 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1245: finishing write tid 4 to trial18717860-34 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1242: done (5 left) 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1243: done (4 left) 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1244: done (3 left) 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1248: done (2 left) 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1249: write oid 21 current snap is 129 2026-02-13T18:10:34.842 INFO:tasks.rados.rados.0.trial187.stdout:1249: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2026-02-13T18:10:34.849 INFO:tasks.rados.rados.0.trial187.stdout:1249: writing trial18717860-21 from 645501 to 1129282 tid 1 2026-02-13T18:10:34.855 INFO:tasks.rados.rados.0.trial187.stdout:1249: writing trial18717860-21 from 1573523 to 2033676 tid 2 2026-02-13T18:10:34.864 INFO:tasks.rados.rados.0.trial187.stdout:1249: writing trial18717860-21 from 2548974 to 3312358 tid 3 2026-02-13T18:10:34.864 INFO:tasks.rados.rados.0.trial187.stdout:1250: snap_remove snap 103 2026-02-13T18:10:35.803 INFO:tasks.rados.rados.0.trial187.stdout:1250: done (3 left) 2026-02-13T18:10:35.803 INFO:tasks.rados.rados.0.trial187.stdout:1251: delete oid 17 current snap is 129 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1245: finishing write tid 5 to trial18717860-34 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1245: oid 34 updating version 0 to 298 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1245: oid 34 updating version 298 to 301 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1245: oid 34 version 301 is already newer than 300 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1245: oid 34 version 301 is already newer than 299 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 301 (ObjNum 440 snap 129 seq_num 440) dirty exists 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1245: left oid 34 (ObjNum 440 snap 129 seq_num 440) 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1247: finishing write tid 1 to trial18717860-14 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1247: finishing write tid 2 to trial18717860-14 2026-02-13T18:10:35.804 INFO:tasks.rados.rados.0.trial187.stdout:1247: finishing write tid 3 to trial18717860-14 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: finishing write tid 4 to trial18717860-14 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: finishing write tid 5 to trial18717860-14 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: oid 14 updating version 0 to 508 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: oid 14 version 508 is already newer than 507 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: oid 14 updating version 508 to 510 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: oid 14 version 510 is already newer than 509 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 510 (ObjNum 441 snap 129 seq_num 441) dirty exists 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1247: left oid 14 (ObjNum 441 snap 129 seq_num 441) 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1249: finishing write tid 1 to trial18717860-21 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1249: finishing write tid 2 to trial18717860-21 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1249: finishing write tid 3 to trial18717860-21 2026-02-13T18:10:35.805 INFO:tasks.rados.rados.0.trial187.stdout:1249: finishing write tid 4 to trial18717860-21 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:1249: finishing write tid 5 to trial18717860-21 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:1249: oid 21 updating version 0 to 431 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:1249: oid 21 version 431 is already newer than 430 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:1249: oid 21 updating version 431 to 433 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:1249: oid 21 version 433 is already newer than 432 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 433 (ObjNum 443 snap 129 seq_num 443) dirty exists 2026-02-13T18:10:35.806 INFO:tasks.rados.rados.0.trial187.stdout:1249: left oid 21 (ObjNum 443 snap 129 seq_num 443) 2026-02-13T18:10:35.807 INFO:tasks.rados.rados.0.trial187.stdout:1245: done (3 left) 2026-02-13T18:10:35.807 INFO:tasks.rados.rados.0.trial187.stdout:1247: done (2 left) 2026-02-13T18:10:35.807 INFO:tasks.rados.rados.0.trial187.stdout:1249: done (1 left) 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1251: done (0 left) 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1252: read oid 44 snap -1 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1252: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1253: read oid 5 snap 125 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1253: expect (ObjNum 420 snap 122 seq_num 420) 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1254: rollback oid 6 current snap is 129 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 121 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1255: write oid 3 current snap is 129 2026-02-13T18:10:35.808 INFO:tasks.rados.rados.0.trial187.stdout:1255: seq_num 445 ranges {679115=634279,2090487=463822,3003820=475295} 2026-02-13T18:10:35.815 INFO:tasks.rados.rados.0.trial187.stdout:1255: writing trial18717860-3 from 679115 to 1313394 tid 1 2026-02-13T18:10:35.824 INFO:tasks.rados.rados.0.trial187.stdout:1255: writing trial18717860-3 from 2090487 to 2554309 tid 2 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1255: writing trial18717860-3 from 3003820 to 3479115 tid 3 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1256: read oid 11 snap -1 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1256: expect (ObjNum 425 snap 124 seq_num 425) 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1257: read oid 27 snap 101 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1257: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1258: rollback oid 36 current snap is 129 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 36 to 113 2026-02-13T18:10:35.831 INFO:tasks.rados.rados.0.trial187.stdout:1254: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:10:35.832 INFO:tasks.rados.rados.0.trial187.stdout:1253: expect (ObjNum 420 snap 122 seq_num 420) 2026-02-13T18:10:35.843 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1896325 2026-02-13T18:10:35.891 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3016470 2026-02-13T18:10:35.891 INFO:tasks.rados.rados.0.trial187.stdout:1254: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:10:35.891 INFO:tasks.rados.rados.0.trial187.stdout:1254: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:10:35.891 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 422 (ObjNum 374 snap 106 seq_num 374) dirty exists 2026-02-13T18:10:35.891 INFO:tasks.rados.rados.0.trial187.stdout:1252: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:10:36.006 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 209970 2026-02-13T18:10:36.064 INFO:tasks.rados.rados.0.trial187.stdout:1255: finishing write tid 1 to trial18717860-3 2026-02-13T18:10:36.064 INFO:tasks.rados.rados.0.trial187.stdout:1255: finishing write tid 2 to trial18717860-3 2026-02-13T18:10:36.064 INFO:tasks.rados.rados.0.trial187.stdout:1256: expect (ObjNum 425 snap 124 seq_num 425) 2026-02-13T18:10:36.178 INFO:tasks.rados.rados.0.trial187.stdout:1255: finishing write tid 3 to trial18717860-3 2026-02-13T18:10:36.179 INFO:tasks.rados.rados.0.trial187.stdout:1258: finishing rollback tid 0 to trial18717860-36 2026-02-13T18:10:36.179 INFO:tasks.rados.rados.0.trial187.stdout:1255: finishing write tid 4 to trial18717860-3 2026-02-13T18:10:36.179 INFO:tasks.rados.rados.0.trial187.stdout:1252: done (6 left) 2026-02-13T18:10:36.179 INFO:tasks.rados.rados.0.trial187.stdout:1253: done (5 left) 2026-02-13T18:10:36.179 INFO:tasks.rados.rados.0.trial187.stdout:1254: done (4 left) 2026-02-13T18:10:36.180 INFO:tasks.rados.rados.0.trial187.stdout:1256: done (3 left) 2026-02-13T18:10:36.180 INFO:tasks.rados.rados.0.trial187.stdout:1259: write oid 2 current snap is 129 2026-02-13T18:10:36.180 INFO:tasks.rados.rados.0.trial187.stdout:1259: seq_num 446 ranges {695922=709528,2032616=607480,3198537=297385} 2026-02-13T18:10:36.187 INFO:tasks.rados.rados.0.trial187.stdout:1259: writing trial18717860-2 from 695922 to 1405450 tid 1 2026-02-13T18:10:36.195 INFO:tasks.rados.rados.0.trial187.stdout:1259: writing trial18717860-2 from 2032616 to 2640096 tid 2 2026-02-13T18:10:36.202 INFO:tasks.rados.rados.0.trial187.stdout:1259: writing trial18717860-2 from 3198537 to 3495922 tid 3 2026-02-13T18:10:36.202 INFO:tasks.rados.rados.0.trial187.stdout:1260: delete oid 6 current snap is 129 2026-02-13T18:10:36.202 INFO:tasks.rados.rados.0.trial187.stdout:1258: finishing rollback tid 1 to trial18717860-36 2026-02-13T18:10:36.203 INFO:tasks.rados.rados.0.trial187.stdout:1255: finishing write tid 5 to trial18717860-3 2026-02-13T18:10:36.203 INFO:tasks.rados.rados.0.trial187.stdout:1255: oid 3 updating version 0 to 589 2026-02-13T18:10:36.203 INFO:tasks.rados.rados.0.trial187.stdout:1255: oid 3 updating version 589 to 591 2026-02-13T18:10:36.203 INFO:tasks.rados.rados.0.trial187.stdout:1255: oid 3 version 591 is already newer than 588 2026-02-13T18:10:36.203 INFO:tasks.rados.rados.0.trial187.stdout:1255: oid 3 version 591 is already newer than 590 2026-02-13T18:10:36.204 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 591 (ObjNum 445 snap 129 seq_num 445) dirty exists 2026-02-13T18:10:36.204 INFO:tasks.rados.rados.0.trial187.stdout:1255: left oid 3 (ObjNum 445 snap 129 seq_num 445) 2026-02-13T18:10:36.204 INFO:tasks.rados.rados.0.trial187.stdout:1258: finishing rollback tid 2 to trial18717860-36 2026-02-13T18:10:36.204 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 513 (ObjNum 343 snap 94 seq_num 343) dirty exists 2026-02-13T18:10:36.204 INFO:tasks.rados.rados.0.trial187.stdout:1257: expect (ObjNum 351 snap 97 seq_num 351) 2026-02-13T18:10:36.278 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1537279 2026-02-13T18:10:36.316 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 235553 2026-02-13T18:10:36.374 INFO:tasks.rados.rados.0.trial187.stdout:1259: finishing write tid 1 to trial18717860-2 2026-02-13T18:10:36.374 INFO:tasks.rados.rados.0.trial187.stdout:1259: finishing write tid 2 to trial18717860-2 2026-02-13T18:10:36.374 INFO:tasks.rados.rados.0.trial187.stdout:1259: finishing write tid 3 to trial18717860-2 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: finishing write tid 4 to trial18717860-2 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: finishing write tid 5 to trial18717860-2 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: oid 2 updating version 0 to 424 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: oid 2 updating version 424 to 425 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: oid 2 version 425 is already newer than 422 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: oid 2 version 425 is already newer than 423 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 425 (ObjNum 446 snap 129 seq_num 446) dirty exists 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: left oid 2 (ObjNum 446 snap 129 seq_num 446) 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1255: done (4 left) 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1257: done (3 left) 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1258: done (2 left) 2026-02-13T18:10:36.375 INFO:tasks.rados.rados.0.trial187.stdout:1259: done (1 left) 2026-02-13T18:10:36.376 INFO:tasks.rados.rados.0.trial187.stdout:1260: done (0 left) 2026-02-13T18:10:36.376 INFO:tasks.rados.rados.0.trial187.stdout:1261: snap_remove snap 109 2026-02-13T18:10:36.806 INFO:tasks.rados.rados.0.trial187.stdout:1261: done (0 left) 2026-02-13T18:10:36.806 INFO:tasks.rados.rados.0.trial187.stdout:1262: write (excl) oid 22 current snap is 129 2026-02-13T18:10:36.806 INFO:tasks.rados.rados.0.trial187.stdout:1262: seq_num 448 ranges {729536=460026,1749580=611149,2853383=452450} 2026-02-13T18:10:36.814 INFO:tasks.rados.rados.0.trial187.stdout:1262: writing trial18717860-22 from 729536 to 1189562 tid 1 2026-02-13T18:10:36.822 INFO:tasks.rados.rados.0.trial187.stdout:1262: writing trial18717860-22 from 1749580 to 2360729 tid 2 2026-02-13T18:10:36.829 INFO:tasks.rados.rados.0.trial187.stdout:1262: writing trial18717860-22 from 2853383 to 3305833 tid 3 2026-02-13T18:10:36.829 INFO:tasks.rados.rados.0.trial187.stdout:1263: read oid 2 snap 127 2026-02-13T18:10:36.829 INFO:tasks.rados.rados.0.trial187.stdout:1263: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:10:36.829 INFO:tasks.rados.rados.0.trial187.stdout:1264: write (excl) oid 42 current snap is 129 2026-02-13T18:10:36.829 INFO:tasks.rados.rados.0.trial187.stdout:1264: seq_num 449 ranges {746343=651628,1924415=754807,3397159=149184} 2026-02-13T18:10:36.837 INFO:tasks.rados.rados.0.trial187.stdout:1264: writing trial18717860-42 from 746343 to 1397971 tid 1 2026-02-13T18:10:36.846 INFO:tasks.rados.rados.0.trial187.stdout:1264: writing trial18717860-42 from 1924415 to 2679222 tid 2 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1264: writing trial18717860-42 from 3397159 to 3546343 tid 3 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1265: copy_from oid 34 from oid 25 current snap is 129 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: finishing write tid 1 to trial18717860-22 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: finishing write tid 2 to trial18717860-22 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: finishing write tid 3 to trial18717860-22 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: finishing write tid 4 to trial18717860-22 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: finishing write tid 5 to trial18717860-22 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: oid 22 updating version 0 to 664 2026-02-13T18:10:36.853 INFO:tasks.rados.rados.0.trial187.stdout:1262: oid 22 updating version 664 to 669 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:1262: oid 22 version 669 is already newer than 667 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:1262: oid 22 version 669 is already newer than 668 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 669 (ObjNum 448 snap 129 seq_num 448) dirty exists 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:1262: left oid 22 (ObjNum 448 snap 129 seq_num 448) 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:1262: done (3 left) 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:1266: copy_from oid 32 from oid 19 current snap is 129 2026-02-13T18:10:36.854 INFO:tasks.rados.rados.0.trial187.stdout:1263: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:10:36.940 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 700518 2026-02-13T18:10:37.066 INFO:tasks.rados.rados.0.trial187.stdout:1264: finishing write tid 1 to trial18717860-42 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: finishing write tid 2 to trial18717860-42 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: finishing write tid 3 to trial18717860-42 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: finishing write tid 4 to trial18717860-42 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: finishing write tid 5 to trial18717860-42 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: oid 42 updating version 0 to 280 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: oid 42 version 280 is already newer than 279 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: oid 42 version 280 is already newer than 278 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:1264: oid 42 updating version 280 to 281 2026-02-13T18:10:37.067 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 281 (ObjNum 449 snap 129 seq_num 449) dirty exists 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1264: left oid 42 (ObjNum 449 snap 129 seq_num 449) 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1266: finishing copy_from racing read to trial18717860-32 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1266: finishing copy_from to trial18717860-32 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 595 (ObjNum 438 snap 127 seq_num 438) dirty exists 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1265: finishing copy_from racing read to trial18717860-34 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1265: finishing copy_from to trial18717860-34 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 312 (ObjNum 423 snap 122 seq_num 423) dirty exists 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1263: done (3 left) 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1264: done (2 left) 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1265: done (1 left) 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1266: done (0 left) 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1267: read oid 21 snap -1 2026-02-13T18:10:37.068 INFO:tasks.rados.rados.0.trial187.stdout:1267: expect (ObjNum 443 snap 129 seq_num 443) 2026-02-13T18:10:37.069 INFO:tasks.rados.rados.0.trial187.stdout:1268: copy_from oid 40 from oid 39 current snap is 129 2026-02-13T18:10:37.069 INFO:tasks.rados.rados.0.trial187.stdout:1269: snap_remove snap 101 2026-02-13T18:10:37.813 INFO:tasks.rados.rados.0.trial187.stdout:1269: done (2 left) 2026-02-13T18:10:37.813 INFO:tasks.rados.rados.0.trial187.stdout:1270: write (excl) oid 12 current snap is 129 2026-02-13T18:10:37.813 INFO:tasks.rados.rados.0.trial187.stdout:1270: seq_num 450 ranges {763150=726877,1982897=614818,3024582=474994} 2026-02-13T18:10:37.823 INFO:tasks.rados.rados.0.trial187.stdout:1270: writing trial18717860-12 from 763150 to 1490027 tid 1 2026-02-13T18:10:37.831 INFO:tasks.rados.rados.0.trial187.stdout:1270: writing trial18717860-12 from 1982897 to 2597715 tid 2 2026-02-13T18:10:37.837 INFO:tasks.rados.rados.0.trial187.stdout:1270: writing trial18717860-12 from 3024582 to 3499576 tid 3 2026-02-13T18:10:37.837 INFO:tasks.rados.rados.0.trial187.stdout:1271: read oid 7 snap -1 2026-02-13T18:10:37.837 INFO:tasks.rados.rados.0.trial187.stdout:1271: expect deleted 2026-02-13T18:10:37.837 INFO:tasks.rados.rados.0.trial187.stdout:1272: copy_from oid 15 from oid 38 current snap is 129 2026-02-13T18:10:37.837 INFO:tasks.rados.rados.0.trial187.stdout:1268: finishing copy_from to trial18717860-40 2026-02-13T18:10:37.838 INFO:tasks.rados.rados.0.trial187.stdout:1268: got expected ENOENT (src dne) 2026-02-13T18:10:37.838 INFO:tasks.rados.rados.0.trial187.stdout:1268: finishing copy_from racing read to trial18717860-40 2026-02-13T18:10:37.838 INFO:tasks.rados.rados.0.trial187.stdout:1267: expect (ObjNum 443 snap 129 seq_num 443) 2026-02-13T18:10:37.909 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3419946 2026-02-13T18:10:37.912 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:37.986 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1110593 2026-02-13T18:10:38.037 INFO:tasks.rados.rados.0.trial187.stdout:1270: finishing write tid 1 to trial18717860-12 2026-02-13T18:10:38.037 INFO:tasks.rados.rados.0.trial187.stdout:1270: finishing write tid 2 to trial18717860-12 2026-02-13T18:10:38.037 INFO:tasks.rados.rados.0.trial187.stdout:1270: finishing write tid 3 to trial18717860-12 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: finishing write tid 4 to trial18717860-12 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: finishing write tid 5 to trial18717860-12 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: oid 12 updating version 0 to 516 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: oid 12 version 516 is already newer than 514 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: oid 12 version 516 is already newer than 513 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: oid 12 version 516 is already newer than 515 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 516 (ObjNum 450 snap 129 seq_num 450) dirty exists 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: left oid 12 (ObjNum 450 snap 129 seq_num 450) 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1267: done (4 left) 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1268: done (3 left) 2026-02-13T18:10:38.038 INFO:tasks.rados.rados.0.trial187.stdout:1270: done (2 left) 2026-02-13T18:10:38.039 INFO:tasks.rados.rados.0.trial187.stdout:1271: done (1 left) 2026-02-13T18:10:38.039 INFO:tasks.rados.rados.0.trial187.stdout:1273: snap_create 2026-02-13T18:10:38.039 INFO:tasks.rados.rados.0.trial187.stdout:1272: finishing copy_from to trial18717860-15 2026-02-13T18:10:38.039 INFO:tasks.rados.rados.0.trial187.stdout:1272: got expected ENOENT (src dne) 2026-02-13T18:10:38.039 INFO:tasks.rados.rados.0.trial187.stdout:1272: finishing copy_from racing read to trial18717860-15 2026-02-13T18:10:38.720 INFO:tasks.rados.rados.0.trial187.stdout:1272: done (1 left) 2026-02-13T18:10:38.720 INFO:tasks.rados.rados.0.trial187.stdout:1273: done (0 left) 2026-02-13T18:10:38.720 INFO:tasks.rados.rados.0.trial187.stdout:1274: write (excl) oid 34 current snap is 130 2026-02-13T18:10:38.720 INFO:tasks.rados.rados.0.trial187.stdout:1274: seq_num 451 ranges {779957=402126,1925026=758476,3335652=244305} 2026-02-13T18:10:38.727 INFO:tasks.rados.rados.0.trial187.stdout:1274: writing trial18717860-34 from 779957 to 1182083 tid 1 2026-02-13T18:10:38.737 INFO:tasks.rados.rados.0.trial187.stdout:1274: writing trial18717860-34 from 1925026 to 2683502 tid 2 2026-02-13T18:10:38.744 INFO:tasks.rados.rados.0.trial187.stdout:1274: writing trial18717860-34 from 3335652 to 3579957 tid 3 2026-02-13T18:10:38.744 INFO:tasks.rados.rados.0.trial187.stdout:1275: copy_from oid 19 from oid 33 current snap is 130 2026-02-13T18:10:38.744 INFO:tasks.rados.rados.0.trial187.stdout:1274: finishing write tid 1 to trial18717860-34 2026-02-13T18:10:38.744 INFO:tasks.rados.rados.0.trial187.stdout:1274: finishing write tid 2 to trial18717860-34 2026-02-13T18:10:38.744 INFO:tasks.rados.rados.0.trial187.stdout:1276: write (excl) oid 11 current snap is 130 2026-02-13T18:10:38.744 INFO:tasks.rados.rados.0.trial187.stdout:1276: seq_num 452 ranges {796764=477375,1983508=618487,3363075=233689} 2026-02-13T18:10:38.752 INFO:tasks.rados.rados.0.trial187.stdout:1276: writing trial18717860-11 from 796764 to 1274139 tid 1 2026-02-13T18:10:38.761 INFO:tasks.rados.rados.0.trial187.stdout:1276: writing trial18717860-11 from 1983508 to 2601995 tid 2 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1276: writing trial18717860-11 from 3363075 to 3596764 tid 3 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1277: rollback oid 7 current snap is 130 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 125 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1274: finishing write tid 3 to trial18717860-34 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1274: finishing write tid 4 to trial18717860-34 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1274: finishing write tid 5 to trial18717860-34 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1274: oid 34 updating version 0 to 314 2026-02-13T18:10:38.769 INFO:tasks.rados.rados.0.trial187.stdout:1274: oid 34 updating version 314 to 315 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1274: oid 34 updating version 315 to 316 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1274: oid 34 version 316 is already newer than 313 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 316 (ObjNum 451 snap 130 seq_num 451) dirty exists 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1274: left oid 34 (ObjNum 451 snap 130 seq_num 451) 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1276: finishing write tid 1 to trial18717860-11 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1275: finishing copy_from racing read to trial18717860-19 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1275: finishing copy_from to trial18717860-19 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 601 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1276: finishing write tid 2 to trial18717860-11 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1274: done (3 left) 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1275: done (2 left) 2026-02-13T18:10:38.770 INFO:tasks.rados.rados.0.trial187.stdout:1278: snap_create 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: finishing write tid 3 to trial18717860-11 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: finishing write tid 4 to trial18717860-11 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: finishing write tid 5 to trial18717860-11 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: oid 11 updating version 0 to 320 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: oid 11 version 320 is already newer than 317 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: oid 11 version 320 is already newer than 318 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: oid 11 version 320 is already newer than 319 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 320 (ObjNum 452 snap 130 seq_num 452) dirty exists 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1276: left oid 11 (ObjNum 452 snap 130 seq_num 452) 2026-02-13T18:10:38.772 INFO:tasks.rados.rados.0.trial187.stdout:1277: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:10:38.773 INFO:tasks.rados.rados.0.trial187.stdout:1277: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:10:38.773 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 453 (ObjNum 319 snap 87 seq_num 319) dirty exists 2026-02-13T18:10:39.721 INFO:tasks.rados.rados.0.trial187.stdout:1276: done (2 left) 2026-02-13T18:10:39.721 INFO:tasks.rados.rados.0.trial187.stdout:1277: done (1 left) 2026-02-13T18:10:39.721 INFO:tasks.rados.rados.0.trial187.stdout:1278: done (0 left) 2026-02-13T18:10:39.721 INFO:tasks.rados.rados.0.trial187.stdout:1279: snap_create 2026-02-13T18:10:41.472 INFO:tasks.rados.rados.0.trial187.stdout:1279: done (0 left) 2026-02-13T18:10:41.472 INFO:tasks.rados.rados.0.trial187.stdout:1280: delete oid 18 current snap is 132 2026-02-13T18:10:41.477 INFO:tasks.rados.rados.0.trial187.stdout:1280: done (0 left) 2026-02-13T18:10:41.477 INFO:tasks.rados.rados.0.trial187.stdout:1281: read oid 28 snap 125 2026-02-13T18:10:41.477 INFO:tasks.rados.rados.0.trial187.stdout:1281: expect (ObjNum 432 snap 125 seq_num 432) 2026-02-13T18:10:41.477 INFO:tasks.rados.rados.0.trial187.stdout:1282: snap_remove snap 127 2026-02-13T18:10:42.475 INFO:tasks.rados.rados.0.trial187.stdout:1282: done (1 left) 2026-02-13T18:10:42.475 INFO:tasks.rados.rados.0.trial187.stdout:1283: snap_remove snap 128 2026-02-13T18:10:43.476 INFO:tasks.rados.rados.0.trial187.stdout:1283: done (1 left) 2026-02-13T18:10:43.476 INFO:tasks.rados.rados.0.trial187.stdout:1284: snap_remove snap 124 2026-02-13T18:10:43.720 INFO:tasks.rados.rados.0.trial187.stdout:1284: done (1 left) 2026-02-13T18:10:43.721 INFO:tasks.rados.rados.0.trial187.stdout:1285: copy_from oid 12 from oid 33 current snap is 132 2026-02-13T18:10:43.721 INFO:tasks.rados.rados.0.trial187.stdout:1281: expect (ObjNum 432 snap 125 seq_num 432) 2026-02-13T18:10:43.733 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2988387 2026-02-13T18:10:43.744 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:43.786 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2399201 2026-02-13T18:10:43.796 INFO:tasks.rados.rados.0.trial187.stdout:1285: finishing copy_from racing read to trial18717860-12 2026-02-13T18:10:43.796 INFO:tasks.rados.rados.0.trial187.stdout:1285: finishing copy_from to trial18717860-12 2026-02-13T18:10:43.797 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 601 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:10:43.797 INFO:tasks.rados.rados.0.trial187.stdout:1281: done (1 left) 2026-02-13T18:10:43.797 INFO:tasks.rados.rados.0.trial187.stdout:1285: done (0 left) 2026-02-13T18:10:43.797 INFO:tasks.rados.rados.0.trial187.stdout:1286: read oid 37 snap -1 2026-02-13T18:10:43.797 INFO:tasks.rados.rados.0.trial187.stdout:1286: expect deleted 2026-02-13T18:10:43.797 INFO:tasks.rados.rados.0.trial187.stdout:1287: snap_remove snap 123 2026-02-13T18:10:44.726 INFO:tasks.rados.rados.0.trial187.stdout:1287: done (1 left) 2026-02-13T18:10:44.726 INFO:tasks.rados.rados.0.trial187.stdout:1288: delete oid 26 current snap is 132 2026-02-13T18:10:44.729 INFO:tasks.rados.rados.0.trial187.stdout:1286: done (1 left) 2026-02-13T18:10:44.729 INFO:tasks.rados.rados.0.trial187.stdout:1288: done (0 left) 2026-02-13T18:10:44.729 INFO:tasks.rados.rados.0.trial187.stdout:1289: delete oid 39 current snap is 132 2026-02-13T18:10:44.730 INFO:tasks.rados.rados.0.trial187.stdout:1289: done (0 left) 2026-02-13T18:10:44.730 INFO:tasks.rados.rados.0.trial187.stdout:1290: read oid 13 snap -1 2026-02-13T18:10:44.730 INFO:tasks.rados.rados.0.trial187.stdout:1290: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:10:44.731 INFO:tasks.rados.rados.0.trial187.stdout:1291: delete oid 44 current snap is 132 2026-02-13T18:10:44.738 INFO:tasks.rados.rados.0.trial187.stdout:1291: done (1 left) 2026-02-13T18:10:44.738 INFO:tasks.rados.rados.0.trial187.stdout:1292: read oid 26 snap -1 2026-02-13T18:10:44.738 INFO:tasks.rados.rados.0.trial187.stdout:1292: expect deleted 2026-02-13T18:10:44.738 INFO:tasks.rados.rados.0.trial187.stdout:1293: read oid 3 snap -1 2026-02-13T18:10:44.738 INFO:tasks.rados.rados.0.trial187.stdout:1293: expect (ObjNum 445 snap 129 seq_num 445) 2026-02-13T18:10:44.738 INFO:tasks.rados.rados.0.trial187.stdout:1294: snap_create 2026-02-13T18:10:44.739 INFO:tasks.rados.rados.0.trial187.stdout:1290: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:10:44.762 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2137874 2026-02-13T18:10:44.910 INFO:tasks.rados.rados.0.trial187.stdout:1293: expect (ObjNum 445 snap 129 seq_num 445) 2026-02-13T18:10:46.154 INFO:tasks.rados.rados.0.trial187.stdout:1290: done (3 left) 2026-02-13T18:10:46.155 INFO:tasks.rados.rados.0.trial187.stdout:1292: done (2 left) 2026-02-13T18:10:46.155 INFO:tasks.rados.rados.0.trial187.stdout:1293: done (1 left) 2026-02-13T18:10:46.155 INFO:tasks.rados.rados.0.trial187.stdout:1294: done (0 left) 2026-02-13T18:10:46.155 INFO:tasks.rados.rados.0.trial187.stdout:1295: write (excl) oid 38 current snap is 133 2026-02-13T18:10:46.155 INFO:tasks.rados.rados.0.trial187.stdout:1295: seq_num 457 ranges {480799=569973,1475918=769483,2700190=586604} 2026-02-13T18:10:46.162 INFO:tasks.rados.rados.0.trial187.stdout:1295: writing trial18717860-38 from 480799 to 1050772 tid 1 2026-02-13T18:10:46.170 INFO:tasks.rados.rados.0.trial187.stdout:1295: writing trial18717860-38 from 1475918 to 2245401 tid 2 2026-02-13T18:10:46.177 INFO:tasks.rados.rados.0.trial187.stdout:1295: writing trial18717860-38 from 2700190 to 3286794 tid 3 2026-02-13T18:10:46.177 INFO:tasks.rados.rados.0.trial187.stdout:1296: read oid 12 snap -1 2026-02-13T18:10:46.177 INFO:tasks.rados.rados.0.trial187.stdout:1296: expect (ObjNum 417 snap 121 seq_num 417) 2026-02-13T18:10:46.178 INFO:tasks.rados.rados.0.trial187.stdout:1297: rollback oid 2 current snap is 133 2026-02-13T18:10:46.178 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 131 2026-02-13T18:10:46.178 INFO:tasks.rados.rados.0.trial187.stdout:1295: finishing write tid 1 to trial18717860-38 2026-02-13T18:10:46.178 INFO:tasks.rados.rados.0.trial187.stdout:1295: finishing write tid 2 to trial18717860-38 2026-02-13T18:10:46.178 INFO:tasks.rados.rados.0.trial187.stdout:1298: snap_create 2026-02-13T18:10:46.179 INFO:tasks.rados.rados.0.trial187.stdout:1295: finishing write tid 3 to trial18717860-38 2026-02-13T18:10:46.179 INFO:tasks.rados.rados.0.trial187.stdout:1295: finishing write tid 4 to trial18717860-38 2026-02-13T18:10:46.179 INFO:tasks.rados.rados.0.trial187.stdout:1295: finishing write tid 5 to trial18717860-38 2026-02-13T18:10:46.179 INFO:tasks.rados.rados.0.trial187.stdout:1295: oid 38 updating version 0 to 512 2026-02-13T18:10:46.179 INFO:tasks.rados.rados.0.trial187.stdout:1295: oid 38 version 512 is already newer than 510 2026-02-13T18:10:46.179 INFO:tasks.rados.rados.0.trial187.stdout:1295: oid 38 version 512 is already newer than 511 2026-02-13T18:10:46.180 INFO:tasks.rados.rados.0.trial187.stdout:1295: oid 38 version 512 is already newer than 509 2026-02-13T18:10:46.180 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 512 (ObjNum 457 snap 133 seq_num 457) dirty exists 2026-02-13T18:10:46.180 INFO:tasks.rados.rados.0.trial187.stdout:1295: left oid 38 (ObjNum 457 snap 133 seq_num 457) 2026-02-13T18:10:46.181 INFO:tasks.rados.rados.0.trial187.stdout:1297: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:10:46.186 INFO:tasks.rados.rados.0.trial187.stdout:1297: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:10:46.186 INFO:tasks.rados.rados.0.trial187.stdout:1297: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:10:46.186 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 429 (ObjNum 446 snap 129 seq_num 446) dirty exists 2026-02-13T18:10:46.187 INFO:tasks.rados.rados.0.trial187.stdout:1296: expect (ObjNum 417 snap 121 seq_num 417) 2026-02-13T18:10:46.187 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 438820 2026-02-13T18:10:46.222 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:47.156 INFO:tasks.rados.rados.0.trial187.stdout:1295: done (3 left) 2026-02-13T18:10:47.156 INFO:tasks.rados.rados.0.trial187.stdout:1296: done (2 left) 2026-02-13T18:10:47.156 INFO:tasks.rados.rados.0.trial187.stdout:1297: done (1 left) 2026-02-13T18:10:47.156 INFO:tasks.rados.rados.0.trial187.stdout:1298: done (0 left) 2026-02-13T18:10:47.156 INFO:tasks.rados.rados.0.trial187.stdout:1299: write (excl) oid 50 current snap is 134 2026-02-13T18:10:47.156 INFO:tasks.rados.rados.0.trial187.stdout:1299: seq_num 458 ranges {497606=645222,1934400=629494,3243966=453640} 2026-02-13T18:10:47.163 INFO:tasks.rados.rados.0.trial187.stdout:1299: writing trial18717860-50 from 497606 to 1142828 tid 1 2026-02-13T18:10:47.170 INFO:tasks.rados.rados.0.trial187.stdout:1299: writing trial18717860-50 from 1934400 to 2563894 tid 2 2026-02-13T18:10:47.175 INFO:tasks.rados.rados.0.trial187.stdout:1299: writing trial18717860-50 from 3243966 to 3697606 tid 3 2026-02-13T18:10:47.175 INFO:tasks.rados.rados.0.trial187.stdout:1300: write (excl) oid 21 current snap is 134 2026-02-13T18:10:47.175 INFO:tasks.rados.rados.0.trial187.stdout:1300: seq_num 459 ranges {514413=720471,1876529=773152,3438683=275730} 2026-02-13T18:10:47.180 INFO:tasks.rados.rados.0.trial187.stdout:1300: writing trial18717860-21 from 514413 to 1234884 tid 1 2026-02-13T18:10:47.185 INFO:tasks.rados.rados.0.trial187.stdout:1300: writing trial18717860-21 from 1876529 to 2649681 tid 2 2026-02-13T18:10:47.189 INFO:tasks.rados.rados.0.trial187.stdout:1300: writing trial18717860-21 from 3438683 to 3714413 tid 3 2026-02-13T18:10:47.189 INFO:tasks.rados.rados.0.trial187.stdout:1301: rollback oid 45 current snap is 134 2026-02-13T18:10:47.189 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 126 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: finishing write tid 1 to trial18717860-50 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: finishing write tid 2 to trial18717860-50 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: finishing write tid 3 to trial18717860-50 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: finishing write tid 4 to trial18717860-50 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: finishing write tid 5 to trial18717860-50 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: oid 50 updating version 0 to 284 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: oid 50 version 284 is already newer than 283 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: oid 50 updating version 284 to 285 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: oid 50 version 285 is already newer than 282 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 285 (ObjNum 458 snap 134 seq_num 458) dirty exists 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1299: left oid 50 (ObjNum 458 snap 134 seq_num 458) 2026-02-13T18:10:47.190 INFO:tasks.rados.rados.0.trial187.stdout:1300: finishing write tid 1 to trial18717860-21 2026-02-13T18:10:47.191 INFO:tasks.rados.rados.0.trial187.stdout:1300: finishing write tid 2 to trial18717860-21 2026-02-13T18:10:47.191 INFO:tasks.rados.rados.0.trial187.stdout:1299: done (2 left) 2026-02-13T18:10:47.191 INFO:tasks.rados.rados.0.trial187.stdout:1302: snap_create 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: finishing write tid 3 to trial18717860-21 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: finishing write tid 4 to trial18717860-21 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: finishing write tid 5 to trial18717860-21 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: oid 21 updating version 0 to 473 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: oid 21 version 473 is already newer than 472 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: oid 21 version 473 is already newer than 471 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:1300: oid 21 updating version 473 to 474 2026-02-13T18:10:47.192 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 474 (ObjNum 459 snap 134 seq_num 459) dirty exists 2026-02-13T18:10:47.193 INFO:tasks.rados.rados.0.trial187.stdout:1300: left oid 21 (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:10:47.193 INFO:tasks.rados.rados.0.trial187.stdout:1301: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:10:47.193 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 327 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:10:48.161 INFO:tasks.rados.rados.0.trial187.stdout:1300: done (2 left) 2026-02-13T18:10:48.161 INFO:tasks.rados.rados.0.trial187.stdout:1301: done (1 left) 2026-02-13T18:10:48.161 INFO:tasks.rados.rados.0.trial187.stdout:1302: done (0 left) 2026-02-13T18:10:48.161 INFO:tasks.rados.rados.0.trial187.stdout:1303: delete oid 11 current snap is 135 2026-02-13T18:10:48.165 INFO:tasks.rados.rados.0.trial187.stdout:1303: done (0 left) 2026-02-13T18:10:48.165 INFO:tasks.rados.rados.0.trial187.stdout:1304: snap_remove snap 125 2026-02-13T18:10:48.722 INFO:tasks.rados.rados.0.trial187.stdout:1304: done (0 left) 2026-02-13T18:10:48.722 INFO:tasks.rados.rados.0.trial187.stdout:1305: read oid 39 snap 121 2026-02-13T18:10:48.722 INFO:tasks.rados.rados.0.trial187.stdout:1305: expect deleted 2026-02-13T18:10:48.722 INFO:tasks.rados.rados.0.trial187.stdout:1306: read oid 40 snap -1 2026-02-13T18:10:48.723 INFO:tasks.rados.rados.0.trial187.stdout:1306: expect deleted 2026-02-13T18:10:48.723 INFO:tasks.rados.rados.0.trial187.stdout:1307: snap_create 2026-02-13T18:10:49.722 INFO:tasks.rados.rados.0.trial187.stdout:1305: done (2 left) 2026-02-13T18:10:49.722 INFO:tasks.rados.rados.0.trial187.stdout:1306: done (1 left) 2026-02-13T18:10:49.722 INFO:tasks.rados.rados.0.trial187.stdout:1307: done (0 left) 2026-02-13T18:10:49.722 INFO:tasks.rados.rados.0.trial187.stdout:1308: write oid 47 current snap is 136 2026-02-13T18:10:49.722 INFO:tasks.rados.rados.0.trial187.stdout:1308: seq_num 461 ranges {548027=470969,1593493=776821,3093529=631692} 2026-02-13T18:10:49.729 INFO:tasks.rados.rados.0.trial187.stdout:1308: writing trial18717860-47 from 548027 to 1018996 tid 1 2026-02-13T18:10:49.738 INFO:tasks.rados.rados.0.trial187.stdout:1308: writing trial18717860-47 from 1593493 to 2370314 tid 2 2026-02-13T18:10:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1308: writing trial18717860-47 from 3093529 to 3725221 tid 3 2026-02-13T18:10:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1309: copy_from oid 35 from oid 22 current snap is 136 2026-02-13T18:10:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1308: finishing write tid 1 to trial18717860-47 2026-02-13T18:10:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1308: finishing write tid 2 to trial18717860-47 2026-02-13T18:10:49.747 INFO:tasks.rados.rados.0.trial187.stdout:1310: delete oid 43 current snap is 136 2026-02-13T18:10:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1310: done (2 left) 2026-02-13T18:10:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1311: copy_from oid 42 from oid 13 current snap is 136 2026-02-13T18:10:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1312: write oid 5 current snap is 136 2026-02-13T18:10:49.748 INFO:tasks.rados.rados.0.trial187.stdout:1312: seq_num 463 ranges {581641=621467,1994104=780490,3432022=349619} 2026-02-13T18:10:49.757 INFO:tasks.rados.rados.0.trial187.stdout:1312: writing trial18717860-5 from 581641 to 1203108 tid 1 2026-02-13T18:10:49.767 INFO:tasks.rados.rados.0.trial187.stdout:1312: writing trial18717860-5 from 1994104 to 2774594 tid 2 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1312: writing trial18717860-5 from 3432022 to 3781641 tid 3 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1313: read oid 34 snap -1 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1313: expect (ObjNum 451 snap 130 seq_num 451) 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1314: read oid 2 snap 133 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1314: expect (ObjNum 446 snap 129 seq_num 446) 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1315: rollback oid 26 current snap is 136 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 135 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1308: finishing write tid 3 to trial18717860-47 2026-02-13T18:10:49.774 INFO:tasks.rados.rados.0.trial187.stdout:1308: finishing write tid 4 to trial18717860-47 2026-02-13T18:10:49.775 INFO:tasks.rados.rados.0.trial187.stdout:1316: snap_remove snap 113 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1316: done (7 left) 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1317: read oid 18 snap -1 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1317: expect deleted 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1318: read oid 25 snap -1 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1318: expect (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1319: write oid 17 current snap is 136 2026-02-13T18:10:50.726 INFO:tasks.rados.rados.0.trial187.stdout:1308: finishing write tid 5 to trial18717860-47 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1308: oid 47 updating version 0 to 421 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1308: oid 47 updating version 421 to 422 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1308: oid 47 version 422 is already newer than 420 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1308: oid 47 updating version 422 to 423 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 423 (ObjNum 461 snap 136 seq_num 461) dirty exists 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1308: left oid 47 (ObjNum 461 snap 136 seq_num 461) 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1312: finishing write tid 1 to trial18717860-5 2026-02-13T18:10:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1319: seq_num 464 ranges {598448=413069,1768939=524148,2775798=581861,3781488=16960} 2026-02-13T18:10:50.729 INFO:tasks.rados.rados.0.trial187.stdout:1319: writing trial18717860-17 from 598448 to 1011517 tid 1 2026-02-13T18:10:50.734 INFO:tasks.rados.rados.0.trial187.stdout:1319: writing trial18717860-17 from 1768939 to 2293087 tid 2 2026-02-13T18:10:50.738 INFO:tasks.rados.rados.0.trial187.stdout:1319: writing trial18717860-17 from 2775798 to 3357659 tid 3 2026-02-13T18:10:50.740 INFO:tasks.rados.rados.0.trial187.stdout:1319: writing trial18717860-17 from 3781488 to 3798448 tid 4 2026-02-13T18:10:50.740 INFO:tasks.rados.rados.0.trial187.stdout:1308: done (9 left) 2026-02-13T18:10:50.740 INFO:tasks.rados.rados.0.trial187.stdout:1320: snap_remove snap 114 2026-02-13T18:10:51.732 INFO:tasks.rados.rados.0.trial187.stdout:1320: done (9 left) 2026-02-13T18:10:51.733 INFO:tasks.rados.rados.0.trial187.stdout:1321: write (excl) oid 11 current snap is 136 2026-02-13T18:10:51.733 INFO:tasks.rados.rados.0.trial187.stdout:1321: seq_num 465 ranges {615255=488318,1827421=784159,3203221=612034} 2026-02-13T18:10:51.739 INFO:tasks.rados.rados.0.trial187.stdout:1321: writing trial18717860-11 from 615255 to 1103573 tid 1 2026-02-13T18:10:51.750 INFO:tasks.rados.rados.0.trial187.stdout:1321: writing trial18717860-11 from 1827421 to 2611580 tid 2 2026-02-13T18:10:51.758 INFO:tasks.rados.rados.0.trial187.stdout:1321: writing trial18717860-11 from 3203221 to 3815255 tid 3 2026-02-13T18:10:51.758 INFO:tasks.rados.rados.0.trial187.stdout:1322: read oid 30 snap -1 2026-02-13T18:10:51.759 INFO:tasks.rados.rados.0.trial187.stdout:1322: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:51.759 INFO:tasks.rados.rados.0.trial187.stdout:1323: write oid 43 current snap is 136 2026-02-13T18:10:51.759 INFO:tasks.rados.rados.0.trial187.stdout:1323: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2026-02-13T18:10:51.766 INFO:tasks.rados.rados.0.trial187.stdout:1323: writing trial18717860-43 from 632062 to 1195629 tid 1 2026-02-13T18:10:51.774 INFO:tasks.rados.rados.0.trial187.stdout:1323: writing trial18717860-43 from 1885903 to 2413720 tid 2 2026-02-13T18:10:51.780 INFO:tasks.rados.rados.0.trial187.stdout:1323: writing trial18717860-43 from 2830644 to 3551402 tid 3 2026-02-13T18:10:51.780 INFO:tasks.rados.rados.0.trial187.stdout:1324: snap_remove snap 121 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1324: done (12 left) 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1325: read oid 4 snap -1 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1325: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1326: copy_from oid 3 from oid 44 current snap is 136 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1311: finishing copy_from racing read to trial18717860-42 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1309: finishing copy_from racing read to trial18717860-35 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:1309: finishing copy_from to trial18717860-35 2026-02-13T18:10:52.737 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 669 (ObjNum 448 snap 129 seq_num 448) dirty exists 2026-02-13T18:10:52.738 INFO:tasks.rados.rados.0.trial187.stdout:1311: finishing copy_from to trial18717860-42 2026-02-13T18:10:52.738 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 234 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:10:52.738 INFO:tasks.rados.rados.0.trial187.stdout:1315: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:10:52.738 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 611 (ObjNum 145 snap 0 seq_num 3013792280) dirty dne 2026-02-13T18:10:52.738 INFO:tasks.rados.rados.0.trial187.stdout:1313: expect (ObjNum 451 snap 130 seq_num 451) 2026-02-13T18:10:52.738 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:52.856 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2537493 2026-02-13T18:10:52.903 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1363594 2026-02-13T18:10:52.952 INFO:tasks.rados.rados.0.trial187.stdout:1312: finishing write tid 2 to trial18717860-5 2026-02-13T18:10:52.952 INFO:tasks.rados.rados.0.trial187.stdout:1312: finishing write tid 3 to trial18717860-5 2026-02-13T18:10:52.952 INFO:tasks.rados.rados.0.trial187.stdout:1312: finishing write tid 4 to trial18717860-5 2026-02-13T18:10:52.952 INFO:tasks.rados.rados.0.trial187.stdout:1314: expect (ObjNum 446 snap 129 seq_num 446) 2026-02-13T18:10:53.015 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:53.139 INFO:tasks.rados.rados.0.trial187.stdout:1312: finishing write tid 5 to trial18717860-5 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1312: oid 5 updating version 0 to 361 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1312: oid 5 updating version 361 to 362 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1312: oid 5 updating version 362 to 363 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1312: oid 5 version 363 is already newer than 360 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 363 (ObjNum 463 snap 136 seq_num 463) dirty exists 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1312: left oid 5 (ObjNum 463 snap 136 seq_num 463) 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1319: finishing write tid 1 to trial18717860-17 2026-02-13T18:10:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1318: expect (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:10:53.296 INFO:tasks.rados.rados.0.trial187.stdout:1319: finishing write tid 2 to trial18717860-17 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: finishing write tid 3 to trial18717860-17 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: finishing write tid 4 to trial18717860-17 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: finishing write tid 5 to trial18717860-17 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: finishing write tid 6 to trial18717860-17 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: oid 17 updating version 0 to 633 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: oid 17 updating version 633 to 634 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: oid 17 version 634 is already newer than 624 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: oid 17 version 634 is already newer than 631 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:1319: oid 17 version 634 is already newer than 632 2026-02-13T18:10:53.297 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 634 (ObjNum 464 snap 136 seq_num 464) dirty exists 2026-02-13T18:10:53.298 INFO:tasks.rados.rados.0.trial187.stdout:1319: left oid 17 (ObjNum 464 snap 136 seq_num 464) 2026-02-13T18:10:53.298 INFO:tasks.rados.rados.0.trial187.stdout:1321: finishing write tid 1 to trial18717860-11 2026-02-13T18:10:53.298 INFO:tasks.rados.rados.0.trial187.stdout:1321: finishing write tid 2 to trial18717860-11 2026-02-13T18:10:53.298 INFO:tasks.rados.rados.0.trial187.stdout:1322: expect (ObjNum 404 snap 115 seq_num 404) 2026-02-13T18:10:53.351 INFO:tasks.rados.rados.0.trial187.stdout:1321: finishing write tid 3 to trial18717860-11 2026-02-13T18:10:53.351 INFO:tasks.rados.rados.0.trial187.stdout:1321: finishing write tid 4 to trial18717860-11 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1321: finishing write tid 5 to trial18717860-11 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1321: oid 11 updating version 0 to 347 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1321: oid 11 updating version 347 to 348 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1321: oid 11 version 348 is already newer than 346 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1321: oid 11 version 348 is already newer than 345 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 348 (ObjNum 465 snap 136 seq_num 465) dirty exists 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1321: left oid 11 (ObjNum 465 snap 136 seq_num 465) 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1323: finishing write tid 1 to trial18717860-43 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1323: finishing write tid 2 to trial18717860-43 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1323: finishing write tid 3 to trial18717860-43 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1323: finishing write tid 4 to trial18717860-43 2026-02-13T18:10:53.352 INFO:tasks.rados.rados.0.trial187.stdout:1323: finishing write tid 5 to trial18717860-43 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1323: oid 43 updating version 0 to 709 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1323: oid 43 updating version 709 to 710 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1323: oid 43 version 710 is already newer than 707 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1323: oid 43 version 710 is already newer than 708 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 710 (ObjNum 466 snap 136 seq_num 466) dirty exists 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1323: left oid 43 (ObjNum 466 snap 136 seq_num 466) 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1326: finishing copy_from to trial18717860-3 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1326: got expected ENOENT (src dne) 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1326: finishing copy_from racing read to trial18717860-3 2026-02-13T18:10:53.353 INFO:tasks.rados.rados.0.trial187.stdout:1325: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:10:53.474 INFO:tasks.rados.rados.0.trial187.stdout:1309: done (13 left) 2026-02-13T18:10:53.474 INFO:tasks.rados.rados.0.trial187.stdout:1311: done (12 left) 2026-02-13T18:10:53.474 INFO:tasks.rados.rados.0.trial187.stdout:1312: done (11 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1313: done (10 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1314: done (9 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1315: done (8 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1317: done (7 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1318: done (6 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1319: done (5 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1321: done (4 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1322: done (3 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1323: done (2 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1325: done (1 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1326: done (0 left) 2026-02-13T18:10:53.475 INFO:tasks.rados.rados.0.trial187.stdout:1327: copy_from oid 3 from oid 34 current snap is 136 2026-02-13T18:10:53.476 INFO:tasks.rados.rados.0.trial187.stdout:1328: snap_remove snap 131 2026-02-13T18:10:53.723 INFO:tasks.rados.rados.0.trial187.stdout:1328: done (1 left) 2026-02-13T18:10:53.723 INFO:tasks.rados.rados.0.trial187.stdout:1329: read oid 33 snap -1 2026-02-13T18:10:53.723 INFO:tasks.rados.rados.0.trial187.stdout:1329: expect (ObjNum 417 snap 121 seq_num 417) 2026-02-13T18:10:53.723 INFO:tasks.rados.rados.0.trial187.stdout:1330: copy_from oid 38 from oid 46 current snap is 136 2026-02-13T18:10:53.724 INFO:tasks.rados.rados.0.trial187.stdout:1327: finishing copy_from racing read to trial18717860-3 2026-02-13T18:10:53.724 INFO:tasks.rados.rados.0.trial187.stdout:1327: finishing copy_from to trial18717860-3 2026-02-13T18:10:53.724 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 316 (ObjNum 451 snap 130 seq_num 451) dirty exists 2026-02-13T18:10:53.724 INFO:tasks.rados.rados.0.trial187.stdout:1327: done (2 left) 2026-02-13T18:10:53.724 INFO:tasks.rados.rados.0.trial187.stdout:1331: snap_create 2026-02-13T18:10:53.740 INFO:tasks.rados.rados.0.trial187.stdout:1330: finishing copy_from racing read to trial18717860-38 2026-02-13T18:10:53.740 INFO:tasks.rados.rados.0.trial187.stdout:1330: finishing copy_from to trial18717860-38 2026-02-13T18:10:53.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 386 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:10:53.740 INFO:tasks.rados.rados.0.trial187.stdout:1329: expect (ObjNum 417 snap 121 seq_num 417) 2026-02-13T18:10:53.740 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:53.779 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:53.804 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1329: done (2 left) 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1330: done (1 left) 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1331: done (0 left) 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1332: read oid 5 snap -1 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1332: expect (ObjNum 463 snap 136 seq_num 463) 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1333: read oid 40 snap -1 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1333: expect deleted 2026-02-13T18:10:54.725 INFO:tasks.rados.rados.0.trial187.stdout:1334: read oid 47 snap -1 2026-02-13T18:10:54.726 INFO:tasks.rados.rados.0.trial187.stdout:1334: expect (ObjNum 461 snap 136 seq_num 461) 2026-02-13T18:10:54.726 INFO:tasks.rados.rados.0.trial187.stdout:1335: snap_create 2026-02-13T18:10:54.728 INFO:tasks.rados.rados.0.trial187.stdout:1334: expect (ObjNum 461 snap 136 seq_num 461) 2026-02-13T18:10:54.888 INFO:tasks.rados.rados.0.trial187.stdout:1332: expect (ObjNum 463 snap 136 seq_num 463) 2026-02-13T18:10:54.961 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 993554 2026-02-13T18:10:55.725 INFO:tasks.rados.rados.0.trial187.stdout:1332: done (3 left) 2026-02-13T18:10:55.726 INFO:tasks.rados.rados.0.trial187.stdout:1333: done (2 left) 2026-02-13T18:10:55.726 INFO:tasks.rados.rados.0.trial187.stdout:1334: done (1 left) 2026-02-13T18:10:55.726 INFO:tasks.rados.rados.0.trial187.stdout:1335: done (0 left) 2026-02-13T18:10:55.726 INFO:tasks.rados.rados.0.trial187.stdout:1336: snap_create 2026-02-13T18:10:56.729 INFO:tasks.rados.rados.0.trial187.stdout:1336: done (0 left) 2026-02-13T18:10:56.729 INFO:tasks.rados.rados.0.trial187.stdout:1337: read oid 13 snap 134 2026-02-13T18:10:56.729 INFO:tasks.rados.rados.0.trial187.stdout:1337: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:10:56.729 INFO:tasks.rados.rados.0.trial187.stdout:1338: read oid 7 snap -1 2026-02-13T18:10:56.729 INFO:tasks.rados.rados.0.trial187.stdout:1338: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:10:56.730 INFO:tasks.rados.rados.0.trial187.stdout:1339: write oid 23 current snap is 139 2026-02-13T18:10:56.730 INFO:tasks.rados.rados.0.trial187.stdout:1339: seq_num 467 ranges {648869=638816,1828032=787828,3141714=532030} 2026-02-13T18:10:56.737 INFO:tasks.rados.rados.0.trial187.stdout:1339: writing trial18717860-23 from 648869 to 1287685 tid 1 2026-02-13T18:10:56.746 INFO:tasks.rados.rados.0.trial187.stdout:1339: writing trial18717860-23 from 1828032 to 2615860 tid 2 2026-02-13T18:10:56.753 INFO:tasks.rados.rados.0.trial187.stdout:1339: writing trial18717860-23 from 3141714 to 3673744 tid 3 2026-02-13T18:10:56.753 INFO:tasks.rados.rados.0.trial187.stdout:1340: rollback oid 19 current snap is 139 2026-02-13T18:10:56.754 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 138 2026-02-13T18:10:56.754 INFO:tasks.rados.rados.0.trial187.stdout:1338: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:10:56.794 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2560996 2026-02-13T18:10:56.866 INFO:tasks.rados.rados.0.trial187.stdout:1339: finishing write tid 1 to trial18717860-23 2026-02-13T18:10:56.866 INFO:tasks.rados.rados.0.trial187.stdout:1337: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:10:56.867 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:10:56.927 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 401669 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: finishing write tid 2 to trial18717860-23 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: finishing write tid 3 to trial18717860-23 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: finishing write tid 4 to trial18717860-23 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: finishing write tid 5 to trial18717860-23 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: oid 23 updating version 0 to 517 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: oid 23 version 517 is already newer than 515 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: oid 23 version 517 is already newer than 516 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: oid 23 version 517 is already newer than 514 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 517 (ObjNum 467 snap 139 seq_num 467) dirty exists 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1339: left oid 23 (ObjNum 467 snap 139 seq_num 467) 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1340: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1340: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1340: finishing rollback tid 2 to trial18717860-19 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 604 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:10:57.047 INFO:tasks.rados.rados.0.trial187.stdout:1337: done (3 left) 2026-02-13T18:10:57.048 INFO:tasks.rados.rados.0.trial187.stdout:1338: done (2 left) 2026-02-13T18:10:57.048 INFO:tasks.rados.rados.0.trial187.stdout:1339: done (1 left) 2026-02-13T18:10:57.048 INFO:tasks.rados.rados.0.trial187.stdout:1340: done (0 left) 2026-02-13T18:10:57.048 INFO:tasks.rados.rados.0.trial187.stdout:1341: snap_create 2026-02-13T18:10:57.731 INFO:tasks.rados.rados.0.trial187.stdout:1341: done (0 left) 2026-02-13T18:10:57.731 INFO:tasks.rados.rados.0.trial187.stdout:1342: write oid 42 current snap is 140 2026-02-13T18:10:57.731 INFO:tasks.rados.rados.0.trial187.stdout:1342: seq_num 468 ranges {665676=714065,1886514=531486,3169137=696539} 2026-02-13T18:10:57.740 INFO:tasks.rados.rados.0.trial187.stdout:1342: writing trial18717860-42 from 665676 to 1379741 tid 1 2026-02-13T18:10:57.747 INFO:tasks.rados.rados.0.trial187.stdout:1342: writing trial18717860-42 from 1886514 to 2418000 tid 2 2026-02-13T18:10:57.757 INFO:tasks.rados.rados.0.trial187.stdout:1342: writing trial18717860-42 from 3169137 to 3865676 tid 3 2026-02-13T18:10:57.757 INFO:tasks.rados.rados.0.trial187.stdout:1343: write (excl) oid 41 current snap is 140 2026-02-13T18:10:57.757 INFO:tasks.rados.rados.0.trial187.stdout:1343: seq_num 469 ranges {682483=789314,1944996=791497,3196560=554574} 2026-02-13T18:10:57.767 INFO:tasks.rados.rados.0.trial187.stdout:1343: writing trial18717860-41 from 682483 to 1471797 tid 1 2026-02-13T18:10:57.776 INFO:tasks.rados.rados.0.trial187.stdout:1343: writing trial18717860-41 from 1944996 to 2736493 tid 2 2026-02-13T18:10:57.780 INFO:tasks.rados.rados.0.trial187.stdout:1343: writing trial18717860-41 from 3196560 to 3751134 tid 3 2026-02-13T18:10:57.780 INFO:tasks.rados.rados.0.trial187.stdout:1344: snap_remove snap 137 2026-02-13T18:10:58.724 INFO:tasks.rados.rados.0.trial187.stdout:1344: done (2 left) 2026-02-13T18:10:58.724 INFO:tasks.rados.rados.0.trial187.stdout:1345: snap_remove snap 129 2026-02-13T18:10:59.103 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:10:59.103 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:10:59.104 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T18:10:59.104 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T18:10:59.107 INFO:tasks.ceph.mon.a:Started 2026-02-13T18:10:59.107 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:10:59.107 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:10:59.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.158+0000 7f7f4d9b7640 10 monclient: get_monmap_and_config 2026-02-13T18:10:59.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.158+0000 7f7f4d9b7640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.158+0000 7f7f4d9b7640 10 monclient: monmap: 2026-02-13T18:10:59.167 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:10:59.165385+0000 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:10:59.165385+0000 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.168 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:10:59.169 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:10:59.169 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 1 Processor -- start 2026-02-13T18:10:59.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 1 -- start start 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient: init 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient(hunting): picked mon.noname-a con 0x7f7f4813f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient(hunting): picked mon.noname-b con 0x7f7f4805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient(hunting): picked mon.noname-c con 0x7f7f481853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f48095530 con 0x7f7f4813f8b0 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f48140390 con 0x7f7f481853c0 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4805d230 con 0x7f7f4805e4b0 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient(hunting): authenticate will time out at 890.221076s 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f46ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7f4813f8b0 0x7f7f4813fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:47232/0 (socket says 10.20.193.78:47232) 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f46ffd640 1 -- 10.20.193.78:0/2275203653 learned_addr learned my addr 10.20.193.78:0/2275203653 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f46ffd640 1 -- 10.20.193.78:0/2275203653 >> v1:10.20.193.78:6789/0 conn(0x7f7f4813f8b0 legacy=0x7f7f4813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f467fc640 1 -- 10.20.193.78:0/2275203653 >> v1:10.20.193.78:6790/0 conn(0x7f7f4805e4b0 legacy=0x7f7f48183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800144011 0 0) 0x7f7f4805d230 con 0x7f7f4805e4b0 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient(hunting): my global_id is 4664 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f34003620 con 0x7f7f4805e4b0 2026-02-13T18:10:59.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 828168254 0 0) 0x7f7f34003620 con 0x7f7f4805e4b0 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 >> v1:10.20.193.187:6789/0 conn(0x7f7f481853c0 legacy=0x7f7f481a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 >> v1:10.20.193.78:6789/0 conn(0x7f7f4813f8b0 legacy=0x7f7f4813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 monclient: found mon.noname-b 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4805d510 con 0x7f7f4805e4b0 2026-02-13T18:10:59.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7f30003090 con 0x7f7f4805e4b0 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 5 monclient: authenticate success, global_id 4664 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:10:59.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: dump: 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.186 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f30003360 con 0x7f7f4805e4b0 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 10 monclient: get_monmap_and_config success 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f4d9b7640 4 set_mon_vals no callback set 2026-02-13T18:10:59.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 1 -- 10.20.193.78:0/2275203653 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7f300038c0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.162+0000 7f7f45ffb640 10 monclient: dump: 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.188 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: shutdown 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2275203653 >> v1:10.20.193.78:6790/0 conn(0x7f7f4805e4b0 legacy=0x7f7f48183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2275203653 shutdown_connections 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2275203653 >> 10.20.193.78:0/2275203653 conn(0x7f7f480545d0 msgr2=0x7f7f480549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2275203653 shutdown_connections 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2275203653 wait complete. 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: monmap: 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:10:59.190 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 Processor -- start 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- start start 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: init 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient(hunting): picked mon.noname-c con 0x7f7f4805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient(hunting): picked mon.noname-b con 0x7f7f4813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient(hunting): picked mon.noname-a con 0x7f7f481853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f48111c40 con 0x7f7f481853c0 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f48110dd0 con 0x7f7f4813f8b0 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4810f8e0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient(hunting): authenticate will time out at 890.225111s 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f46ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f7f4805e4b0 0x7f7f4813e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49686/0 (socket says 10.20.193.78:49686) 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f46ffd640 1 -- 10.20.193.78:0/2185205511 learned_addr learned my addr 10.20.193.78:0/2185205511 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f46ffd640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.78:6790/0 conn(0x7f7f4805e4b0 legacy=0x7f7f4813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f477fe640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.78:6789/0 conn(0x7f7f481853c0 legacy=0x7f7f481815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300001253 0 0) 0x7f7f4810f8e0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): my global_id is 4667 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f18003620 con 0x7f7f4805e4b0 2026-02-13T18:10:59.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f467fc640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.187:6789/0 conn(0x7f7f4813f8b0 legacy=0x7f7f4813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1813133012 0 0) 0x7f7f18003620 con 0x7f7f4805e4b0 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f4810f8e0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7f3c003330 con 0x7f7f4805e4b0 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): dump: 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.193 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2077000820 0 0) 0x7f7f4810f8e0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.187:6789/0 conn(0x7f7f4813f8b0 legacy=0x7f7f4813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.78:6789/0 conn(0x7f7f481853c0 legacy=0x7f7f481815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 monclient: found mon.c 2026-02-13T18:10:59.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f481113a0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 5 monclient: authenticate success, global_id 4667 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: _renew_subs 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4810f290 con 0x7f7f4805e4b0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: _renew_subs 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.166+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f48110610 con 0x7f7f4805e4b0 2026-02-13T18:10:59.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f3c004b90 con 0x7f7f4805e4b0 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7f3c004ef0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f457fa640 4 set_mon_vals no callback set 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 10 monclient: dump: 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.196 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f4d9b7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f4d9b7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f4d9b7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f480008e0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f7f3c0050d0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(295..295 src has 1..295) ==== 4003+0+0 (unknown 859999861 0 0) 0x7f7f3c04b560 con 0x7f7f4805e4b0 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f467fc640 10 monclient: get_auth_request con 0x7f7f1803d370 auth_method 0 2026-02-13T18:10:59.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f7f48095530 con 0x7f7f4805e4b0 2026-02-13T18:10:59.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.170+0000 7f7f1ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:10:59.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:10:59.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:10:59.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f48093020 con 0x7f7f4805e4b0 2026-02-13T18:10:59.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f1ffff640 1 -- 10.20.193.78:0/2185205511 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3085382353) 0x7f7f3c0177d0 con 0x7f7f4805e4b0 2026-02-13T18:10:59.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f1ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:10:59.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f1ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:10:59.294 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:10:59.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.187:6812/2668687789 conn(0x7f7f1803d370 legacy=0x7f7f1805d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 10 monclient: shutdown 2026-02-13T18:10:59.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 >> v1:10.20.193.78:6790/0 conn(0x7f7f4805e4b0 legacy=0x7f7f4813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 shutdown_connections 2026-02-13T18:10:59.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 >> 10.20.193.78:0/2185205511 conn(0x7f7f480545d0 msgr2=0x7f7f480965f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 shutdown_connections 2026-02-13T18:10:59.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.286+0000 7f7f4d9b7640 1 -- 10.20.193.78:0/2185205511 wait complete. 2026-02-13T18:10:59.304 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:10:59.304 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:10:59.305 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:10:59.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient: get_monmap_and_config 2026-02-13T18:10:59.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient: monmap: 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:10:59.371692+0000 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:10:59.371692+0000 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:10:59.374 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 1 Processor -- start 2026-02-13T18:10:59.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 1 -- start start 2026-02-13T18:10:59.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient: init 2026-02-13T18:10:59.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:10:59.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient(hunting): picked mon.noname-c con 0x7f1e2408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient(hunting): picked mon.noname-a con 0x7f1e2408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient(hunting): picked mon.noname-b con 0x7f1e2408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e24089e80 con 0x7f1e2408dc80 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e24088c20 con 0x7f1e2408c2f0 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e24089ba0 con 0x7f1e2408cdd0 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2bf16640 10 monclient(hunting): authenticate will time out at 890.427062s 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2a48c640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1e2408cdd0 0x7f1e241a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49694/0 (socket says 10.20.193.78:49694) 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2a48c640 1 -- 10.20.193.78:0/3074372440 learned_addr learned my addr 10.20.193.78:0/3074372440 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.367+0000 7f1e2948a640 1 --1- 10.20.193.78:0/3074372440 >> v1:10.20.193.78:6789/0 conn(0x7f1e2408dc80 0x7f1e24181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:47248/0 (socket says 10.20.193.78:47248) 2026-02-13T18:10:59.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2948a640 1 -- 10.20.193.78:0/3074372440 >> v1:10.20.193.78:6789/0 conn(0x7f1e2408dc80 legacy=0x7f1e24181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2a48c640 1 -- 10.20.193.78:0/3074372440 >> v1:10.20.193.78:6790/0 conn(0x7f1e2408cdd0 legacy=0x7f1e241a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749150568 0 0) 0x7f1e24089ba0 con 0x7f1e2408cdd0 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e29c8b640 1 -- 10.20.193.78:0/3074372440 >> v1:10.20.193.187:6789/0 conn(0x7f1e2408c2f0 legacy=0x7f1e2408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient(hunting): my global_id is 4670 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e0c003620 con 0x7f1e2408cdd0 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2087581007 0 0) 0x7f1e0c003620 con 0x7f1e2408cdd0 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 >> v1:10.20.193.187:6789/0 conn(0x7f1e2408c2f0 legacy=0x7f1e2408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 >> v1:10.20.193.78:6789/0 conn(0x7f1e2408dc80 legacy=0x7f1e24181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 monclient: found mon.noname-b 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2408d370 con 0x7f1e2408cdd0 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e20004620 con 0x7f1e2408cdd0 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 5 monclient: authenticate success, global_id 4670 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:10:59.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: dump: 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e200048f0 con 0x7f1e2408cdd0 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 1 -- 10.20.193.78:0/3074372440 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e20006060 con 0x7f1e2408cdd0 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e28c89640 10 monclient: dump: 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.384 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: get_monmap_and_config success 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 4 set_mon_vals no callback set 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: shutdown 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- 10.20.193.78:0/3074372440 >> v1:10.20.193.78:6790/0 conn(0x7f1e2408cdd0 legacy=0x7f1e241a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- 10.20.193.78:0/3074372440 shutdown_connections 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- 10.20.193.78:0/3074372440 >> 10.20.193.78:0/3074372440 conn(0x7f1e24091720 msgr2=0x7f1e24091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- 10.20.193.78:0/3074372440 shutdown_connections 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- 10.20.193.78:0/3074372440 wait complete. 2026-02-13T18:10:59.385 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: monmap: 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 Processor -- start 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- start start 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: init 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient(hunting): picked mon.noname-b con 0x7f1e2408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient(hunting): picked mon.noname-c con 0x7f1e2408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient(hunting): picked mon.noname-a con 0x7f1e2408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e2407e0c0 con 0x7f1e2408dc80 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e24057a70 con 0x7f1e2408c2f0 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e24088910 con 0x7f1e2408cdd0 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2bf16640 10 monclient(hunting): authenticate will time out at 890.431787s 2026-02-13T18:10:59.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2948a640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1e2408cdd0 0x7f1e24083970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49696/0 (socket says 10.20.193.78:49696) 2026-02-13T18:10:59.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.371+0000 7f1e2948a640 1 -- 10.20.193.78:0/4260704851 learned_addr learned my addr 10.20.193.78:0/4260704851 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e2948a640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6790/0 conn(0x7f1e2408cdd0 legacy=0x7f1e24083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e2a48c640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2408dc80 legacy=0x7f1e24193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e29c8b640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.187:6789/0 conn(0x7f1e2408c2f0 legacy=0x7f1e241510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791544627 0 0) 0x7f1e24057a70 con 0x7f1e2408c2f0 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): my global_id is 4693 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1df4003620 con 0x7f1e2408c2f0 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e2a48c640 1 --1- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2408dc80 0x7f1e24193450 :-1 s=OPENED pgs=130 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f1e2407e0c0 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 283654354 0 0) 0x7f1df4003620 con 0x7f1e2408c2f0 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e24057a70 con 0x7f1e2408c2f0 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e14003380 con 0x7f1e2408c2f0 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): dump: 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.394 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.375+0000 7f1e127fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262663325 0 0) 0x7f1e24088910 con 0x7f1e2408cdd0 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): my global_id is 4673 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1df4003620 con 0x7f1e2408cdd0 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3305647521 0 0) 0x7f1e24057a70 con 0x7f1e2408c2f0 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6790/0 conn(0x7f1e2408cdd0 legacy=0x7f1e24083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2408dc80 legacy=0x7f1e24193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 monclient: found mon.b 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e24080420 con 0x7f1e2408c2f0 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959619773 0 0) 0x7f1e2407e0c0 con 0x7f1e2408dc80 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 5 monclient: authenticate success, global_id 4693 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 10 monclient: _renew_subs 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2407fb80 con 0x7f1e2408c2f0 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 10 monclient: _renew_subs 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e24084080 con 0x7f1e2408c2f0 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e140039c0 con 0x7f1e2408c2f0 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e14003d20 con 0x7f1e2408c2f0 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: dump: 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.398 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e13fff640 4 set_mon_vals no callback set 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e2408f5e0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1e14003f00 con 0x7f1e2408c2f0 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(295..295 src has 1..295) ==== 4003+0+0 (unknown 859999861 0 0) 0x7f1e1404c680 con 0x7f1e2408c2f0 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2a48c640 10 monclient: get_auth_request con 0x7f1df403d500 auth_method 0 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e2948a640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2405b4e0 legacy=0x7f1e2404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2748521938 0 0) 0x7f1e2408f5e0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient(hunting): my global_id is 74100 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e2407e0c0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1992833946 0 0) 0x7f1e2407e0c0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e2408f5e0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e18003290 con 0x7f1e2405b4e0 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: dump: 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.400 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2084280238 0 0) 0x7f1e2408f5e0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e24090810 con 0x7f1e2405b4e0 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1e180048e0 con 0x7f1e2405b4e0 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2405b4e0 legacy=0x7f1e2404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.379+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2405b4e0 legacy=0x7f1e2404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.383+0000 7f1e2bf16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.383+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e240510e0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2948a640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2405b8b0 legacy=0x7f1e24195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582522906 0 0) 0x7f1e240510e0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient(hunting): my global_id is 74103 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e2408f5e0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3282588274 0 0) 0x7f1e2408f5e0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e240510e0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e18004ee0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient: dump: 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.403 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 58062222 0 0) 0x7f1e240510e0 con 0x7f1e2405b8b0 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e2404d910 con 0x7f1e2405b8b0 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4338 (unknown 0 0 3988120088) 0x7f1e18007220 con 0x7f1e2405b8b0 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2405b8b0 legacy=0x7f1e24195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e127fc640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.78:6789/0 conn(0x7f1e2405b8b0 legacy=0x7f1e24195b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:10:59.404 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 20, 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 244, 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:10:59.405 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.406 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.407 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:10:59.408 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.409 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.410 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.411 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.412 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:10:59.413 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.414 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.415 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:10:59.415 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.415 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.415 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.415 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:10:59.415 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1df403d500 legacy=0x7f1df405d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 10 monclient: shutdown 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 >> v1:10.20.193.187:6789/0 conn(0x7f1e2408c2f0 legacy=0x7f1e241510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2a48c640 1 -- 10.20.193.78:0/4260704851 reap_dead start 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2a48c640 1 -- 10.20.193.78:0/4260704851 reap_dead start 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 shutdown_connections 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 >> 10.20.193.78:0/4260704851 conn(0x7f1e24091720 msgr2=0x7f1e24058c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 shutdown_connections 2026-02-13T18:10:59.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.387+0000 7f1e2bf16640 1 -- 10.20.193.78:0/4260704851 wait complete. 2026-02-13T18:10:59.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:10:59.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:10:59.417 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:10:59.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.483+0000 7f7bd1fbe640 10 monclient: get_monmap_and_config 2026-02-13T18:10:59.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.483+0000 7f7bd1fbe640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.483+0000 7f7bd1fbe640 10 monclient: monmap: 2026-02-13T18:10:59.490 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.490 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:10:59.488518+0000 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:10:59.488518+0000 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:10:59.491 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.483+0000 7f7bd1fbe640 1 Processor -- start 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.483+0000 7f7bd1fbe640 1 -- start start 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.483+0000 7f7bd1fbe640 10 monclient: init 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient(hunting): picked mon.noname-b con 0x7f7bcc13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient(hunting): picked mon.noname-a con 0x7f7bcc05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient(hunting): picked mon.noname-c con 0x7f7bcc1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc095530 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc140390 con 0x7f7bcc1853c0 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc05d230 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient(hunting): authenticate will time out at 890.544154s 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bcaffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7bcc05e4b0 0x7f7bcc183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:47278/0 (socket says 10.20.193.78:47278) 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bcaffd640 1 -- 10.20.193.78:0/2357805746 learned_addr learned my addr 10.20.193.78:0/2357805746 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bcaffd640 1 -- 10.20.193.78:0/2357805746 >> v1:10.20.193.78:6789/0 conn(0x7f7bcc05e4b0 legacy=0x7f7bcc183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bcb7fe640 1 -- 10.20.193.78:0/2357805746 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc13f8b0 legacy=0x7f7bcc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476767752 0 0) 0x7f7bbc002c60 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): my global_id is 74106 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bb0003620 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172555786 0 0) 0x7f7bcc05d230 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient(hunting): my global_id is 4676 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc002c60 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2916102428 0 0) 0x7f7bb0003620 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc13f8b0 legacy=0x7f7bcc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 >> v1:10.20.193.187:6789/0 conn(0x7f7bcc1853c0 legacy=0x7f7bcc1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bcbfff640 1 -- 10.20.193.78:0/2357805746 >> v1:10.20.193.187:6789/0 conn(0x7f7bcc1853c0 legacy=0x7f7bcc1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 monclient: found mon.noname-a 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc05d510 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bbc0032e0 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: dump: 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.509 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 5 monclient: authenticate success, global_id 74106 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bbc0049a0 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 1 -- 10.20.193.78:0/2357805746 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bbc004d30 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bca7fc640 10 monclient: dump: 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.510 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient: get_monmap_and_config success 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 4 set_mon_vals no callback set 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient: shutdown 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/2357805746 >> v1:10.20.193.78:6789/0 conn(0x7f7bcc05e4b0 legacy=0x7f7bcc183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/2357805746 shutdown_connections 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/2357805746 >> 10.20.193.78:0/2357805746 conn(0x7f7bcc0545d0 msgr2=0x7f7bcc0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/2357805746 shutdown_connections 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/2357805746 wait complete. 2026-02-13T18:10:59.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 10 monclient: monmap: 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.487+0000 7f7bd1fbe640 1 Processor -- start 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- start start 2026-02-13T18:10:59.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: init 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient(hunting): picked mon.noname-b con 0x7f7bcc05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient(hunting): picked mon.noname-a con 0x7f7bcc13f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient(hunting): picked mon.noname-c con 0x7f7bcc1853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc112090 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc111220 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc10fd30 con 0x7f7bcc1853c0 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient(hunting): authenticate will time out at 890.548294s 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bcaffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7bcc13f8b0 0x7f7bcc180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:47286/0 (socket says 10.20.193.78:47286) 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bcaffd640 1 -- 10.20.193.78:0/1768619124 learned_addr learned my addr 10.20.193.78:0/1768619124 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bcbfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f7bcc1853c0 0x7f7bcc181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49704/0 (socket says 10.20.193.78:49704) 2026-02-13T18:10:59.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bcbfff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc1853c0 legacy=0x7f7bcc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bcaffd640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6789/0 conn(0x7f7bcc13f8b0 legacy=0x7f7bcc180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167880369 0 0) 0x7f7bcc10fd30 con 0x7f7bcc1853c0 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): my global_id is 4679 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b9c003620 con 0x7f7bcc1853c0 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198564909 0 0) 0x7f7bcc112090 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): my global_id is 74109 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc10fd30 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bcb7fe640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.187:6789/0 conn(0x7f7bcc05e4b0 legacy=0x7f7bcc13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2393631533 0 0) 0x7f7b9c003620 con 0x7f7bcc1853c0 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bcc112090 con 0x7f7bcc1853c0 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bc0004810 con 0x7f7bcc1853c0 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): dump: 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.515 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1013510257 0 0) 0x7f7bcc10fd30 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b9c003620 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bbc002b30 con 0x7f7bcc13f8b0 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): dump: 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.516 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636956305 0 0) 0x7f7bcc111220 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient(hunting): my global_id is 4699 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc10fd30 con 0x7f7bcc05e4b0 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 156487883 0 0) 0x7f7bcc112090 con 0x7f7bcc1853c0 2026-02-13T18:10:59.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.187:6789/0 conn(0x7f7bcc05e4b0 legacy=0x7f7bcc13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6789/0 conn(0x7f7bcc13f8b0 legacy=0x7f7bcc180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 monclient: found mon.c 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc1117f0 con 0x7f7bcc1853c0 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 5 monclient: authenticate success, global_id 4679 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: _renew_subs 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc10f6e0 con 0x7f7bcc1853c0 2026-02-13T18:10:59.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: _renew_subs 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7bcc110890 con 0x7f7bcc1853c0 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bc00049f0 con 0x7f7bcc1853c0 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bc9ffb640 4 set_mon_vals no callback set 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bc0005100 con 0x7f7bcc1853c0 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 10 monclient: dump: 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.519 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7bcc110bd0 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f7bc0005320 con 0x7f7bcc1853c0 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.491+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(295..295 src has 1..295) ==== 4003+0+0 (unknown 859999861 0 0) 0x7f7bc004db20 con 0x7f7bcc1853c0 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7bcaffd640 10 monclient: get_auth_request con 0x7f7b9c03d7d0 auth_method 0 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7bcb7fe640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc12d6d0 legacy=0x7f7bcc08d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209597396 0 0) 0x7f7bcc110bd0 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient(hunting): my global_id is 4682 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc112090 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4199543338 0 0) 0x7f7bcc112090 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bcc110bd0 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bb8002f90 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient: dump: 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.521 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1370987359 0 0) 0x7f7bcc110bd0 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bcc0008e0 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7bb80058c0 con 0x7f7bcc12d6d0 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc12d6d0 legacy=0x7f7bcc08d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.495+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc12d6d0 legacy=0x7f7bcc08d0d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.499+0000 7f7bd1fbe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:10:59.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.499+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7bcc12daa0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bcb7fe640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc184ba0 legacy=0x7f7bcc08bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441225050 0 0) 0x7f7bcc12daa0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient(hunting): my global_id is 4685 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc110bd0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1353595255 0 0) 0x7f7bcc110bd0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bcc12daa0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7bb8003bb0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient: dump: 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3351154025 0 0) 0x7f7bcc12daa0 con 0x7f7bcc184ba0 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7bcc093020 con 0x7f7bcc184ba0 2026-02-13T18:10:59.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 724519699) 0x7f7bb8005b30 con 0x7f7bcc184ba0 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc184ba0 legacy=0x7f7bcc08bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7ba7fff640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc184ba0 legacy=0x7f7bcc08bf50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 20, 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 340894, 2026-02-13T18:10:59.526 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.527 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.528 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:10:59.529 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.530 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:10:59.531 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.532 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.533 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:10:59.534 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:10:59.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.187:6812/2668687789 conn(0x7f7b9c03d7d0 legacy=0x7f7b9c05dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 10 monclient: shutdown 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 >> v1:10.20.193.78:6790/0 conn(0x7f7bcc1853c0 legacy=0x7f7bcc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bcbfff640 1 -- 10.20.193.78:0/1768619124 reap_dead start 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bcbfff640 1 -- 10.20.193.78:0/1768619124 reap_dead start 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 shutdown_connections 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 >> 10.20.193.78:0/1768619124 conn(0x7f7bcc0545d0 msgr2=0x7f7bcc096600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 shutdown_connections 2026-02-13T18:10:59.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.503+0000 7f7bd1fbe640 1 -- 10.20.193.78:0/1768619124 wait complete. 2026-02-13T18:10:59.536 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:10:59.536 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:10:59.536 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:10:59.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient: get_monmap_and_config 2026-02-13T18:10:59.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient: monmap: 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:10:59.604216+0000 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:10:59.604216+0000 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:10:59.606 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 1 Processor -- start 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 1 -- start start 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient: init 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient(hunting): picked mon.noname-c con 0x7f3ef813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient(hunting): picked mon.noname-a con 0x7f3ef805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient(hunting): picked mon.noname-b con 0x7f3ef81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef8095530 con 0x7f3ef805e4b0 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef8140390 con 0x7f3ef813f8b0 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef805d230 con 0x7f3ef81853c0 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efff5f640 10 monclient(hunting): authenticate will time out at 890.659688s 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efe4d5640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f3ef81853c0 0x7f3ef81a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49730/0 (socket says 10.20.193.78:49730) 2026-02-13T18:10:59.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efd4d3640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3ef805e4b0 0x7f3ef8183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:47290/0 (socket says 10.20.193.78:47290) 2026-02-13T18:10:59.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.599+0000 7f3efe4d5640 1 -- 10.20.193.78:0/3369851404 learned_addr learned my addr 10.20.193.78:0/3369851404 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efe4d5640 1 -- 10.20.193.78:0/3369851404 >> v1:10.20.193.78:6790/0 conn(0x7f3ef81853c0 legacy=0x7f3ef81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efd4d3640 1 -- 10.20.193.78:0/3369851404 >> v1:10.20.193.78:6789/0 conn(0x7f3ef805e4b0 legacy=0x7f3ef8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666097036 0 0) 0x7f3eec002b90 con 0x7f3ef805e4b0 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): my global_id is 74112 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee0003620 con 0x7f3ef805e4b0 2026-02-13T18:10:59.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748216042 0 0) 0x7f3ef805d230 con 0x7f3ef81853c0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient(hunting): my global_id is 4688 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eec002b90 con 0x7f3ef81853c0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efdcd4640 1 -- 10.20.193.78:0/3369851404 >> v1:10.20.193.187:6789/0 conn(0x7f3ef813f8b0 legacy=0x7f3ef813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22076565 0 0) 0x7f3ee0003620 con 0x7f3ef805e4b0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 >> v1:10.20.193.78:6790/0 conn(0x7f3ef81853c0 legacy=0x7f3ef81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 >> v1:10.20.193.187:6789/0 conn(0x7f3ef813f8b0 legacy=0x7f3ef813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 monclient: found mon.noname-a 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef805d510 con 0x7f3ef805e4b0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 5 monclient: authenticate success, global_id 74112 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3eec003210 con 0x7f3ef805e4b0 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: dump: 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3eec0034e0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 1 -- 10.20.193.78:0/3369851404 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3eec004a90 con 0x7f3ef805e4b0 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efccd2640 10 monclient: dump: 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: get_monmap_and_config success 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 4 set_mon_vals no callback set 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: shutdown 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- 10.20.193.78:0/3369851404 >> v1:10.20.193.78:6789/0 conn(0x7f3ef805e4b0 legacy=0x7f3ef8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- 10.20.193.78:0/3369851404 shutdown_connections 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- 10.20.193.78:0/3369851404 >> 10.20.193.78:0/3369851404 conn(0x7f3ef80545d0 msgr2=0x7f3ef80549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- 10.20.193.78:0/3369851404 shutdown_connections 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- 10.20.193.78:0/3369851404 wait complete. 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: monmap: 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:10:59.615 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 Processor -- start 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- start start 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: init 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient(hunting): picked mon.noname-a con 0x7f3ef805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient(hunting): picked mon.noname-b con 0x7f3ef813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient(hunting): picked mon.noname-c con 0x7f3ef81853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef8112030 con 0x7f3ef805e4b0 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef81111c0 con 0x7f3ef813f8b0 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef810fcd0 con 0x7f3ef81853c0 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efff5f640 10 monclient(hunting): authenticate will time out at 890.663700s 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efdcd4640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3ef805e4b0 0x7f3ef813eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:47296/0 (socket says 10.20.193.78:47296) 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efdcd4640 1 -- 10.20.193.78:0/3965079018 learned_addr learned my addr 10.20.193.78:0/3965079018 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.603+0000 7f3efe4d5640 1 --1- 10.20.193.78:0/3965079018 >> v1:10.20.193.78:6790/0 conn(0x7f3ef81853c0 0x7f3ef8181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49738/0 (socket says 10.20.193.78:49738) 2026-02-13T18:10:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3efdcd4640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.78:6789/0 conn(0x7f3ef805e4b0 legacy=0x7f3ef813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3efe4d5640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.78:6790/0 conn(0x7f3ef81853c0 legacy=0x7f3ef8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770640407 0 0) 0x7f3ef8112030 con 0x7f3ef805e4b0 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): my global_id is 74115 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec8003620 con 0x7f3ef805e4b0 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761553010 0 0) 0x7f3ef810fcd0 con 0x7f3ef81853c0 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 10 monclient(hunting): my global_id is 4691 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef8112030 con 0x7f3ef81853c0 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.607+0000 7f3efd4d3640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef813f8b0 legacy=0x7f3ef8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1032341947 0 0) 0x7f3ec8003620 con 0x7f3ef805e4b0 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef810fcd0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942274000 0 0) 0x7f3ef81111c0 con 0x7f3ef813f8b0 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): my global_id is 4705 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec8003620 con 0x7f3ef813f8b0 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2419402730 0 0) 0x7f3ef8112030 con 0x7f3ef81853c0 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef81111c0 con 0x7f3ef81853c0 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3ee8003420 con 0x7f3ef805e4b0 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): dump: 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.621 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3ef40048b0 con 0x7f3ef81853c0 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): dump: 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1616114143 0 0) 0x7f3ef810fcd0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.78:6790/0 conn(0x7f3ef81853c0 legacy=0x7f3ef8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef813f8b0 legacy=0x7f3ef8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 monclient: found mon.a 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef8111790 con 0x7f3ef805e4b0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 5 monclient: authenticate success, global_id 74115 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 10 monclient: _renew_subs 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef810f5f0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 10 monclient: _renew_subs 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ef813f480 con 0x7f3ef805e4b0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ee80039c0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3ee8003d50 con 0x7f3ef805e4b0 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee7fff640 4 set_mon_vals no callback set 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient: dump: 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3ef81a6e40 con 0x7f3ef8110950 2026-02-13T18:10:59.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3ee8003fe0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(295..295 src has 1..295) ==== 4003+0+0 (unknown 859999861 0 0) 0x7f3ee804c7a0 con 0x7f3ef805e4b0 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efe4d5640 10 monclient: get_auth_request con 0x7f3ec803d850 auth_method 0 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3efd4d3640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef8110950 legacy=0x7f3ef808d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462412795 0 0) 0x7f3ef81a6e40 con 0x7f3ef8110950 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 10 monclient(hunting): my global_id is 4708 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.611+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef810fcd0 con 0x7f3ef8110950 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1285305352 0 0) 0x7f3ef810fcd0 con 0x7f3ef8110950 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef81a6e40 con 0x7f3ef8110950 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3eec003060 con 0x7f3ef8110950 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 10 monclient: dump: 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.625 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 284758888 0 0) 0x7f3ef81a6e40 con 0x7f3ef8110950 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ef80008e0 con 0x7f3ef8110950 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3eec0032d0 con 0x7f3ef8110950 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef8110950 legacy=0x7f3ef808d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef8110950 legacy=0x7f3ef808d060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:10:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3efff5f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:10:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.615+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3ef812dab0 con 0x7f3ef812d6c0 2026-02-13T18:10:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efd4d3640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef812d6c0 legacy=0x7f3ef8184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749325699 0 0) 0x7f3ef812dab0 con 0x7f3ef812d6c0 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient(hunting): my global_id is 4711 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef81a6e40 con 0x7f3ef812d6c0 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2153849792 0 0) 0x7f3ef81a6e40 con 0x7f3ef812d6c0 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef812dab0 con 0x7f3ef812d6c0 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3eec0051f0 con 0x7f3ef812d6c0 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient: dump: 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.628 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1350394153 0 0) 0x7f3ef812dab0 con 0x7f3ef812d6c0 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ef8090840 con 0x7f3ef812d6c0 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 3646387890) 0x7f3eec0075a0 con 0x7f3ef812d6c0 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef812d6c0 legacy=0x7f3ef8184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3ee67fc640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6789/0 conn(0x7f3ef812d6c0 legacy=0x7f3ef8184ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:10:59.629 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 20, 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 340983, 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.630 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.631 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:10:59.632 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:10:59.633 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.634 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.635 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:10:59.636 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:10:59.637 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:10:59.638 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:10:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.187:6812/2668687789 conn(0x7f3ec803d850 legacy=0x7f3ec805dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 10 monclient: shutdown 2026-02-13T18:10:59.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 >> v1:10.20.193.78:6789/0 conn(0x7f3ef805e4b0 legacy=0x7f3ef813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efe4d5640 1 -- 10.20.193.78:0/3965079018 reap_dead start 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efe4d5640 1 -- 10.20.193.78:0/3965079018 reap_dead start 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 shutdown_connections 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 >> 10.20.193.78:0/3965079018 conn(0x7f3ef80545d0 msgr2=0x7f3ef80966c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 shutdown_connections 2026-02-13T18:10:59.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.619+0000 7f3efff5f640 1 -- 10.20.193.78:0/3965079018 wait complete. 2026-02-13T18:10:59.640 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:10:59.640 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:10:59.640 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient: get_monmap_and_config 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient: monmap: 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:10:59.708557+0000 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:10:59.708557+0000 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:10:59.710 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 1 Processor -- start 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 1 -- start start 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient: init 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.703+0000 7f0aefbf7640 10 monclient(hunting): picked mon.noname-c con 0x7f0ae8085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient(hunting): picked mon.noname-b con 0x7f0ae8085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient(hunting): picked mon.noname-a con 0x7f0ae8181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8088400 con 0x7f0ae8181d50 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8088120 con 0x7f0ae8085790 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae808c550 con 0x7f0ae8085b60 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient(hunting): authenticate will time out at 890.764063s 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aed16b640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0ae8085b60 0x7f0ae8085fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49742/0 (socket says 10.20.193.78:49742) 2026-02-13T18:10:59.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aed16b640 1 -- 10.20.193.78:0/1250600797 learned_addr learned my addr 10.20.193.78:0/1250600797 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aed16b640 1 -- 10.20.193.78:0/1250600797 >> v1:10.20.193.78:6790/0 conn(0x7f0ae8085b60 legacy=0x7f0ae8085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aee16d640 1 -- 10.20.193.78:0/1250600797 >> v1:10.20.193.78:6789/0 conn(0x7f0ae8181d50 legacy=0x7f0ae81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aed96c640 1 -- 10.20.193.78:0/1250600797 >> v1:10.20.193.187:6789/0 conn(0x7f0ae8085790 legacy=0x7f0ae8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122943719 0 0) 0x7f0ae808c550 con 0x7f0ae8085b60 2026-02-13T18:10:59.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): my global_id is 4694 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad0003620 con 0x7f0ae8085b60 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976039764 0 0) 0x7f0ae40041c0 con 0x7f0ae8181d50 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): my global_id is 74118 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae808c550 con 0x7f0ae8181d50 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043920971 0 0) 0x7f0ae8088120 con 0x7f0ae8085790 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient(hunting): my global_id is 4714 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae40041c0 con 0x7f0ae8085790 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 948813484 0 0) 0x7f0ad0003620 con 0x7f0ae8085b60 2026-02-13T18:10:59.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 >> v1:10.20.193.187:6789/0 conn(0x7f0ae8085790 legacy=0x7f0ae8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 >> v1:10.20.193.78:6789/0 conn(0x7f0ae8181d50 legacy=0x7f0ae81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 monclient: found mon.noname-b 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae8087540 con 0x7f0ae8085b60 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 5 monclient: authenticate success, global_id 4694 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0adc003110 con 0x7f0ae8085b60 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: dump: 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.717 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0adc0033e0 con 0x7f0ae8085b60 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 1 -- 10.20.193.78:0/1250600797 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0adc004b50 con 0x7f0ae8085b60 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aec96a640 10 monclient: dump: 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient: get_monmap_and_config success 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 4 set_mon_vals no callback set 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient: shutdown 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1250600797 >> v1:10.20.193.78:6790/0 conn(0x7f0ae8085b60 legacy=0x7f0ae8085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1250600797 shutdown_connections 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1250600797 >> 10.20.193.78:0/1250600797 conn(0x7f0ae8091720 msgr2=0x7f0ae8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1250600797 shutdown_connections 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1250600797 wait complete. 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient: build_initial_monmap 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient: monmap: 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:10:59.719 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 Processor -- start 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 1 -- start start 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.707+0000 7f0aefbf7640 10 monclient: init 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _reopen_session rank -1 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient(hunting): picked mon.noname-c con 0x7f0ae8085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient(hunting): picked mon.noname-a con 0x7f0ae8085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient(hunting): picked mon.noname-b con 0x7f0ae8181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae813f750 con 0x7f0ae8085b60 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8089d60 con 0x7f0ae8181d50 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8154000 con 0x7f0ae8085790 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient(hunting): _renew_subs 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient(hunting): authenticate will time out at 890.768184s 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aed96c640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0ae8085790 0x7f0ae81531e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49752/0 (socket says 10.20.193.78:49752) 2026-02-13T18:10:59.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aed96c640 1 -- 10.20.193.78:0/1285262786 learned_addr learned my addr 10.20.193.78:0/1285262786 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:10:59.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aed16b640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.78:6789/0 conn(0x7f0ae8085b60 legacy=0x7f0ae81538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aed96c640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.78:6790/0 conn(0x7f0ae8085790 legacy=0x7f0ae81531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859082769 0 0) 0x7f0ae813f750 con 0x7f0ae8085b60 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): my global_id is 74121 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab8003620 con 0x7f0ae8085b60 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528277888 0 0) 0x7f0ae8154000 con 0x7f0ae8085790 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): my global_id is 4697 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae813f750 con 0x7f0ae8085790 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2452230578 0 0) 0x7f0ab8003620 con 0x7f0ae8085b60 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ae8154000 con 0x7f0ae8085b60 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0adc0048e0 con 0x7f0ae8085b60 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): dump: 2026-02-13T18:10:59.723 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aee16d640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.187:6789/0 conn(0x7f0ae8181d50 legacy=0x7f0ae8175820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2983249395 0 0) 0x7f0ae813f750 con 0x7f0ae8085790 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ab8003620 con 0x7f0ae8085790 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0ad8003490 con 0x7f0ae8085790 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient(hunting): dump: 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.724 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 419737362 0 0) 0x7f0ae8154000 con 0x7f0ae8085b60 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.78:6790/0 conn(0x7f0ae8085790 legacy=0x7f0ae81531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.187:6789/0 conn(0x7f0ae8181d50 legacy=0x7f0ae8175820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 monclient: found mon.a 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae813fa30 con 0x7f0ae8085b60 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: _finish_auth 0 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:10:59.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 5 monclient: authenticate success, global_id 74121 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _renew_subs 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae805d650 con 0x7f0ae8085b60 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _renew_subs 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ae8140850 con 0x7f0ae8085b60 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0adc0033e0 con 0x7f0ae8085b60 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0adc005320 con 0x7f0ae8085b60 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 10 monclient: dump: 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:10:59.726 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad7fff640 4 set_mon_vals no callback set 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0adc0119b0 con 0x7f0ae8085b60 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae80389c0 con 0x7f0ae8085b60 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(295..295 src has 1..295) ==== 4003+0+0 (unknown 859999861 0 0) 0x7f0adc04c630 con 0x7f0ae8085b60 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.711+0000 7f0aed96c640 10 monclient: get_auth_request con 0x7f0ab803d650 auth_method 0 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.715+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f0adc0176a0 con 0x7f0ae8085b60 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.715+0000 7f0ad67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:10:59.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.715+0000 7f0ad67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1345: done (2 left) 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1346: read oid 11 snap -1 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1346: expect (ObjNum 465 snap 136 seq_num 465) 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1347: write (excl) oid 14 current snap is 140 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1342: finishing write tid 1 to trial18717860-42 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1342: finishing write tid 2 to trial18717860-42 2026-02-13T18:10:59.738 INFO:tasks.rados.rados.0.trial187.stdout:1347: seq_num 470 ranges {699290=464563,1603478=535155,2823983=765846} 2026-02-13T18:10:59.745 INFO:tasks.rados.rados.0.trial187.stdout:1347: writing trial18717860-14 from 699290 to 1163853 tid 1 2026-02-13T18:10:59.752 INFO:tasks.rados.rados.0.trial187.stdout:1347: writing trial18717860-14 from 1603478 to 2138633 tid 2 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1347: writing trial18717860-14 from 2823983 to 3589829 tid 3 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1348: snap_create 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: finishing write tid 3 to trial18717860-42 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: finishing write tid 4 to trial18717860-42 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: finishing write tid 5 to trial18717860-42 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: oid 42 updating version 0 to 299 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: oid 42 updating version 299 to 300 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: oid 42 updating version 300 to 301 2026-02-13T18:10:59.763 INFO:tasks.rados.rados.0.trial187.stdout:1342: oid 42 version 301 is already newer than 298 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 301 (ObjNum 468 snap 140 seq_num 468) dirty exists 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1342: left oid 42 (ObjNum 468 snap 140 seq_num 468) 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: finishing write tid 1 to trial18717860-41 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: finishing write tid 2 to trial18717860-41 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: finishing write tid 3 to trial18717860-41 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: finishing write tid 4 to trial18717860-41 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: finishing write tid 5 to trial18717860-41 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: oid 41 updating version 0 to 304 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: oid 41 updating version 304 to 305 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: oid 41 version 305 is already newer than 303 2026-02-13T18:10:59.764 INFO:tasks.rados.rados.0.trial187.stdout:1343: oid 41 updating version 305 to 306 2026-02-13T18:10:59.765 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 306 (ObjNum 469 snap 140 seq_num 469) dirty exists 2026-02-13T18:10:59.765 INFO:tasks.rados.rados.0.trial187.stdout:1343: left oid 41 (ObjNum 469 snap 140 seq_num 469) 2026-02-13T18:10:59.765 INFO:tasks.rados.rados.0.trial187.stdout:1346: expect (ObjNum 465 snap 136 seq_num 465) 2026-02-13T18:10:59.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.835+0000 7f0aefbf7640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:10:59.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.835+0000 7f0aefbf7640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:10:59.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.835+0000 7f0aefbf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:10:59.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.835+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f0ae808a890 con 0x7f0ae8085b60 2026-02-13T18:10:59.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.843+0000 7f0ad67fc640 1 -- 10.20.193.78:0/1285262786 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f0adc016f80 con 0x7f0ae8085b60 2026-02-13T18:10:59.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.843+0000 7f0ad67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:10:59.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.843+0000 7f0ad67fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=11,kv=11,logm=63} crc {auth=1408038226,config=1618278320,health=1732272203,kv=4087868365,logm=3700596182}) 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=13,kv=11,logm=63} crc {auth=2479132011,config=1618278320,health=1181117202,kv=3141804788,logm=1232395086}) 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=11,kv=11,logm=63} crc {auth=1408038226,config=1618278320,health=1732272203,kv=4087868365,logm=3700596182}) 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=13,kv=10,logm=62} crc {auth=3486749620,config=1618278320,health=1181117202,kv=4087868365,logm=2038186457}) 2026-02-13T18:10:59.851 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.852 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3367518615}) 2026-02-13T18:10:59.852 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=757652883}) 2026-02-13T18:10:59.852 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.852 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3367518615}) 2026-02-13T18:10:59.852 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1561140655}) 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.187:6812/2668687789 conn(0x7f0ab803d650 legacy=0x7f0ab805db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 10 monclient: shutdown 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 >> v1:10.20.193.78:6789/0 conn(0x7f0ae8085b60 legacy=0x7f0ae81538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 shutdown_connections 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 >> 10.20.193.78:0/1285262786 conn(0x7f0ae8091720 msgr2=0x7f0ae805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 shutdown_connections 2026-02-13T18:10:59.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:10:59.847+0000 7f0aefbf7640 1 -- 10.20.193.78:0/1285262786 wait complete. 2026-02-13T18:10:59.855 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.855 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3867168974}) 2026-02-13T18:10:59.855 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3567682955}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3867168974}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.843+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3158794657}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=195003794}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=242163658}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=195003794}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=876394562}) 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.856 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=840863332}) 2026-02-13T18:10:59.857 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541899469}) 2026-02-13T18:10:59.857 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.857 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=840863332}) 2026-02-13T18:10:59.857 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=796533710}) 2026-02-13T18:10:59.857 INFO:tasks.rados.rados.0.trial187.stdout:1347: finishing write tid 1 to trial18717860-14 2026-02-13T18:10:59.857 INFO:tasks.rados.rados.0.trial187.stdout:1347: finishing write tid 2 to trial18717860-14 2026-02-13T18:10:59.857 INFO:tasks.rados.rados.0.trial187.stdout:1347: finishing write tid 3 to trial18717860-14 2026-02-13T18:10:59.857 INFO:tasks.rados.rados.0.trial187.stdout:1347: finishing write tid 4 to trial18717860-14 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:1347: finishing write tid 5 to trial18717860-14 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:1347: oid 14 updating version 0 to 519 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:1347: oid 14 updating version 519 to 520 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:1347: oid 14 version 520 is already newer than 518 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:1347: oid 14 updating version 520 to 521 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 521 (ObjNum 470 snap 140 seq_num 470) dirty exists 2026-02-13T18:10:59.858 INFO:tasks.rados.rados.0.trial187.stdout:1347: left oid 14 (ObjNum 470 snap 140 seq_num 470) 2026-02-13T18:10:59.862 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3350149635}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3718697751}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3350149635}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2261990203}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=263991488}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3457091364}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=263991488}) 2026-02-13T18:10:59.863 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1139228179}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1555849781}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612376620}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1555849781}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.847+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2105921323}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1935842786}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3436278274}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1935842786}) 2026-02-13T18:10:59.864 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2063351236}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3413494266}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=767216436}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3413494266}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=640777345}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=348218737}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=93817002}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=348218737}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3745645393}) 2026-02-13T18:10:59.865 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=86,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=4196738361,mdsmap=685858242,mgr=174722761,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=1695644472}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=445908763,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=1141288841}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=86,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=2} crc {logm=4196738361,mdsmap=685858242,mgr=174722761,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=1695644472}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.851+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=85,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=3} crc {logm=236425117,mdsmap=1435686815,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2829413434}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=54,osdmap=15} crc {mgrstat=4088820138,mon_config_key=2172609631,monmap=2635724903,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=3035946785,osd_snap=2516728109,osdmap=4090984927}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=55,osdmap=14} crc {mgrstat=4088820138,mon_config_key=3718364256,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=3035946785,osd_snap=3820323152,osdmap=1670137974}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=54,osdmap=15} crc {mgrstat=4088820138,mon_config_key=2172609631,monmap=2635724903,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=3035946785,osd_snap=2516728109,osdmap=4090984927}) 2026-02-13T18:10:59.866 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=55,osdmap=13} crc {mgrstat=4088820138,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=3035946785,osd_snap=100209442,osdmap=2808041639}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4195849521}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2282281376}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4195849521}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=516202886}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2687726622}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=995184978}) 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.867 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2687726622}) 2026-02-13T18:10:59.868 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3117139413}) 2026-02-13T18:10:59.870 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:10:59.870 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.870 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1221095887}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2844388931}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1221095887}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.855+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=480409425}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1301582448}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=949745680}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1301582448}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1989243952}) 2026-02-13T18:10:59.871 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.872 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=31} crc {osdmap=3802516664}) 2026-02-13T18:10:59.872 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=3854103006}) 2026-02-13T18:10:59.872 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:10:59.872 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=31} crc {osdmap=3802516664}) 2026-02-13T18:10:59.872 INFO:tasks.ceph.mon.b.trial187.stderr:2026-02-13T18:10:59.859+0000 7fcb8e7bc640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=30} crc {osdmap=2599672048}) 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1342: done (4 left) 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1343: done (3 left) 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1346: done (2 left) 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1347: done (1 left) 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1348: done (0 left) 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1349: copy_from oid 27 from oid 16 current snap is 141 2026-02-13T18:11:00.747 INFO:tasks.rados.rados.0.trial187.stdout:1350: write (excl) oid 5 current snap is 141 2026-02-13T18:11:00.748 INFO:tasks.rados.rados.0.trial187.stdout:1350: seq_num 471 ranges {716097=539812,1945607=795166,3535053=381044} 2026-02-13T18:11:00.755 INFO:tasks.rados.rados.0.trial187.stdout:1350: writing trial18717860-5 from 716097 to 1255909 tid 1 2026-02-13T18:11:00.765 INFO:tasks.rados.rados.0.trial187.stdout:1350: writing trial18717860-5 from 1945607 to 2740773 tid 2 2026-02-13T18:11:00.773 INFO:tasks.rados.rados.0.trial187.stdout:1350: writing trial18717860-5 from 3535053 to 3916097 tid 3 2026-02-13T18:11:00.773 INFO:tasks.rados.rados.0.trial187.stdout:1351: copy_from oid 39 from oid 49 current snap is 141 2026-02-13T18:11:00.773 INFO:tasks.rados.rados.0.trial187.stdout:1349: finishing copy_from racing read to trial18717860-27 2026-02-13T18:11:00.774 INFO:tasks.rados.rados.0.trial187.stdout:1349: finishing copy_from to trial18717860-27 2026-02-13T18:11:00.774 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 419 (ObjNum 432 snap 125 seq_num 432) dirty exists 2026-02-13T18:11:00.774 INFO:tasks.rados.rados.0.trial187.stdout:1349: done (2 left) 2026-02-13T18:11:00.774 INFO:tasks.rados.rados.0.trial187.stdout:1352: write oid 11 current snap is 141 2026-02-13T18:11:00.774 INFO:tasks.rados.rados.0.trial187.stdout:1352: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2026-02-13T18:11:00.783 INFO:tasks.rados.rados.0.trial187.stdout:1352: writing trial18717860-11 from 732904 to 1464318 tid 1 2026-02-13T18:11:00.791 INFO:tasks.rados.rados.0.trial187.stdout:1352: writing trial18717860-11 from 2120442 to 2659266 tid 2 2026-02-13T18:11:00.796 INFO:tasks.rados.rados.0.trial187.stdout:1352: writing trial18717860-11 from 3278829 to 3783572 tid 3 2026-02-13T18:11:00.796 INFO:tasks.rados.rados.0.trial187.stdout:1353: read oid 9 snap -1 2026-02-13T18:11:00.797 INFO:tasks.rados.rados.0.trial187.stdout:1353: expect (ObjNum 403 snap 114 seq_num 403) 2026-02-13T18:11:00.797 INFO:tasks.rados.rados.0.trial187.stdout:1354: read oid 21 snap 136 2026-02-13T18:11:00.797 INFO:tasks.rados.rados.0.trial187.stdout:1354: expect (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:11:00.797 INFO:tasks.rados.rados.0.trial187.stdout:1355: write oid 29 current snap is 141 2026-02-13T18:11:00.797 INFO:tasks.rados.rados.0.trial187.stdout:1355: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2026-02-13T18:11:00.800 INFO:tasks.rados.rados.0.trial187.stdout:1355: writing trial18717860-29 from 749711 to 1156374 tid 1 2026-02-13T18:11:00.805 INFO:tasks.rados.rados.0.trial187.stdout:1355: writing trial18717860-29 from 1778924 to 2461406 tid 2 2026-02-13T18:11:00.811 INFO:tasks.rados.rados.0.trial187.stdout:1355: writing trial18717860-29 from 3189899 to 3905914 tid 3 2026-02-13T18:11:00.811 INFO:tasks.rados.rados.0.trial187.stdout:1356: snap_remove snap 134 2026-02-13T18:11:00.871 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:11:00.871 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:11:00.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient: get_monmap_and_config 2026-02-13T18:11:00.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient: build_initial_monmap 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient: monmap: 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:00.940211+0000 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:00.940211+0000 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:00.943 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 1 Processor -- start 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 1 -- start start 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient: init 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient(hunting): picked mon.noname-a con 0x7f183808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient(hunting): picked mon.noname-c con 0x7f183808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient(hunting): picked mon.noname-b con 0x7f183808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838089e80 con 0x7f183808c2f0 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838088c20 con 0x7f183808dc80 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838089ba0 con 0x7f183808cdd0 2026-02-13T18:11:00.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:00.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f183dab1640 10 monclient(hunting): authenticate will time out at 891.995342s 2026-02-13T18:11:00.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f18377fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f183808c2f0 0x7f183808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:38852/0 (socket says 10.20.193.78:38852) 2026-02-13T18:11:00.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.935+0000 7f18377fe640 1 -- 10.20.193.78:0/3601629488 learned_addr learned my addr 10.20.193.78:0/3601629488 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:00.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f1837fff640 1 -- 10.20.193.78:0/3601629488 >> v1:10.20.193.78:6790/0 conn(0x7f183808cdd0 legacy=0x7f18381a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:00.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18377fe640 1 -- 10.20.193.78:0/3601629488 >> v1:10.20.193.78:6789/0 conn(0x7f183808c2f0 legacy=0x7f183808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:00.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f1836ffd640 1 -- 10.20.193.78:0/3601629488 >> v1:10.20.193.187:6789/0 conn(0x7f183808dc80 legacy=0x7f1838181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:00.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095744207 0 0) 0x7f1838089ba0 con 0x7f183808cdd0 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): my global_id is 4700 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f181c003620 con 0x7f183808cdd0 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667922587 0 0) 0x7f1838089e80 con 0x7f183808c2f0 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): my global_id is 74124 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1838089ba0 con 0x7f183808c2f0 2026-02-13T18:11:00.952 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595287252 0 0) 0x7f1838088c20 con 0x7f183808dc80 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient(hunting): my global_id is 4720 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1838089e80 con 0x7f183808dc80 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1251823695 0 0) 0x7f181c003620 con 0x7f183808cdd0 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 >> v1:10.20.193.187:6789/0 conn(0x7f183808dc80 legacy=0x7f1838181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 >> v1:10.20.193.78:6789/0 conn(0x7f183808c2f0 legacy=0x7f183808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: _finish_hunting 0 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 monclient: found mon.noname-b 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:00.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183808d370 con 0x7f183808cdd0 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: _finish_auth 0 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: _check_auth_tickets 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f182c004670 con 0x7f183808cdd0 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: dump: 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.954 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 5 monclient: authenticate success, global_id 4700 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f182c004940 con 0x7f183808cdd0 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:00.955 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 4 set_mon_vals no callback set 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 1 -- 10.20.193.78:0/3601629488 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f182c004dd0 con 0x7f183808cdd0 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18367fc640 10 monclient: dump: 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:00.956 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: shutdown 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- 10.20.193.78:0/3601629488 >> v1:10.20.193.78:6790/0 conn(0x7f183808cdd0 legacy=0x7f18381a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- 10.20.193.78:0/3601629488 shutdown_connections 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- 10.20.193.78:0/3601629488 >> 10.20.193.78:0/3601629488 conn(0x7f1838091720 msgr2=0x7f1838091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- 10.20.193.78:0/3601629488 shutdown_connections 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- 10.20.193.78:0/3601629488 wait complete. 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: build_initial_monmap 2026-02-13T18:11:00.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: monmap: 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 Processor -- start 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- start start 2026-02-13T18:11:00.958 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: init 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient(hunting): picked mon.noname-c con 0x7f183808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient(hunting): picked mon.noname-a con 0x7f183808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient(hunting): picked mon.noname-b con 0x7f183808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838082370 con 0x7f183808cdd0 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183805de60 con 0x7f183808dc80 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838153f60 con 0x7f183808c2f0 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f183dab1640 10 monclient(hunting): authenticate will time out at 891.999533s 2026-02-13T18:11:00.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18377fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f183808c2f0 0x7f18380838a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35416/0 (socket says 10.20.193.78:35416) 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.939+0000 7f18377fe640 1 -- 10.20.193.78:0/2949123686 learned_addr learned my addr 10.20.193.78:0/2949123686 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f18377fe640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.78:6790/0 conn(0x7f183808c2f0 legacy=0x7f18380838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1836ffd640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.78:6789/0 conn(0x7f183808cdd0 legacy=0x7f18381943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562888601 0 0) 0x7f1838153f60 con 0x7f183808c2f0 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): my global_id is 4703 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1837fff640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.187:6789/0 conn(0x7f183808dc80 legacy=0x7f1838195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1808003620 con 0x7f183808c2f0 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514017664 0 0) 0x7f1838082370 con 0x7f183808cdd0 2026-02-13T18:11:00.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): my global_id is 74127 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1838153f60 con 0x7f183808cdd0 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870446524 0 0) 0x7f183805de60 con 0x7f183808dc80 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): my global_id is 4723 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1838082370 con 0x7f183808dc80 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1725010486 0 0) 0x7f1808003620 con 0x7f183808c2f0 2026-02-13T18:11:00.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f183805de60 con 0x7f183808c2f0 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1824002f40 con 0x7f183808c2f0 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): dump: 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:00.962 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 915433347 0 0) 0x7f1838153f60 con 0x7f183808cdd0 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1808003620 con 0x7f183808cdd0 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f18280033c0 con 0x7f183808cdd0 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient(hunting): dump: 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.963 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1725064130 0 0) 0x7f183805de60 con 0x7f183808c2f0 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.187:6789/0 conn(0x7f183808dc80 legacy=0x7f1838195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.78:6789/0 conn(0x7f183808cdd0 legacy=0x7f18381943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:00.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: _finish_hunting 0 2026-02-13T18:11:00.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 monclient: found mon.c 2026-02-13T18:11:00.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:00.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:00.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1838080010 con 0x7f183808c2f0 2026-02-13T18:11:00.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: _finish_auth 0 2026-02-13T18:11:00.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: _check_auth_tickets 2026-02-13T18:11:00.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:00.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 5 monclient: authenticate success, global_id 4703 2026-02-13T18:11:00.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 monclient: _renew_subs 2026-02-13T18:11:00.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:00.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1838082090 con 0x7f183808c2f0 2026-02-13T18:11:00.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 monclient: _renew_subs 2026-02-13T18:11:00.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:00.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1838083fb0 con 0x7f183808c2f0 2026-02-13T18:11:00.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1824004b90 con 0x7f183808c2f0 2026-02-13T18:11:00.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:00.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1824004f20 con 0x7f183808c2f0 2026-02-13T18:11:00.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 10 monclient: dump: 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:00.968 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1835ffb640 4 set_mon_vals no callback set 2026-02-13T18:11:00.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:00.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:00.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:00.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183808f620 con 0x7f183808c2f0 2026-02-13T18:11:00.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f18240051f0 con 0x7f183808c2f0 2026-02-13T18:11:00.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(297..297 src has 1..297) ==== 3963+0+0 (unknown 1014490472 0 0) 0x7f182404c680 con 0x7f183808c2f0 2026-02-13T18:11:00.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.943+0000 7f1836ffd640 10 monclient: get_auth_request con 0x7f180803d780 auth_method 0 2026-02-13T18:11:00.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.947+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f183808f620 con 0x7f183808c2f0 2026-02-13T18:11:00.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.947+0000 7f1813fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:00.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:00.947+0000 7f1813fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:01.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:11:01.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:11:01.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:01.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1838090810 con 0x7f183808c2f0 2026-02-13T18:11:01.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f1813fff640 1 -- 10.20.193.78:0/2949123686 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3687125917) 0x7f1824017600 con 0x7f183808c2f0 2026-02-13T18:11:01.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f1813fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:11:01.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f1813fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:01.068 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:11:01.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.187:6812/2668687789 conn(0x7f180803d780 legacy=0x7f180805dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 10 monclient: shutdown 2026-02-13T18:11:01.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 >> v1:10.20.193.78:6790/0 conn(0x7f183808c2f0 legacy=0x7f18380838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 shutdown_connections 2026-02-13T18:11:01.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 >> 10.20.193.78:0/2949123686 conn(0x7f1838091720 msgr2=0x7f183805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 shutdown_connections 2026-02-13T18:11:01.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.063+0000 7f183dab1640 1 -- 10.20.193.78:0/2949123686 wait complete. 2026-02-13T18:11:01.077 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:11:01.077 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:11:01.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:11:01.078 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:11:01.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient: get_monmap_and_config 2026-02-13T18:11:01.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient: build_initial_monmap 2026-02-13T18:11:01.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient: monmap: 2026-02-13T18:11:01.140 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:01.140 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.140 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:01.136082+0000 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:01.136082+0000 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:01.141 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 1 Processor -- start 2026-02-13T18:11:01.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 1 -- start start 2026-02-13T18:11:01.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient: init 2026-02-13T18:11:01.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:01.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:11:01.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient(hunting): picked mon.noname-b con 0x7feb5c08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:01.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient(hunting): picked mon.noname-a con 0x7feb5c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:01.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient(hunting): picked mon.noname-c con 0x7feb5c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:01.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c089e80 con 0x7feb5c08dc80 2026-02-13T18:11:01.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c088c20 con 0x7feb5c08cdd0 2026-02-13T18:11:01.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c089ba0 con 0x7feb5c08c2f0 2026-02-13T18:11:01.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:01.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb613bf640 10 monclient(hunting): authenticate will time out at 892.191399s 2026-02-13T18:11:01.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb5affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7feb5c08c2f0 0x7feb5c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35420/0 (socket says 10.20.193.78:35420) 2026-02-13T18:11:01.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.131+0000 7feb5affd640 1 -- 10.20.193.78:0/172051240 learned_addr learned my addr 10.20.193.78:0/172051240 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb5a7fc640 1 -- 10.20.193.78:0/172051240 >> v1:10.20.193.78:6789/0 conn(0x7feb5c08dc80 legacy=0x7feb5c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb5affd640 1 -- 10.20.193.78:0/172051240 >> v1:10.20.193.78:6790/0 conn(0x7feb5c08c2f0 legacy=0x7feb5c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533024491 0 0) 0x7feb5c089e80 con 0x7feb5c08dc80 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): my global_id is 74130 2026-02-13T18:11:01.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb48003620 con 0x7feb5c08dc80 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb5b7fe640 1 -- 10.20.193.78:0/172051240 >> v1:10.20.193.187:6789/0 conn(0x7feb5c08cdd0 legacy=0x7feb5c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685839119 0 0) 0x7feb5c089ba0 con 0x7feb5c08c2f0 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient(hunting): my global_id is 4706 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5c089e80 con 0x7feb5c08c2f0 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743758121 0 0) 0x7feb48003620 con 0x7feb5c08dc80 2026-02-13T18:11:01.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 >> v1:10.20.193.78:6790/0 conn(0x7feb5c08c2f0 legacy=0x7feb5c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 >> v1:10.20.193.187:6789/0 conn(0x7feb5c08cdd0 legacy=0x7feb5c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 monclient: found mon.noname-a 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c08d370 con 0x7feb5c08dc80 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: _finish_auth 0 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:01.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb44003160 con 0x7feb5c08dc80 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 5 monclient: authenticate success, global_id 74130 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: dump: 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.161 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb44003430 con 0x7feb5c08dc80 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 4 set_mon_vals no callback set 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 1 -- 10.20.193.78:0/172051240 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb440038c0 con 0x7feb5c08dc80 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb59ffb640 10 monclient: dump: 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.162 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: shutdown 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- 10.20.193.78:0/172051240 >> v1:10.20.193.78:6789/0 conn(0x7feb5c08dc80 legacy=0x7feb5c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- 10.20.193.78:0/172051240 shutdown_connections 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- 10.20.193.78:0/172051240 >> 10.20.193.78:0/172051240 conn(0x7feb5c091720 msgr2=0x7feb5c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- 10.20.193.78:0/172051240 shutdown_connections 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- 10.20.193.78:0/172051240 wait complete. 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: build_initial_monmap 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: monmap: 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 Processor -- start 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- start start 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: init 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient(hunting): picked mon.noname-a con 0x7feb5c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient(hunting): picked mon.noname-c con 0x7feb5c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient(hunting): picked mon.noname-b con 0x7feb5c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c088910 con 0x7feb5c08c2f0 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c080370 con 0x7feb5c08dc80 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c05d640 con 0x7feb5c08cdd0 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb613bf640 10 monclient(hunting): authenticate will time out at 892.195818s 2026-02-13T18:11:01.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb5a7fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7feb5c08cdd0 0x7feb5c1923b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35436/0 (socket says 10.20.193.78:35436) 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.135+0000 7feb5a7fc640 1 -- 10.20.193.78:0/3238366318 learned_addr learned my addr 10.20.193.78:0/3238366318 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb5affd640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c08c2f0 legacy=0x7feb5c0838c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb5a7fc640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6790/0 conn(0x7feb5c08cdd0 legacy=0x7feb5c1923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb5b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.187:6789/0 conn(0x7feb5c08dc80 legacy=0x7feb5c193ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151617422 0 0) 0x7feb5c089e80 con 0x7feb5c08c2f0 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 10 monclient(hunting): my global_id is 74133 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb28003620 con 0x7feb5c08c2f0 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.139+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506550397 0 0) 0x7feb5c05d640 con 0x7feb5c08cdd0 2026-02-13T18:11:01.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): my global_id is 4709 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5c089e80 con 0x7feb5c08cdd0 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882290139 0 0) 0x7feb5c080370 con 0x7feb5c08dc80 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): my global_id is 4729 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5c05d640 con 0x7feb5c08dc80 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2975255931 0 0) 0x7feb28003620 con 0x7feb5c08c2f0 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb5c080370 con 0x7feb5c08c2f0 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb500033a0 con 0x7feb5c08c2f0 2026-02-13T18:11:01.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): dump: 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:01.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2797952705 0 0) 0x7feb5c080370 con 0x7feb5c08c2f0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6790/0 conn(0x7feb5c08cdd0 legacy=0x7feb5c1923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.187:6789/0 conn(0x7feb5c08dc80 legacy=0x7feb5c193ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 monclient: found mon.a 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c07e010 con 0x7feb5c08c2f0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: _finish_auth 0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 5 monclient: authenticate success, global_id 74133 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 10 monclient: _renew_subs 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c080090 con 0x7feb5c08c2f0 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 10 monclient: _renew_subs 2026-02-13T18:11:01.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb5c083fd0 con 0x7feb5c08c2f0 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb50004b90 con 0x7feb5c08c2f0 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb50004f20 con 0x7feb5c08c2f0 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: dump: 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.170 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb597fa640 4 set_mon_vals no callback set 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7feb500051f0 con 0x7feb5c08c2f0 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb5c08f600 con 0x7feb5c151050 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(297..297 src has 1..297) ==== 3963+0+0 (unknown 1014490472 0 0) 0x7feb5004c660 con 0x7feb5c08c2f0 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb5b7fe640 10 monclient: get_auth_request con 0x7feb2803d770 auth_method 0 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb5a7fc640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c151050 legacy=0x7feb5c05b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001807094 0 0) 0x7feb5c08f600 con 0x7feb5c151050 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient(hunting): my global_id is 74136 2026-02-13T18:11:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5c080370 con 0x7feb5c151050 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1759292310 0 0) 0x7feb5c080370 con 0x7feb5c151050 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb5c08f600 con 0x7feb5c151050 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb440038c0 con 0x7feb5c151050 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 10 monclient: dump: 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.172 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 38419754 0 0) 0x7feb5c08f600 con 0x7feb5c151050 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.143+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb5c090810 con 0x7feb5c151050 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7feb44002e60 con 0x7feb5c151050 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb3b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb3b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c151050 legacy=0x7feb5c05b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c151050 legacy=0x7feb5c05b460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb613bf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.147+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb5c0510e0 con 0x7feb5c04d200 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb5a7fc640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c04d200 legacy=0x7feb5c196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525664573 0 0) 0x7feb5c0510e0 con 0x7feb5c04d200 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient(hunting): my global_id is 74139 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5c08f600 con 0x7feb5c04d200 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2927041806 0 0) 0x7feb5c08f600 con 0x7feb5c04d200 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb5c0510e0 con 0x7feb5c04d200 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feb44003d60 con 0x7feb5c04d200 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient: dump: 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.174 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 762836906 0 0) 0x7feb5c0510e0 con 0x7feb5c04d200 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb5c07fc60 con 0x7feb5c04d200 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4339 (unknown 0 0 2579903245) 0x7feb44004060 con 0x7feb5c04d200 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c04d200 legacy=0x7feb5c196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb3b7fe640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c04d200 legacy=0x7feb5c196200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.175 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 20, 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 2008, 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:01.176 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.177 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.178 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:11:01.179 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.180 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:11:01.181 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:11:01.182 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:11:01.183 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.184 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.185 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.185 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:11:01.185 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.187:6812/2668687789 conn(0x7feb2803d770 legacy=0x7feb2805dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 10 monclient: shutdown 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 >> v1:10.20.193.78:6789/0 conn(0x7feb5c08c2f0 legacy=0x7feb5c0838c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb5b7fe640 1 -- 10.20.193.78:0/3238366318 reap_dead start 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb5b7fe640 1 -- 10.20.193.78:0/3238366318 reap_dead start 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 shutdown_connections 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 >> 10.20.193.78:0/3238366318 conn(0x7feb5c091720 msgr2=0x7feb5c058bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 shutdown_connections 2026-02-13T18:11:01.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.151+0000 7feb613bf640 1 -- 10.20.193.78:0/3238366318 wait complete. 2026-02-13T18:11:01.186 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:11:01.187 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:11:01.187 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: get_monmap_and_config 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: build_initial_monmap 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: monmap: 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:01.245913+0000 2026-02-13T18:11:01.247 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:01.245913+0000 2026-02-13T18:11:01.248 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:01.248 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.248 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:01.248 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:01.248 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:01.248 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 1 Processor -- start 2026-02-13T18:11:01.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 1 -- start start 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: init 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient(hunting): picked mon.noname-a con 0x7fd1bc08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient(hunting): picked mon.noname-b con 0x7fd1bc08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient(hunting): picked mon.noname-c con 0x7fd1bc08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc089e80 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc088c20 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc089ba0 con 0x7fd1bc08dc80 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient(hunting): authenticate will time out at 892.301037s 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b3fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd1bc08dc80 0x7fd1bc181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35438/0 (socket says 10.20.193.78:35438) 2026-02-13T18:11:01.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b3fff640 1 -- 10.20.193.78:0/3918562347 learned_addr learned my addr 10.20.193.78:0/3918562347 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:01.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c0909640 1 --1- 10.20.193.78:0/3918562347 >> v1:10.20.193.78:6789/0 conn(0x7fd1bc08c2f0 0x7fd1bc08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:38894/0 (socket says 10.20.193.78:38894) 2026-02-13T18:11:01.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b3fff640 1 -- 10.20.193.78:0/3918562347 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc08dc80 legacy=0x7fd1bc181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c0909640 1 -- 10.20.193.78:0/3918562347 >> v1:10.20.193.78:6789/0 conn(0x7fd1bc08c2f0 legacy=0x7fd1bc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230584867 0 0) 0x7fd1bc089e80 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): my global_id is 74142 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a8003620 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330907764 0 0) 0x7fd1bc089ba0 con 0x7fd1bc08dc80 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient(hunting): my global_id is 4712 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1bc089e80 con 0x7fd1bc08dc80 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c110a640 1 -- 10.20.193.78:0/3918562347 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08cdd0 legacy=0x7fd1bc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1228971016 0 0) 0x7fd1a8003620 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc08dc80 legacy=0x7fd1bc181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08cdd0 legacy=0x7fd1bc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 monclient: found mon.noname-a 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc08d370 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: _finish_auth 0 2026-02-13T18:11:01.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1ac003110 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 5 monclient: authenticate success, global_id 74142 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: dump: 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.259 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1ac0033e0 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 1 -- 10.20.193.78:0/3918562347 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1ac004a90 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1b37fe640 10 monclient: dump: 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.260 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.243+0000 7fd1c2b94640 4 set_mon_vals no callback set 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient: shutdown 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3918562347 >> v1:10.20.193.78:6789/0 conn(0x7fd1bc08c2f0 legacy=0x7fd1bc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3918562347 shutdown_connections 2026-02-13T18:11:01.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3918562347 >> 10.20.193.78:0/3918562347 conn(0x7fd1bc091720 msgr2=0x7fd1bc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3918562347 shutdown_connections 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3918562347 wait complete. 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient: build_initial_monmap 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient: monmap: 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:01.262 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 Processor -- start 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- start start 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient: init 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient(hunting): picked mon.noname-c con 0x7fd1bc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient(hunting): picked mon.noname-a con 0x7fd1bc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient(hunting): picked mon.noname-b con 0x7fd1bc08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc0579c0 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc07de20 con 0x7fd1bc08dc80 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc080180 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c2b94640 10 monclient(hunting): authenticate will time out at 892.305517s 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c0909640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd1bc08c2f0 0x7fd1bc0836d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35444/0 (socket says 10.20.193.78:35444) 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c0909640 1 -- 10.20.193.78:0/3681345823 learned_addr learned my addr 10.20.193.78:0/3681345823 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b3fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd1bc08cdd0 0x7fd1bc192180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:38908/0 (socket says 10.20.193.78:38908) 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b3fff640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6789/0 conn(0x7fd1bc08cdd0 legacy=0x7fd1bc192180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c0909640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc08c2f0 legacy=0x7fd1bc0836d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298131295 0 0) 0x7fd1bc0579c0 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): my global_id is 74145 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1c110a640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08dc80 legacy=0x7fd1bc1938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd18c003620 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433608721 0 0) 0x7fd1bc080180 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 10 monclient(hunting): my global_id is 4715 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.247+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1bc0579c0 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785558333 0 0) 0x7fd1bc07de20 con 0x7fd1bc08dc80 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): my global_id is 4735 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1bc080180 con 0x7fd1bc08dc80 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1857896316 0 0) 0x7fd18c003620 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1bc07de20 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1a40033a0 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): dump: 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 552575439 0 0) 0x7fd1bc0579c0 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd18c003620 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1ac0048e0 con 0x7fd1bc08c2f0 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): dump: 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c110a640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08dc80 legacy=0x7fd1bc1938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c110a640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08dc80 legacy=0x7fd1bc1938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c110a640 1 --1- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08dc80 0x7fd1bc1938a0 :-1 s=OPENED pgs=346 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c110a640 1 --1- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08dc80 0x7fd1bc1938a0 :-1 s=OPENED pgs=346 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.187:6789/0 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 105047091 0 0) 0x7fd1bc07de20 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc08c2f0 legacy=0x7fd1bc0836d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6789/0 conn(0x7fd1bc08dc80 legacy=0x7fd1bc1938a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: _finish_hunting 0 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 monclient: found mon.a 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc07f8e0 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: _finish_auth 0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: _check_auth_tickets 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 5 monclient: authenticate success, global_id 74145 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 10 monclient: _renew_subs 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1bc083de0 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 10 monclient: _renew_subs 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1bc07eb50 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1a4004b90 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1a4004f20 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: dump: 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b2ffd640 4 set_mon_vals no callback set 2026-02-13T18:11:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd1bc08f600 con 0x7fd1bc150e20 2026-02-13T18:11:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd1a40051f0 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(297..297 src has 1..297) ==== 3963+0+0 (unknown 1014490472 0 0) 0x7fd1a404c630 con 0x7fd1bc08cdd0 2026-02-13T18:11:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c110a640 10 monclient: get_auth_request con 0x7fd18c03d790 auth_method 0 2026-02-13T18:11:01.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1c0909640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc150e20 legacy=0x7fd1bc05b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141918178 0 0) 0x7fd1bc08f600 con 0x7fd1bc150e20 2026-02-13T18:11:01.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient(hunting): my global_id is 4718 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1bc07de20 con 0x7fd1bc150e20 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 217738480 0 0) 0x7fd1bc07de20 con 0x7fd1bc150e20 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1bc08f600 con 0x7fd1bc150e20 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1ac004f30 con 0x7fd1bc150e20 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: dump: 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.274 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3688472105 0 0) 0x7fd1bc08f600 con 0x7fd1bc150e20 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1bc151d80 con 0x7fd1bc150e20 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd1ac005060 con 0x7fd1bc150e20 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc150e20 legacy=0x7fd1bc05b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.251+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc150e20 legacy=0x7fd1bc05b4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.255+0000 7fd1c2b94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:11:01.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.255+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd1bc090810 con 0x7fd1bc04d200 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c0909640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc04d200 legacy=0x7fd1bc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372733946 0 0) 0x7fd1bc090810 con 0x7fd1bc04d200 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient(hunting): my global_id is 4721 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1bc08f600 con 0x7fd1bc04d200 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3178251811 0 0) 0x7fd1bc08f600 con 0x7fd1bc04d200 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1bc090810 con 0x7fd1bc04d200 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1ac0055e0 con 0x7fd1bc04d200 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient: dump: 2026-02-13T18:11:01.276 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 634038328 0 0) 0x7fd1bc090810 con 0x7fd1bc04d200 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd1bc07fd50 con 0x7fd1bc04d200 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 714714884) 0x7fd1ac008ab0 con 0x7fd1bc04d200 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:11:01.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc04d200 legacy=0x7fd1bc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1b17fa640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6790/0 conn(0x7fd1bc04d200 legacy=0x7fd1bc195fd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 20, 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 342650, 2026-02-13T18:11:01.278 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.279 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.280 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.281 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:11:01.282 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.283 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:11:01.284 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.285 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.286 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:11:01.287 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:11:01.288 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:11:01.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd18c03d790 legacy=0x7fd18c05dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 10 monclient: shutdown 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 >> v1:10.20.193.78:6789/0 conn(0x7fd1bc08cdd0 legacy=0x7fd1bc192180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c110a640 1 -- 10.20.193.78:0/3681345823 reap_dead start 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c110a640 1 -- 10.20.193.78:0/3681345823 reap_dead start 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 shutdown_connections 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 >> 10.20.193.78:0/3681345823 conn(0x7fd1bc091720 msgr2=0x7fd1bc058c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 shutdown_connections 2026-02-13T18:11:01.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.259+0000 7fd1c2b94640 1 -- 10.20.193.78:0/3681345823 wait complete. 2026-02-13T18:11:01.290 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:11:01.291 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:11:01.291 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:11:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient: get_monmap_and_config 2026-02-13T18:11:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient: build_initial_monmap 2026-02-13T18:11:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient: monmap: 2026-02-13T18:11:01.357 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:01.356265+0000 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:01.356265+0000 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:01.358 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 1 Processor -- start 2026-02-13T18:11:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 1 -- start start 2026-02-13T18:11:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient: init 2026-02-13T18:11:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient(hunting): picked mon.noname-a con 0x7fd82008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient(hunting): picked mon.noname-b con 0x7fd82008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient(hunting): picked mon.noname-c con 0x7fd82008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd820089e80 con 0x7fd82008c2f0 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd820088c20 con 0x7fd82008cdd0 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd820089ba0 con 0x7fd82008dc80 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd825e58640 10 monclient(hunting): authenticate will time out at 892.411469s 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd81f7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd82008c2f0 0x7fd82008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:38922/0 (socket says 10.20.193.78:38922) 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd81effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd82008dc80 0x7fd820181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35488/0 (socket says 10.20.193.78:35488) 2026-02-13T18:11:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.351+0000 7fd81f7fe640 1 -- 10.20.193.78:0/2003939288 learned_addr learned my addr 10.20.193.78:0/2003939288 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81f7fe640 1 -- 10.20.193.78:0/2003939288 >> v1:10.20.193.78:6789/0 conn(0x7fd82008c2f0 legacy=0x7fd82008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81effd640 1 -- 10.20.193.78:0/2003939288 >> v1:10.20.193.78:6790/0 conn(0x7fd82008dc80 legacy=0x7fd820181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889037833 0 0) 0x7fd820089e80 con 0x7fd82008c2f0 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): my global_id is 74148 2026-02-13T18:11:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd804003620 con 0x7fd82008c2f0 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81ffff640 1 -- 10.20.193.78:0/2003939288 >> v1:10.20.193.187:6789/0 conn(0x7fd82008cdd0 legacy=0x7fd8201a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942550916 0 0) 0x7fd820089ba0 con 0x7fd82008dc80 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient(hunting): my global_id is 4724 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd820089e80 con 0x7fd82008dc80 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2383027144 0 0) 0x7fd804003620 con 0x7fd82008c2f0 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 >> v1:10.20.193.78:6790/0 conn(0x7fd82008dc80 legacy=0x7fd820181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 >> v1:10.20.193.187:6789/0 conn(0x7fd82008cdd0 legacy=0x7fd8201a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 monclient: found mon.noname-a 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82008d370 con 0x7fd82008c2f0 2026-02-13T18:11:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd80c003110 con 0x7fd82008c2f0 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 5 monclient: authenticate success, global_id 74148 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: dump: 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.365 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd80c0033e0 con 0x7fd82008c2f0 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 1 -- 10.20.193.78:0/2003939288 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd80c004b50 con 0x7fd82008c2f0 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd81e7fc640 10 monclient: dump: 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.366 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 4 set_mon_vals no callback set 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 10 monclient: shutdown 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 -- 10.20.193.78:0/2003939288 >> v1:10.20.193.78:6789/0 conn(0x7fd82008c2f0 legacy=0x7fd82008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 -- 10.20.193.78:0/2003939288 shutdown_connections 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 -- 10.20.193.78:0/2003939288 >> 10.20.193.78:0/2003939288 conn(0x7fd820091720 msgr2=0x7fd820091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 -- 10.20.193.78:0/2003939288 shutdown_connections 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 -- 10.20.193.78:0/2003939288 wait complete. 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 10 monclient: build_initial_monmap 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 10 monclient: monmap: 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:01.367 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 Processor -- start 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 1 -- start start 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.355+0000 7fd825e58640 10 monclient: init 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient(hunting): picked mon.noname-c con 0x7fd82008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient(hunting): picked mon.noname-a con 0x7fd82008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient(hunting): picked mon.noname-b con 0x7fd82008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8200800e0 con 0x7fd82008cdd0 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd82005dce0 con 0x7fd82008dc80 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd820088910 con 0x7fd82008c2f0 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:01.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient(hunting): authenticate will time out at 892.416124s 2026-02-13T18:11:01.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd81f7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd82008c2f0 0x7fd820153100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35500/0 (socket says 10.20.193.78:35500) 2026-02-13T18:11:01.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd81f7fe640 1 -- 10.20.193.78:0/3844105201 learned_addr learned my addr 10.20.193.78:0/3844105201 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd81effd640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.78:6789/0 conn(0x7fd82008cdd0 legacy=0x7fd820083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd81f7fe640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.78:6790/0 conn(0x7fd82008c2f0 legacy=0x7fd820153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817619466 0 0) 0x7fd8200800e0 con 0x7fd82008cdd0 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): my global_id is 74151 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7f0003620 con 0x7fd82008cdd0 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831631972 0 0) 0x7fd820088910 con 0x7fd82008c2f0 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): my global_id is 4727 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8200800e0 con 0x7fd82008c2f0 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd81ffff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82008dc80 legacy=0x7fd820195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3838896301 0 0) 0x7fd7f0003620 con 0x7fd82008cdd0 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd820088910 con 0x7fd82008cdd0 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd8100032d0 con 0x7fd82008cdd0 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): dump: 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1233058516 0 0) 0x7fd8200800e0 con 0x7fd82008c2f0 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7f0003620 con 0x7fd82008c2f0 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd80c0048e0 con 0x7fd82008c2f0 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): dump: 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728030479 0 0) 0x7fd82005dce0 con 0x7fd82008dc80 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient(hunting): my global_id is 4741 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8200800e0 con 0x7fd82008dc80 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4009216342 0 0) 0x7fd820088910 con 0x7fd82008cdd0 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.78:6790/0 conn(0x7fd82008c2f0 legacy=0x7fd820153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82008dc80 legacy=0x7fd820195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: _finish_hunting 0 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 monclient: found mon.a 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd820082440 con 0x7fd82008cdd0 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: _finish_auth 0 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: _check_auth_tickets 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 5 monclient: authenticate success, global_id 74151 2026-02-13T18:11:01.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient: _renew_subs 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd820081ba0 con 0x7fd82008cdd0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient: _renew_subs 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd820084080 con 0x7fd82008cdd0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd810004b90 con 0x7fd82008cdd0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd810004ef0 con 0x7fd82008cdd0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd81dffb640 4 set_mon_vals no callback set 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 10 monclient: dump: 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.376 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd82008f600 con 0x7fd82007a3d0 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd810005150 con 0x7fd82008cdd0 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.359+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(297..297 src has 1..297) ==== 3963+0+0 (unknown 1014490472 0 0) 0x7fd81004c640 con 0x7fd82008cdd0 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd81ffff640 10 monclient: get_auth_request con 0x7fd7f003d830 auth_method 0 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd81f7fe640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82007a3d0 legacy=0x7fd82007a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057009835 0 0) 0x7fd82008f600 con 0x7fd82007a3d0 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient(hunting): my global_id is 4744 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd820088910 con 0x7fd82007a3d0 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1953598966 0 0) 0x7fd820088910 con 0x7fd82007a3d0 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd82008f600 con 0x7fd82007a3d0 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd80c005070 con 0x7fd82007a3d0 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient: dump: 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.378 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4271321264 0 0) 0x7fd82008f600 con 0x7fd82007a3d0 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd820090810 con 0x7fd82007a3d0 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd80c005070 con 0x7fd82007a3d0 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82007a3d0 legacy=0x7fd82007a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.379 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.363+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82007a3d0 legacy=0x7fd82007a7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.367+0000 7fd825e58640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:11:01.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.367+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd8200510e0 con 0x7fd82007aeb0 2026-02-13T18:11:01.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd81f7fe640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82007aeb0 legacy=0x7fd820197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:01.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286871399 0 0) 0x7fd8200510e0 con 0x7fd82007aeb0 2026-02-13T18:11:01.380 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient(hunting): my global_id is 4747 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd82008f600 con 0x7fd82007aeb0 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3555222152 0 0) 0x7fd82008f600 con 0x7fd82007aeb0 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8200510e0 con 0x7fd82007aeb0 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd80c005710 con 0x7fd82007aeb0 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient: dump: 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:01.381 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2600814486 0 0) 0x7fd8200510e0 con 0x7fd82007aeb0 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd82007b280 con 0x7fd82007aeb0 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 1423905902) 0x7fd80c005a60 con 0x7fd82007aeb0 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82007aeb0 legacy=0x7fd820197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd7fbfff640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6789/0 conn(0x7fd82007aeb0 legacy=0x7fd820197ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:11:01.382 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 20, 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 342735, 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.383 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.384 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:11:01.385 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:01.386 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.387 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.388 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.389 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.390 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:11:01.391 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:11:01.392 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd7f003d830 legacy=0x7fd7f005dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 10 monclient: shutdown 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 >> v1:10.20.193.78:6789/0 conn(0x7fd82008cdd0 legacy=0x7fd820083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd81ffff640 1 -- 10.20.193.78:0/3844105201 reap_dead start 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd81ffff640 1 -- 10.20.193.78:0/3844105201 reap_dead start 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 shutdown_connections 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 >> 10.20.193.78:0/3844105201 conn(0x7fd820091720 msgr2=0x7fd820057a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 shutdown_connections 2026-02-13T18:11:01.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:01.371+0000 7fd825e58640 1 -- 10.20.193.78:0/3844105201 wait complete. 2026-02-13T18:11:01.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:11:01.394 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T18:11:01.394 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-13T18:11:01.394 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T18:11:01.394 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T18:11:01.394 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T18:11:01.394 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:11:01.410 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T18:11:01.410 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T18:11:01.410 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T18:11:01.410 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T18:11:01.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T18:11:16.411 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T18:11:16.411 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T18:11:16.412 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T18:11:16.412 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:11:16.412 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:11:16.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.476+0000 7fe0b81e1640 10 monclient: get_monmap_and_config 2026-02-13T18:11:16.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.476+0000 7fe0b81e1640 10 monclient: build_initial_monmap 2026-02-13T18:11:16.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.476+0000 7fe0b81e1640 10 monclient: monmap: 2026-02-13T18:11:16.484 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:16.484 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:16.481195+0000 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:16.481195+0000 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:16.485 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.476+0000 7fe0b81e1640 1 Processor -- start 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 1 -- start start 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient: init 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient(hunting): picked mon.noname-b con 0x7fe0b0142e80 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:16.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient(hunting): picked mon.noname-a con 0x7fe0b00882e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient(hunting): picked mon.noname-c con 0x7fe0b01853d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0085a60 con 0x7fe0b00882e0 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0086f80 con 0x7fe0b01853d0 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0142990 con 0x7fe0b0142e80 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b81e1640 10 monclient(hunting): authenticate will time out at 907.536633s 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b5755640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 0x7fe0b0183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:58354/0 (socket says 10.20.193.78:58354) 2026-02-13T18:11:16.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b5755640 1 -- 10.20.193.78:0/4241817176 learned_addr learned my addr 10.20.193.78:0/4241817176 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:16.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b6757640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0b01a57b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:16.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b5f56640 1 --1- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6790/0 conn(0x7fe0b0142e80 0x7fe0b0143250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:56732/0 (socket says 10.20.193.78:56732) 2026-02-13T18:11:16.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b5755640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 legacy=0x7fe0b0183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:16.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.480+0000 7fe0b5f56640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6790/0 conn(0x7fe0b0142e80 legacy=0x7fe0b0143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:16.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:16.680+0000 7fe0b6757640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0b01a57b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:17.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:17.080+0000 7fe0b6757640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0b01a57b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:17.880+0000 7fe0b6757640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0b01a57b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:19.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): tick 2026-02-13T18:11:19.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:11:19.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 monclient(hunting): continuing hunt 2026-02-13T18:11:19.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:11:19.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6790/0 conn(0x7fe0b0142e80 legacy=0x7fe0b0143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0b01a57b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 legacy=0x7fe0b0183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fe0b01853d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fe0b0142e80 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fe0b00882e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 -- 10.20.193.78:0/4241817176 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b008c550 con 0x7fe0b00882e0 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 -- 10.20.193.78:0/4241817176 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0086f80 con 0x7fe0b01853d0 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 1 -- 10.20.193.78:0/4241817176 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09406a0c0 con 0x7fe0b0142e80 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe09f7fe640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:19.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe0b5f56640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0940238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe0b5755640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6790/0 conn(0x7fe0b0142e80 legacy=0x7fe0940450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.480+0000 7fe0b6757640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 legacy=0x7fe0940668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:19.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:19.680+0000 7fe0b5f56640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0940238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:20.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:20.080+0000 7fe0b5f56640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0940238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:20.880+0000 7fe0b5f56640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0940238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:21.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.416+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374348385 0 0) 0x7fe09406a0c0 con 0x7fe0b0142e80 2026-02-13T18:11:21.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.416+0000 7fe0b4f54640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.416+0000 7fe0b4f54640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.416+0000 7fe0b4f54640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.416+0000 7fe0b4f54640 10 monclient(hunting): my global_id is 4730 2026-02-13T18:11:21.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.416+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe098003620 con 0x7fe0b0142e80 2026-02-13T18:11:21.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3416864530 0 0) 0x7fe098003620 con 0x7fe0b0142e80 2026-02-13T18:11:21.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.187:6789/0 conn(0x7fe0b01853d0 legacy=0x7fe0940238d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 legacy=0x7fe0940668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: _finish_hunting 0 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 monclient: found mon.noname-b 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09406b360 con 0x7fe0b0142e80 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: _finish_auth 0 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: _check_auth_tickets 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 5 monclient: authenticate success, global_id 4730 2026-02-13T18:11:21.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0a40030d0 con 0x7fe0b0142e80 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: dump: 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.428 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0a4003410 con 0x7fe0b0142e80 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 4 set_mon_vals no callback set 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 1 -- 10.20.193.78:0/4241817176 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0a4004b50 con 0x7fe0b0142e80 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b4f54640 10 monclient: dump: 2026-02-13T18:11:21.429 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: shutdown 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:21.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- 10.20.193.78:0/4241817176 >> v1:10.20.193.78:6790/0 conn(0x7fe0b0142e80 legacy=0x7fe0940450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- 10.20.193.78:0/4241817176 shutdown_connections 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- 10.20.193.78:0/4241817176 >> 10.20.193.78:0/4241817176 conn(0x7fe0b0091720 msgr2=0x7fe0b0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- 10.20.193.78:0/4241817176 shutdown_connections 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- 10.20.193.78:0/4241817176 wait complete. 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: build_initial_monmap 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: monmap: 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:21.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 Processor -- start 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- start start 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: init 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient(hunting): picked mon.noname-a con 0x7fe0b00882e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient(hunting): picked mon.noname-b con 0x7fe0b0142e80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:21.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient(hunting): picked mon.noname-c con 0x7fe0b01853d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b00821a0 con 0x7fe0b00882e0 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0082480 con 0x7fe0b0142e80 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b00812f0 con 0x7fe0b01853d0 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b81e1640 10 monclient(hunting): authenticate will time out at 912.479273s 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b5755640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7fe0b0142e80 legacy=0x7fe0b00849c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b6757640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 0x7fe0b0175280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37470/0 (socket says 10.20.193.78:37470) 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b5f56640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 0x7fe0b0152f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:33072/0 (socket says 10.20.193.78:33072) 2026-02-13T18:11:21.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.420+0000 7fe0b6757640 1 -- 10.20.193.78:0/1925524247 learned_addr learned my addr 10.20.193.78:0/1925524247 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:21.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe0b6757640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 legacy=0x7fe0b0175280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe0b5f56640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 legacy=0x7fe0b0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947819070 0 0) 0x7fe0b00812f0 con 0x7fe0b01853d0 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 10 monclient(hunting): my global_id is 4733 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe080003620 con 0x7fe0b01853d0 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe0b6757640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 legacy=0x7fe0b0175280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe0b6757640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 legacy=0x7fe0b0175280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe0b6757640 1 --1- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 0x7fe0b0175280 :-1 s=OPENED pgs=343 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe0b6757640 1 --1- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 0x7fe0b0175280 :-1 s=OPENED pgs=343 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:11:21.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.424+0000 7fe09e7fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6790/0 2026-02-13T18:11:21.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836598435 0 0) 0x7fe0b00821a0 con 0x7fe0b00882e0 2026-02-13T18:11:21.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): my global_id is 74154 2026-02-13T18:11:21.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0b00812f0 con 0x7fe0b00882e0 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3470324474 0 0) 0x7fe0b00812f0 con 0x7fe0b00882e0 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0b00821a0 con 0x7fe0b00882e0 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0a00033f0 con 0x7fe0b00882e0 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): dump: 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.447 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1864629094 0 0) 0x7fe0b00821a0 con 0x7fe0b00882e0 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6790/0 conn(0x7fe0b01853d0 legacy=0x7fe0b0175280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.187:6789/0 conn(0x7fe0b0142e80 legacy=0x7fe0b00849c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 monclient: found mon.a 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:21.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b0080120 con 0x7fe0b00882e0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 5 monclient: authenticate success, global_id 74154 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 monclient: _renew_subs 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b0081be0 con 0x7fe0b00882e0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 monclient: _renew_subs 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0b00852a0 con 0x7fe0b00882e0 2026-02-13T18:11:21.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0a0004b90 con 0x7fe0b00882e0 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0a0004f20 con 0x7fe0b00882e0 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09ffff640 4 set_mon_vals no callback set 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 10 monclient: dump: 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b008f620 con 0x7fe0b00882e0 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe0a00051b0 con 0x7fe0b00882e0 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.440+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(297..297 src has 1..297) ==== 3963+0+0 (unknown 1014490472 0 0) 0x7fe0a004c750 con 0x7fe0b00882e0 2026-02-13T18:11:21.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.444+0000 7fe0b5755640 10 monclient: get_auth_request con 0x7fe08003d430 auth_method 0 2026-02-13T18:11:21.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.444+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fe0b008f620 con 0x7fe0b00882e0 2026-02-13T18:11:21.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.444+0000 7fe09e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.444+0000 7fe09e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:21.478 INFO:tasks.rados.rados.0.trial187.stdout:1356: done (6 left) 2026-02-13T18:11:21.478 INFO:tasks.rados.rados.0.trial187.stdout:1357: rollback oid 46 current snap is 141 2026-02-13T18:11:21.478 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 135 2026-02-13T18:11:21.478 INFO:tasks.rados.rados.0.trial187.stdout:1350: finishing write tid 1 to trial18717860-5 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: finishing write tid 2 to trial18717860-5 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: finishing write tid 3 to trial18717860-5 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: finishing write tid 4 to trial18717860-5 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: finishing write tid 5 to trial18717860-5 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: oid 5 updating version 0 to 376 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: oid 5 version 376 is already newer than 375 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: oid 5 updating version 376 to 377 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: oid 5 updating version 377 to 378 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 378 (ObjNum 471 snap 141 seq_num 471) dirty exists 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1350: left oid 5 (ObjNum 471 snap 141 seq_num 471) 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1351: finishing copy_from racing read to trial18717860-39 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:1351: finishing copy_from to trial18717860-39 2026-02-13T18:11:21.479 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 297 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:11:21.480 INFO:tasks.rados.rados.0.trial187.stdout:1352: finishing write tid 1 to trial18717860-11 2026-02-13T18:11:21.480 INFO:tasks.rados.rados.0.trial187.stdout:1352: finishing write tid 2 to trial18717860-11 2026-02-13T18:11:21.480 INFO:tasks.rados.rados.0.trial187.stdout:1353: expect (ObjNum 403 snap 114 seq_num 403) 2026-02-13T18:11:21.486 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1206518 2026-02-13T18:11:21.507 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:21.535 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1355: finishing write tid 1 to trial18717860-29 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: finishing write tid 3 to trial18717860-11 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: finishing write tid 4 to trial18717860-11 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: finishing write tid 5 to trial18717860-11 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: oid 11 updating version 0 to 361 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: oid 11 version 361 is already newer than 360 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: oid 11 updating version 361 to 363 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:1352: oid 11 version 363 is already newer than 362 2026-02-13T18:11:21.558 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 363 (ObjNum 472 snap 141 seq_num 472) dirty exists 2026-02-13T18:11:21.559 INFO:tasks.rados.rados.0.trial187.stdout:1352: left oid 11 (ObjNum 472 snap 141 seq_num 472) 2026-02-13T18:11:21.559 INFO:tasks.rados.rados.0.trial187.stdout:1354: expect (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:11:21.559 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:21.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:11:21.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:11:21.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0b00510e0 con 0x7fe0b00882e0 2026-02-13T18:11:21.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe09e7fc640 1 -- 10.20.193.78:0/1925524247 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 3720453004) 0x7fe0a00176d0 con 0x7fe0b00882e0 2026-02-13T18:11:21.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe09e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:11:21.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe09e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:21.570 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":22,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:11:21.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe08003d430 legacy=0x7fe08005d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 10 monclient: shutdown 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 >> v1:10.20.193.78:6789/0 conn(0x7fe0b00882e0 legacy=0x7fe0b0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 shutdown_connections 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 >> 10.20.193.78:0/1925524247 conn(0x7fe0b0091720 msgr2=0x7fe0b005bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 shutdown_connections 2026-02-13T18:11:21.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.564+0000 7fe0b81e1640 1 -- 10.20.193.78:0/1925524247 wait complete. 2026-02-13T18:11:21.580 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:11:21.580 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T18:11:21.581 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:11:21.624 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:21.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.640+0000 7f2b4e02d640 10 monclient: get_monmap_and_config 2026-02-13T18:11:21.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.640+0000 7f2b4e02d640 10 monclient: build_initial_monmap 2026-02-13T18:11:21.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.640+0000 7f2b4e02d640 10 monclient: monmap: 2026-02-13T18:11:21.645 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:21.645 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:21.645003+0000 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:21.645003+0000 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:21.646 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 Processor -- start 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- start start 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient: init 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient(hunting): picked mon.noname-b con 0x7f2b4813f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient(hunting): picked mon.noname-c con 0x7f2b4805e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:21.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient(hunting): picked mon.noname-a con 0x7f2b481853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b48095530 con 0x7f2b481853c0 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b48140390 con 0x7f2b4805e4b0 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4805d230 con 0x7f2b4813f8b0 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient(hunting): authenticate will time out at 912.700501s 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b46ffd640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f2b4805e4b0 legacy=0x7f2b48183ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b47fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2b481853c0 0x7f2b481a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:33078/0 (socket says 10.20.193.78:33078) 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b47fff640 1 -- 10.20.193.78:0/3494276795 learned_addr learned my addr 10.20.193.78:0/3494276795 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:21.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b477fe640 1 --1- 10.20.193.78:0/3494276795 >> v1:10.20.193.78:6790/0 conn(0x7f2b4813f8b0 0x7f2b4813fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37484/0 (socket says 10.20.193.78:37484) 2026-02-13T18:11:21.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b47fff640 1 -- 10.20.193.78:0/3494276795 >> v1:10.20.193.78:6789/0 conn(0x7f2b481853c0 legacy=0x7f2b481a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b477fe640 1 -- 10.20.193.78:0/3494276795 >> v1:10.20.193.78:6790/0 conn(0x7f2b4813f8b0 legacy=0x7f2b4813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157098516 0 0) 0x7f2b3c004170 con 0x7f2b481853c0 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): my global_id is 74157 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c003620 con 0x7f2b481853c0 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188993456 0 0) 0x7f2b4805d230 con 0x7f2b4813f8b0 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient(hunting): my global_id is 4736 2026-02-13T18:11:21.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b3c004170 con 0x7f2b4813f8b0 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3995367083 0 0) 0x7f2b2c003620 con 0x7f2b481853c0 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 >> v1:10.20.193.78:6790/0 conn(0x7f2b4813f8b0 legacy=0x7f2b4813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 >> v1:10.20.193.187:6789/0 conn(0x7f2b4805e4b0 legacy=0x7f2b48183ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: _finish_hunting 0 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 monclient: found mon.noname-a 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4805d510 con 0x7f2b481853c0 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: _finish_auth 0 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: _check_auth_tickets 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:21.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b3c0047f0 con 0x7f2b481853c0 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: dump: 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.659 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 5 monclient: authenticate success, global_id 74157 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b3c005eb0 con 0x7f2b481853c0 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 1 -- 10.20.193.78:0/3494276795 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b3c006240 con 0x7f2b481853c0 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b467fc640 10 monclient: dump: 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.660 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 4 set_mon_vals no callback set 2026-02-13T18:11:21.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 10 monclient: shutdown 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- 10.20.193.78:0/3494276795 >> v1:10.20.193.78:6789/0 conn(0x7f2b481853c0 legacy=0x7f2b481a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- 10.20.193.78:0/3494276795 shutdown_connections 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- 10.20.193.78:0/3494276795 >> 10.20.193.78:0/3494276795 conn(0x7f2b480545d0 msgr2=0x7f2b480549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- 10.20.193.78:0/3494276795 shutdown_connections 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.644+0000 7f2b4e02d640 1 -- 10.20.193.78:0/3494276795 wait complete. 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient: build_initial_monmap 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient: monmap: 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:21.662 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 1 Processor -- start 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 1 -- start start 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient: init 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:11:21.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient(hunting): picked mon.noname-a con 0x7f2b4805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient(hunting): picked mon.noname-b con 0x7f2b4813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient(hunting): picked mon.noname-c con 0x7f2b481853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b48111f10 con 0x7f2b4805e4b0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b481110a0 con 0x7f2b4813f8b0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4810fbb0 con 0x7f2b481853c0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b4e02d640 10 monclient(hunting): authenticate will time out at 912.705260s 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b46ffd640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f2b4813f8b0 legacy=0x7f2b48180590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b47fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2b481853c0 0x7f2b48181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37496/0 (socket says 10.20.193.78:37496) 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b47fff640 1 -- 10.20.193.78:0/933979116 learned_addr learned my addr 10.20.193.78:0/933979116 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:21.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b47fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6790/0 conn(0x7f2b481853c0 legacy=0x7f2b48181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b477fe640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b4805e4b0 legacy=0x7f2b4813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034134949 0 0) 0x7f2b4810fbb0 con 0x7f2b481853c0 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): my global_id is 4739 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b18003620 con 0x7f2b481853c0 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257101968 0 0) 0x7f2b48111f10 con 0x7f2b4805e4b0 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): my global_id is 74160 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b4810fbb0 con 0x7f2b4805e4b0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b47fff640 1 --1- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6790/0 conn(0x7f2b481853c0 0x7f2b48181cb0 :-1 s=OPENED pgs=345 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f2b3c0041f0 mon_map magic: 0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 354568709 0 0) 0x7f2b18003620 con 0x7f2b481853c0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b48111f10 con 0x7f2b481853c0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4282082435 0 0) 0x7f2b4810fbb0 con 0x7f2b4805e4b0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b18003620 con 0x7f2b4805e4b0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b340048e0 con 0x7f2b4805e4b0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): dump: 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.666 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.648+0000 7f2b23fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b3c0041f0 con 0x7f2b481853c0 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:21.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): dump: 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3445325248 0 0) 0x7f2b18003620 con 0x7f2b4805e4b0 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6790/0 conn(0x7f2b481853c0 legacy=0x7f2b48181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.187:6789/0 conn(0x7f2b4813f8b0 legacy=0x7f2b48180590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: _finish_hunting 0 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 monclient: found mon.a 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b48111670 con 0x7f2b4805e4b0 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: _finish_auth 0 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: _check_auth_tickets 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1304216651 0 0) 0x7f2b48111f10 con 0x7f2b481853c0 2026-02-13T18:11:21.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 5 monclient: authenticate success, global_id 74160 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 10 monclient: _renew_subs 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4810f600 con 0x7f2b4805e4b0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 10 monclient: _renew_subs 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b4813f3b0 con 0x7f2b4805e4b0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b34004d30 con 0x7f2b4805e4b0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b34005090 con 0x7f2b4805e4b0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: dump: 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b45ffb640 4 set_mon_vals no callback set 2026-02-13T18:11:21.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2b480008e0 con 0x7f2b481107d0 2026-02-13T18:11:21.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f2b34011720 con 0x7f2b4805e4b0 2026-02-13T18:11:21.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(298..298 src has 1..298) ==== 4007+0+0 (unknown 241700007 0 0) 0x7f2b3404c6d0 con 0x7f2b4805e4b0 2026-02-13T18:11:21.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b47fff640 10 monclient: get_auth_request con 0x7f2b1803d510 auth_method 0 2026-02-13T18:11:21.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b46ffd640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b481107d0 legacy=0x7f2b4808cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758703117 0 0) 0x7f2b480008e0 con 0x7f2b481107d0 2026-02-13T18:11:21.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient(hunting): my global_id is 74163 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b48111f10 con 0x7f2b481107d0 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3613889067 0 0) 0x7f2b48111f10 con 0x7f2b481107d0 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b480008e0 con 0x7f2b481107d0 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b38004380 con 0x7f2b481107d0 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: dump: 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.676 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2868762489 0 0) 0x7f2b480008e0 con 0x7f2b481107d0 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b48093020 con 0x7f2b481107d0 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2b380067b0 con 0x7f2b481107d0 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.652+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b481107d0 legacy=0x7f2b4808cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.656+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b481107d0 legacy=0x7f2b4808cfd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.656+0000 7f2b4e02d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.656+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2b4812d920 con 0x7f2b4812d550 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b46ffd640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b4812d550 legacy=0x7f2b48184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754486039 0 0) 0x7f2b4812d920 con 0x7f2b4812d550 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient(hunting): my global_id is 74166 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b480008e0 con 0x7f2b4812d550 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3504675906 0 0) 0x7f2b480008e0 con 0x7f2b4812d550 2026-02-13T18:11:21.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b4812d920 con 0x7f2b4812d550 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2b38004b80 con 0x7f2b4812d550 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient: dump: 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.679 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1427791689 0 0) 0x7f2b4812d920 con 0x7f2b4812d550 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2b48090840 con 0x7f2b4812d550 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 1302726103) 0x7f2b38006960 con 0x7f2b4812d550 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b4812d550 legacy=0x7f2b48184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b23fff640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b4812d550 legacy=0x7f2b48184ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:21.680 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 22, 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 22517, 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.681 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:21.682 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:21.683 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:21.684 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:21.685 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:21.686 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:21.687 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:21.688 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.689 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.690 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:11:21.691 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:11:21.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.187:6812/2668687789 conn(0x7f2b1803d510 legacy=0x7f2b1805d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 10 monclient: shutdown 2026-02-13T18:11:21.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 >> v1:10.20.193.78:6789/0 conn(0x7f2b4805e4b0 legacy=0x7f2b4813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b47fff640 1 -- 10.20.193.78:0/933979116 reap_dead start 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b47fff640 1 -- 10.20.193.78:0/933979116 reap_dead start 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 shutdown_connections 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 >> 10.20.193.78:0/933979116 conn(0x7f2b480545d0 msgr2=0x7f2b481a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 shutdown_connections 2026-02-13T18:11:21.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.660+0000 7f2b4e02d640 1 -- 10.20.193.78:0/933979116 wait complete. 2026-02-13T18:11:21.693 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:11:21.693 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:11:21.693 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:11:21.694 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:21.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient: get_monmap_and_config 2026-02-13T18:11:21.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient: build_initial_monmap 2026-02-13T18:11:21.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient: monmap: 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:11:21.756094+0000 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:11:21.756094+0000 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 1 Processor -- start 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 1 -- start start 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient: init 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:21.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient(hunting): picked mon.noname-b con 0x7f16bc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient(hunting): picked mon.noname-c con 0x7f16bc08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient(hunting): picked mon.noname-a con 0x7f16bc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc089e80 con 0x7f16bc08cdd0 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc088c20 con 0x7f16bc08dc80 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc089ba0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c409d640 10 monclient(hunting): authenticate will time out at 912.811214s 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c1611640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f16bc08dc80 legacy=0x7f16bc181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c2613640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f16bc08cdd0 0x7f16bc1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:33120/0 (socket says 10.20.193.78:33120) 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c1e12640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f16bc08c2f0 0x7f16bc08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37504/0 (socket says 10.20.193.78:37504) 2026-02-13T18:11:21.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.752+0000 7f16c2613640 1 -- 10.20.193.78:0/1063577993 learned_addr learned my addr 10.20.193.78:0/1063577993 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:21.761 INFO:tasks.rados.rados.0.trial187.stdout:1355: finishing write tid 2 to trial18717860-29 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: finishing write tid 3 to trial18717860-29 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: finishing write tid 4 to trial18717860-29 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: finishing write tid 5 to trial18717860-29 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: oid 29 updating version 0 to 606 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: oid 29 updating version 606 to 607 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: oid 29 version 607 is already newer than 605 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: oid 29 updating version 607 to 608 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 608 (ObjNum 473 snap 141 seq_num 473) dirty exists 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1355: left oid 29 (ObjNum 473 snap 141 seq_num 473) 2026-02-13T18:11:21.762 INFO:tasks.rados.rados.0.trial187.stdout:1357: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1357: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1357: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 504 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1350: done (6 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1351: done (5 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1352: done (4 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1353: done (3 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1354: done (2 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1355: done (1 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1357: done (0 left) 2026-02-13T18:11:21.763 INFO:tasks.rados.rados.0.trial187.stdout:1358: delete oid 41 current snap is 141 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1358: done (0 left) 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1359: copy_from oid 22 from oid 30 current snap is 141 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1360: rollback oid 41 current snap is 141 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 135 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1361: read oid 46 snap -1 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1361: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1362: read oid 31 snap -1 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1362: expect (ObjNum 427 snap 125 seq_num 427) 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:1363: rollback oid 4 current snap is 141 2026-02-13T18:11:21.766 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 135 2026-02-13T18:11:21.767 INFO:tasks.rados.rados.0.trial187.stdout:1364: write oid 6 current snap is 141 2026-02-13T18:11:21.767 INFO:tasks.rados.rados.0.trial187.stdout:1364: seq_num 475 ranges {783325=557161,1779535=686151,3244745=454912} 2026-02-13T18:11:21.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c1e12640 1 -- 10.20.193.78:0/1063577993 >> v1:10.20.193.78:6790/0 conn(0x7f16bc08c2f0 legacy=0x7f16bc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c2613640 1 -- 10.20.193.78:0/1063577993 >> v1:10.20.193.78:6789/0 conn(0x7f16bc08cdd0 legacy=0x7f16bc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537359168 0 0) 0x7f16bc089ba0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): my global_id is 4742 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16a4003620 con 0x7f16bc08c2f0 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3325826662 0 0) 0x7f16bc089e80 con 0x7f16bc08cdd0 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient(hunting): my global_id is 74169 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16bc089ba0 con 0x7f16bc08cdd0 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2175797434 0 0) 0x7f16a4003620 con 0x7f16bc08c2f0 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 >> v1:10.20.193.187:6789/0 conn(0x7f16bc08dc80 legacy=0x7f16bc181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 >> v1:10.20.193.78:6789/0 conn(0x7f16bc08cdd0 legacy=0x7f16bc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: _finish_hunting 0 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 monclient: found mon.noname-b 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc08d370 con 0x7f16bc08c2f0 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: _finish_auth 0 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: _check_auth_tickets 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16ac003110 con 0x7f16bc08c2f0 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: dump: 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.772 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 5 monclient: authenticate success, global_id 4742 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16ac0033e0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 1 -- 10.20.193.78:0/1063577993 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16ac004a90 con 0x7f16bc08c2f0 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c0e10640 10 monclient: dump: 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.773 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: get_monmap_and_config success 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 4 set_mon_vals no callback set 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: shutdown 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- 10.20.193.78:0/1063577993 >> v1:10.20.193.78:6790/0 conn(0x7f16bc08c2f0 legacy=0x7f16bc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- 10.20.193.78:0/1063577993 shutdown_connections 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- 10.20.193.78:0/1063577993 >> 10.20.193.78:0/1063577993 conn(0x7f16bc091720 msgr2=0x7f16bc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- 10.20.193.78:0/1063577993 shutdown_connections 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- 10.20.193.78:0/1063577993 wait complete. 2026-02-13T18:11:21.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: build_initial_monmap 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: monmap: 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 Processor -- start 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- start start 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: init 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: _reopen_session rank -1 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:11:21.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient(hunting): picked mon.noname-c con 0x7f16bc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient(hunting): picked mon.noname-a con 0x7f16bc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient(hunting): picked mon.noname-b con 0x7f16bc08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc05dbb0 con 0x7f16bc08cdd0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc088910 con 0x7f16bc08dc80 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc080080 con 0x7f16bc08c2f0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient(hunting): _renew_subs 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c409d640 10 monclient(hunting): authenticate will time out at 912.815843s 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c1e12640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f16bc08c2f0 0x7f16bc083910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:37512/0 (socket says 10.20.193.78:37512) 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c1e12640 1 -- 10.20.193.78:0/1650670292 learned_addr learned my addr 10.20.193.78:0/1650670292 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.756+0000 7f16c2613640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.187:6789/0 conn(0x7f16bc08dc80 legacy=0x7f16bc195b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c1e12640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc08c2f0 legacy=0x7f16bc083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c1611640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6789/0 conn(0x7f16bc08cdd0 legacy=0x7f16bc194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581726335 0 0) 0x7f16bc080080 con 0x7f16bc08c2f0 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): my global_id is 4745 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f168c003620 con 0x7f16bc08c2f0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453397212 0 0) 0x7f16bc05dbb0 con 0x7f16bc08cdd0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): my global_id is 74172 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16bc080080 con 0x7f16bc08cdd0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3168716253 0 0) 0x7f168c003620 con 0x7f16bc08c2f0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16bc05dbb0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16ac0048e0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): dump: 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.777 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1265506363 0 0) 0x7f16bc080080 con 0x7f16bc08cdd0 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f168c003620 con 0x7f16bc08cdd0 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16b00044d0 con 0x7f16bc08cdd0 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient(hunting): dump: 2026-02-13T18:11:21.778 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1959137090 0 0) 0x7f16bc05dbb0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.187:6789/0 conn(0x7f16bc08dc80 legacy=0x7f16bc195b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6789/0 conn(0x7f16bc08cdd0 legacy=0x7f16bc194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 monclient: found mon.c 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:21.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc0823e0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: _finish_auth 0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 5 monclient: authenticate success, global_id 4745 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 10 monclient: _renew_subs 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc081b40 con 0x7f16bc08c2f0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 10 monclient: _renew_subs 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f16bc084020 con 0x7f16bc08c2f0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16ac0033c0 con 0x7f16bc08c2f0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16ac004f60 con 0x7f16bc08c2f0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 10 monclient: dump: 2026-02-13T18:11:21.780 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16abfff640 4 set_mon_vals no callback set 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f16bc084310 con 0x7f16bc153360 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f16ac005230 con 0x7f16bc08c2f0 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(298..298 src has 1..298) ==== 4007+0+0 (unknown 241700007 0 0) 0x7f16ac04c620 con 0x7f16bc08c2f0 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.760+0000 7f16c2613640 10 monclient: get_auth_request con 0x7f168c03d610 auth_method 0 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16c1611640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc153360 legacy=0x7f16bc07a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965542446 0 0) 0x7f16bc084310 con 0x7f16bc153360 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient(hunting): my global_id is 4748 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16bc05dbb0 con 0x7f16bc153360 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 504158816 0 0) 0x7f16bc05dbb0 con 0x7f16bc153360 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16bc084310 con 0x7f16bc153360 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16b0004bd0 con 0x7f16bc153360 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient: dump: 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.782 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2656346495 0 0) 0x7f16bc084310 con 0x7f16bc153360 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16bc08f600 con 0x7f16bc153360 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f16b0004f10 con 0x7f16bc153360 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc153360 legacy=0x7f16bc07a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.764+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc153360 legacy=0x7f16bc07a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:21.784 INFO:tasks.rados.rados.0.trial187.stdout:1364: writing trial18717860-6 from 783325 to 1340486 tid 1 2026-02-13T18:11:21.784 INFO:tasks.rados.rados.0.trial187.stdout:1364: writing trial18717860-6 from 1779535 to 2465686 tid 2 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.768+0000 7f16c409d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.768+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f16bc090810 con 0x7f16bc07aae0 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c1611640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc07aae0 legacy=0x7f16bc1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811594228 0 0) 0x7f16bc090810 con 0x7f16bc07aae0 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient(hunting): my global_id is 4751 2026-02-13T18:11:21.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16bc084310 con 0x7f16bc07aae0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 481237969 0 0) 0x7f16bc084310 con 0x7f16bc07aae0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16bc090810 con 0x7f16bc07aae0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f16b0005530 con 0x7f16bc07aae0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient: dump: 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 816360003 0 0) 0x7f16bc090810 con 0x7f16bc07aae0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16bc0510e0 con 0x7f16bc07aae0 2026-02-13T18:11:21.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4499 (unknown 0 0 1399601061) 0x7f16b0006950 con 0x7f16bc07aae0 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc07aae0 legacy=0x7f16bc1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16aa7fc640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc07aae0 legacy=0x7f16bc1982b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 22, 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 363163, 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:11:21.787 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:21.788 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:11:21.789 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:11:21.790 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:11:21.791 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:11:21.792 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.793 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.794 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:11:21.795 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:11:21.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.187:6812/2668687789 conn(0x7f168c03d610 legacy=0x7f168c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 10 monclient: shutdown 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 >> v1:10.20.193.78:6790/0 conn(0x7f16bc08c2f0 legacy=0x7f16bc083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c2613640 1 -- 10.20.193.78:0/1650670292 reap_dead start 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c2613640 1 -- 10.20.193.78:0/1650670292 reap_dead start 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 shutdown_connections 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 >> 10.20.193.78:0/1650670292 conn(0x7f16bc091720 msgr2=0x7f16bc08a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 shutdown_connections 2026-02-13T18:11:21.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:11:21.772+0000 7f16c409d640 1 -- 10.20.193.78:0/1650670292 wait complete. 2026-02-13T18:11:21.797 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:11:21.797 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:11:21.797 INFO:tasks.rados.rados.0.trial187.stdout:1364: writing trial18717860-6 from 3244745 to 3699657 tid 3 2026-02-13T18:11:21.797 INFO:tasks.rados.rados.0.trial187.stdout:1365: read oid 42 snap 136 2026-02-13T18:11:21.797 INFO:tasks.rados.rados.0.trial187.stdout:1365: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:11:21.797 INFO:tasks.rados.rados.0.trial187.stdout:1366: write (excl) oid 24 current snap is 141 2026-02-13T18:11:21.798 INFO:tasks.rados.rados.0.trial187.stdout:1366: seq_num 476 ranges {400132=632410,1438017=546162} 2026-02-13T18:11:21.798 INFO:tasks.rados.rados.0.trial187.stdout:1366: writing trial18717860-24 from 400132 to 1032542 tid 1 2026-02-13T18:11:21.803 INFO:tasks.rados.rados.0.trial187.stdout:1366: writing trial18717860-24 from 1438017 to 1984179 tid 2 2026-02-13T18:11:21.803 INFO:tasks.rados.rados.0.trial187.stdout:1367: write oid 50 current snap is 141 2026-02-13T18:11:21.803 INFO:tasks.rados.rados.0.trial187.stdout:1367: seq_num 477 ranges {416939=707659,1896499=120440} 2026-02-13T18:11:21.809 INFO:tasks.rados.rados.0.trial187.stdout:1367: writing trial18717860-50 from 416939 to 1124598 tid 1 2026-02-13T18:11:21.813 INFO:tasks.rados.rados.0.trial187.stdout:1367: writing trial18717860-50 from 1896499 to 2016939 tid 2 2026-02-13T18:11:21.813 INFO:tasks.rados.rados.0.trial187.stdout:1368: snap_remove snap 139 2026-02-13T18:11:22.662 INFO:tasks.rados.rados.0.trial187.stdout:1368: done (9 left) 2026-02-13T18:11:22.663 INFO:tasks.rados.rados.0.trial187.stdout:1369: write oid 14 current snap is 141 2026-02-13T18:11:22.663 INFO:tasks.rados.rados.0.trial187.stdout:1369: seq_num 478 ranges {433746=782908,1954981=78765} 2026-02-13T18:11:22.668 INFO:tasks.rados.rados.0.trial187.stdout:1369: writing trial18717860-14 from 433746 to 1216654 tid 1 2026-02-13T18:11:22.672 INFO:tasks.rados.rados.0.trial187.stdout:1369: writing trial18717860-14 from 1954981 to 2033746 tid 2 2026-02-13T18:11:22.672 INFO:tasks.rados.rados.0.trial187.stdout:1370: copy_from oid 34 from oid 25 current snap is 141 2026-02-13T18:11:22.672 INFO:tasks.rados.rados.0.trial187.stdout:1361: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:11:22.822 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 271093 2026-02-13T18:11:22.889 INFO:tasks.rados.rados.0.trial187.stdout:1362: expect (ObjNum 427 snap 125 seq_num 427) 2026-02-13T18:11:22.927 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1050561 2026-02-13T18:11:22.944 INFO:tasks.rados.rados.0.trial187.stdout:1363: finishing rollback tid 0 to trial18717860-4 2026-02-13T18:11:22.944 INFO:tasks.rados.rados.0.trial187.stdout:1363: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:11:22.944 INFO:tasks.rados.rados.0.trial187.stdout:1363: finishing rollback tid 2 to trial18717860-4 2026-02-13T18:11:22.944 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 285 (ObjNum 422 snap 122 seq_num 422) dirty exists 2026-02-13T18:11:22.944 INFO:tasks.rados.rados.0.trial187.stdout:1360: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: finishing write tid 1 to trial18717860-6 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1360: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 322 (ObjNum 435 snap 126 seq_num 435) dirty exists 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1359: finishing copy_from racing read to trial18717860-22 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1359: finishing copy_from to trial18717860-22 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 423 (ObjNum 404 snap 115 seq_num 404) dirty exists 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: finishing write tid 2 to trial18717860-6 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: finishing write tid 3 to trial18717860-6 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: finishing write tid 4 to trial18717860-6 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: finishing write tid 5 to trial18717860-6 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: oid 6 updating version 0 to 425 2026-02-13T18:11:22.945 INFO:tasks.rados.rados.0.trial187.stdout:1364: oid 6 updating version 425 to 427 2026-02-13T18:11:22.946 INFO:tasks.rados.rados.0.trial187.stdout:1364: oid 6 version 427 is already newer than 424 2026-02-13T18:11:22.946 INFO:tasks.rados.rados.0.trial187.stdout:1364: oid 6 version 427 is already newer than 426 2026-02-13T18:11:22.946 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 427 (ObjNum 475 snap 141 seq_num 475) dirty exists 2026-02-13T18:11:22.946 INFO:tasks.rados.rados.0.trial187.stdout:1364: left oid 6 (ObjNum 475 snap 141 seq_num 475) 2026-02-13T18:11:22.946 INFO:tasks.rados.rados.0.trial187.stdout:1365: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1366: finishing write tid 1 to trial18717860-24 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1366: finishing write tid 2 to trial18717860-24 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1366: finishing write tid 3 to trial18717860-24 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1359: done (10 left) 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1360: done (9 left) 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1361: done (8 left) 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1362: done (7 left) 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1363: done (6 left) 2026-02-13T18:11:23.118 INFO:tasks.rados.rados.0.trial187.stdout:1364: done (5 left) 2026-02-13T18:11:23.119 INFO:tasks.rados.rados.0.trial187.stdout:1365: done (4 left) 2026-02-13T18:11:23.119 INFO:tasks.rados.rados.0.trial187.stdout:1371: write (excl) oid 41 current snap is 141 2026-02-13T18:11:23.119 INFO:tasks.rados.rados.0.trial187.stdout:1371: seq_num 479 ranges {450553=574510,1613463=437090} 2026-02-13T18:11:23.124 INFO:tasks.rados.rados.0.trial187.stdout:1371: writing trial18717860-41 from 450553 to 1025063 tid 1 2026-02-13T18:11:23.132 INFO:tasks.rados.rados.0.trial187.stdout:1371: writing trial18717860-41 from 1613463 to 2050553 tid 2 2026-02-13T18:11:23.132 INFO:tasks.rados.rados.0.trial187.stdout:1372: snap_create 2026-02-13T18:11:23.132 INFO:tasks.rados.rados.0.trial187.stdout:1366: finishing write tid 4 to trial18717860-24 2026-02-13T18:11:23.132 INFO:tasks.rados.rados.0.trial187.stdout:1366: oid 24 updating version 0 to 430 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1366: oid 24 version 430 is already newer than 429 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1366: oid 24 version 430 is already newer than 428 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 430 (ObjNum 476 snap 141 seq_num 476) dirty exists 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1366: left oid 24 (ObjNum 476 snap 141 seq_num 476) 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: finishing write tid 1 to trial18717860-50 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: finishing write tid 2 to trial18717860-50 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: finishing write tid 3 to trial18717860-50 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: finishing write tid 4 to trial18717860-50 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: oid 50 updating version 0 to 325 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: oid 50 version 325 is already newer than 324 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:1367: oid 50 updating version 325 to 326 2026-02-13T18:11:23.133 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 326 (ObjNum 477 snap 141 seq_num 477) dirty exists 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1367: left oid 50 (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: finishing write tid 1 to trial18717860-14 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: finishing write tid 2 to trial18717860-14 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: finishing write tid 3 to trial18717860-14 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: finishing write tid 4 to trial18717860-14 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: oid 14 updating version 0 to 522 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: oid 14 updating version 522 to 523 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: oid 14 updating version 523 to 524 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 524 (ObjNum 478 snap 141 seq_num 478) dirty exists 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1369: left oid 14 (ObjNum 478 snap 141 seq_num 478) 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1370: finishing copy_from racing read to trial18717860-34 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:1370: finishing copy_from to trial18717860-34 2026-02-13T18:11:23.134 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 312 (ObjNum 423 snap 122 seq_num 423) dirty exists 2026-02-13T18:11:23.135 INFO:tasks.rados.rados.0.trial187.stdout:1371: finishing write tid 1 to trial18717860-41 2026-02-13T18:11:23.135 INFO:tasks.rados.rados.0.trial187.stdout:1371: finishing write tid 2 to trial18717860-41 2026-02-13T18:11:23.135 INFO:tasks.rados.rados.0.trial187.stdout:1371: finishing write tid 3 to trial18717860-41 2026-02-13T18:11:23.136 INFO:tasks.rados.rados.0.trial187.stdout:1371: finishing write tid 4 to trial18717860-41 2026-02-13T18:11:23.136 INFO:tasks.rados.rados.0.trial187.stdout:1371: oid 41 updating version 0 to 334 2026-02-13T18:11:23.136 INFO:tasks.rados.rados.0.trial187.stdout:1371: oid 41 updating version 334 to 335 2026-02-13T18:11:23.136 INFO:tasks.rados.rados.0.trial187.stdout:1371: oid 41 version 335 is already newer than 333 2026-02-13T18:11:23.136 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 335 (ObjNum 479 snap 141 seq_num 479) dirty exists 2026-02-13T18:11:23.136 INFO:tasks.rados.rados.0.trial187.stdout:1371: left oid 41 (ObjNum 479 snap 141 seq_num 479) 2026-02-13T18:11:23.663 INFO:tasks.rados.rados.0.trial187.stdout:1366: done (5 left) 2026-02-13T18:11:23.663 INFO:tasks.rados.rados.0.trial187.stdout:1367: done (4 left) 2026-02-13T18:11:23.663 INFO:tasks.rados.rados.0.trial187.stdout:1369: done (3 left) 2026-02-13T18:11:23.663 INFO:tasks.rados.rados.0.trial187.stdout:1370: done (2 left) 2026-02-13T18:11:23.663 INFO:tasks.rados.rados.0.trial187.stdout:1371: done (1 left) 2026-02-13T18:11:23.664 INFO:tasks.rados.rados.0.trial187.stdout:1372: done (0 left) 2026-02-13T18:11:23.664 INFO:tasks.rados.rados.0.trial187.stdout:1373: copy_from oid 47 from oid 13 current snap is 142 2026-02-13T18:11:23.664 INFO:tasks.rados.rados.0.trial187.stdout:1374: snap_remove snap 132 2026-02-13T18:11:24.663 INFO:tasks.rados.rados.0.trial187.stdout:1374: done (1 left) 2026-02-13T18:11:24.664 INFO:tasks.rados.rados.0.trial187.stdout:1375: snap_remove snap 126 2026-02-13T18:11:25.664 INFO:tasks.rados.rados.0.trial187.stdout:1375: done (1 left) 2026-02-13T18:11:25.665 INFO:tasks.rados.rados.0.trial187.stdout:1376: snap_create 2026-02-13T18:11:25.665 INFO:tasks.rados.rados.0.trial187.stdout:1373: finishing copy_from racing read to trial18717860-47 2026-02-13T18:11:25.665 INFO:tasks.rados.rados.0.trial187.stdout:1373: finishing copy_from to trial18717860-47 2026-02-13T18:11:25.665 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 234 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:11:26.417 INFO:tasks.rados.rados.0.trial187.stdout:1373: done (1 left) 2026-02-13T18:11:26.417 INFO:tasks.rados.rados.0.trial187.stdout:1376: done (0 left) 2026-02-13T18:11:26.417 INFO:tasks.rados.rados.0.trial187.stdout:1377: snap_create 2026-02-13T18:11:27.418 INFO:tasks.rados.rados.0.trial187.stdout:1377: done (0 left) 2026-02-13T18:11:27.418 INFO:tasks.rados.rados.0.trial187.stdout:1378: snap_create 2026-02-13T18:11:28.419 INFO:tasks.rados.rados.0.trial187.stdout:1378: done (0 left) 2026-02-13T18:11:28.419 INFO:tasks.rados.rados.0.trial187.stdout:1379: write (excl) oid 31 current snap is 145 2026-02-13T18:11:28.420 INFO:tasks.rados.rados.0.trial187.stdout:1379: seq_num 480 ranges {467360=649759,1671945=395415} 2026-02-13T18:11:28.426 INFO:tasks.rados.rados.0.trial187.stdout:1379: writing trial18717860-31 from 467360 to 1117119 tid 1 2026-02-13T18:11:28.433 INFO:tasks.rados.rados.0.trial187.stdout:1379: writing trial18717860-31 from 1671945 to 2067360 tid 2 2026-02-13T18:11:28.433 INFO:tasks.rados.rados.0.trial187.stdout:1380: write oid 43 current snap is 145 2026-02-13T18:11:28.434 INFO:tasks.rados.rados.0.trial187.stdout:1380: seq_num 481 ranges {484167=725008,1730427=353740} 2026-02-13T18:11:28.441 INFO:tasks.rados.rados.0.trial187.stdout:1380: writing trial18717860-43 from 484167 to 1209175 tid 1 2026-02-13T18:11:28.447 INFO:tasks.rados.rados.0.trial187.stdout:1380: writing trial18717860-43 from 1730427 to 2084167 tid 2 2026-02-13T18:11:28.447 INFO:tasks.rados.rados.0.trial187.stdout:1381: snap_remove snap 142 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1381: done (2 left) 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1382: snap_create 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1379: finishing write tid 1 to trial18717860-31 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1379: finishing write tid 2 to trial18717860-31 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1379: finishing write tid 3 to trial18717860-31 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1379: finishing write tid 4 to trial18717860-31 2026-02-13T18:11:29.425 INFO:tasks.rados.rados.0.trial187.stdout:1379: oid 31 updating version 0 to 293 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1379: oid 31 updating version 293 to 294 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1379: oid 31 updating version 294 to 295 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 295 (ObjNum 480 snap 145 seq_num 480) dirty exists 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1379: left oid 31 (ObjNum 480 snap 145 seq_num 480) 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1380: finishing write tid 1 to trial18717860-43 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1380: finishing write tid 2 to trial18717860-43 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1380: finishing write tid 3 to trial18717860-43 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1380: finishing write tid 4 to trial18717860-43 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1380: oid 43 updating version 0 to 732 2026-02-13T18:11:29.426 INFO:tasks.rados.rados.0.trial187.stdout:1380: oid 43 version 732 is already newer than 730 2026-02-13T18:11:29.427 INFO:tasks.rados.rados.0.trial187.stdout:1380: oid 43 version 732 is already newer than 731 2026-02-13T18:11:29.427 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 732 (ObjNum 481 snap 145 seq_num 481) dirty exists 2026-02-13T18:11:29.427 INFO:tasks.rados.rados.0.trial187.stdout:1380: left oid 43 (ObjNum 481 snap 145 seq_num 481) 2026-02-13T18:11:30.425 INFO:tasks.rados.rados.0.trial187.stdout:1379: done (2 left) 2026-02-13T18:11:30.425 INFO:tasks.rados.rados.0.trial187.stdout:1380: done (1 left) 2026-02-13T18:11:30.425 INFO:tasks.rados.rados.0.trial187.stdout:1382: done (0 left) 2026-02-13T18:11:30.426 INFO:tasks.rados.rados.0.trial187.stdout:1383: snap_remove snap 130 2026-02-13T18:11:31.418 INFO:tasks.rados.rados.0.trial187.stdout:1383: done (0 left) 2026-02-13T18:11:31.418 INFO:tasks.rados.rados.0.trial187.stdout:1384: rollback oid 2 current snap is 146 2026-02-13T18:11:31.418 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 141 2026-02-13T18:11:31.418 INFO:tasks.rados.rados.0.trial187.stdout:1385: read oid 47 snap -1 2026-02-13T18:11:31.418 INFO:tasks.rados.rados.0.trial187.stdout:1385: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:11:31.418 INFO:tasks.rados.rados.0.trial187.stdout:1386: snap_remove snap 140 2026-02-13T18:11:32.419 INFO:tasks.rados.rados.0.trial187.stdout:1386: done (2 left) 2026-02-13T18:11:32.419 INFO:tasks.rados.rados.0.trial187.stdout:1387: write (excl) oid 13 current snap is 146 2026-02-13T18:11:32.419 INFO:tasks.rados.rados.0.trial187.stdout:1387: seq_num 482 ranges {500974=400257,1388909=557169} 2026-02-13T18:11:32.425 INFO:tasks.rados.rados.0.trial187.stdout:1387: writing trial18717860-13 from 500974 to 901231 tid 1 2026-02-13T18:11:32.433 INFO:tasks.rados.rados.0.trial187.stdout:1387: writing trial18717860-13 from 1388909 to 1946078 tid 2 2026-02-13T18:11:32.433 INFO:tasks.rados.rados.0.trial187.stdout:1388: delete oid 38 current snap is 146 2026-02-13T18:11:32.433 INFO:tasks.rados.rados.0.trial187.stdout:1384: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:11:32.433 INFO:tasks.rados.rados.0.trial187.stdout:1385: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:11:32.544 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3026213 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1384: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1384: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 432 (ObjNum 446 snap 129 seq_num 446) dirty exists 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1387: finishing write tid 1 to trial18717860-13 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1387: finishing write tid 2 to trial18717860-13 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1387: finishing write tid 3 to trial18717860-13 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1387: finishing write tid 4 to trial18717860-13 2026-02-13T18:11:32.615 INFO:tasks.rados.rados.0.trial187.stdout:1387: oid 13 updating version 0 to 434 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1387: oid 13 updating version 434 to 435 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1387: oid 13 version 435 is already newer than 433 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 435 (ObjNum 482 snap 146 seq_num 482) dirty exists 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1387: left oid 13 (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1384: done (3 left) 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1385: done (2 left) 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1387: done (1 left) 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1388: done (0 left) 2026-02-13T18:11:32.616 INFO:tasks.rados.rados.0.trial187.stdout:1389: delete oid 45 current snap is 146 2026-02-13T18:11:32.617 INFO:tasks.rados.rados.0.trial187.stdout:1389: done (0 left) 2026-02-13T18:11:32.617 INFO:tasks.rados.rados.0.trial187.stdout:1390: read oid 34 snap -1 2026-02-13T18:11:32.617 INFO:tasks.rados.rados.0.trial187.stdout:1390: expect (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:11:32.617 INFO:tasks.rados.rados.0.trial187.stdout:1391: write (excl) oid 23 current snap is 146 2026-02-13T18:11:32.617 INFO:tasks.rados.rados.0.trial187.stdout:1391: seq_num 485 ranges {551395=626004,1848002=303393} 2026-02-13T18:11:32.623 INFO:tasks.rados.rados.0.trial187.stdout:1391: writing trial18717860-23 from 551395 to 1177399 tid 1 2026-02-13T18:11:32.630 INFO:tasks.rados.rados.0.trial187.stdout:1391: writing trial18717860-23 from 1848002 to 2151395 tid 2 2026-02-13T18:11:32.630 INFO:tasks.rados.rados.0.trial187.stdout:1392: write (excl) oid 27 current snap is 146 2026-02-13T18:11:32.630 INFO:tasks.rados.rados.0.trial187.stdout:1392: seq_num 486 ranges {568202=701253,1906484=261718} 2026-02-13T18:11:32.639 INFO:tasks.rados.rados.0.trial187.stdout:1392: writing trial18717860-27 from 568202 to 1269455 tid 1 2026-02-13T18:11:32.645 INFO:tasks.rados.rados.0.trial187.stdout:1392: writing trial18717860-27 from 1906484 to 2168202 tid 2 2026-02-13T18:11:32.645 INFO:tasks.rados.rados.0.trial187.stdout:1393: snap_remove snap 145 2026-02-13T18:11:33.434 INFO:tasks.rados.rados.0.trial187.stdout:1393: done (3 left) 2026-02-13T18:11:33.434 INFO:tasks.rados.rados.0.trial187.stdout:1394: read oid 50 snap 141 2026-02-13T18:11:33.434 INFO:tasks.rados.rados.0.trial187.stdout:1394: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:33.434 INFO:tasks.rados.rados.0.trial187.stdout:1395: copy_from oid 1 from oid 6 current snap is 146 2026-02-13T18:11:33.434 INFO:tasks.rados.rados.0.trial187.stdout:1390: expect (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:11:33.509 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:33.618 INFO:tasks.rados.rados.0.trial187.stdout:1391: finishing write tid 1 to trial18717860-23 2026-02-13T18:11:33.618 INFO:tasks.rados.rados.0.trial187.stdout:1391: finishing write tid 2 to trial18717860-23 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1391: finishing write tid 3 to trial18717860-23 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1391: finishing write tid 4 to trial18717860-23 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1391: oid 23 updating version 0 to 526 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1391: oid 23 updating version 526 to 527 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1391: oid 23 version 527 is already newer than 525 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 527 (ObjNum 485 snap 146 seq_num 485) dirty exists 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1391: left oid 23 (ObjNum 485 snap 146 seq_num 485) 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1392: finishing write tid 1 to trial18717860-27 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1392: finishing write tid 2 to trial18717860-27 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1392: finishing write tid 3 to trial18717860-27 2026-02-13T18:11:33.619 INFO:tasks.rados.rados.0.trial187.stdout:1390: done (4 left) 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1391: done (3 left) 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1396: delete oid 17 current snap is 146 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1392: finishing write tid 4 to trial18717860-27 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1392: oid 27 updating version 0 to 421 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1392: oid 27 updating version 421 to 422 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1392: oid 27 version 422 is already newer than 420 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 422 (ObjNum 486 snap 146 seq_num 486) dirty exists 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1392: left oid 27 (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:11:33.620 INFO:tasks.rados.rados.0.trial187.stdout:1394: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:33.638 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1225445 2026-02-13T18:11:33.668 INFO:tasks.rados.rados.0.trial187.stdout:1395: finishing copy_from racing read to trial18717860-1 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1395: finishing copy_from to trial18717860-1 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 427 (ObjNum 475 snap 141 seq_num 475) dirty exists 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1392: done (3 left) 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1394: done (2 left) 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1395: done (1 left) 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1396: done (0 left) 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1397: copy_from oid 9 from oid 7 current snap is 146 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1398: write (excl) oid 30 current snap is 146 2026-02-13T18:11:33.669 INFO:tasks.rados.rados.0.trial187.stdout:1398: seq_num 488 ranges {601816=568104,1623448=451823} 2026-02-13T18:11:33.678 INFO:tasks.rados.rados.0.trial187.stdout:1398: writing trial18717860-30 from 601816 to 1169920 tid 1 2026-02-13T18:11:33.684 INFO:tasks.rados.rados.0.trial187.stdout:1398: writing trial18717860-30 from 1623448 to 2075271 tid 2 2026-02-13T18:11:33.684 INFO:tasks.rados.rados.0.trial187.stdout:1399: delete oid 28 current snap is 146 2026-02-13T18:11:33.684 INFO:tasks.rados.rados.0.trial187.stdout:1398: finishing write tid 1 to trial18717860-30 2026-02-13T18:11:33.685 INFO:tasks.rados.rados.0.trial187.stdout:1397: finishing copy_from racing read to trial18717860-9 2026-02-13T18:11:33.685 INFO:tasks.rados.rados.0.trial187.stdout:1397: finishing copy_from to trial18717860-9 2026-02-13T18:11:33.685 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 453 (ObjNum 319 snap 87 seq_num 319) dirty exists 2026-02-13T18:11:33.686 INFO:tasks.rados.rados.0.trial187.stdout:1397: done (2 left) 2026-02-13T18:11:33.686 INFO:tasks.rados.rados.0.trial187.stdout:1399: done (1 left) 2026-02-13T18:11:33.686 INFO:tasks.rados.rados.0.trial187.stdout:1400: snap_remove snap 133 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1400: done (1 left) 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1401: rollback oid 3 current snap is 146 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 143 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1398: finishing write tid 2 to trial18717860-30 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1398: finishing write tid 3 to trial18717860-30 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1398: finishing write tid 4 to trial18717860-30 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1398: oid 30 updating version 0 to 596 2026-02-13T18:11:34.438 INFO:tasks.rados.rados.0.trial187.stdout:1398: oid 30 updating version 596 to 598 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:1398: oid 30 version 598 is already newer than 597 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 598 (ObjNum 488 snap 146 seq_num 488) dirty exists 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:1398: left oid 30 (ObjNum 488 snap 146 seq_num 488) 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:1398: done (1 left) 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:1402: read oid 45 snap -1 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:1402: expect deleted 2026-02-13T18:11:34.439 INFO:tasks.rados.rados.0.trial187.stdout:1403: snap_create 2026-02-13T18:11:34.443 INFO:tasks.rados.rados.0.trial187.stdout:1401: finishing rollback tid 0 to trial18717860-3 2026-02-13T18:11:34.443 INFO:tasks.rados.rados.0.trial187.stdout:1401: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:11:34.443 INFO:tasks.rados.rados.0.trial187.stdout:1401: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:11:34.443 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 677 (ObjNum 451 snap 130 seq_num 451) dirty exists 2026-02-13T18:11:35.505 INFO:tasks.rados.rados.0.trial187.stdout:1401: done (2 left) 2026-02-13T18:11:35.506 INFO:tasks.rados.rados.0.trial187.stdout:1402: done (1 left) 2026-02-13T18:11:35.506 INFO:tasks.rados.rados.0.trial187.stdout:1403: done (0 left) 2026-02-13T18:11:35.506 INFO:tasks.rados.rados.0.trial187.stdout:1404: write (excl) oid 22 current snap is 147 2026-02-13T18:11:35.506 INFO:tasks.rados.rados.0.trial187.stdout:1404: seq_num 490 ranges {635430=718602,2140412=95018} 2026-02-13T18:11:35.514 INFO:tasks.rados.rados.0.trial187.stdout:1404: writing trial18717860-22 from 635430 to 1354032 tid 1 2026-02-13T18:11:35.521 INFO:tasks.rados.rados.0.trial187.stdout:1404: writing trial18717860-22 from 2140412 to 2235430 tid 2 2026-02-13T18:11:35.521 INFO:tasks.rados.rados.0.trial187.stdout:1405: copy_from oid 38 from oid 4 current snap is 147 2026-02-13T18:11:35.521 INFO:tasks.rados.rados.0.trial187.stdout:1404: finishing write tid 1 to trial18717860-22 2026-02-13T18:11:35.521 INFO:tasks.rados.rados.0.trial187.stdout:1406: read oid 49 snap -1 2026-02-13T18:11:35.521 INFO:tasks.rados.rados.0.trial187.stdout:1406: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:11:35.521 INFO:tasks.rados.rados.0.trial187.stdout:1407: delete oid 35 current snap is 147 2026-02-13T18:11:35.522 INFO:tasks.rados.rados.0.trial187.stdout:1404: finishing write tid 2 to trial18717860-22 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:1404: finishing write tid 3 to trial18717860-22 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:1404: finishing write tid 4 to trial18717860-22 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:1404: oid 22 updating version 0 to 746 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:1404: oid 22 updating version 746 to 748 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:1404: oid 22 version 748 is already newer than 747 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 748 (ObjNum 490 snap 147 seq_num 490) dirty exists 2026-02-13T18:11:35.523 INFO:tasks.rados.rados.0.trial187.stdout:1404: left oid 22 (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:11:35.526 INFO:tasks.rados.rados.0.trial187.stdout:1406: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:11:35.606 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 211565 2026-02-13T18:11:36.281 INFO:tasks.rados.rados.0.trial187.stdout:1404: done (3 left) 2026-02-13T18:11:36.281 INFO:tasks.rados.rados.0.trial187.stdout:1406: done (2 left) 2026-02-13T18:11:36.281 INFO:tasks.rados.rados.0.trial187.stdout:1407: done (1 left) 2026-02-13T18:11:36.281 INFO:tasks.rados.rados.0.trial187.stdout:1408: read oid 50 snap -1 2026-02-13T18:11:36.281 INFO:tasks.rados.rados.0.trial187.stdout:1408: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:36.281 INFO:tasks.rados.rados.0.trial187.stdout:1409: write oid 42 current snap is 147 2026-02-13T18:11:36.282 INFO:tasks.rados.rados.0.trial187.stdout:1409: seq_num 492 ranges {669044=469100,1741023=459161} 2026-02-13T18:11:36.289 INFO:tasks.rados.rados.0.trial187.stdout:1409: writing trial18717860-42 from 669044 to 1138144 tid 1 2026-02-13T18:11:36.297 INFO:tasks.rados.rados.0.trial187.stdout:1409: writing trial18717860-42 from 1741023 to 2200184 tid 2 2026-02-13T18:11:36.297 INFO:tasks.rados.rados.0.trial187.stdout:1410: write (excl) oid 29 current snap is 147 2026-02-13T18:11:36.297 INFO:tasks.rados.rados.0.trial187.stdout:1410: seq_num 493 ranges {685851=544349,1799505=486346} 2026-02-13T18:11:36.305 INFO:tasks.rados.rados.0.trial187.stdout:1410: writing trial18717860-29 from 685851 to 1230200 tid 1 2026-02-13T18:11:36.313 INFO:tasks.rados.rados.0.trial187.stdout:1410: writing trial18717860-29 from 1799505 to 2285851 tid 2 2026-02-13T18:11:36.313 INFO:tasks.rados.rados.0.trial187.stdout:1411: write (excl) oid 48 current snap is 147 2026-02-13T18:11:36.313 INFO:tasks.rados.rados.0.trial187.stdout:1411: seq_num 494 ranges {702658=619598,1857987=444671} 2026-02-13T18:11:36.322 INFO:tasks.rados.rados.0.trial187.stdout:1411: writing trial18717860-48 from 702658 to 1322256 tid 1 2026-02-13T18:11:36.327 INFO:tasks.rados.rados.0.trial187.stdout:1411: writing trial18717860-48 from 1857987 to 2302658 tid 2 2026-02-13T18:11:36.327 INFO:tasks.rados.rados.0.trial187.stdout:1412: rollback oid 19 current snap is 147 2026-02-13T18:11:36.327 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 138 2026-02-13T18:11:36.327 INFO:tasks.rados.rados.0.trial187.stdout:1408: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:36.359 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1198586 2026-02-13T18:11:36.395 INFO:tasks.rados.rados.0.trial187.stdout:1405: finishing copy_from racing read to trial18717860-38 2026-02-13T18:11:36.395 INFO:tasks.rados.rados.0.trial187.stdout:1405: finishing copy_from to trial18717860-38 2026-02-13T18:11:36.395 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 285 (ObjNum 422 snap 122 seq_num 422) dirty exists 2026-02-13T18:11:36.395 INFO:tasks.rados.rados.0.trial187.stdout:1409: finishing write tid 1 to trial18717860-42 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: finishing write tid 2 to trial18717860-42 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: finishing write tid 3 to trial18717860-42 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: finishing write tid 4 to trial18717860-42 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: oid 42 updating version 0 to 358 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: oid 42 updating version 358 to 359 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: oid 42 version 359 is already newer than 357 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 359 (ObjNum 492 snap 147 seq_num 492) dirty exists 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1409: left oid 42 (ObjNum 492 snap 147 seq_num 492) 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1410: finishing write tid 1 to trial18717860-29 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1410: finishing write tid 2 to trial18717860-29 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1410: finishing write tid 3 to trial18717860-29 2026-02-13T18:11:36.396 INFO:tasks.rados.rados.0.trial187.stdout:1410: finishing write tid 4 to trial18717860-29 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1410: oid 29 updating version 0 to 609 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1410: oid 29 updating version 609 to 610 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1410: oid 29 updating version 610 to 611 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 611 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1410: left oid 29 (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: finishing write tid 1 to trial18717860-48 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: finishing write tid 2 to trial18717860-48 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: finishing write tid 3 to trial18717860-48 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: finishing write tid 4 to trial18717860-48 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: oid 48 updating version 0 to 750 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: oid 48 updating version 750 to 751 2026-02-13T18:11:36.397 INFO:tasks.rados.rados.0.trial187.stdout:1411: oid 48 version 751 is already newer than 749 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 751 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1411: left oid 48 (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1412: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1412: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1412: finishing rollback tid 2 to trial18717860-19 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 614 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1405: done (5 left) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1408: done (4 left) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1409: done (3 left) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1410: done (2 left) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1411: done (1 left) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1412: done (0 left) 2026-02-13T18:11:36.398 INFO:tasks.rados.rados.0.trial187.stdout:1413: delete oid 12 current snap is 147 2026-02-13T18:11:36.399 INFO:tasks.rados.rados.0.trial187.stdout:1413: done (0 left) 2026-02-13T18:11:36.399 INFO:tasks.rados.rados.0.trial187.stdout:1414: snap_remove snap 146 2026-02-13T18:11:36.418 INFO:tasks.rados.rados.0.trial187.stdout:1414: done (0 left) 2026-02-13T18:11:36.418 INFO:tasks.rados.rados.0.trial187.stdout:1415: write oid 34 current snap is 147 2026-02-13T18:11:36.419 INFO:tasks.rados.rados.0.trial187.stdout:1415: seq_num 496 ranges {736272=486449,1974951=361321} 2026-02-13T18:11:36.427 INFO:tasks.rados.rados.0.trial187.stdout:1415: writing trial18717860-34 from 736272 to 1222721 tid 1 2026-02-13T18:11:36.434 INFO:tasks.rados.rados.0.trial187.stdout:1415: writing trial18717860-34 from 1974951 to 2336272 tid 2 2026-02-13T18:11:36.435 INFO:tasks.rados.rados.0.trial187.stdout:1416: snap_create 2026-02-13T18:11:36.435 INFO:tasks.rados.rados.0.trial187.stdout:1415: finishing write tid 1 to trial18717860-34 2026-02-13T18:11:36.436 INFO:tasks.rados.rados.0.trial187.stdout:1415: finishing write tid 2 to trial18717860-34 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:1415: finishing write tid 3 to trial18717860-34 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:1415: finishing write tid 4 to trial18717860-34 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:1415: oid 34 updating version 0 to 393 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:1415: oid 34 version 393 is already newer than 391 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:1415: oid 34 version 393 is already newer than 392 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 393 (ObjNum 496 snap 147 seq_num 496) dirty exists 2026-02-13T18:11:36.437 INFO:tasks.rados.rados.0.trial187.stdout:1415: left oid 34 (ObjNum 496 snap 147 seq_num 496) 2026-02-13T18:11:37.422 INFO:tasks.rados.rados.0.trial187.stdout:1415: done (1 left) 2026-02-13T18:11:37.422 INFO:tasks.rados.rados.0.trial187.stdout:1416: done (0 left) 2026-02-13T18:11:37.422 INFO:tasks.rados.rados.0.trial187.stdout:1417: read oid 6 snap -1 2026-02-13T18:11:37.423 INFO:tasks.rados.rados.0.trial187.stdout:1417: expect (ObjNum 475 snap 141 seq_num 475) 2026-02-13T18:11:37.423 INFO:tasks.rados.rados.0.trial187.stdout:1418: copy_from oid 31 from oid 39 current snap is 148 2026-02-13T18:11:37.423 INFO:tasks.rados.rados.0.trial187.stdout:1419: snap_remove snap 138 2026-02-13T18:11:38.425 INFO:tasks.rados.rados.0.trial187.stdout:1419: done (2 left) 2026-02-13T18:11:38.426 INFO:tasks.rados.rados.0.trial187.stdout:1420: read oid 42 snap -1 2026-02-13T18:11:38.426 INFO:tasks.rados.rados.0.trial187.stdout:1420: expect (ObjNum 492 snap 147 seq_num 492) 2026-02-13T18:11:38.426 INFO:tasks.rados.rados.0.trial187.stdout:1421: copy_from oid 32 from oid 22 current snap is 148 2026-02-13T18:11:38.426 INFO:tasks.rados.rados.0.trial187.stdout:1417: expect (ObjNum 475 snap 141 seq_num 475) 2026-02-13T18:11:38.426 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:38.534 INFO:tasks.rados.rados.0.trial187.stdout:1418: finishing copy_from racing read to trial18717860-31 2026-02-13T18:11:38.534 INFO:tasks.rados.rados.0.trial187.stdout:1418: finishing copy_from to trial18717860-31 2026-02-13T18:11:38.535 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 297 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:11:38.535 INFO:tasks.rados.rados.0.trial187.stdout:1420: expect (ObjNum 492 snap 147 seq_num 492) 2026-02-13T18:11:38.557 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1627302 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:1421: finishing copy_from racing read to trial18717860-32 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:1421: finishing copy_from to trial18717860-32 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 748 (ObjNum 490 snap 147 seq_num 490) dirty exists 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:1417: done (3 left) 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:1418: done (2 left) 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:1420: done (1 left) 2026-02-13T18:11:38.661 INFO:tasks.rados.rados.0.trial187.stdout:1421: done (0 left) 2026-02-13T18:11:38.662 INFO:tasks.rados.rados.0.trial187.stdout:1422: rollback oid 15 current snap is 148 2026-02-13T18:11:38.662 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 136 2026-02-13T18:11:38.662 INFO:tasks.rados.rados.0.trial187.stdout:1423: snap_remove snap 135 2026-02-13T18:11:39.428 INFO:tasks.rados.rados.0.trial187.stdout:1423: done (1 left) 2026-02-13T18:11:39.429 INFO:tasks.rados.rados.0.trial187.stdout:1424: delete oid 28 current snap is 148 2026-02-13T18:11:39.429 INFO:tasks.rados.rados.0.trial187.stdout:1422: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:11:39.429 INFO:tasks.rados.rados.0.trial187.stdout:1422: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:11:39.429 INFO:tasks.rados.rados.0.trial187.stdout:1422: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:11:39.429 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 617 (ObjNum 373 snap 106 seq_num 373) dirty exists 2026-02-13T18:11:39.432 INFO:tasks.rados.rados.0.trial187.stdout:1422: done (1 left) 2026-02-13T18:11:39.432 INFO:tasks.rados.rados.0.trial187.stdout:1424: done (0 left) 2026-02-13T18:11:39.432 INFO:tasks.rados.rados.0.trial187.stdout:1425: snap_create 2026-02-13T18:11:40.432 INFO:tasks.rados.rados.0.trial187.stdout:1425: done (0 left) 2026-02-13T18:11:40.432 INFO:tasks.rados.rados.0.trial187.stdout:1426: read oid 41 snap 141 2026-02-13T18:11:40.432 INFO:tasks.rados.rados.0.trial187.stdout:1426: expect (ObjNum 479 snap 141 seq_num 479) 2026-02-13T18:11:40.432 INFO:tasks.rados.rados.0.trial187.stdout:1427: read oid 3 snap -1 2026-02-13T18:11:40.432 INFO:tasks.rados.rados.0.trial187.stdout:1427: expect (ObjNum 451 snap 130 seq_num 451) 2026-02-13T18:11:40.432 INFO:tasks.rados.rados.0.trial187.stdout:1428: snap_remove snap 143 2026-02-13T18:11:41.420 INFO:tasks.rados.rados.0.trial187.stdout:1428: done (2 left) 2026-02-13T18:11:41.420 INFO:tasks.rados.rados.0.trial187.stdout:1429: read oid 46 snap -1 2026-02-13T18:11:41.420 INFO:tasks.rados.rados.0.trial187.stdout:1429: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:11:41.421 INFO:tasks.rados.rados.0.trial187.stdout:1430: copy_from oid 14 from oid 47 current snap is 149 2026-02-13T18:11:41.421 INFO:tasks.rados.rados.0.trial187.stdout:1426: expect (ObjNum 479 snap 141 seq_num 479) 2026-02-13T18:11:41.481 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1232470 2026-02-13T18:11:41.490 INFO:tasks.rados.rados.0.trial187.stdout:1427: expect (ObjNum 451 snap 130 seq_num 451) 2026-02-13T18:11:41.549 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:41.619 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:41.688 INFO:tasks.rados.rados.0.trial187.stdout:1430: finishing copy_from racing read to trial18717860-14 2026-02-13T18:11:41.688 INFO:tasks.rados.rados.0.trial187.stdout:1429: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:11:41.688 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:41.757 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 250023 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1430: finishing copy_from to trial18717860-14 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 234 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1426: done (3 left) 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1427: done (2 left) 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1429: done (1 left) 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1430: done (0 left) 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1431: rollback oid 21 current snap is 149 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 136 2026-02-13T18:11:41.888 INFO:tasks.rados.rados.0.trial187.stdout:1432: read oid 9 snap -1 2026-02-13T18:11:41.889 INFO:tasks.rados.rados.0.trial187.stdout:1432: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:11:41.889 INFO:tasks.rados.rados.0.trial187.stdout:1433: snap_create 2026-02-13T18:11:41.889 INFO:tasks.rados.rados.0.trial187.stdout:1432: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:11:41.998 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3032276 2026-02-13T18:11:41.999 INFO:tasks.rados.rados.0.trial187.stdout:1431: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:11:41.999 INFO:tasks.rados.rados.0.trial187.stdout:1431: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:11:42.000 INFO:tasks.rados.rados.0.trial187.stdout:1431: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:11:42.000 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 534 (ObjNum 459 snap 134 seq_num 459) dirty exists 2026-02-13T18:11:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1431: done (2 left) 2026-02-13T18:11:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1432: done (1 left) 2026-02-13T18:11:42.434 INFO:tasks.rados.rados.0.trial187.stdout:1433: done (0 left) 2026-02-13T18:11:42.434 INFO:tasks.rados.rados.0.trial187.stdout:1434: write (excl) oid 24 current snap is 150 2026-02-13T18:11:42.434 INFO:tasks.rados.rados.0.trial187.stdout:1434: seq_num 498 ranges {769886=636947,2091915=277971} 2026-02-13T18:11:42.443 INFO:tasks.rados.rados.0.trial187.stdout:1434: writing trial18717860-24 from 769886 to 1406833 tid 1 2026-02-13T18:11:42.450 INFO:tasks.rados.rados.0.trial187.stdout:1434: writing trial18717860-24 from 2091915 to 2369886 tid 2 2026-02-13T18:11:42.450 INFO:tasks.rados.rados.0.trial187.stdout:1435: rollback oid 46 current snap is 150 2026-02-13T18:11:42.451 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 147 2026-02-13T18:11:42.451 INFO:tasks.rados.rados.0.trial187.stdout:1434: finishing write tid 1 to trial18717860-24 2026-02-13T18:11:42.451 INFO:tasks.rados.rados.0.trial187.stdout:1436: write oid 16 current snap is 150 2026-02-13T18:11:42.451 INFO:tasks.rados.rados.0.trial187.stdout:1436: seq_num 499 ranges {786693=712196,2150397=236296} 2026-02-13T18:11:42.460 INFO:tasks.rados.rados.0.trial187.stdout:1436: writing trial18717860-16 from 786693 to 1498889 tid 1 2026-02-13T18:11:42.467 INFO:tasks.rados.rados.0.trial187.stdout:1436: writing trial18717860-16 from 2150397 to 2386693 tid 2 2026-02-13T18:11:42.467 INFO:tasks.rados.rados.0.trial187.stdout:1437: delete oid 18 current snap is 150 2026-02-13T18:11:42.467 INFO:tasks.rados.rados.0.trial187.stdout:1434: finishing write tid 2 to trial18717860-24 2026-02-13T18:11:42.467 INFO:tasks.rados.rados.0.trial187.stdout:1434: finishing write tid 3 to trial18717860-24 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1434: finishing write tid 4 to trial18717860-24 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1434: oid 24 updating version 0 to 434 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1434: oid 24 version 434 is already newer than 432 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1434: oid 24 version 434 is already newer than 433 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 434 (ObjNum 498 snap 150 seq_num 498) dirty exists 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1434: left oid 24 (ObjNum 498 snap 150 seq_num 498) 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1435: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1435: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1435: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 538 (ObjNum 344 snap 95 seq_num 344) dirty exists 2026-02-13T18:11:42.468 INFO:tasks.rados.rados.0.trial187.stdout:1436: finishing write tid 1 to trial18717860-16 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1434: done (3 left) 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1435: done (2 left) 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1437: done (1 left) 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1438: copy_from oid 6 from oid 50 current snap is 150 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1439: read oid 7 snap 141 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1439: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1440: snap_create 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1436: finishing write tid 2 to trial18717860-16 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1436: finishing write tid 3 to trial18717860-16 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1436: finishing write tid 4 to trial18717860-16 2026-02-13T18:11:42.470 INFO:tasks.rados.rados.0.trial187.stdout:1436: oid 16 updating version 0 to 426 2026-02-13T18:11:42.471 INFO:tasks.rados.rados.0.trial187.stdout:1436: oid 16 version 426 is already newer than 425 2026-02-13T18:11:42.471 INFO:tasks.rados.rados.0.trial187.stdout:1436: oid 16 version 426 is already newer than 424 2026-02-13T18:11:42.471 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 426 (ObjNum 499 snap 150 seq_num 499) dirty exists 2026-02-13T18:11:42.471 INFO:tasks.rados.rados.0.trial187.stdout:1436: left oid 16 (ObjNum 499 snap 150 seq_num 499) 2026-02-13T18:11:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1438: finishing copy_from racing read to trial18717860-6 2026-02-13T18:11:42.477 INFO:tasks.rados.rados.0.trial187.stdout:1438: finishing copy_from to trial18717860-6 2026-02-13T18:11:42.477 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 326 (ObjNum 477 snap 141 seq_num 477) dirty exists 2026-02-13T18:11:42.477 INFO:tasks.rados.rados.0.trial187.stdout:1439: expect (ObjNum 319 snap 87 seq_num 319) 2026-02-13T18:11:42.536 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:42.575 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:43.437 INFO:tasks.rados.rados.0.trial187.stdout:1436: done (3 left) 2026-02-13T18:11:43.437 INFO:tasks.rados.rados.0.trial187.stdout:1438: done (2 left) 2026-02-13T18:11:43.437 INFO:tasks.rados.rados.0.trial187.stdout:1439: done (1 left) 2026-02-13T18:11:43.438 INFO:tasks.rados.rados.0.trial187.stdout:1440: done (0 left) 2026-02-13T18:11:43.438 INFO:tasks.rados.rados.0.trial187.stdout:1441: write oid 25 current snap is 151 2026-02-13T18:11:43.438 INFO:tasks.rados.rados.0.trial187.stdout:1441: seq_num 501 ranges {420307=462694,1351008=617495} 2026-02-13T18:11:43.443 INFO:tasks.rados.rados.0.trial187.stdout:1441: writing trial18717860-25 from 420307 to 883001 tid 1 2026-02-13T18:11:43.451 INFO:tasks.rados.rados.0.trial187.stdout:1441: writing trial18717860-25 from 1351008 to 1968503 tid 2 2026-02-13T18:11:43.451 INFO:tasks.rados.rados.0.trial187.stdout:1442: read oid 48 snap -1 2026-02-13T18:11:43.451 INFO:tasks.rados.rados.0.trial187.stdout:1442: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:11:43.451 INFO:tasks.rados.rados.0.trial187.stdout:1443: read oid 22 snap -1 2026-02-13T18:11:43.451 INFO:tasks.rados.rados.0.trial187.stdout:1443: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:11:43.451 INFO:tasks.rados.rados.0.trial187.stdout:1444: snap_remove snap 149 2026-02-13T18:11:44.546 INFO:tasks.rados.rados.0.trial187.stdout:1444: done (3 left) 2026-02-13T18:11:44.547 INFO:tasks.rados.rados.0.trial187.stdout:1445: snap_remove snap 144 2026-02-13T18:11:45.549 INFO:tasks.rados.rados.0.trial187.stdout:1445: done (3 left) 2026-02-13T18:11:45.550 INFO:tasks.rados.rados.0.trial187.stdout:1446: snap_remove snap 141 2026-02-13T18:11:46.421 INFO:tasks.rados.rados.0.trial187.stdout:1446: done (3 left) 2026-02-13T18:11:46.421 INFO:tasks.rados.rados.0.trial187.stdout:1447: read oid 46 snap -1 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1447: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1448: copy_from oid 14 from oid 2 current snap is 151 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: finishing write tid 1 to trial18717860-25 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: finishing write tid 2 to trial18717860-25 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: finishing write tid 3 to trial18717860-25 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: finishing write tid 4 to trial18717860-25 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: oid 25 updating version 0 to 424 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: oid 25 updating version 424 to 425 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: oid 25 version 425 is already newer than 423 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 425 (ObjNum 501 snap 151 seq_num 501) dirty exists 2026-02-13T18:11:46.422 INFO:tasks.rados.rados.0.trial187.stdout:1441: left oid 25 (ObjNum 501 snap 151 seq_num 501) 2026-02-13T18:11:46.423 INFO:tasks.rados.rados.0.trial187.stdout:1442: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:11:46.423 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 393020 2026-02-13T18:11:46.475 INFO:tasks.rados.rados.0.trial187.stdout:1443: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:11:46.479 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 885275 2026-02-13T18:11:46.500 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 847747 2026-02-13T18:11:46.518 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:46.544 INFO:tasks.rados.rados.0.trial187.stdout:1447: expect (ObjNum 344 snap 95 seq_num 344) 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1441: done (4 left) 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1442: done (3 left) 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1443: done (2 left) 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1447: done (1 left) 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1449: read oid 35 snap -1 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1449: expect deleted 2026-02-13T18:11:46.751 INFO:tasks.rados.rados.0.trial187.stdout:1450: delete oid 20 current snap is 151 2026-02-13T18:11:46.753 INFO:tasks.rados.rados.0.trial187.stdout:1449: done (2 left) 2026-02-13T18:11:46.753 INFO:tasks.rados.rados.0.trial187.stdout:1450: done (1 left) 2026-02-13T18:11:46.753 INFO:tasks.rados.rados.0.trial187.stdout:1451: read oid 50 snap -1 2026-02-13T18:11:46.753 INFO:tasks.rados.rados.0.trial187.stdout:1451: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:46.753 INFO:tasks.rados.rados.0.trial187.stdout:1452: copy_from oid 20 from oid 5 current snap is 151 2026-02-13T18:11:46.753 INFO:tasks.rados.rados.0.trial187.stdout:1453: snap_create 2026-02-13T18:11:46.757 INFO:tasks.rados.rados.0.trial187.stdout:1451: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:11:46.757 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:46.777 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 297176 2026-02-13T18:11:46.796 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:46.816 INFO:tasks.rados.rados.0.trial187.stdout:1452: finishing copy_from racing read to trial18717860-20 2026-02-13T18:11:46.816 INFO:tasks.rados.rados.0.trial187.stdout:1452: finishing copy_from to trial18717860-20 2026-02-13T18:11:46.816 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 378 (ObjNum 471 snap 141 seq_num 471) dirty exists 2026-02-13T18:11:46.816 INFO:tasks.rados.rados.0.trial187.stdout:1448: finishing copy_from racing read to trial18717860-14 2026-02-13T18:11:46.816 INFO:tasks.rados.rados.0.trial187.stdout:1448: finishing copy_from to trial18717860-14 2026-02-13T18:11:46.817 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 432 (ObjNum 446 snap 129 seq_num 446) dirty exists 2026-02-13T18:11:47.554 INFO:tasks.rados.rados.0.trial187.stdout:1448: done (3 left) 2026-02-13T18:11:47.554 INFO:tasks.rados.rados.0.trial187.stdout:1451: done (2 left) 2026-02-13T18:11:47.554 INFO:tasks.rados.rados.0.trial187.stdout:1452: done (1 left) 2026-02-13T18:11:47.554 INFO:tasks.rados.rados.0.trial187.stdout:1453: done (0 left) 2026-02-13T18:11:47.554 INFO:tasks.rados.rados.0.trial187.stdout:1454: read oid 36 snap -1 2026-02-13T18:11:47.555 INFO:tasks.rados.rados.0.trial187.stdout:1454: expect (ObjNum 343 snap 94 seq_num 343) 2026-02-13T18:11:47.555 INFO:tasks.rados.rados.0.trial187.stdout:1455: snap_remove snap 148 2026-02-13T18:11:48.554 INFO:tasks.rados.rados.0.trial187.stdout:1455: done (1 left) 2026-02-13T18:11:48.555 INFO:tasks.rados.rados.0.trial187.stdout:1456: read oid 24 snap 147 2026-02-13T18:11:48.555 INFO:tasks.rados.rados.0.trial187.stdout:1456: expect (ObjNum 476 snap 141 seq_num 476) 2026-02-13T18:11:48.555 INFO:tasks.rados.rados.0.trial187.stdout:1457: write (excl) oid 30 current snap is 152 2026-02-13T18:11:48.555 INFO:tasks.rados.rados.0.trial187.stdout:1457: seq_num 503 ranges {453921=729545,1584325=621164} 2026-02-13T18:11:48.563 INFO:tasks.rados.rados.0.trial187.stdout:1457: writing trial18717860-30 from 453921 to 1183466 tid 1 2026-02-13T18:11:48.570 INFO:tasks.rados.rados.0.trial187.stdout:1457: writing trial18717860-30 from 1584325 to 2205489 tid 2 2026-02-13T18:11:48.570 INFO:tasks.rados.rados.0.trial187.stdout:1458: read oid 44 snap -1 2026-02-13T18:11:48.570 INFO:tasks.rados.rados.0.trial187.stdout:1458: expect deleted 2026-02-13T18:11:48.570 INFO:tasks.rados.rados.0.trial187.stdout:1459: delete oid 3 current snap is 152 2026-02-13T18:11:48.570 INFO:tasks.rados.rados.0.trial187.stdout:1454: expect (ObjNum 343 snap 94 seq_num 343) 2026-02-13T18:11:48.639 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:48.677 INFO:tasks.rados.rados.0.trial187.stdout:1456: expect (ObjNum 476 snap 141 seq_num 476) 2026-02-13T18:11:48.677 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:48.714 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:48.733 INFO:tasks.rados.rados.0.trial187.stdout:1457: finishing write tid 1 to trial18717860-30 2026-02-13T18:11:48.733 INFO:tasks.rados.rados.0.trial187.stdout:1457: finishing write tid 2 to trial18717860-30 2026-02-13T18:11:48.733 INFO:tasks.rados.rados.0.trial187.stdout:1457: finishing write tid 3 to trial18717860-30 2026-02-13T18:11:48.733 INFO:tasks.rados.rados.0.trial187.stdout:1457: finishing write tid 4 to trial18717860-30 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1457: oid 30 updating version 0 to 751 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1457: oid 30 version 751 is already newer than 749 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1457: oid 30 version 751 is already newer than 750 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 751 (ObjNum 503 snap 152 seq_num 503) dirty exists 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1457: left oid 30 (ObjNum 503 snap 152 seq_num 503) 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1454: done (4 left) 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1456: done (3 left) 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1457: done (2 left) 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1458: done (1 left) 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1459: done (0 left) 2026-02-13T18:11:48.734 INFO:tasks.rados.rados.0.trial187.stdout:1460: snap_create 2026-02-13T18:11:49.560 INFO:tasks.rados.rados.0.trial187.stdout:1460: done (0 left) 2026-02-13T18:11:49.560 INFO:tasks.rados.rados.0.trial187.stdout:1461: write oid 46 current snap is 153 2026-02-13T18:11:49.560 INFO:tasks.rados.rados.0.trial187.stdout:1461: seq_num 505 ranges {487535=480043,1584936=624833} 2026-02-13T18:11:49.567 INFO:tasks.rados.rados.0.trial187.stdout:1461: writing trial18717860-46 from 487535 to 967578 tid 1 2026-02-13T18:11:49.575 INFO:tasks.rados.rados.0.trial187.stdout:1461: writing trial18717860-46 from 1584936 to 2209769 tid 2 2026-02-13T18:11:49.575 INFO:tasks.rados.rados.0.trial187.stdout:1462: rollback oid 41 current snap is 153 2026-02-13T18:11:49.576 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 151 2026-02-13T18:11:49.576 INFO:tasks.rados.rados.0.trial187.stdout:1461: finishing write tid 1 to trial18717860-46 2026-02-13T18:11:49.576 INFO:tasks.rados.rados.0.trial187.stdout:1463: snap_create 2026-02-13T18:11:49.579 INFO:tasks.rados.rados.0.trial187.stdout:1461: finishing write tid 2 to trial18717860-46 2026-02-13T18:11:49.579 INFO:tasks.rados.rados.0.trial187.stdout:1461: finishing write tid 3 to trial18717860-46 2026-02-13T18:11:49.579 INFO:tasks.rados.rados.0.trial187.stdout:1461: finishing write tid 4 to trial18717860-46 2026-02-13T18:11:49.579 INFO:tasks.rados.rados.0.trial187.stdout:1461: oid 46 updating version 0 to 554 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:1461: oid 46 updating version 554 to 556 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:1461: oid 46 version 556 is already newer than 555 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 556 (ObjNum 505 snap 153 seq_num 505) dirty exists 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:1461: left oid 46 (ObjNum 505 snap 153 seq_num 505) 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:1462: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:1462: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:1462: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:11:49.580 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 383 (ObjNum 479 snap 141 seq_num 479) dirty exists 2026-02-13T18:11:50.565 INFO:tasks.rados.rados.0.trial187.stdout:1461: done (2 left) 2026-02-13T18:11:50.566 INFO:tasks.rados.rados.0.trial187.stdout:1462: done (1 left) 2026-02-13T18:11:50.566 INFO:tasks.rados.rados.0.trial187.stdout:1463: done (0 left) 2026-02-13T18:11:50.566 INFO:tasks.rados.rados.0.trial187.stdout:1464: delete oid 20 current snap is 154 2026-02-13T18:11:50.568 INFO:tasks.rados.rados.0.trial187.stdout:1464: done (0 left) 2026-02-13T18:11:50.568 INFO:tasks.rados.rados.0.trial187.stdout:1465: rollback oid 41 current snap is 154 2026-02-13T18:11:50.568 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 152 2026-02-13T18:11:50.568 INFO:tasks.rados.rados.0.trial187.stdout:1466: delete oid 6 current snap is 154 2026-02-13T18:11:50.570 INFO:tasks.rados.rados.0.trial187.stdout:1466: done (1 left) 2026-02-13T18:11:50.570 INFO:tasks.rados.rados.0.trial187.stdout:1467: write oid 36 current snap is 154 2026-02-13T18:11:50.570 INFO:tasks.rados.rados.0.trial187.stdout:1467: seq_num 508 ranges {537956=705790,1644029=772160} 2026-02-13T18:11:50.578 INFO:tasks.rados.rados.0.trial187.stdout:1467: writing trial18717860-36 from 537956 to 1243746 tid 1 2026-02-13T18:11:50.587 INFO:tasks.rados.rados.0.trial187.stdout:1467: writing trial18717860-36 from 1644029 to 2416189 tid 2 2026-02-13T18:11:50.587 INFO:tasks.rados.rados.0.trial187.stdout:1468: copy_from oid 46 from oid 49 current snap is 154 2026-02-13T18:11:50.587 INFO:tasks.rados.rados.0.trial187.stdout:1465: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:11:50.587 INFO:tasks.rados.rados.0.trial187.stdout:1467: finishing write tid 1 to trial18717860-36 2026-02-13T18:11:50.587 INFO:tasks.rados.rados.0.trial187.stdout:1469: snap_remove snap 147 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1469: done (3 left) 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1470: delete oid 12 current snap is 154 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1467: finishing write tid 2 to trial18717860-36 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1467: finishing write tid 3 to trial18717860-36 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1465: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1465: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 387 (ObjNum 479 snap 141 seq_num 479) dirty exists 2026-02-13T18:11:51.423 INFO:tasks.rados.rados.0.trial187.stdout:1467: finishing write tid 4 to trial18717860-36 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:1467: oid 36 updating version 0 to 528 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:1467: oid 36 updating version 528 to 530 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:1467: oid 36 version 530 is already newer than 529 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 530 (ObjNum 508 snap 154 seq_num 508) dirty exists 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:1467: left oid 36 (ObjNum 508 snap 154 seq_num 508) 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:1468: finishing copy_from racing read to trial18717860-46 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:1468: finishing copy_from to trial18717860-46 2026-02-13T18:11:51.424 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 297 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:11:51.427 INFO:tasks.rados.rados.0.trial187.stdout:1465: done (3 left) 2026-02-13T18:11:51.427 INFO:tasks.rados.rados.0.trial187.stdout:1467: done (2 left) 2026-02-13T18:11:51.427 INFO:tasks.rados.rados.0.trial187.stdout:1468: done (1 left) 2026-02-13T18:11:51.427 INFO:tasks.rados.rados.0.trial187.stdout:1470: done (0 left) 2026-02-13T18:11:51.428 INFO:tasks.rados.rados.0.trial187.stdout:1471: write oid 8 current snap is 154 2026-02-13T18:11:51.428 INFO:tasks.rados.rados.0.trial187.stdout:1471: seq_num 510 ranges {571570=572641,1877346=694224} 2026-02-13T18:11:51.435 INFO:tasks.rados.rados.0.trial187.stdout:1471: writing trial18717860-8 from 571570 to 1144211 tid 1 2026-02-13T18:11:51.444 INFO:tasks.rados.rados.0.trial187.stdout:1471: writing trial18717860-8 from 1877346 to 2571570 tid 2 2026-02-13T18:11:51.445 INFO:tasks.rados.rados.0.trial187.stdout:1472: snap_create 2026-02-13T18:11:51.445 INFO:tasks.rados.rados.0.trial187.stdout:1471: finishing write tid 1 to trial18717860-8 2026-02-13T18:11:51.447 INFO:tasks.rados.rados.0.trial187.stdout:1471: finishing write tid 2 to trial18717860-8 2026-02-13T18:11:51.447 INFO:tasks.rados.rados.0.trial187.stdout:1471: finishing write tid 3 to trial18717860-8 2026-02-13T18:11:51.448 INFO:tasks.rados.rados.0.trial187.stdout:1471: finishing write tid 4 to trial18717860-8 2026-02-13T18:11:51.448 INFO:tasks.rados.rados.0.trial187.stdout:1471: oid 8 updating version 0 to 753 2026-02-13T18:11:51.448 INFO:tasks.rados.rados.0.trial187.stdout:1471: oid 8 version 753 is already newer than 752 2026-02-13T18:11:51.448 INFO:tasks.rados.rados.0.trial187.stdout:1471: oid 8 updating version 753 to 754 2026-02-13T18:11:51.448 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 754 (ObjNum 510 snap 154 seq_num 510) dirty exists 2026-02-13T18:11:51.448 INFO:tasks.rados.rados.0.trial187.stdout:1471: left oid 8 (ObjNum 510 snap 154 seq_num 510) 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:1471: done (1 left) 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:1472: done (0 left) 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:1473: copy_from oid 42 from oid 49 current snap is 155 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:1474: rollback oid 5 current snap is 155 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 152 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:1475: rollback oid 6 current snap is 155 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 153 2026-02-13T18:11:52.424 INFO:tasks.rados.rados.0.trial187.stdout:1476: read oid 25 snap 150 2026-02-13T18:11:52.425 INFO:tasks.rados.rados.0.trial187.stdout:1476: expect (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:11:52.425 INFO:tasks.rados.rados.0.trial187.stdout:1477: rollback oid 30 current snap is 155 2026-02-13T18:11:52.425 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 153 2026-02-13T18:11:52.425 INFO:tasks.rados.rados.0.trial187.stdout:1478: snap_remove snap 151 2026-02-13T18:11:53.424 INFO:tasks.rados.rados.0.trial187.stdout:1478: done (5 left) 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1479: copy_from oid 2 from oid 27 current snap is 155 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1477: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1477: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1477: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 757 (ObjNum 503 snap 152 seq_num 503) dirty exists 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1474: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1475: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1475: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 437 (ObjNum 477 snap 141 seq_num 477) dirty exists 2026-02-13T18:11:53.425 INFO:tasks.rados.rados.0.trial187.stdout:1474: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:11:53.426 INFO:tasks.rados.rados.0.trial187.stdout:1474: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:11:53.426 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 401 (ObjNum 471 snap 141 seq_num 471) dirty exists 2026-02-13T18:11:53.426 INFO:tasks.rados.rados.0.trial187.stdout:1476: expect (ObjNum 423 snap 122 seq_num 423) 2026-02-13T18:11:53.446 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1812518 2026-02-13T18:11:53.492 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:53.546 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:1473: finishing copy_from racing read to trial18717860-42 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:1473: finishing copy_from to trial18717860-42 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 297 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:1479: finishing copy_from racing read to trial18717860-2 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:1479: finishing copy_from to trial18717860-2 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 422 (ObjNum 486 snap 146 seq_num 486) dirty exists 2026-02-13T18:11:53.601 INFO:tasks.rados.rados.0.trial187.stdout:1473: done (5 left) 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1474: done (4 left) 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1475: done (3 left) 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1476: done (2 left) 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1477: done (1 left) 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1479: done (0 left) 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1480: write oid 34 current snap is 155 2026-02-13T18:11:53.602 INFO:tasks.rados.rados.0.trial187.stdout:1480: seq_num 511 ranges {588377=647890,1935828=635840} 2026-02-13T18:11:53.609 INFO:tasks.rados.rados.0.trial187.stdout:1480: writing trial18717860-34 from 588377 to 1236267 tid 1 2026-02-13T18:11:53.619 INFO:tasks.rados.rados.0.trial187.stdout:1480: writing trial18717860-34 from 1935828 to 2571668 tid 2 2026-02-13T18:11:53.619 INFO:tasks.rados.rados.0.trial187.stdout:1481: delete oid 7 current snap is 155 2026-02-13T18:11:53.619 INFO:tasks.rados.rados.0.trial187.stdout:1480: finishing write tid 1 to trial18717860-34 2026-02-13T18:11:53.621 INFO:tasks.rados.rados.0.trial187.stdout:1480: finishing write tid 2 to trial18717860-34 2026-02-13T18:11:53.621 INFO:tasks.rados.rados.0.trial187.stdout:1480: finishing write tid 3 to trial18717860-34 2026-02-13T18:11:53.621 INFO:tasks.rados.rados.0.trial187.stdout:1481: done (1 left) 2026-02-13T18:11:53.621 INFO:tasks.rados.rados.0.trial187.stdout:1482: copy_from oid 19 from oid 38 current snap is 155 2026-02-13T18:11:53.621 INFO:tasks.rados.rados.0.trial187.stdout:1483: delete oid 20 current snap is 155 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1480: finishing write tid 4 to trial18717860-34 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1480: oid 34 updating version 0 to 408 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1480: oid 34 updating version 408 to 409 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1480: oid 34 version 409 is already newer than 407 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 409 (ObjNum 511 snap 155 seq_num 511) dirty exists 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1480: left oid 34 (ObjNum 511 snap 155 seq_num 511) 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1480: done (2 left) 2026-02-13T18:11:53.622 INFO:tasks.rados.rados.0.trial187.stdout:1483: done (1 left) 2026-02-13T18:11:53.623 INFO:tasks.rados.rados.0.trial187.stdout:1484: snap_remove snap 150 2026-02-13T18:11:54.431 INFO:tasks.rados.rados.0.trial187.stdout:1484: done (1 left) 2026-02-13T18:11:54.431 INFO:tasks.rados.rados.0.trial187.stdout:1485: read oid 43 snap -1 2026-02-13T18:11:54.431 INFO:tasks.rados.rados.0.trial187.stdout:1485: expect (ObjNum 481 snap 145 seq_num 481) 2026-02-13T18:11:54.431 INFO:tasks.rados.rados.0.trial187.stdout:1486: read oid 21 snap -1 2026-02-13T18:11:54.431 INFO:tasks.rados.rados.0.trial187.stdout:1486: expect (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:11:54.431 INFO:tasks.rados.rados.0.trial187.stdout:1487: read oid 10 snap -1 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:1487: expect (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:1488: read oid 4 snap -1 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:1488: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:1489: snap_create 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:1482: finishing copy_from racing read to trial18717860-19 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:1482: finishing copy_from to trial18717860-19 2026-02-13T18:11:54.432 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 285 (ObjNum 422 snap 122 seq_num 422) dirty exists 2026-02-13T18:11:54.436 INFO:tasks.rados.rados.0.trial187.stdout:1485: expect (ObjNum 481 snap 145 seq_num 481) 2026-02-13T18:11:54.461 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:54.476 INFO:tasks.rados.rados.0.trial187.stdout:1488: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:11:54.542 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2928517 2026-02-13T18:11:54.543 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:54.585 INFO:tasks.rados.rados.0.trial187.stdout:1486: expect (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:11:54.617 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2152525 2026-02-13T18:11:54.771 INFO:tasks.rados.rados.0.trial187.stdout:1487: expect (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:11:54.804 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:55.444 INFO:tasks.rados.rados.0.trial187.stdout:1482: done (5 left) 2026-02-13T18:11:55.444 INFO:tasks.rados.rados.0.trial187.stdout:1485: done (4 left) 2026-02-13T18:11:55.444 INFO:tasks.rados.rados.0.trial187.stdout:1486: done (3 left) 2026-02-13T18:11:55.444 INFO:tasks.rados.rados.0.trial187.stdout:1487: done (2 left) 2026-02-13T18:11:55.444 INFO:tasks.rados.rados.0.trial187.stdout:1488: done (1 left) 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1489: done (0 left) 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1490: rollback oid 4 current snap is 156 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 152 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1491: rollback oid 50 current snap is 156 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 155 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1492: read oid 47 snap -1 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1492: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1493: read oid 43 snap -1 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1493: expect (ObjNum 481 snap 145 seq_num 481) 2026-02-13T18:11:55.445 INFO:tasks.rados.rados.0.trial187.stdout:1494: snap_remove snap 153 2026-02-13T18:11:56.423 INFO:tasks.rados.rados.0.trial187.stdout:1494: done (4 left) 2026-02-13T18:11:56.424 INFO:tasks.rados.rados.0.trial187.stdout:1495: snap_remove snap 136 2026-02-13T18:11:57.424 INFO:tasks.rados.rados.0.trial187.stdout:1495: done (4 left) 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:1496: delete oid 16 current snap is 156 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:1490: finishing rollback tid 0 to trial18717860-4 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:1491: finishing rollback tid 0 to trial18717860-50 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:1491: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:1491: finishing rollback tid 2 to trial18717860-50 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 403 (ObjNum 477 snap 141 seq_num 477) dirty exists 2026-02-13T18:11:57.425 INFO:tasks.rados.rados.0.trial187.stdout:1492: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:11:57.587 INFO:tasks.rados.rados.0.trial187.stdout:1490: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:11:57.587 INFO:tasks.rados.rados.0.trial187.stdout:1490: finishing rollback tid 2 to trial18717860-4 2026-02-13T18:11:57.587 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 331 (ObjNum 422 snap 122 seq_num 422) dirty exists 2026-02-13T18:11:57.587 INFO:tasks.rados.rados.0.trial187.stdout:1493: expect (ObjNum 481 snap 145 seq_num 481) 2026-02-13T18:11:57.602 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:11:57.621 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 789118 2026-02-13T18:11:57.631 INFO:tasks.rados.rados.0.trial187.stdout:1490: done (4 left) 2026-02-13T18:11:57.631 INFO:tasks.rados.rados.0.trial187.stdout:1491: done (3 left) 2026-02-13T18:11:57.631 INFO:tasks.rados.rados.0.trial187.stdout:1492: done (2 left) 2026-02-13T18:11:57.631 INFO:tasks.rados.rados.0.trial187.stdout:1493: done (1 left) 2026-02-13T18:11:57.631 INFO:tasks.rados.rados.0.trial187.stdout:1496: done (0 left) 2026-02-13T18:11:57.631 INFO:tasks.rados.rados.0.trial187.stdout:1497: copy_from oid 27 from oid 33 current snap is 156 2026-02-13T18:11:57.632 INFO:tasks.rados.rados.0.trial187.stdout:1498: write (excl) oid 3 current snap is 156 2026-02-13T18:11:57.632 INFO:tasks.rados.rados.0.trial187.stdout:1498: seq_num 515 ranges {655605=548886,1653403=643178} 2026-02-13T18:11:57.639 INFO:tasks.rados.rados.0.trial187.stdout:1498: writing trial18717860-3 from 655605 to 1204491 tid 1 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1498: writing trial18717860-3 from 1653403 to 2296581 tid 2 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1499: rollback oid 47 current snap is 156 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1498: finishing write tid 1 to trial18717860-3 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1497: finishing copy_from racing read to trial18717860-27 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1497: finishing copy_from to trial18717860-27 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 601 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 155 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1497: done (2 left) 2026-02-13T18:11:57.647 INFO:tasks.rados.rados.0.trial187.stdout:1500: delete oid 35 current snap is 156 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: finishing write tid 2 to trial18717860-3 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: finishing write tid 3 to trial18717860-3 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: finishing write tid 4 to trial18717860-3 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: oid 3 updating version 0 to 725 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: oid 3 version 725 is already newer than 724 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: oid 3 updating version 725 to 726 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 726 (ObjNum 515 snap 156 seq_num 515) dirty exists 2026-02-13T18:11:57.649 INFO:tasks.rados.rados.0.trial187.stdout:1498: left oid 3 (ObjNum 515 snap 156 seq_num 515) 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1499: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1499: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1498: done (2 left) 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1500: done (1 left) 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1501: read oid 35 snap -1 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1501: expect deleted 2026-02-13T18:11:57.650 INFO:tasks.rados.rados.0.trial187.stdout:1502: snap_create 2026-02-13T18:11:57.658 INFO:tasks.rados.rados.0.trial187.stdout:1499: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:11:57.658 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 432 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:11:58.449 INFO:tasks.rados.rados.0.trial187.stdout:1499: done (2 left) 2026-02-13T18:11:58.450 INFO:tasks.rados.rados.0.trial187.stdout:1501: done (1 left) 2026-02-13T18:11:58.450 INFO:tasks.rados.rados.0.trial187.stdout:1502: done (0 left) 2026-02-13T18:11:58.450 INFO:tasks.rados.rados.0.trial187.stdout:1503: snap_create 2026-02-13T18:11:59.451 INFO:tasks.rados.rados.0.trial187.stdout:1503: done (0 left) 2026-02-13T18:11:59.451 INFO:tasks.rados.rados.0.trial187.stdout:1504: write oid 43 current snap is 158 2026-02-13T18:11:59.451 INFO:tasks.rados.rados.0.trial187.stdout:1504: seq_num 517 ranges {689219=415737,1770367=646847} 2026-02-13T18:11:59.458 INFO:tasks.rados.rados.0.trial187.stdout:1504: writing trial18717860-43 from 689219 to 1104956 tid 1 2026-02-13T18:11:59.468 INFO:tasks.rados.rados.0.trial187.stdout:1504: writing trial18717860-43 from 1770367 to 2417214 tid 2 2026-02-13T18:11:59.468 INFO:tasks.rados.rados.0.trial187.stdout:1505: rollback oid 2 current snap is 158 2026-02-13T18:11:59.468 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 155 2026-02-13T18:11:59.468 INFO:tasks.rados.rados.0.trial187.stdout:1504: finishing write tid 1 to trial18717860-43 2026-02-13T18:11:59.469 INFO:tasks.rados.rados.0.trial187.stdout:1506: rollback oid 6 current snap is 158 2026-02-13T18:11:59.469 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 157 2026-02-13T18:11:59.469 INFO:tasks.rados.rados.0.trial187.stdout:1507: copy_from oid 28 from oid 8 current snap is 158 2026-02-13T18:11:59.469 INFO:tasks.rados.rados.0.trial187.stdout:1508: snap_create 2026-02-13T18:11:59.471 INFO:tasks.rados.rados.0.trial187.stdout:1505: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:11:59.471 INFO:tasks.rados.rados.0.trial187.stdout:1505: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:11:59.471 INFO:tasks.rados.rados.0.trial187.stdout:1506: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:11:59.472 INFO:tasks.rados.rados.0.trial187.stdout:1506: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1504: finishing write tid 2 to trial18717860-43 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1506: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 440 (ObjNum 477 snap 141 seq_num 477) dirty exists 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1504: finishing write tid 3 to trial18717860-43 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1505: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 447 (ObjNum 486 snap 146 seq_num 486) dirty exists 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1504: finishing write tid 4 to trial18717860-43 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1504: oid 43 updating version 0 to 777 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1504: oid 43 updating version 777 to 779 2026-02-13T18:11:59.473 INFO:tasks.rados.rados.0.trial187.stdout:1504: oid 43 version 779 is already newer than 778 2026-02-13T18:11:59.474 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 779 (ObjNum 517 snap 158 seq_num 517) dirty exists 2026-02-13T18:11:59.474 INFO:tasks.rados.rados.0.trial187.stdout:1504: left oid 43 (ObjNum 517 snap 158 seq_num 517) 2026-02-13T18:11:59.483 INFO:tasks.rados.rados.0.trial187.stdout:1507: finishing copy_from racing read to trial18717860-28 2026-02-13T18:11:59.483 INFO:tasks.rados.rados.0.trial187.stdout:1507: finishing copy_from to trial18717860-28 2026-02-13T18:11:59.483 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 754 (ObjNum 510 snap 154 seq_num 510) dirty exists 2026-02-13T18:12:00.471 INFO:tasks.rados.rados.0.trial187.stdout:1504: done (4 left) 2026-02-13T18:12:00.471 INFO:tasks.rados.rados.0.trial187.stdout:1505: done (3 left) 2026-02-13T18:12:00.471 INFO:tasks.rados.rados.0.trial187.stdout:1506: done (2 left) 2026-02-13T18:12:00.471 INFO:tasks.rados.rados.0.trial187.stdout:1507: done (1 left) 2026-02-13T18:12:00.471 INFO:tasks.rados.rados.0.trial187.stdout:1508: done (0 left) 2026-02-13T18:12:00.471 INFO:tasks.rados.rados.0.trial187.stdout:1509: write (excl) oid 25 current snap is 159 2026-02-13T18:12:00.472 INFO:tasks.rados.rados.0.trial187.stdout:1509: seq_num 518 ranges {706026=490986,1828849=790505} 2026-02-13T18:12:00.479 INFO:tasks.rados.rados.0.trial187.stdout:1509: writing trial18717860-25 from 706026 to 1197012 tid 1 2026-02-13T18:12:00.489 INFO:tasks.rados.rados.0.trial187.stdout:1509: writing trial18717860-25 from 1828849 to 2619354 tid 2 2026-02-13T18:12:00.489 INFO:tasks.rados.rados.0.trial187.stdout:1510: write (excl) oid 26 current snap is 159 2026-02-13T18:12:00.490 INFO:tasks.rados.rados.0.trial187.stdout:1509: finishing write tid 1 to trial18717860-25 2026-02-13T18:12:00.490 INFO:tasks.rados.rados.0.trial187.stdout:1510: seq_num 519 ranges {722833=566235,1887331=650516} 2026-02-13T18:12:00.497 INFO:tasks.rados.rados.0.trial187.stdout:1510: writing trial18717860-26 from 722833 to 1289068 tid 1 2026-02-13T18:12:00.506 INFO:tasks.rados.rados.0.trial187.stdout:1510: writing trial18717860-26 from 1887331 to 2537847 tid 2 2026-02-13T18:12:00.506 INFO:tasks.rados.rados.0.trial187.stdout:1511: snap_remove snap 152 2026-02-13T18:12:01.424 INFO:tasks.rados.rados.0.trial187.stdout:1511: done (2 left) 2026-02-13T18:12:01.424 INFO:tasks.rados.rados.0.trial187.stdout:1512: read oid 2 snap 157 2026-02-13T18:12:01.424 INFO:tasks.rados.rados.0.trial187.stdout:1512: expect (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:12:01.425 INFO:tasks.rados.rados.0.trial187.stdout:1513: write (excl) oid 17 current snap is 159 2026-02-13T18:12:01.425 INFO:tasks.rados.rados.0.trial187.stdout:1513: seq_num 520 ranges {739640=641484,1829460=794174} 2026-02-13T18:12:01.433 INFO:tasks.rados.rados.0.trial187.stdout:1513: writing trial18717860-17 from 739640 to 1381124 tid 1 2026-02-13T18:12:01.442 INFO:tasks.rados.rados.0.trial187.stdout:1513: writing trial18717860-17 from 1829460 to 2623634 tid 2 2026-02-13T18:12:01.442 INFO:tasks.rados.rados.0.trial187.stdout:1514: copy_from oid 38 from oid 43 current snap is 159 2026-02-13T18:12:01.442 INFO:tasks.rados.rados.0.trial187.stdout:1509: finishing write tid 2 to trial18717860-25 2026-02-13T18:12:01.442 INFO:tasks.rados.rados.0.trial187.stdout:1509: finishing write tid 3 to trial18717860-25 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1509: finishing write tid 4 to trial18717860-25 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1509: oid 25 updating version 0 to 603 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1509: oid 25 updating version 603 to 604 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1509: oid 25 version 604 is already newer than 602 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 604 (ObjNum 518 snap 159 seq_num 518) dirty exists 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1509: left oid 25 (ObjNum 518 snap 159 seq_num 518) 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1510: finishing write tid 1 to trial18717860-26 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1510: finishing write tid 2 to trial18717860-26 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1510: finishing write tid 3 to trial18717860-26 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1510: finishing write tid 4 to trial18717860-26 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1510: oid 26 updating version 0 to 729 2026-02-13T18:12:01.443 INFO:tasks.rados.rados.0.trial187.stdout:1510: oid 26 version 729 is already newer than 728 2026-02-13T18:12:01.444 INFO:tasks.rados.rados.0.trial187.stdout:1510: oid 26 version 729 is already newer than 727 2026-02-13T18:12:01.444 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 729 (ObjNum 519 snap 159 seq_num 519) dirty exists 2026-02-13T18:12:01.444 INFO:tasks.rados.rados.0.trial187.stdout:1510: left oid 26 (ObjNum 519 snap 159 seq_num 519) 2026-02-13T18:12:01.444 INFO:tasks.rados.rados.0.trial187.stdout:1512: expect (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:12:01.518 INFO:tasks.rados.rados.0.trial187.stdout:1513: finishing write tid 1 to trial18717860-17 2026-02-13T18:12:01.518 INFO:tasks.rados.rados.0.trial187.stdout:1513: finishing write tid 2 to trial18717860-17 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1513: finishing write tid 3 to trial18717860-17 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1509: done (4 left) 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1510: done (3 left) 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1512: done (2 left) 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1515: copy_from oid 34 from oid 33 current snap is 159 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1513: finishing write tid 4 to trial18717860-17 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1513: oid 17 updating version 0 to 732 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1513: oid 17 version 732 is already newer than 731 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:1513: oid 17 version 732 is already newer than 730 2026-02-13T18:12:01.519 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 732 (ObjNum 520 snap 159 seq_num 520) dirty exists 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1513: left oid 17 (ObjNum 520 snap 159 seq_num 520) 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1514: finishing copy_from racing read to trial18717860-38 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1514: finishing copy_from to trial18717860-38 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 779 (ObjNum 517 snap 158 seq_num 517) dirty exists 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1513: done (2 left) 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1514: done (1 left) 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1516: read oid 26 snap 158 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1516: expect deleted 2026-02-13T18:12:01.520 INFO:tasks.rados.rados.0.trial187.stdout:1517: snap_create 2026-02-13T18:12:01.528 INFO:tasks.rados.rados.0.trial187.stdout:1515: finishing copy_from racing read to trial18717860-34 2026-02-13T18:12:01.528 INFO:tasks.rados.rados.0.trial187.stdout:1515: finishing copy_from to trial18717860-34 2026-02-13T18:12:01.528 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 601 (ObjNum 417 snap 121 seq_num 417) dirty exists 2026-02-13T18:12:02.425 INFO:tasks.rados.rados.0.trial187.stdout:1515: done (2 left) 2026-02-13T18:12:02.425 INFO:tasks.rados.rados.0.trial187.stdout:1516: done (1 left) 2026-02-13T18:12:02.425 INFO:tasks.rados.rados.0.trial187.stdout:1517: done (0 left) 2026-02-13T18:12:02.425 INFO:tasks.rados.rados.0.trial187.stdout:1518: read oid 10 snap -1 2026-02-13T18:12:02.425 INFO:tasks.rados.rados.0.trial187.stdout:1518: expect (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:12:02.426 INFO:tasks.rados.rados.0.trial187.stdout:1519: snap_remove snap 159 2026-02-13T18:12:03.426 INFO:tasks.rados.rados.0.trial187.stdout:1519: done (1 left) 2026-02-13T18:12:03.426 INFO:tasks.rados.rados.0.trial187.stdout:1520: snap_create 2026-02-13T18:12:03.426 INFO:tasks.rados.rados.0.trial187.stdout:1518: expect (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1518: done (1 left) 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1520: done (0 left) 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1521: read oid 25 snap -1 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1521: expect (ObjNum 518 snap 159 seq_num 518) 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1522: copy_from oid 31 from oid 7 current snap is 161 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1523: read oid 40 snap -1 2026-02-13T18:12:04.427 INFO:tasks.rados.rados.0.trial187.stdout:1523: expect deleted 2026-02-13T18:12:04.428 INFO:tasks.rados.rados.0.trial187.stdout:1524: snap_create 2026-02-13T18:12:04.430 INFO:tasks.rados.rados.0.trial187.stdout:1522: finishing copy_from to trial18717860-31 2026-02-13T18:12:04.430 INFO:tasks.rados.rados.0.trial187.stdout:1522: got expected ENOENT (src dne) 2026-02-13T18:12:04.431 INFO:tasks.rados.rados.0.trial187.stdout:1522: finishing copy_from racing read to trial18717860-31 2026-02-13T18:12:04.436 INFO:tasks.rados.rados.0.trial187.stdout:1521: expect (ObjNum 518 snap 159 seq_num 518) 2026-02-13T18:12:04.495 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 552838 2026-02-13T18:12:04.551 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2230893 2026-02-13T18:12:05.429 INFO:tasks.rados.rados.0.trial187.stdout:1521: done (3 left) 2026-02-13T18:12:05.430 INFO:tasks.rados.rados.0.trial187.stdout:1522: done (2 left) 2026-02-13T18:12:05.430 INFO:tasks.rados.rados.0.trial187.stdout:1523: done (1 left) 2026-02-13T18:12:05.430 INFO:tasks.rados.rados.0.trial187.stdout:1524: done (0 left) 2026-02-13T18:12:05.430 INFO:tasks.rados.rados.0.trial187.stdout:1525: snap_create 2026-02-13T18:12:06.424 INFO:tasks.rados.rados.0.trial187.stdout:1525: done (0 left) 2026-02-13T18:12:06.424 INFO:tasks.rados.rados.0.trial187.stdout:1526: snap_create 2026-02-13T18:12:07.425 INFO:tasks.rados.rados.0.trial187.stdout:1526: done (0 left) 2026-02-13T18:12:07.426 INFO:tasks.rados.rados.0.trial187.stdout:1527: read oid 32 snap -1 2026-02-13T18:12:07.426 INFO:tasks.rados.rados.0.trial187.stdout:1527: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:12:07.426 INFO:tasks.rados.rados.0.trial187.stdout:1528: write oid 33 current snap is 164 2026-02-13T18:12:07.426 INFO:tasks.rados.rados.0.trial187.stdout:1528: seq_num 521 ranges {756447=716733,1887942=537832} 2026-02-13T18:12:07.435 INFO:tasks.rados.rados.0.trial187.stdout:1528: writing trial18717860-33 from 756447 to 1473180 tid 1 2026-02-13T18:12:07.442 INFO:tasks.rados.rados.0.trial187.stdout:1528: writing trial18717860-33 from 1887942 to 2425774 tid 2 2026-02-13T18:12:07.442 INFO:tasks.rados.rados.0.trial187.stdout:1529: snap_remove snap 163 2026-02-13T18:12:08.439 INFO:tasks.rados.rados.0.trial187.stdout:1529: done (2 left) 2026-02-13T18:12:08.439 INFO:tasks.rados.rados.0.trial187.stdout:1530: snap_remove snap 161 2026-02-13T18:12:09.440 INFO:tasks.rados.rados.0.trial187.stdout:1530: done (2 left) 2026-02-13T18:12:09.440 INFO:tasks.rados.rados.0.trial187.stdout:1531: read oid 25 snap 162 2026-02-13T18:12:09.440 INFO:tasks.rados.rados.0.trial187.stdout:1531: expect (ObjNum 518 snap 159 seq_num 518) 2026-02-13T18:12:09.440 INFO:tasks.rados.rados.0.trial187.stdout:1532: delete oid 9 current snap is 164 2026-02-13T18:12:09.440 INFO:tasks.rados.rados.0.trial187.stdout:1527: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:12:09.487 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 884395 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: finishing write tid 1 to trial18717860-33 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: finishing write tid 2 to trial18717860-33 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: finishing write tid 3 to trial18717860-33 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: finishing write tid 4 to trial18717860-33 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: oid 33 updating version 0 to 783 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: oid 33 updating version 783 to 785 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: oid 33 version 785 is already newer than 784 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 785 (ObjNum 521 snap 164 seq_num 521) dirty exists 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1528: left oid 33 (ObjNum 521 snap 164 seq_num 521) 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:1531: expect (ObjNum 518 snap 159 seq_num 518) 2026-02-13T18:12:09.523 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:09.621 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2319930 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1527: done (3 left) 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1528: done (2 left) 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1531: done (1 left) 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1532: done (0 left) 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1533: read oid 47 snap -1 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1533: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1534: read oid 9 snap -1 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1534: expect deleted 2026-02-13T18:12:09.629 INFO:tasks.rados.rados.0.trial187.stdout:1535: delete oid 37 current snap is 164 2026-02-13T18:12:09.630 INFO:tasks.rados.rados.0.trial187.stdout:1534: done (2 left) 2026-02-13T18:12:09.630 INFO:tasks.rados.rados.0.trial187.stdout:1535: done (1 left) 2026-02-13T18:12:09.630 INFO:tasks.rados.rados.0.trial187.stdout:1536: copy_from oid 48 from oid 40 current snap is 164 2026-02-13T18:12:09.630 INFO:tasks.rados.rados.0.trial187.stdout:1537: write oid 42 current snap is 164 2026-02-13T18:12:09.630 INFO:tasks.rados.rados.0.trial187.stdout:1537: seq_num 524 ranges {406868=542480,1547035=401512,2690354=116514} 2026-02-13T18:12:09.637 INFO:tasks.rados.rados.0.trial187.stdout:1537: writing trial18717860-42 from 406868 to 949348 tid 1 2026-02-13T18:12:09.644 INFO:tasks.rados.rados.0.trial187.stdout:1537: writing trial18717860-42 from 1547035 to 1948547 tid 2 2026-02-13T18:12:09.650 INFO:tasks.rados.rados.0.trial187.stdout:1537: writing trial18717860-42 from 2690354 to 2806868 tid 3 2026-02-13T18:12:09.650 INFO:tasks.rados.rados.0.trial187.stdout:1538: write (excl) oid 22 current snap is 164 2026-02-13T18:12:09.650 INFO:tasks.rados.rados.0.trial187.stdout:1536: finishing copy_from to trial18717860-48 2026-02-13T18:12:09.650 INFO:tasks.rados.rados.0.trial187.stdout:1536: got expected ENOENT (src dne) 2026-02-13T18:12:09.650 INFO:tasks.rados.rados.0.trial187.stdout:1536: finishing copy_from racing read to trial18717860-48 2026-02-13T18:12:09.650 INFO:tasks.rados.rados.0.trial187.stdout:1538: seq_num 525 ranges {423675=734082,1721870=545170,2717777=105898} 2026-02-13T18:12:09.658 INFO:tasks.rados.rados.0.trial187.stdout:1538: writing trial18717860-22 from 423675 to 1157757 tid 1 2026-02-13T18:12:09.666 INFO:tasks.rados.rados.0.trial187.stdout:1538: writing trial18717860-22 from 1721870 to 2267040 tid 2 2026-02-13T18:12:09.670 INFO:tasks.rados.rados.0.trial187.stdout:1538: writing trial18717860-22 from 2717777 to 2823675 tid 3 2026-02-13T18:12:09.670 INFO:tasks.rados.rados.0.trial187.stdout:1536: done (3 left) 2026-02-13T18:12:09.670 INFO:tasks.rados.rados.0.trial187.stdout:1539: read oid 14 snap -1 2026-02-13T18:12:09.670 INFO:tasks.rados.rados.0.trial187.stdout:1539: expect (ObjNum 446 snap 129 seq_num 446) 2026-02-13T18:12:09.670 INFO:tasks.rados.rados.0.trial187.stdout:1533: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:12:09.780 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:09.841 INFO:tasks.rados.rados.0.trial187.stdout:1537: finishing write tid 1 to trial18717860-42 2026-02-13T18:12:09.841 INFO:tasks.rados.rados.0.trial187.stdout:1537: finishing write tid 2 to trial18717860-42 2026-02-13T18:12:09.841 INFO:tasks.rados.rados.0.trial187.stdout:1537: finishing write tid 3 to trial18717860-42 2026-02-13T18:12:09.841 INFO:tasks.rados.rados.0.trial187.stdout:1537: finishing write tid 4 to trial18717860-42 2026-02-13T18:12:09.841 INFO:tasks.rados.rados.0.trial187.stdout:1537: finishing write tid 5 to trial18717860-42 2026-02-13T18:12:09.841 INFO:tasks.rados.rados.0.trial187.stdout:1537: oid 42 updating version 0 to 423 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1537: oid 42 updating version 423 to 425 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1537: oid 42 version 425 is already newer than 424 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1537: oid 42 updating version 425 to 426 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 426 (ObjNum 524 snap 164 seq_num 524) dirty exists 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1537: left oid 42 (ObjNum 524 snap 164 seq_num 524) 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: finishing write tid 1 to trial18717860-22 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: finishing write tid 2 to trial18717860-22 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: finishing write tid 3 to trial18717860-22 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: finishing write tid 4 to trial18717860-22 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1533: done (3 left) 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1537: done (2 left) 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1540: read oid 40 snap -1 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1540: expect deleted 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1541: snap_create 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: finishing write tid 5 to trial18717860-22 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: oid 22 updating version 0 to 795 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: oid 22 version 795 is already newer than 794 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: oid 22 version 795 is already newer than 792 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: oid 22 version 795 is already newer than 793 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 795 (ObjNum 525 snap 164 seq_num 525) dirty exists 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1538: left oid 22 (ObjNum 525 snap 164 seq_num 525) 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1539: expect (ObjNum 446 snap 129 seq_num 446) 2026-02-13T18:12:09.842 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:09.903 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 296398 2026-02-13T18:12:10.443 INFO:tasks.rados.rados.0.trial187.stdout:1538: done (3 left) 2026-02-13T18:12:10.443 INFO:tasks.rados.rados.0.trial187.stdout:1539: done (2 left) 2026-02-13T18:12:10.443 INFO:tasks.rados.rados.0.trial187.stdout:1540: done (1 left) 2026-02-13T18:12:10.443 INFO:tasks.rados.rados.0.trial187.stdout:1541: done (0 left) 2026-02-13T18:12:10.443 INFO:tasks.rados.rados.0.trial187.stdout:1542: delete oid 7 current snap is 165 2026-02-13T18:12:10.444 INFO:tasks.rados.rados.0.trial187.stdout:1542: done (0 left) 2026-02-13T18:12:10.444 INFO:tasks.rados.rados.0.trial187.stdout:1543: write oid 35 current snap is 165 2026-02-13T18:12:10.444 INFO:tasks.rados.rados.0.trial187.stdout:1543: seq_num 527 ranges {457289=484580,1438834=548839,2772623=84666} 2026-02-13T18:12:10.451 INFO:tasks.rados.rados.0.trial187.stdout:1543: writing trial18717860-35 from 457289 to 941869 tid 1 2026-02-13T18:12:10.458 INFO:tasks.rados.rados.0.trial187.stdout:1543: writing trial18717860-35 from 1438834 to 1987673 tid 2 2026-02-13T18:12:10.464 INFO:tasks.rados.rados.0.trial187.stdout:1543: writing trial18717860-35 from 2772623 to 2857289 tid 3 2026-02-13T18:12:10.464 INFO:tasks.rados.rados.0.trial187.stdout:1544: write oid 28 current snap is 165 2026-02-13T18:12:10.464 INFO:tasks.rados.rados.0.trial187.stdout:1544: seq_num 528 ranges {474096=559829,1780963=408850,2800046=74050} 2026-02-13T18:12:10.471 INFO:tasks.rados.rados.0.trial187.stdout:1544: writing trial18717860-28 from 474096 to 1033925 tid 1 2026-02-13T18:12:10.479 INFO:tasks.rados.rados.0.trial187.stdout:1544: writing trial18717860-28 from 1780963 to 2189813 tid 2 2026-02-13T18:12:10.484 INFO:tasks.rados.rados.0.trial187.stdout:1544: writing trial18717860-28 from 2800046 to 2874096 tid 3 2026-02-13T18:12:10.484 INFO:tasks.rados.rados.0.trial187.stdout:1545: write (excl) oid 22 current snap is 165 2026-02-13T18:12:10.484 INFO:tasks.rados.rados.0.trial187.stdout:1545: seq_num 529 ranges {490903=635078,1839445=552508} 2026-02-13T18:12:10.491 INFO:tasks.rados.rados.0.trial187.stdout:1545: writing trial18717860-22 from 490903 to 1125981 tid 1 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1545: writing trial18717860-22 from 1839445 to 2391953 tid 2 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1546: delete oid 25 current snap is 165 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: finishing write tid 1 to trial18717860-35 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: finishing write tid 2 to trial18717860-35 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: finishing write tid 3 to trial18717860-35 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: finishing write tid 4 to trial18717860-35 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: finishing write tid 5 to trial18717860-35 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: oid 35 updating version 0 to 783 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: oid 35 version 783 is already newer than 781 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: oid 35 version 783 is already newer than 782 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: oid 35 version 783 is already newer than 780 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 783 (ObjNum 527 snap 165 seq_num 527) dirty exists 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1543: left oid 35 (ObjNum 527 snap 165 seq_num 527) 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: finishing write tid 1 to trial18717860-28 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: finishing write tid 2 to trial18717860-28 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: finishing write tid 3 to trial18717860-28 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: finishing write tid 4 to trial18717860-28 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: finishing write tid 5 to trial18717860-28 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: oid 28 updating version 0 to 756 2026-02-13T18:12:10.496 INFO:tasks.rados.rados.0.trial187.stdout:1544: oid 28 updating version 756 to 758 2026-02-13T18:12:10.497 INFO:tasks.rados.rados.0.trial187.stdout:1544: oid 28 version 758 is already newer than 755 2026-02-13T18:12:10.497 INFO:tasks.rados.rados.0.trial187.stdout:1544: oid 28 version 758 is already newer than 757 2026-02-13T18:12:10.497 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 758 (ObjNum 528 snap 165 seq_num 528) dirty exists 2026-02-13T18:12:10.497 INFO:tasks.rados.rados.0.trial187.stdout:1544: left oid 28 (ObjNum 528 snap 165 seq_num 528) 2026-02-13T18:12:10.497 INFO:tasks.rados.rados.0.trial187.stdout:1545: finishing write tid 1 to trial18717860-22 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1543: done (3 left) 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1544: done (2 left) 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1546: done (1 left) 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1547: read oid 21 snap -1 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1547: expect (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1548: read oid 10 snap -1 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1548: expect (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1549: read oid 15 snap 156 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1549: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1550: delete oid 9 current snap is 165 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: finishing write tid 2 to trial18717860-22 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: finishing write tid 3 to trial18717860-22 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: finishing write tid 4 to trial18717860-22 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: oid 22 updating version 0 to 798 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: oid 22 updating version 798 to 799 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: oid 22 version 799 is already newer than 797 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 799 (ObjNum 529 snap 165 seq_num 529) dirty exists 2026-02-13T18:12:10.499 INFO:tasks.rados.rados.0.trial187.stdout:1545: left oid 22 (ObjNum 529 snap 165 seq_num 529) 2026-02-13T18:12:10.501 INFO:tasks.rados.rados.0.trial187.stdout:1549: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:12:10.515 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2093895 2026-02-13T18:12:10.549 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1403292 2026-02-13T18:12:10.559 INFO:tasks.rados.rados.0.trial187.stdout:1547: expect (ObjNum 459 snap 134 seq_num 459) 2026-02-13T18:12:10.626 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:10.751 INFO:tasks.rados.rados.0.trial187.stdout:1548: expect (ObjNum 434 snap 125 seq_num 434) 2026-02-13T18:12:10.762 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2028435 2026-02-13T18:12:10.776 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:10.832 INFO:tasks.rados.rados.0.trial187.stdout:1545: done (4 left) 2026-02-13T18:12:10.832 INFO:tasks.rados.rados.0.trial187.stdout:1547: done (3 left) 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1548: done (2 left) 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1549: done (1 left) 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1550: done (0 left) 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1551: read oid 31 snap -1 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1551: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1552: read oid 12 snap -1 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1552: expect deleted 2026-02-13T18:12:10.833 INFO:tasks.rados.rados.0.trial187.stdout:1553: snap_create 2026-02-13T18:12:10.839 INFO:tasks.rados.rados.0.trial187.stdout:1551: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:12:10.868 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:11.424 INFO:tasks.rados.rados.0.trial187.stdout:1551: done (2 left) 2026-02-13T18:12:11.424 INFO:tasks.rados.rados.0.trial187.stdout:1552: done (1 left) 2026-02-13T18:12:11.425 INFO:tasks.rados.rados.0.trial187.stdout:1553: done (0 left) 2026-02-13T18:12:11.425 INFO:tasks.rados.rados.0.trial187.stdout:1554: snap_remove snap 165 2026-02-13T18:12:12.425 INFO:tasks.rados.rados.0.trial187.stdout:1554: done (0 left) 2026-02-13T18:12:12.425 INFO:tasks.rados.rados.0.trial187.stdout:1555: snap_create 2026-02-13T18:12:13.426 INFO:tasks.rados.rados.0.trial187.stdout:1555: done (0 left) 2026-02-13T18:12:13.426 INFO:tasks.rados.rados.0.trial187.stdout:1556: copy_from oid 22 from oid 12 current snap is 167 2026-02-13T18:12:13.426 INFO:tasks.rados.rados.0.trial187.stdout:1557: snap_remove snap 154 2026-02-13T18:12:14.431 INFO:tasks.rados.rados.0.trial187.stdout:1557: done (1 left) 2026-02-13T18:12:14.432 INFO:tasks.rados.rados.0.trial187.stdout:1558: delete oid 35 current snap is 167 2026-02-13T18:12:14.432 INFO:tasks.rados.rados.0.trial187.stdout:1556: finishing copy_from to trial18717860-22 2026-02-13T18:12:14.432 INFO:tasks.rados.rados.0.trial187.stdout:1556: got expected ENOENT (src dne) 2026-02-13T18:12:14.432 INFO:tasks.rados.rados.0.trial187.stdout:1556: finishing copy_from racing read to trial18717860-22 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:1556: done (1 left) 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:1558: done (0 left) 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:1559: rollback oid 26 current snap is 167 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 160 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:1560: read oid 15 snap -1 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:1560: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:12:14.434 INFO:tasks.rados.rados.0.trial187.stdout:1561: snap_remove snap 166 2026-02-13T18:12:15.434 INFO:tasks.rados.rados.0.trial187.stdout:1561: done (2 left) 2026-02-13T18:12:15.434 INFO:tasks.rados.rados.0.trial187.stdout:1562: write (excl) oid 22 current snap is 167 2026-02-13T18:12:15.434 INFO:tasks.rados.rados.0.trial187.stdout:1562: seq_num 533 ranges {558131=652427,1673373=559846,2820808=137323} 2026-02-13T18:12:15.442 INFO:tasks.rados.rados.0.trial187.stdout:1562: writing trial18717860-22 from 558131 to 1210558 tid 1 2026-02-13T18:12:15.449 INFO:tasks.rados.rados.0.trial187.stdout:1562: writing trial18717860-22 from 1673373 to 2233219 tid 2 2026-02-13T18:12:15.454 INFO:tasks.rados.rados.0.trial187.stdout:1562: writing trial18717860-22 from 2820808 to 2958131 tid 3 2026-02-13T18:12:15.454 INFO:tasks.rados.rados.0.trial187.stdout:1563: snap_remove snap 157 2026-02-13T18:12:16.426 INFO:tasks.rados.rados.0.trial187.stdout:1563: done (3 left) 2026-02-13T18:12:16.426 INFO:tasks.rados.rados.0.trial187.stdout:1564: read oid 13 snap -1 2026-02-13T18:12:16.426 INFO:tasks.rados.rados.0.trial187.stdout:1564: expect (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:12:16.426 INFO:tasks.rados.rados.0.trial187.stdout:1565: write (excl) oid 3 current snap is 167 2026-02-13T18:12:16.426 INFO:tasks.rados.rados.0.trial187.stdout:1565: seq_num 534 ranges {574938=727676,1731855=703504,2848231=126707} 2026-02-13T18:12:16.434 INFO:tasks.rados.rados.0.trial187.stdout:1565: writing trial18717860-3 from 574938 to 1302614 tid 1 2026-02-13T18:12:16.442 INFO:tasks.rados.rados.0.trial187.stdout:1565: writing trial18717860-3 from 1731855 to 2435359 tid 2 2026-02-13T18:12:16.445 INFO:tasks.rados.rados.0.trial187.stdout:1565: writing trial18717860-3 from 2848231 to 2974938 tid 3 2026-02-13T18:12:16.445 INFO:tasks.rados.rados.0.trial187.stdout:1566: snap_create 2026-02-13T18:12:16.446 INFO:tasks.rados.rados.0.trial187.stdout:1559: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:12:16.446 INFO:tasks.rados.rados.0.trial187.stdout:1560: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:12:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1559: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:12:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1559: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:12:16.514 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 739 (ObjNum 519 snap 159 seq_num 519) dirty exists 2026-02-13T18:12:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1562: finishing write tid 1 to trial18717860-22 2026-02-13T18:12:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1562: finishing write tid 2 to trial18717860-22 2026-02-13T18:12:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1562: finishing write tid 3 to trial18717860-22 2026-02-13T18:12:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1562: finishing write tid 4 to trial18717860-22 2026-02-13T18:12:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1562: finishing write tid 5 to trial18717860-22 2026-02-13T18:12:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1562: oid 22 updating version 0 to 809 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:1562: oid 22 version 809 is already newer than 806 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:1562: oid 22 version 809 is already newer than 808 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:1562: oid 22 version 809 is already newer than 807 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 809 (ObjNum 533 snap 167 seq_num 533) dirty exists 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:1562: left oid 22 (ObjNum 533 snap 167 seq_num 533) 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:1564: expect (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:12:16.516 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:16.548 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1369608 2026-02-13T18:12:16.587 INFO:tasks.rados.rados.0.trial187.stdout:1565: finishing write tid 1 to trial18717860-3 2026-02-13T18:12:16.587 INFO:tasks.rados.rados.0.trial187.stdout:1565: finishing write tid 2 to trial18717860-3 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: finishing write tid 3 to trial18717860-3 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: finishing write tid 4 to trial18717860-3 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: finishing write tid 5 to trial18717860-3 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: oid 3 updating version 0 to 747 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: oid 3 updating version 747 to 750 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: oid 3 version 750 is already newer than 748 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: oid 3 version 750 is already newer than 749 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 750 (ObjNum 534 snap 167 seq_num 534) dirty exists 2026-02-13T18:12:16.588 INFO:tasks.rados.rados.0.trial187.stdout:1565: left oid 3 (ObjNum 534 snap 167 seq_num 534) 2026-02-13T18:12:17.440 INFO:tasks.rados.rados.0.trial187.stdout:1559: done (5 left) 2026-02-13T18:12:17.441 INFO:tasks.rados.rados.0.trial187.stdout:1560: done (4 left) 2026-02-13T18:12:17.441 INFO:tasks.rados.rados.0.trial187.stdout:1562: done (3 left) 2026-02-13T18:12:17.441 INFO:tasks.rados.rados.0.trial187.stdout:1564: done (2 left) 2026-02-13T18:12:17.441 INFO:tasks.rados.rados.0.trial187.stdout:1565: done (1 left) 2026-02-13T18:12:17.441 INFO:tasks.rados.rados.0.trial187.stdout:1566: done (0 left) 2026-02-13T18:12:17.442 INFO:tasks.rados.rados.0.trial187.stdout:1567: read oid 35 snap 167 2026-02-13T18:12:17.442 INFO:tasks.rados.rados.0.trial187.stdout:1567: expect deleted 2026-02-13T18:12:17.442 INFO:tasks.rados.rados.0.trial187.stdout:1568: read oid 4 snap 160 2026-02-13T18:12:17.442 INFO:tasks.rados.rados.0.trial187.stdout:1568: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:12:17.442 INFO:tasks.rados.rados.0.trial187.stdout:1569: rollback oid 12 current snap is 168 2026-02-13T18:12:17.442 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 160 2026-02-13T18:12:17.443 INFO:tasks.rados.rados.0.trial187.stdout:1570: copy_from oid 49 from oid 36 current snap is 168 2026-02-13T18:12:17.443 INFO:tasks.rados.rados.0.trial187.stdout:1571: rollback oid 26 current snap is 168 2026-02-13T18:12:17.443 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 164 2026-02-13T18:12:17.443 INFO:tasks.rados.rados.0.trial187.stdout:1572: write oid 22 current snap is 168 2026-02-13T18:12:17.443 INFO:tasks.rados.rados.0.trial187.stdout:1572: seq_num 535 ranges {591745=402925,1790337=563515} 2026-02-13T18:12:17.447 INFO:tasks.rados.rados.0.trial187.stdout:1572: writing trial18717860-22 from 591745 to 994670 tid 1 2026-02-13T18:12:17.457 INFO:tasks.rados.rados.0.trial187.stdout:1572: writing trial18717860-22 from 1790337 to 2353852 tid 2 2026-02-13T18:12:17.457 INFO:tasks.rados.rados.0.trial187.stdout:1573: read oid 23 snap -1 2026-02-13T18:12:17.457 INFO:tasks.rados.rados.0.trial187.stdout:1573: expect (ObjNum 485 snap 146 seq_num 485) 2026-02-13T18:12:17.457 INFO:tasks.rados.rados.0.trial187.stdout:1574: snap_remove snap 158 2026-02-13T18:12:18.637 INFO:tasks.rados.rados.0.trial187.stdout:1574: done (7 left) 2026-02-13T18:12:18.638 INFO:tasks.rados.rados.0.trial187.stdout:1575: snap_remove snap 162 2026-02-13T18:12:19.638 INFO:tasks.rados.rados.0.trial187.stdout:1575: done (7 left) 2026-02-13T18:12:19.638 INFO:tasks.rados.rados.0.trial187.stdout:1576: write (excl) oid 41 current snap is 168 2026-02-13T18:12:19.638 INFO:tasks.rados.rados.0.trial187.stdout:1576: seq_num 536 ranges {608552=478174,1848819=707173} 2026-02-13T18:12:19.646 INFO:tasks.rados.rados.0.trial187.stdout:1576: writing trial18717860-41 from 608552 to 1086726 tid 1 2026-02-13T18:12:19.656 INFO:tasks.rados.rados.0.trial187.stdout:1576: writing trial18717860-41 from 1848819 to 2555992 tid 2 2026-02-13T18:12:19.656 INFO:tasks.rados.rados.0.trial187.stdout:1577: read oid 18 snap -1 2026-02-13T18:12:19.656 INFO:tasks.rados.rados.0.trial187.stdout:1577: expect deleted 2026-02-13T18:12:19.656 INFO:tasks.rados.rados.0.trial187.stdout:1578: snap_remove snap 155 2026-02-13T18:12:20.643 INFO:tasks.rados.rados.0.trial187.stdout:1578: done (9 left) 2026-02-13T18:12:20.643 INFO:tasks.rados.rados.0.trial187.stdout:1579: rollback oid 6 current snap is 168 2026-02-13T18:12:20.643 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 156 2026-02-13T18:12:20.643 INFO:tasks.rados.rados.0.trial187.stdout:1569: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:12:20.643 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 0 (ObjNum 33 snap 0 seq_num 3013701024) dirty dne 2026-02-13T18:12:20.643 INFO:tasks.rados.rados.0.trial187.stdout:1568: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:12:20.752 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2178047 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1571: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1571: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1571: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 754 (ObjNum 519 snap 159 seq_num 519) dirty exists 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1572: finishing write tid 1 to trial18717860-22 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1570: finishing copy_from racing read to trial18717860-49 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1567: done (9 left) 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1568: done (8 left) 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1569: done (7 left) 2026-02-13T18:12:20.769 INFO:tasks.rados.rados.0.trial187.stdout:1571: done (6 left) 2026-02-13T18:12:20.770 INFO:tasks.rados.rados.0.trial187.stdout:1580: write (excl) oid 43 current snap is 168 2026-02-13T18:12:20.770 INFO:tasks.rados.rados.0.trial187.stdout:1580: seq_num 537 ranges {625359=553423,1790948=567184,2930500=94859} 2026-02-13T18:12:20.776 INFO:tasks.rados.rados.0.trial187.stdout:1580: writing trial18717860-43 from 625359 to 1178782 tid 1 2026-02-13T18:12:20.785 INFO:tasks.rados.rados.0.trial187.stdout:1580: writing trial18717860-43 from 1790948 to 2358132 tid 2 2026-02-13T18:12:20.790 INFO:tasks.rados.rados.0.trial187.stdout:1580: writing trial18717860-43 from 2930500 to 3025359 tid 3 2026-02-13T18:12:20.790 INFO:tasks.rados.rados.0.trial187.stdout:1581: rollback oid 2 current snap is 168 2026-02-13T18:12:20.790 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 164 2026-02-13T18:12:20.790 INFO:tasks.rados.rados.0.trial187.stdout:1570: finishing copy_from to trial18717860-49 2026-02-13T18:12:20.790 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 530 (ObjNum 508 snap 154 seq_num 508) dirty exists 2026-02-13T18:12:20.790 INFO:tasks.rados.rados.0.trial187.stdout:1573: expect (ObjNum 485 snap 146 seq_num 485) 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:1572: finishing write tid 2 to trial18717860-22 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:1572: finishing write tid 3 to trial18717860-22 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:1572: finishing write tid 4 to trial18717860-22 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:1572: oid 22 updating version 0 to 819 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:1572: oid 22 version 819 is already newer than 817 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:1572: oid 22 version 819 is already newer than 818 2026-02-13T18:12:20.859 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 819 (ObjNum 535 snap 168 seq_num 535) dirty exists 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1572: left oid 22 (ObjNum 535 snap 168 seq_num 535) 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: finishing write tid 1 to trial18717860-41 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: finishing write tid 2 to trial18717860-41 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: finishing write tid 3 to trial18717860-41 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: finishing write tid 4 to trial18717860-41 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: oid 41 updating version 0 to 438 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: oid 41 updating version 438 to 439 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: oid 41 updating version 439 to 440 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 440 (ObjNum 536 snap 168 seq_num 536) dirty exists 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1576: left oid 41 (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1579: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:12:20.860 INFO:tasks.rados.rados.0.trial187.stdout:1579: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1579: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 761 (ObjNum 477 snap 141 seq_num 477) dirty exists 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1580: finishing write tid 1 to trial18717860-43 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1580: finishing write tid 2 to trial18717860-43 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1570: done (7 left) 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1572: done (6 left) 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1573: done (5 left) 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1576: done (4 left) 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1577: done (3 left) 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1579: done (2 left) 2026-02-13T18:12:20.861 INFO:tasks.rados.rados.0.trial187.stdout:1582: snap_remove snap 160 2026-02-13T18:12:21.426 INFO:tasks.rados.rados.0.trial187.stdout:1582: done (2 left) 2026-02-13T18:12:21.426 INFO:tasks.rados.rados.0.trial187.stdout:1583: write (excl) oid 7 current snap is 168 2026-02-13T18:12:21.426 INFO:tasks.rados.rados.0.trial187.stdout:1583: seq_num 538 ranges {642166=628672,1849430=710842} 2026-02-13T18:12:21.434 INFO:tasks.rados.rados.0.trial187.stdout:1583: writing trial18717860-7 from 642166 to 1270838 tid 1 2026-02-13T18:12:21.444 INFO:tasks.rados.rados.0.trial187.stdout:1583: writing trial18717860-7 from 1849430 to 2560272 tid 2 2026-02-13T18:12:21.444 INFO:tasks.rados.rados.0.trial187.stdout:1584: read oid 18 snap -1 2026-02-13T18:12:21.444 INFO:tasks.rados.rados.0.trial187.stdout:1584: expect deleted 2026-02-13T18:12:21.444 INFO:tasks.rados.rados.0.trial187.stdout:1585: delete oid 50 current snap is 168 2026-02-13T18:12:21.444 INFO:tasks.rados.rados.0.trial187.stdout:1581: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: finishing write tid 3 to trial18717860-43 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1581: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: finishing write tid 4 to trial18717860-43 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1581: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 459 (ObjNum 486 snap 146 seq_num 486) dirty exists 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: finishing write tid 5 to trial18717860-43 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: oid 43 updating version 0 to 838 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: oid 43 version 838 is already newer than 835 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: oid 43 version 838 is already newer than 836 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:1580: oid 43 version 838 is already newer than 837 2026-02-13T18:12:21.445 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:12:21.446 INFO:tasks.rados.rados.0.trial187.stdout:1580: left oid 43 (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:12:21.446 INFO:tasks.rados.rados.0.trial187.stdout:1583: finishing write tid 1 to trial18717860-7 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1580: done (4 left) 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1581: done (3 left) 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1585: done (2 left) 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1586: copy_from oid 2 from oid 40 current snap is 168 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1587: read oid 15 snap -1 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1587: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1588: snap_create 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1583: finishing write tid 2 to trial18717860-7 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1583: finishing write tid 3 to trial18717860-7 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1583: finishing write tid 4 to trial18717860-7 2026-02-13T18:12:21.447 INFO:tasks.rados.rados.0.trial187.stdout:1583: oid 7 updating version 0 to 590 2026-02-13T18:12:21.448 INFO:tasks.rados.rados.0.trial187.stdout:1583: oid 7 version 590 is already newer than 589 2026-02-13T18:12:21.448 INFO:tasks.rados.rados.0.trial187.stdout:1583: oid 7 version 590 is already newer than 588 2026-02-13T18:12:21.448 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 590 (ObjNum 538 snap 168 seq_num 538) dirty exists 2026-02-13T18:12:21.448 INFO:tasks.rados.rados.0.trial187.stdout:1583: left oid 7 (ObjNum 538 snap 168 seq_num 538) 2026-02-13T18:12:21.448 INFO:tasks.rados.rados.0.trial187.stdout:1586: finishing copy_from to trial18717860-2 2026-02-13T18:12:21.448 INFO:tasks.rados.rados.0.trial187.stdout:1586: got expected ENOENT (src dne) 2026-02-13T18:12:21.449 INFO:tasks.rados.rados.0.trial187.stdout:1586: finishing copy_from racing read to trial18717860-2 2026-02-13T18:12:21.449 INFO:tasks.rados.rados.0.trial187.stdout:1587: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:12:21.449 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:21.479 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:21.506 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 786647 2026-02-13T18:12:22.427 INFO:tasks.rados.rados.0.trial187.stdout:1583: done (4 left) 2026-02-13T18:12:22.427 INFO:tasks.rados.rados.0.trial187.stdout:1584: done (3 left) 2026-02-13T18:12:22.427 INFO:tasks.rados.rados.0.trial187.stdout:1586: done (2 left) 2026-02-13T18:12:22.428 INFO:tasks.rados.rados.0.trial187.stdout:1587: done (1 left) 2026-02-13T18:12:22.428 INFO:tasks.rados.rados.0.trial187.stdout:1588: done (0 left) 2026-02-13T18:12:22.428 INFO:tasks.rados.rados.0.trial187.stdout:1589: read oid 33 snap -1 2026-02-13T18:12:22.428 INFO:tasks.rados.rados.0.trial187.stdout:1589: expect (ObjNum 521 snap 164 seq_num 521) 2026-02-13T18:12:22.428 INFO:tasks.rados.rados.0.trial187.stdout:1590: snap_create 2026-02-13T18:12:22.436 INFO:tasks.rados.rados.0.trial187.stdout:1589: expect (ObjNum 521 snap 164 seq_num 521) 2026-02-13T18:12:22.436 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:23.586 INFO:tasks.rados.rados.0.trial187.stdout:1589: done (1 left) 2026-02-13T18:12:23.586 INFO:tasks.rados.rados.0.trial187.stdout:1590: done (0 left) 2026-02-13T18:12:23.586 INFO:tasks.rados.rados.0.trial187.stdout:1591: snap_create 2026-02-13T18:12:24.586 INFO:tasks.rados.rados.0.trial187.stdout:1591: done (0 left) 2026-02-13T18:12:24.587 INFO:tasks.rados.rados.0.trial187.stdout:1592: snap_create 2026-02-13T18:12:25.587 INFO:tasks.rados.rados.0.trial187.stdout:1592: done (0 left) 2026-02-13T18:12:25.587 INFO:tasks.rados.rados.0.trial187.stdout:1593: write (excl) oid 36 current snap is 172 2026-02-13T18:12:25.587 INFO:tasks.rados.rados.0.trial187.stdout:1593: seq_num 540 ranges {675780=495523,1682747=714511,3012769=63011} 2026-02-13T18:12:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1593: writing trial18717860-36 from 675780 to 1171303 tid 1 2026-02-13T18:12:25.604 INFO:tasks.rados.rados.0.trial187.stdout:1593: writing trial18717860-36 from 1682747 to 2397258 tid 2 2026-02-13T18:12:25.608 INFO:tasks.rados.rados.0.trial187.stdout:1593: writing trial18717860-36 from 3012769 to 3075780 tid 3 2026-02-13T18:12:25.608 INFO:tasks.rados.rados.0.trial187.stdout:1594: snap_remove snap 164 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1594: done (1 left) 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: finishing write tid 1 to trial18717860-36 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: finishing write tid 2 to trial18717860-36 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: finishing write tid 3 to trial18717860-36 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: finishing write tid 4 to trial18717860-36 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: finishing write tid 5 to trial18717860-36 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: oid 36 updating version 0 to 534 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: oid 36 version 534 is already newer than 531 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: oid 36 version 534 is already newer than 533 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: oid 36 version 534 is already newer than 532 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 534 (ObjNum 540 snap 172 seq_num 540) dirty exists 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: left oid 36 (ObjNum 540 snap 172 seq_num 540) 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1595: read oid 17 snap -1 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1595: expect (ObjNum 520 snap 159 seq_num 520) 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1593: done (1 left) 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1596: read oid 6 snap -1 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1596: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1597: read oid 32 snap -1 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1597: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:12:26.427 INFO:tasks.rados.rados.0.trial187.stdout:1598: snap_create 2026-02-13T18:12:26.429 INFO:tasks.rados.rados.0.trial187.stdout:1597: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:12:26.482 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1790383 2026-02-13T18:12:26.517 INFO:tasks.rados.rados.0.trial187.stdout:1595: expect (ObjNum 520 snap 159 seq_num 520) 2026-02-13T18:12:26.517 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:26.561 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1891548 2026-02-13T18:12:26.566 INFO:tasks.rados.rados.0.trial187.stdout:1596: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:12:26.572 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1267055 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:1595: done (3 left) 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:1596: done (2 left) 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:1597: done (1 left) 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:1598: done (0 left) 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:1599: rollback oid 23 current snap is 173 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 23 to 167 2026-02-13T18:12:27.428 INFO:tasks.rados.rados.0.trial187.stdout:1600: snap_create 2026-02-13T18:12:27.431 INFO:tasks.rados.rados.0.trial187.stdout:1599: finishing rollback tid 0 to trial18717860-23 2026-02-13T18:12:27.431 INFO:tasks.rados.rados.0.trial187.stdout:1599: finishing rollback tid 1 to trial18717860-23 2026-02-13T18:12:27.431 INFO:tasks.rados.rados.0.trial187.stdout:1599: finishing rollback tid 2 to trial18717860-23 2026-02-13T18:12:27.431 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 537 (ObjNum 485 snap 146 seq_num 485) dirty exists 2026-02-13T18:12:28.430 INFO:tasks.rados.rados.0.trial187.stdout:1599: done (1 left) 2026-02-13T18:12:28.430 INFO:tasks.rados.rados.0.trial187.stdout:1600: done (0 left) 2026-02-13T18:12:28.431 INFO:tasks.rados.rados.0.trial187.stdout:1601: read oid 44 snap -1 2026-02-13T18:12:28.431 INFO:tasks.rados.rados.0.trial187.stdout:1601: expect deleted 2026-02-13T18:12:28.431 INFO:tasks.rados.rados.0.trial187.stdout:1602: write oid 17 current snap is 174 2026-02-13T18:12:28.431 INFO:tasks.rados.rados.0.trial187.stdout:1602: seq_num 541 ranges {692587=570772,2024876=574522,3040192=52395} 2026-02-13T18:12:28.439 INFO:tasks.rados.rados.0.trial187.stdout:1602: writing trial18717860-17 from 692587 to 1263359 tid 1 2026-02-13T18:12:28.448 INFO:tasks.rados.rados.0.trial187.stdout:1602: writing trial18717860-17 from 2024876 to 2599398 tid 2 2026-02-13T18:12:28.452 INFO:tasks.rados.rados.0.trial187.stdout:1602: writing trial18717860-17 from 3040192 to 3092587 tid 3 2026-02-13T18:12:28.452 INFO:tasks.rados.rados.0.trial187.stdout:1603: rollback oid 3 current snap is 174 2026-02-13T18:12:28.452 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 156 2026-02-13T18:12:28.452 INFO:tasks.rados.rados.0.trial187.stdout:1602: finishing write tid 1 to trial18717860-17 2026-02-13T18:12:28.452 INFO:tasks.rados.rados.0.trial187.stdout:1601: done (2 left) 2026-02-13T18:12:28.452 INFO:tasks.rados.rados.0.trial187.stdout:1604: rollback oid 20 current snap is 174 2026-02-13T18:12:28.453 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 167 2026-02-13T18:12:28.453 INFO:tasks.rados.rados.0.trial187.stdout:1602: finishing write tid 2 to trial18717860-17 2026-02-13T18:12:28.453 INFO:tasks.rados.rados.0.trial187.stdout:1605: copy_from oid 10 from oid 32 current snap is 174 2026-02-13T18:12:28.453 INFO:tasks.rados.rados.0.trial187.stdout:1606: snap_remove snap 168 2026-02-13T18:12:29.437 INFO:tasks.rados.rados.0.trial187.stdout:1606: done (4 left) 2026-02-13T18:12:29.438 INFO:tasks.rados.rados.0.trial187.stdout:1607: snap_remove snap 171 2026-02-13T18:12:30.440 INFO:tasks.rados.rados.0.trial187.stdout:1607: done (4 left) 2026-02-13T18:12:30.440 INFO:tasks.rados.rados.0.trial187.stdout:1608: write oid 13 current snap is 174 2026-02-13T18:12:30.441 INFO:tasks.rados.rados.0.trial187.stdout:1608: seq_num 542 ranges {709394=646021,2083358=718180} 2026-02-13T18:12:30.449 INFO:tasks.rados.rados.0.trial187.stdout:1608: writing trial18717860-13 from 709394 to 1355415 tid 1 2026-02-13T18:12:30.459 INFO:tasks.rados.rados.0.trial187.stdout:1608: writing trial18717860-13 from 2083358 to 2801538 tid 2 2026-02-13T18:12:30.459 INFO:tasks.rados.rados.0.trial187.stdout:1609: snap_remove snap 173 2026-02-13T18:12:31.427 INFO:tasks.rados.rados.0.trial187.stdout:1609: done (5 left) 2026-02-13T18:12:31.428 INFO:tasks.rados.rados.0.trial187.stdout:1610: write (excl) oid 26 current snap is 174 2026-02-13T18:12:31.428 INFO:tasks.rados.rados.0.trial187.stdout:1610: seq_num 543 ranges {726201=721270,2141840=578191} 2026-02-13T18:12:31.437 INFO:tasks.rados.rados.0.trial187.stdout:1610: writing trial18717860-26 from 726201 to 1447471 tid 1 2026-02-13T18:12:31.446 INFO:tasks.rados.rados.0.trial187.stdout:1610: writing trial18717860-26 from 2141840 to 2720031 tid 2 2026-02-13T18:12:31.446 INFO:tasks.rados.rados.0.trial187.stdout:1611: snap_create 2026-02-13T18:12:31.446 INFO:tasks.rados.rados.0.trial187.stdout:1604: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:12:31.446 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 0 (ObjNum 1457 snap 0 seq_num 1685356848) dirty dne 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: finishing write tid 3 to trial18717860-17 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: finishing write tid 4 to trial18717860-17 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: finishing write tid 5 to trial18717860-17 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: oid 17 updating version 0 to 781 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: oid 17 version 781 is already newer than 779 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: oid 17 version 781 is already newer than 778 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: oid 17 version 781 is already newer than 780 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 781 (ObjNum 541 snap 174 seq_num 541) dirty exists 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1602: left oid 17 (ObjNum 541 snap 174 seq_num 541) 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1603: finishing rollback tid 0 to trial18717860-3 2026-02-13T18:12:31.447 INFO:tasks.rados.rados.0.trial187.stdout:1603: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1603: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 785 (ObjNum 515 snap 156 seq_num 515) dirty exists 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1605: finishing copy_from racing read to trial18717860-10 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1605: finishing copy_from to trial18717860-10 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 748 (ObjNum 490 snap 147 seq_num 490) dirty exists 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: finishing write tid 1 to trial18717860-13 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: finishing write tid 2 to trial18717860-13 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: finishing write tid 3 to trial18717860-13 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: finishing write tid 4 to trial18717860-13 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: oid 13 updating version 0 to 466 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: oid 13 version 466 is already newer than 465 2026-02-13T18:12:31.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: oid 13 updating version 466 to 467 2026-02-13T18:12:31.449 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 467 (ObjNum 542 snap 174 seq_num 542) dirty exists 2026-02-13T18:12:31.449 INFO:tasks.rados.rados.0.trial187.stdout:1608: left oid 13 (ObjNum 542 snap 174 seq_num 542) 2026-02-13T18:12:31.449 INFO:tasks.rados.rados.0.trial187.stdout:1610: finishing write tid 1 to trial18717860-26 2026-02-13T18:12:31.449 INFO:tasks.rados.rados.0.trial187.stdout:1610: finishing write tid 2 to trial18717860-26 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:1610: finishing write tid 3 to trial18717860-26 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:1610: finishing write tid 4 to trial18717860-26 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:1610: oid 26 updating version 0 to 801 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:1610: oid 26 version 801 is already newer than 795 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:1610: oid 26 version 801 is already newer than 800 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 801 (ObjNum 543 snap 174 seq_num 543) dirty exists 2026-02-13T18:12:31.450 INFO:tasks.rados.rados.0.trial187.stdout:1610: left oid 26 (ObjNum 543 snap 174 seq_num 543) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1602: done (6 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1603: done (5 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1604: done (4 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1605: done (3 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1608: done (2 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1610: done (1 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1611: done (0 left) 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1612: read oid 25 snap -1 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1612: expect deleted 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1613: write (excl) oid 9 current snap is 175 2026-02-13T18:12:32.448 INFO:tasks.rados.rados.0.trial187.stdout:1613: seq_num 544 ranges {743008=796519,2200322=721849} 2026-02-13T18:12:32.458 INFO:tasks.rados.rados.0.trial187.stdout:1613: writing trial18717860-9 from 743008 to 1539527 tid 1 2026-02-13T18:12:32.467 INFO:tasks.rados.rados.0.trial187.stdout:1613: writing trial18717860-9 from 2200322 to 2922171 tid 2 2026-02-13T18:12:32.468 INFO:tasks.rados.rados.0.trial187.stdout:1614: rollback oid 47 current snap is 175 2026-02-13T18:12:32.468 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 170 2026-02-13T18:12:32.468 INFO:tasks.rados.rados.0.trial187.stdout:1613: finishing write tid 1 to trial18717860-9 2026-02-13T18:12:32.468 INFO:tasks.rados.rados.0.trial187.stdout:1612: done (2 left) 2026-02-13T18:12:32.468 INFO:tasks.rados.rados.0.trial187.stdout:1615: copy_from oid 15 from oid 12 current snap is 175 2026-02-13T18:12:32.468 INFO:tasks.rados.rados.0.trial187.stdout:1616: snap_create 2026-02-13T18:12:32.469 INFO:tasks.rados.rados.0.trial187.stdout:1613: finishing write tid 2 to trial18717860-9 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:1613: finishing write tid 3 to trial18717860-9 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:1613: finishing write tid 4 to trial18717860-9 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:1613: oid 9 updating version 0 to 804 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:1613: oid 9 version 804 is already newer than 803 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:1613: oid 9 version 804 is already newer than 802 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 804 (ObjNum 544 snap 175 seq_num 544) dirty exists 2026-02-13T18:12:32.470 INFO:tasks.rados.rados.0.trial187.stdout:1613: left oid 9 (ObjNum 544 snap 175 seq_num 544) 2026-02-13T18:12:32.471 INFO:tasks.rados.rados.0.trial187.stdout:1615: finishing copy_from to trial18717860-15 2026-02-13T18:12:32.471 INFO:tasks.rados.rados.0.trial187.stdout:1615: got expected ENOENT (src dne) 2026-02-13T18:12:32.471 INFO:tasks.rados.rados.0.trial187.stdout:1615: finishing copy_from racing read to trial18717860-15 2026-02-13T18:12:32.471 INFO:tasks.rados.rados.0.trial187.stdout:1614: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:12:32.472 INFO:tasks.rados.rados.0.trial187.stdout:1614: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:12:32.472 INFO:tasks.rados.rados.0.trial187.stdout:1614: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:12:32.472 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 448 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1613: done (3 left) 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1614: done (2 left) 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1615: done (1 left) 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1616: done (0 left) 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1617: read oid 31 snap 156 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1617: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1618: read oid 6 snap 167 2026-02-13T18:12:33.450 INFO:tasks.rados.rados.0.trial187.stdout:1618: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:12:33.451 INFO:tasks.rados.rados.0.trial187.stdout:1619: write (excl) oid 5 current snap is 176 2026-02-13T18:12:33.451 INFO:tasks.rados.rados.0.trial187.stdout:1619: seq_num 545 ranges {759815=471768,1742451=465507,2917178=242637} 2026-02-13T18:12:33.457 INFO:tasks.rados.rados.0.trial187.stdout:1619: writing trial18717860-5 from 759815 to 1231583 tid 1 2026-02-13T18:12:33.464 INFO:tasks.rados.rados.0.trial187.stdout:1619: writing trial18717860-5 from 1742451 to 2207958 tid 2 2026-02-13T18:12:33.470 INFO:tasks.rados.rados.0.trial187.stdout:1619: writing trial18717860-5 from 2917178 to 3159815 tid 3 2026-02-13T18:12:33.471 INFO:tasks.rados.rados.0.trial187.stdout:1620: write (excl) oid 28 current snap is 176 2026-02-13T18:12:33.471 INFO:tasks.rados.rados.0.trial187.stdout:1620: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2026-02-13T18:12:33.479 INFO:tasks.rados.rados.0.trial187.stdout:1620: writing trial18717860-28 from 776622 to 1323639 tid 1 2026-02-13T18:12:33.487 INFO:tasks.rados.rados.0.trial187.stdout:1620: writing trial18717860-28 from 1800933 to 2526451 tid 2 2026-02-13T18:12:33.492 INFO:tasks.rados.rados.0.trial187.stdout:1620: writing trial18717860-28 from 2944601 to 3176622 tid 3 2026-02-13T18:12:33.492 INFO:tasks.rados.rados.0.trial187.stdout:1621: write (excl) oid 44 current snap is 176 2026-02-13T18:12:33.492 INFO:tasks.rados.rados.0.trial187.stdout:1621: seq_num 547 ranges {793429=622266,1859415=469176,2972024=221405} 2026-02-13T18:12:33.498 INFO:tasks.rados.rados.0.trial187.stdout:1621: writing trial18717860-44 from 793429 to 1415695 tid 1 2026-02-13T18:12:33.501 INFO:tasks.rados.rados.0.trial187.stdout:1621: writing trial18717860-44 from 1859415 to 2328591 tid 2 2026-02-13T18:12:33.505 INFO:tasks.rados.rados.0.trial187.stdout:1621: writing trial18717860-44 from 2972024 to 3193429 tid 3 2026-02-13T18:12:33.505 INFO:tasks.rados.rados.0.trial187.stdout:1622: read oid 16 snap -1 2026-02-13T18:12:33.506 INFO:tasks.rados.rados.0.trial187.stdout:1622: expect deleted 2026-02-13T18:12:33.506 INFO:tasks.rados.rados.0.trial187.stdout:1623: snap_create 2026-02-13T18:12:33.506 INFO:tasks.rados.rados.0.trial187.stdout:1617: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:12:33.539 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2885298 2026-02-13T18:12:33.560 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2189954 2026-02-13T18:12:33.570 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:33.602 INFO:tasks.rados.rados.0.trial187.stdout:1618: expect (ObjNum 477 snap 141 seq_num 477) 2026-02-13T18:12:33.613 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:33.633 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: finishing write tid 1 to trial18717860-5 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: finishing write tid 2 to trial18717860-5 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: finishing write tid 3 to trial18717860-5 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: finishing write tid 4 to trial18717860-5 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: finishing write tid 5 to trial18717860-5 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: oid 5 updating version 0 to 415 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: oid 5 updating version 415 to 416 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: oid 5 updating version 416 to 417 2026-02-13T18:12:33.653 INFO:tasks.rados.rados.0.trial187.stdout:1619: oid 5 updating version 417 to 418 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 418 (ObjNum 545 snap 176 seq_num 545) dirty exists 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1619: left oid 5 (ObjNum 545 snap 176 seq_num 545) 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: finishing write tid 1 to trial18717860-28 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: finishing write tid 2 to trial18717860-28 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: finishing write tid 3 to trial18717860-28 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: finishing write tid 4 to trial18717860-28 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: finishing write tid 5 to trial18717860-28 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: oid 28 updating version 0 to 763 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: oid 28 updating version 763 to 765 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: oid 28 version 765 is already newer than 764 2026-02-13T18:12:33.654 INFO:tasks.rados.rados.0.trial187.stdout:1620: oid 28 version 765 is already newer than 762 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 765 (ObjNum 546 snap 176 seq_num 546) dirty exists 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1620: left oid 28 (ObjNum 546 snap 176 seq_num 546) 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: finishing write tid 1 to trial18717860-44 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: finishing write tid 2 to trial18717860-44 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: finishing write tid 3 to trial18717860-44 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: finishing write tid 4 to trial18717860-44 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: finishing write tid 5 to trial18717860-44 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: oid 44 updating version 0 to 851 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: oid 44 version 851 is already newer than 850 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: oid 44 updating version 851 to 852 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:1621: oid 44 version 852 is already newer than 849 2026-02-13T18:12:33.655 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 852 (ObjNum 547 snap 176 seq_num 547) dirty exists 2026-02-13T18:12:33.656 INFO:tasks.rados.rados.0.trial187.stdout:1621: left oid 44 (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1617: done (6 left) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1618: done (5 left) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1619: done (4 left) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1620: done (3 left) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1621: done (2 left) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1622: done (1 left) 2026-02-13T18:12:34.456 INFO:tasks.rados.rados.0.trial187.stdout:1623: done (0 left) 2026-02-13T18:12:34.457 INFO:tasks.rados.rados.0.trial187.stdout:1624: read oid 32 snap 169 2026-02-13T18:12:34.457 INFO:tasks.rados.rados.0.trial187.stdout:1624: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:12:34.457 INFO:tasks.rados.rados.0.trial187.stdout:1625: snap_create 2026-02-13T18:12:34.458 INFO:tasks.rados.rados.0.trial187.stdout:1624: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:12:34.461 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 742560 2026-02-13T18:12:35.456 INFO:tasks.rados.rados.0.trial187.stdout:1624: done (1 left) 2026-02-13T18:12:35.456 INFO:tasks.rados.rados.0.trial187.stdout:1625: done (0 left) 2026-02-13T18:12:35.456 INFO:tasks.rados.rados.0.trial187.stdout:1626: copy_from oid 44 from oid 20 current snap is 178 2026-02-13T18:12:35.456 INFO:tasks.rados.rados.0.trial187.stdout:1627: delete oid 30 current snap is 178 2026-02-13T18:12:35.459 INFO:tasks.rados.rados.0.trial187.stdout:1627: done (1 left) 2026-02-13T18:12:35.459 INFO:tasks.rados.rados.0.trial187.stdout:1628: rollback oid 9 current snap is 178 2026-02-13T18:12:35.459 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 174 2026-02-13T18:12:35.459 INFO:tasks.rados.rados.0.trial187.stdout:1629: delete oid 6 current snap is 178 2026-02-13T18:12:35.460 INFO:tasks.rados.rados.0.trial187.stdout:1629: done (2 left) 2026-02-13T18:12:35.461 INFO:tasks.rados.rados.0.trial187.stdout:1630: snap_create 2026-02-13T18:12:35.461 INFO:tasks.rados.rados.0.trial187.stdout:1626: finishing copy_from to trial18717860-44 2026-02-13T18:12:35.461 INFO:tasks.rados.rados.0.trial187.stdout:1626: got expected ENOENT (src dne) 2026-02-13T18:12:35.461 INFO:tasks.rados.rados.0.trial187.stdout:1626: finishing copy_from racing read to trial18717860-44 2026-02-13T18:12:35.462 INFO:tasks.rados.rados.0.trial187.stdout:1628: finishing rollback tid 0 to trial18717860-9 2026-02-13T18:12:35.462 INFO:tasks.rados.rados.0.trial187.stdout:1628: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:12:35.462 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 807 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:12:36.428 INFO:tasks.rados.rados.0.trial187.stdout:1626: done (2 left) 2026-02-13T18:12:36.428 INFO:tasks.rados.rados.0.trial187.stdout:1628: done (1 left) 2026-02-13T18:12:36.428 INFO:tasks.rados.rados.0.trial187.stdout:1630: done (0 left) 2026-02-13T18:12:36.428 INFO:tasks.rados.rados.0.trial187.stdout:1631: snap_create 2026-02-13T18:12:37.429 INFO:tasks.rados.rados.0.trial187.stdout:1631: done (0 left) 2026-02-13T18:12:37.429 INFO:tasks.rados.rados.0.trial187.stdout:1632: read oid 37 snap -1 2026-02-13T18:12:37.429 INFO:tasks.rados.rados.0.trial187.stdout:1632: expect deleted 2026-02-13T18:12:37.429 INFO:tasks.rados.rados.0.trial187.stdout:1633: read oid 44 snap -1 2026-02-13T18:12:37.429 INFO:tasks.rados.rados.0.trial187.stdout:1633: expect (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:12:37.429 INFO:tasks.rados.rados.0.trial187.stdout:1634: snap_create 2026-02-13T18:12:37.438 INFO:tasks.rados.rados.0.trial187.stdout:1633: expect (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:12:37.481 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:37.514 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2116868 2026-02-13T18:12:38.430 INFO:tasks.rados.rados.0.trial187.stdout:1632: done (2 left) 2026-02-13T18:12:38.430 INFO:tasks.rados.rados.0.trial187.stdout:1633: done (1 left) 2026-02-13T18:12:38.431 INFO:tasks.rados.rados.0.trial187.stdout:1634: done (0 left) 2026-02-13T18:12:38.431 INFO:tasks.rados.rados.0.trial187.stdout:1635: read oid 13 snap 169 2026-02-13T18:12:38.431 INFO:tasks.rados.rados.0.trial187.stdout:1635: expect (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:12:38.431 INFO:tasks.rados.rados.0.trial187.stdout:1636: read oid 30 snap -1 2026-02-13T18:12:38.431 INFO:tasks.rados.rados.0.trial187.stdout:1636: expect deleted 2026-02-13T18:12:38.431 INFO:tasks.rados.rados.0.trial187.stdout:1637: snap_create 2026-02-13T18:12:38.436 INFO:tasks.rados.rados.0.trial187.stdout:1635: expect (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:12:38.441 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 700962 2026-02-13T18:12:39.890 INFO:tasks.rados.rados.0.trial187.stdout:1635: done (2 left) 2026-02-13T18:12:39.890 INFO:tasks.rados.rados.0.trial187.stdout:1636: done (1 left) 2026-02-13T18:12:39.890 INFO:tasks.rados.rados.0.trial187.stdout:1637: done (0 left) 2026-02-13T18:12:39.890 INFO:tasks.rados.rados.0.trial187.stdout:1638: delete oid 45 current snap is 182 2026-02-13T18:12:39.893 INFO:tasks.rados.rados.0.trial187.stdout:1638: done (0 left) 2026-02-13T18:12:39.893 INFO:tasks.rados.rados.0.trial187.stdout:1639: read oid 36 snap -1 2026-02-13T18:12:39.893 INFO:tasks.rados.rados.0.trial187.stdout:1639: expect (ObjNum 540 snap 172 seq_num 540) 2026-02-13T18:12:39.893 INFO:tasks.rados.rados.0.trial187.stdout:1640: copy_from oid 10 from oid 6 current snap is 182 2026-02-13T18:12:39.894 INFO:tasks.rados.rados.0.trial187.stdout:1641: snap_remove snap 175 2026-02-13T18:12:40.893 INFO:tasks.rados.rados.0.trial187.stdout:1641: done (2 left) 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1642: read oid 24 snap -1 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1642: expect (ObjNum 498 snap 150 seq_num 498) 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1643: snap_create 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1640: finishing copy_from to trial18717860-10 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1640: got expected ENOENT (src dne) 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1640: finishing copy_from racing read to trial18717860-10 2026-02-13T18:12:40.894 INFO:tasks.rados.rados.0.trial187.stdout:1639: expect (ObjNum 540 snap 172 seq_num 540) 2026-02-13T18:12:40.996 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 432433 2026-02-13T18:12:41.039 INFO:tasks.rados.rados.0.trial187.stdout:1642: expect (ObjNum 498 snap 150 seq_num 498) 2026-02-13T18:12:41.066 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 612432 2026-02-13T18:12:41.429 INFO:tasks.rados.rados.0.trial187.stdout:1639: done (3 left) 2026-02-13T18:12:41.430 INFO:tasks.rados.rados.0.trial187.stdout:1640: done (2 left) 2026-02-13T18:12:41.430 INFO:tasks.rados.rados.0.trial187.stdout:1642: done (1 left) 2026-02-13T18:12:41.430 INFO:tasks.rados.rados.0.trial187.stdout:1643: done (0 left) 2026-02-13T18:12:41.430 INFO:tasks.rados.rados.0.trial187.stdout:1644: delete oid 33 current snap is 183 2026-02-13T18:12:41.438 INFO:tasks.rados.rados.0.trial187.stdout:1644: done (0 left) 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1645: copy_from oid 1 from oid 41 current snap is 183 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1646: rollback oid 8 current snap is 183 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 176 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1647: rollback oid 26 current snap is 183 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 178 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1648: copy_from oid 21 from oid 40 current snap is 183 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1649: rollback oid 16 current snap is 183 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 167 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1650: read oid 6 snap -1 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1650: expect deleted 2026-02-13T18:12:41.439 INFO:tasks.rados.rados.0.trial187.stdout:1651: snap_create 2026-02-13T18:12:41.440 INFO:tasks.rados.rados.0.trial187.stdout:1649: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:12:41.440 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 0 (ObjNum 33 snap 0 seq_num 3013705856) dirty dne 2026-02-13T18:12:41.440 INFO:tasks.rados.rados.0.trial187.stdout:1648: finishing copy_from to trial18717860-21 2026-02-13T18:12:41.440 INFO:tasks.rados.rados.0.trial187.stdout:1648: got expected ENOENT (src dne) 2026-02-13T18:12:41.440 INFO:tasks.rados.rados.0.trial187.stdout:1648: finishing copy_from racing read to trial18717860-21 2026-02-13T18:12:41.441 INFO:tasks.rados.rados.0.trial187.stdout:1646: finishing rollback tid 0 to trial18717860-8 2026-02-13T18:12:41.441 INFO:tasks.rados.rados.0.trial187.stdout:1646: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:12:41.441 INFO:tasks.rados.rados.0.trial187.stdout:1646: finishing rollback tid 2 to trial18717860-8 2026-02-13T18:12:41.441 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 761 (ObjNum 510 snap 154 seq_num 510) dirty exists 2026-02-13T18:12:41.442 INFO:tasks.rados.rados.0.trial187.stdout:1647: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:12:41.442 INFO:tasks.rados.rados.0.trial187.stdout:1647: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:12:41.442 INFO:tasks.rados.rados.0.trial187.stdout:1647: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:12:41.442 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 813 (ObjNum 543 snap 174 seq_num 543) dirty exists 2026-02-13T18:12:41.453 INFO:tasks.rados.rados.0.trial187.stdout:1645: finishing copy_from racing read to trial18717860-1 2026-02-13T18:12:41.454 INFO:tasks.rados.rados.0.trial187.stdout:1645: finishing copy_from to trial18717860-1 2026-02-13T18:12:41.454 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 440 (ObjNum 536 snap 168 seq_num 536) dirty exists 2026-02-13T18:12:42.432 INFO:tasks.rados.rados.0.trial187.stdout:1645: done (6 left) 2026-02-13T18:12:42.432 INFO:tasks.rados.rados.0.trial187.stdout:1646: done (5 left) 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1647: done (4 left) 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1648: done (3 left) 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1649: done (2 left) 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1650: done (1 left) 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1651: done (0 left) 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1652: write (excl) oid 32 current snap is 184 2026-02-13T18:12:42.433 INFO:tasks.rados.rados.0.trial187.stdout:1652: seq_num 552 ranges {477464=714864,1751825=736525,3225492=51972} 2026-02-13T18:12:42.440 INFO:tasks.rados.rados.0.trial187.stdout:1652: writing trial18717860-32 from 477464 to 1192328 tid 1 2026-02-13T18:12:42.449 INFO:tasks.rados.rados.0.trial187.stdout:1652: writing trial18717860-32 from 1751825 to 2488350 tid 2 2026-02-13T18:12:42.454 INFO:tasks.rados.rados.0.trial187.stdout:1652: writing trial18717860-32 from 3225492 to 3277464 tid 3 2026-02-13T18:12:42.454 INFO:tasks.rados.rados.0.trial187.stdout:1653: write (excl) oid 27 current snap is 184 2026-02-13T18:12:42.454 INFO:tasks.rados.rados.0.trial187.stdout:1653: seq_num 553 ranges {494271=790113,1693954=480183,2620209=512129} 2026-02-13T18:12:42.463 INFO:tasks.rados.rados.0.trial187.stdout:1653: writing trial18717860-27 from 494271 to 1284384 tid 1 2026-02-13T18:12:42.469 INFO:tasks.rados.rados.0.trial187.stdout:1653: writing trial18717860-27 from 1693954 to 2174137 tid 2 2026-02-13T18:12:42.475 INFO:tasks.rados.rados.0.trial187.stdout:1653: writing trial18717860-27 from 2620209 to 3132338 tid 3 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1654: snap_create 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: finishing write tid 1 to trial18717860-32 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: finishing write tid 2 to trial18717860-32 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: finishing write tid 3 to trial18717860-32 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: finishing write tid 4 to trial18717860-32 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: finishing write tid 5 to trial18717860-32 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: oid 32 updating version 0 to 765 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: oid 32 version 765 is already newer than 763 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: oid 32 version 765 is already newer than 764 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:1652: oid 32 version 765 is already newer than 762 2026-02-13T18:12:42.476 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 765 (ObjNum 552 snap 184 seq_num 552) dirty exists 2026-02-13T18:12:42.477 INFO:tasks.rados.rados.0.trial187.stdout:1652: left oid 32 (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:12:42.477 INFO:tasks.rados.rados.0.trial187.stdout:1653: finishing write tid 1 to trial18717860-27 2026-02-13T18:12:42.477 INFO:tasks.rados.rados.0.trial187.stdout:1653: finishing write tid 2 to trial18717860-27 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: finishing write tid 3 to trial18717860-27 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: finishing write tid 4 to trial18717860-27 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: finishing write tid 5 to trial18717860-27 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: oid 27 updating version 0 to 607 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: oid 27 updating version 607 to 608 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: oid 27 updating version 608 to 609 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: oid 27 version 609 is already newer than 606 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 609 (ObjNum 553 snap 184 seq_num 553) dirty exists 2026-02-13T18:12:42.478 INFO:tasks.rados.rados.0.trial187.stdout:1653: left oid 27 (ObjNum 553 snap 184 seq_num 553) 2026-02-13T18:12:43.785 INFO:tasks.rados.rados.0.trial187.stdout:1652: done (2 left) 2026-02-13T18:12:43.785 INFO:tasks.rados.rados.0.trial187.stdout:1653: done (1 left) 2026-02-13T18:12:43.785 INFO:tasks.rados.rados.0.trial187.stdout:1654: done (0 left) 2026-02-13T18:12:43.785 INFO:tasks.rados.rados.0.trial187.stdout:1655: delete oid 13 current snap is 185 2026-02-13T18:12:43.790 INFO:tasks.rados.rados.0.trial187.stdout:1655: done (0 left) 2026-02-13T18:12:43.790 INFO:tasks.rados.rados.0.trial187.stdout:1656: snap_remove snap 182 2026-02-13T18:12:44.786 INFO:tasks.rados.rados.0.trial187.stdout:1656: done (0 left) 2026-02-13T18:12:44.786 INFO:tasks.rados.rados.0.trial187.stdout:1657: rollback oid 22 current snap is 185 2026-02-13T18:12:44.786 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 170 2026-02-13T18:12:44.787 INFO:tasks.rados.rados.0.trial187.stdout:1658: write oid 13 current snap is 185 2026-02-13T18:12:44.787 INFO:tasks.rados.rados.0.trial187.stdout:1658: seq_num 555 ranges {527885=656964,1927271=483852,3191408=136477} 2026-02-13T18:12:44.794 INFO:tasks.rados.rados.0.trial187.stdout:1658: writing trial18717860-13 from 527885 to 1184849 tid 1 2026-02-13T18:12:44.802 INFO:tasks.rados.rados.0.trial187.stdout:1658: writing trial18717860-13 from 1927271 to 2411123 tid 2 2026-02-13T18:12:44.809 INFO:tasks.rados.rados.0.trial187.stdout:1658: writing trial18717860-13 from 3191408 to 3327885 tid 3 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1659: rollback oid 15 current snap is 185 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 178 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1657: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1657: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1657: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 858 (ObjNum 535 snap 168 seq_num 535) dirty exists 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1658: finishing write tid 1 to trial18717860-13 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1658: finishing write tid 2 to trial18717860-13 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1657: done (2 left) 2026-02-13T18:12:44.810 INFO:tasks.rados.rados.0.trial187.stdout:1660: rollback oid 5 current snap is 185 2026-02-13T18:12:44.811 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 180 2026-02-13T18:12:44.811 INFO:tasks.rados.rados.0.trial187.stdout:1661: snap_remove snap 172 2026-02-13T18:12:45.788 INFO:tasks.rados.rados.0.trial187.stdout:1661: done (3 left) 2026-02-13T18:12:45.788 INFO:tasks.rados.rados.0.trial187.stdout:1662: copy_from oid 12 from oid 2 current snap is 185 2026-02-13T18:12:45.788 INFO:tasks.rados.rados.0.trial187.stdout:1659: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1659: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: finishing write tid 3 to trial18717860-13 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1659: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 620 (ObjNum 373 snap 106 seq_num 373) dirty exists 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: finishing write tid 4 to trial18717860-13 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: finishing write tid 5 to trial18717860-13 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: oid 13 updating version 0 to 477 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: oid 13 version 477 is already newer than 475 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: oid 13 version 477 is already newer than 474 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:1658: oid 13 version 477 is already newer than 476 2026-02-13T18:12:45.789 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 477 (ObjNum 555 snap 185 seq_num 555) dirty exists 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1658: left oid 13 (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1660: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1660: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1658: done (3 left) 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1659: done (2 left) 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1663: read oid 41 snap 178 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1663: expect (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1664: copy_from oid 38 from oid 43 current snap is 185 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:1660: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:12:45.790 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 425 (ObjNum 545 snap 176 seq_num 545) dirty exists 2026-02-13T18:12:45.791 INFO:tasks.rados.rados.0.trial187.stdout:1660: done (3 left) 2026-02-13T18:12:45.791 INFO:tasks.rados.rados.0.trial187.stdout:1665: snap_create 2026-02-13T18:12:45.794 INFO:tasks.rados.rados.0.trial187.stdout:1663: expect (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:12:45.794 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:45.866 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2574752 2026-02-13T18:12:45.883 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1784457 2026-02-13T18:12:45.898 INFO:tasks.rados.rados.0.trial187.stdout:1662: finishing copy_from racing read to trial18717860-12 2026-02-13T18:12:45.899 INFO:tasks.rados.rados.0.trial187.stdout:1662: finishing copy_from to trial18717860-12 2026-02-13T18:12:45.899 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 459 (ObjNum 486 snap 146 seq_num 486) dirty exists 2026-02-13T18:12:45.899 INFO:tasks.rados.rados.0.trial187.stdout:1664: finishing copy_from racing read to trial18717860-38 2026-02-13T18:12:45.899 INFO:tasks.rados.rados.0.trial187.stdout:1664: finishing copy_from to trial18717860-38 2026-02-13T18:12:45.899 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:12:46.430 INFO:tasks.rados.rados.0.trial187.stdout:1662: done (3 left) 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1663: done (2 left) 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1664: done (1 left) 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1665: done (0 left) 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1666: copy_from oid 3 from oid 20 current snap is 186 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1667: copy_from oid 17 from oid 43 current snap is 186 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1668: copy_from oid 23 from oid 13 current snap is 186 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1669: write (excl) oid 30 current snap is 186 2026-02-13T18:12:46.431 INFO:tasks.rados.rados.0.trial187.stdout:1669: seq_num 556 ranges {544692=732213,1985753=743863,3335184=9508} 2026-02-13T18:12:46.438 INFO:tasks.rados.rados.0.trial187.stdout:1669: writing trial18717860-30 from 544692 to 1276905 tid 1 2026-02-13T18:12:46.449 INFO:tasks.rados.rados.0.trial187.stdout:1669: writing trial18717860-30 from 1985753 to 2729616 tid 2 2026-02-13T18:12:46.453 INFO:tasks.rados.rados.0.trial187.stdout:1669: writing trial18717860-30 from 3335184 to 3344692 tid 3 2026-02-13T18:12:46.453 INFO:tasks.rados.rados.0.trial187.stdout:1670: delete oid 16 current snap is 186 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1666: finishing copy_from to trial18717860-3 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1666: got expected ENOENT (src dne) 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1666: finishing copy_from racing read to trial18717860-3 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1667: finishing copy_from racing read to trial18717860-17 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1669: finishing write tid 1 to trial18717860-30 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1667: finishing copy_from to trial18717860-17 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1668: finishing copy_from racing read to trial18717860-23 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1668: finishing copy_from to trial18717860-23 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 477 (ObjNum 555 snap 185 seq_num 555) dirty exists 2026-02-13T18:12:46.454 INFO:tasks.rados.rados.0.trial187.stdout:1669: finishing write tid 2 to trial18717860-30 2026-02-13T18:12:46.455 INFO:tasks.rados.rados.0.trial187.stdout:1669: finishing write tid 3 to trial18717860-30 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1666: done (4 left) 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1667: done (3 left) 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1668: done (2 left) 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1670: done (1 left) 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1671: read oid 11 snap -1 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1671: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1672: snap_create 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1669: finishing write tid 4 to trial18717860-30 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1669: finishing write tid 5 to trial18717860-30 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1669: oid 30 updating version 0 to 766 2026-02-13T18:12:46.456 INFO:tasks.rados.rados.0.trial187.stdout:1669: oid 30 updating version 766 to 768 2026-02-13T18:12:46.457 INFO:tasks.rados.rados.0.trial187.stdout:1669: oid 30 version 768 is already newer than 767 2026-02-13T18:12:46.457 INFO:tasks.rados.rados.0.trial187.stdout:1669: oid 30 updating version 768 to 769 2026-02-13T18:12:46.457 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 769 (ObjNum 556 snap 186 seq_num 556) dirty exists 2026-02-13T18:12:46.457 INFO:tasks.rados.rados.0.trial187.stdout:1669: left oid 30 (ObjNum 556 snap 186 seq_num 556) 2026-02-13T18:12:46.458 INFO:tasks.rados.rados.0.trial187.stdout:1671: expect (ObjNum 472 snap 141 seq_num 472) 2026-02-13T18:12:46.516 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:47.434 INFO:tasks.rados.rados.0.trial187.stdout:1669: done (2 left) 2026-02-13T18:12:47.434 INFO:tasks.rados.rados.0.trial187.stdout:1671: done (1 left) 2026-02-13T18:12:47.434 INFO:tasks.rados.rados.0.trial187.stdout:1672: done (0 left) 2026-02-13T18:12:47.434 INFO:tasks.rados.rados.0.trial187.stdout:1673: read oid 17 snap -1 2026-02-13T18:12:47.434 INFO:tasks.rados.rados.0.trial187.stdout:1673: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:12:47.434 INFO:tasks.rados.rados.0.trial187.stdout:1674: write oid 48 current snap is 187 2026-02-13T18:12:47.435 INFO:tasks.rados.rados.0.trial187.stdout:1674: seq_num 558 ranges {578306=482711,1586364=631179,2757324=484842} 2026-02-13T18:12:47.441 INFO:tasks.rados.rados.0.trial187.stdout:1674: writing trial18717860-48 from 578306 to 1061017 tid 1 2026-02-13T18:12:47.449 INFO:tasks.rados.rados.0.trial187.stdout:1674: writing trial18717860-48 from 1586364 to 2217543 tid 2 2026-02-13T18:12:47.456 INFO:tasks.rados.rados.0.trial187.stdout:1674: writing trial18717860-48 from 2757324 to 3242166 tid 3 2026-02-13T18:12:47.456 INFO:tasks.rados.rados.0.trial187.stdout:1675: snap_remove snap 177 2026-02-13T18:12:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1675: done (2 left) 2026-02-13T18:12:48.712 INFO:tasks.rados.rados.0.trial187.stdout:1676: snap_remove snap 156 2026-02-13T18:12:49.715 INFO:tasks.rados.rados.0.trial187.stdout:1676: done (2 left) 2026-02-13T18:12:49.715 INFO:tasks.rados.rados.0.trial187.stdout:1677: rollback oid 8 current snap is 187 2026-02-13T18:12:49.715 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 170 2026-02-13T18:12:49.715 INFO:tasks.rados.rados.0.trial187.stdout:1673: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:12:49.796 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2235287 2026-02-13T18:12:49.808 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:12:49.848 INFO:tasks.rados.rados.0.trial187.stdout:1674: finishing write tid 1 to trial18717860-48 2026-02-13T18:12:49.849 INFO:tasks.rados.rados.0.trial187.stdout:1674: finishing write tid 2 to trial18717860-48 2026-02-13T18:12:49.849 INFO:tasks.rados.rados.0.trial187.stdout:1674: finishing write tid 3 to trial18717860-48 2026-02-13T18:12:49.849 INFO:tasks.rados.rados.0.trial187.stdout:1673: done (2 left) 2026-02-13T18:12:49.849 INFO:tasks.rados.rados.0.trial187.stdout:1678: write (excl) oid 6 current snap is 187 2026-02-13T18:12:49.849 INFO:tasks.rados.rados.0.trial187.stdout:1678: seq_num 559 ranges {595113=557960,1644846=491190,2784747=610366} 2026-02-13T18:12:49.856 INFO:tasks.rados.rados.0.trial187.stdout:1678: writing trial18717860-6 from 595113 to 1153073 tid 1 2026-02-13T18:12:49.863 INFO:tasks.rados.rados.0.trial187.stdout:1678: writing trial18717860-6 from 1644846 to 2136036 tid 2 2026-02-13T18:12:49.871 INFO:tasks.rados.rados.0.trial187.stdout:1678: writing trial18717860-6 from 2784747 to 3395113 tid 3 2026-02-13T18:12:49.872 INFO:tasks.rados.rados.0.trial187.stdout:1679: write (excl) oid 22 current snap is 187 2026-02-13T18:12:49.872 INFO:tasks.rados.rados.0.trial187.stdout:1679: seq_num 560 ranges {611920=633209,1703328=634848,2812170=507386} 2026-02-13T18:12:49.880 INFO:tasks.rados.rados.0.trial187.stdout:1679: writing trial18717860-22 from 611920 to 1245129 tid 1 2026-02-13T18:12:49.887 INFO:tasks.rados.rados.0.trial187.stdout:1679: writing trial18717860-22 from 1703328 to 2338176 tid 2 2026-02-13T18:12:49.895 INFO:tasks.rados.rados.0.trial187.stdout:1679: writing trial18717860-22 from 2812170 to 3319556 tid 3 2026-02-13T18:12:49.895 INFO:tasks.rados.rados.0.trial187.stdout:1680: read oid 47 snap -1 2026-02-13T18:12:49.895 INFO:tasks.rados.rados.0.trial187.stdout:1680: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:12:49.895 INFO:tasks.rados.rados.0.trial187.stdout:1681: copy_from oid 45 from oid 37 current snap is 187 2026-02-13T18:12:49.895 INFO:tasks.rados.rados.0.trial187.stdout:1674: finishing write tid 4 to trial18717860-48 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1674: finishing write tid 5 to trial18717860-48 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1674: oid 48 updating version 0 to 869 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1674: oid 48 version 869 is already newer than 868 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1674: oid 48 version 869 is already newer than 867 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1674: oid 48 version 869 is already newer than 866 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 869 (ObjNum 558 snap 187 seq_num 558) dirty exists 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1674: left oid 48 (ObjNum 558 snap 187 seq_num 558) 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1677: finishing rollback tid 0 to trial18717860-8 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1677: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:1677: finishing rollback tid 2 to trial18717860-8 2026-02-13T18:12:49.896 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 772 (ObjNum 510 snap 154 seq_num 510) dirty exists 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: finishing write tid 1 to trial18717860-6 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: finishing write tid 2 to trial18717860-6 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: finishing write tid 3 to trial18717860-6 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: finishing write tid 4 to trial18717860-6 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1674: done (5 left) 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1677: done (4 left) 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1682: read oid 30 snap -1 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1682: expect (ObjNum 556 snap 186 seq_num 556) 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1683: snap_create 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: finishing write tid 5 to trial18717860-6 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: oid 6 updating version 0 to 769 2026-02-13T18:12:49.897 INFO:tasks.rados.rados.0.trial187.stdout:1678: oid 6 version 769 is already newer than 767 2026-02-13T18:12:49.898 INFO:tasks.rados.rados.0.trial187.stdout:1678: oid 6 updating version 769 to 770 2026-02-13T18:12:49.898 INFO:tasks.rados.rados.0.trial187.stdout:1678: oid 6 version 770 is already newer than 768 2026-02-13T18:12:49.898 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 770 (ObjNum 559 snap 187 seq_num 559) dirty exists 2026-02-13T18:12:49.898 INFO:tasks.rados.rados.0.trial187.stdout:1678: left oid 6 (ObjNum 559 snap 187 seq_num 559) 2026-02-13T18:12:49.898 INFO:tasks.rados.rados.0.trial187.stdout:1679: finishing write tid 1 to trial18717860-22 2026-02-13T18:12:49.898 INFO:tasks.rados.rados.0.trial187.stdout:1679: finishing write tid 2 to trial18717860-22 2026-02-13T18:12:49.899 INFO:tasks.rados.rados.0.trial187.stdout:1679: finishing write tid 3 to trial18717860-22 2026-02-13T18:12:49.899 INFO:tasks.rados.rados.0.trial187.stdout:1681: finishing copy_from to trial18717860-45 2026-02-13T18:12:49.899 INFO:tasks.rados.rados.0.trial187.stdout:1681: got expected ENOENT (src dne) 2026-02-13T18:12:49.899 INFO:tasks.rados.rados.0.trial187.stdout:1679: finishing write tid 4 to trial18717860-22 2026-02-13T18:12:49.899 INFO:tasks.rados.rados.0.trial187.stdout:1681: finishing copy_from racing read to trial18717860-45 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1679: finishing write tid 5 to trial18717860-22 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1679: oid 22 updating version 0 to 886 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1679: oid 22 updating version 886 to 888 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1679: oid 22 version 888 is already newer than 887 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1679: oid 22 version 888 is already newer than 885 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 888 (ObjNum 560 snap 187 seq_num 560) dirty exists 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1679: left oid 22 (ObjNum 560 snap 187 seq_num 560) 2026-02-13T18:12:49.900 INFO:tasks.rados.rados.0.trial187.stdout:1682: expect (ObjNum 556 snap 186 seq_num 556) 2026-02-13T18:12:49.918 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3122070 2026-02-13T18:12:49.926 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1497920 2026-02-13T18:12:49.944 INFO:tasks.rados.rados.0.trial187.stdout:1680: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:12:49.986 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3359449 2026-02-13T18:12:50.036 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3497711 2026-02-13T18:12:50.727 INFO:tasks.rados.rados.0.trial187.stdout:1678: done (5 left) 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1679: done (4 left) 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1680: done (3 left) 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1681: done (2 left) 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1682: done (1 left) 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1683: done (0 left) 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1684: copy_from oid 48 from oid 46 current snap is 188 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1685: read oid 18 snap 180 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1685: expect deleted 2026-02-13T18:12:50.728 INFO:tasks.rados.rados.0.trial187.stdout:1686: snap_create 2026-02-13T18:12:50.886 INFO:tasks.rados.rados.0.trial187.stdout:1684: finishing copy_from racing read to trial18717860-48 2026-02-13T18:12:50.886 INFO:tasks.rados.rados.0.trial187.stdout:1684: finishing copy_from to trial18717860-48 2026-02-13T18:12:50.886 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 297 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:12:51.431 INFO:tasks.rados.rados.0.trial187.stdout:1684: done (2 left) 2026-02-13T18:12:51.431 INFO:tasks.rados.rados.0.trial187.stdout:1685: done (1 left) 2026-02-13T18:12:51.431 INFO:tasks.rados.rados.0.trial187.stdout:1686: done (0 left) 2026-02-13T18:12:51.431 INFO:tasks.rados.rados.0.trial187.stdout:1687: write (excl) oid 14 current snap is 189 2026-02-13T18:12:51.432 INFO:tasks.rados.rados.0.trial187.stdout:1687: seq_num 561 ranges {628727=708458,2045457=494859,3123240=305487} 2026-02-13T18:12:51.440 INFO:tasks.rados.rados.0.trial187.stdout:1687: writing trial18717860-14 from 628727 to 1337185 tid 1 2026-02-13T18:12:51.448 INFO:tasks.rados.rados.0.trial187.stdout:1687: writing trial18717860-14 from 2045457 to 2540316 tid 2 2026-02-13T18:12:51.454 INFO:tasks.rados.rados.0.trial187.stdout:1687: writing trial18717860-14 from 3123240 to 3428727 tid 3 2026-02-13T18:12:51.454 INFO:tasks.rados.rados.0.trial187.stdout:1688: delete oid 20 current snap is 189 2026-02-13T18:12:51.454 INFO:tasks.rados.rados.0.trial187.stdout:1687: finishing write tid 1 to trial18717860-14 2026-02-13T18:12:51.455 INFO:tasks.rados.rados.0.trial187.stdout:1687: finishing write tid 2 to trial18717860-14 2026-02-13T18:12:51.456 INFO:tasks.rados.rados.0.trial187.stdout:1687: finishing write tid 3 to trial18717860-14 2026-02-13T18:12:51.456 INFO:tasks.rados.rados.0.trial187.stdout:1687: finishing write tid 4 to trial18717860-14 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: finishing write tid 5 to trial18717860-14 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: oid 14 updating version 0 to 539 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: oid 14 updating version 539 to 541 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: oid 14 version 541 is already newer than 540 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: oid 14 version 541 is already newer than 538 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 541 (ObjNum 561 snap 189 seq_num 561) dirty exists 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: left oid 14 (ObjNum 561 snap 189 seq_num 561) 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1687: done (1 left) 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1688: done (0 left) 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:1689: rollback oid 48 current snap is 189 2026-02-13T18:12:51.457 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 48 to 187 2026-02-13T18:12:51.458 INFO:tasks.rados.rados.0.trial187.stdout:1690: write oid 49 current snap is 189 2026-02-13T18:12:51.458 INFO:tasks.rados.rados.0.trial187.stdout:1690: seq_num 563 ranges {662341=575309,1878774=498528,2894439=457555} 2026-02-13T18:12:51.465 INFO:tasks.rados.rados.0.trial187.stdout:1690: writing trial18717860-49 from 662341 to 1237650 tid 1 2026-02-13T18:12:51.472 INFO:tasks.rados.rados.0.trial187.stdout:1690: writing trial18717860-49 from 1878774 to 2377302 tid 2 2026-02-13T18:12:51.479 INFO:tasks.rados.rados.0.trial187.stdout:1690: writing trial18717860-49 from 2894439 to 3351994 tid 3 2026-02-13T18:12:51.479 INFO:tasks.rados.rados.0.trial187.stdout:1691: read oid 1 snap -1 2026-02-13T18:12:51.479 INFO:tasks.rados.rados.0.trial187.stdout:1691: expect (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:12:51.479 INFO:tasks.rados.rados.0.trial187.stdout:1692: write (excl) oid 37 current snap is 189 2026-02-13T18:12:51.480 INFO:tasks.rados.rados.0.trial187.stdout:1692: seq_num 564 ranges {679148=650558,1937256=642186,3321862=157286} 2026-02-13T18:12:51.485 INFO:tasks.rados.rados.0.trial187.stdout:1692: writing trial18717860-37 from 679148 to 1329706 tid 1 2026-02-13T18:12:51.490 INFO:tasks.rados.rados.0.trial187.stdout:1692: writing trial18717860-37 from 1937256 to 2579442 tid 2 2026-02-13T18:12:51.494 INFO:tasks.rados.rados.0.trial187.stdout:1692: writing trial18717860-37 from 3321862 to 3479148 tid 3 2026-02-13T18:12:51.494 INFO:tasks.rados.rados.0.trial187.stdout:1693: snap_remove snap 176 2026-02-13T18:12:51.798 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T18:12:51.798 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T18:12:51.798 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T18:12:51.799 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T18:12:51.801 INFO:tasks.ceph.mon.b:Started 2026-02-13T18:12:51.801 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T18:12:51.801 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T18:12:51.801 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T18:12:51.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T18:13:06.802 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T18:13:06.803 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T18:13:06.803 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T18:13:06.803 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:13:06.804 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:06.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.861+0000 7f9b2d9cc640 10 monclient: get_monmap_and_config 2026-02-13T18:13:06.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.861+0000 7f9b2d9cc640 10 monclient: build_initial_monmap 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.861+0000 7f9b2d9cc640 10 monclient: monmap: 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:06.864938+0000 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:06.864938+0000 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:06.866 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.861+0000 7f9b2d9cc640 1 Processor -- start 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.861+0000 7f9b2d9cc640 1 -- start start 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.861+0000 7f9b2d9cc640 10 monclient: init 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient(hunting): picked mon.noname-c con 0x7f9b2808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient(hunting): picked mon.noname-a con 0x7f9b2808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient(hunting): picked mon.noname-b con 0x7f9b2808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28089e80 con 0x7f9b2808dc80 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28088c20 con 0x7f9b2808c2f0 2026-02-13T18:13:06.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28089ba0 con 0x7f9b2808cdd0 2026-02-13T18:13:06.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:06.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient(hunting): authenticate will time out at 1017.920178s 2026-02-13T18:13:06.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b267fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9b2808dc80 0x7f9b28181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39498/0 (socket says 10.20.193.78:39498) 2026-02-13T18:13:06.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b267fc640 1 -- 10.20.193.78:0/2780919754 learned_addr learned my addr 10.20.193.78:0/2780919754 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b267fc640 1 -- 10.20.193.78:0/2780919754 >> v1:10.20.193.78:6789/0 conn(0x7f9b2808dc80 legacy=0x7f9b28181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b277fe640 1 -- 10.20.193.78:0/2780919754 >> v1:10.20.193.78:6790/0 conn(0x7f9b2808cdd0 legacy=0x7f9b281a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553573266 0 0) 0x7f9b28089e80 con 0x7f9b2808dc80 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient(hunting): my global_id is 74175 2026-02-13T18:13:06.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b14003620 con 0x7f9b2808dc80 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b26ffd640 1 -- 10.20.193.78:0/2780919754 >> v1:10.20.193.187:6789/0 conn(0x7f9b2808c2f0 legacy=0x7f9b2808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335298576 0 0) 0x7f9b14003620 con 0x7f9b2808dc80 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 >> v1:10.20.193.78:6790/0 conn(0x7f9b2808cdd0 legacy=0x7f9b281a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 >> v1:10.20.193.187:6789/0 conn(0x7f9b2808c2f0 legacy=0x7f9b2808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 monclient: found mon.noname-a 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2808d370 con 0x7f9b2808dc80 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: _finish_auth 0 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:06.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b10003110 con 0x7f9b2808dc80 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: dump: 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:06.878 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 5 monclient: authenticate success, global_id 74175 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b100033e0 con 0x7f9b2808dc80 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 4 set_mon_vals no callback set 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 1 -- 10.20.193.78:0/2780919754 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b10004b50 con 0x7f9b2808dc80 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b25ffb640 10 monclient: dump: 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.879 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient: shutdown 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/2780919754 >> v1:10.20.193.78:6789/0 conn(0x7f9b2808dc80 legacy=0x7f9b28181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/2780919754 shutdown_connections 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/2780919754 >> 10.20.193.78:0/2780919754 conn(0x7f9b28091720 msgr2=0x7f9b28091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/2780919754 shutdown_connections 2026-02-13T18:13:06.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/2780919754 wait complete. 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient: build_initial_monmap 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.865+0000 7f9b2d9cc640 10 monclient: monmap: 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 Processor -- start 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 -- start start 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: init 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:13:06.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient(hunting): picked mon.noname-a con 0x7f9b2808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient(hunting): picked mon.noname-c con 0x7f9b2808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient(hunting): picked mon.noname-b con 0x7f9b2808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b280822b0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28081400 con 0x7f9b2808dc80 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28082590 con 0x7f9b2808cdd0 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient(hunting): authenticate will time out at 1017.924780s 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b26ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9b2808c2f0 0x7f9b28153200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:39500/0 (socket says 10.20.193.78:39500) 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b26ffd640 1 -- 10.20.193.78:0/3450803933 learned_addr learned my addr 10.20.193.78:0/3450803933 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b26ffd640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.78:6789/0 conn(0x7f9b2808c2f0 legacy=0x7f9b28153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b267fc640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.78:6790/0 conn(0x7f9b2808cdd0 legacy=0x7f9b28083ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260535265 0 0) 0x7f9b280822b0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): my global_id is 74178 2026-02-13T18:13:06.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af8003620 con 0x7f9b2808c2f0 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b277fe640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.187:6789/0 conn(0x7f9b2808dc80 legacy=0x7f9b28195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1208031371 0 0) 0x7f9af8003620 con 0x7f9b2808c2f0 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b280822b0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b1c003420 con 0x7f9b2808c2f0 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): dump: 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:06.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 736712237 0 0) 0x7f9b280822b0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.78:6790/0 conn(0x7f9b2808cdd0 legacy=0x7f9b28083ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.187:6789/0 conn(0x7f9b2808dc80 legacy=0x7f9b28195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: _finish_hunting 0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 monclient: found mon.a 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28057a00 con 0x7f9b2808c2f0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: _finish_auth 0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: _check_auth_tickets 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 5 monclient: authenticate success, global_id 74178 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: _renew_subs 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b28081fd0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: _renew_subs 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b28196c90 con 0x7f9b2808c2f0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b1c0039c0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9b1c003d20 con 0x7f9b2808c2f0 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9afffff640 10 monclient: dump: 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.869+0000 7f9b257fa640 4 set_mon_vals no callback set 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9b2d9cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9b2d9cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9b2d9cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:06.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2808f600 con 0x7f9b2808c2f0 2026-02-13T18:13:06.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9b1c003ff0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(388..388 src has 1..388) ==== 3959+0+0 (unknown 4169175010 0 0) 0x7f9b1c04c7a0 con 0x7f9b2808c2f0 2026-02-13T18:13:06.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.873+0000 7f9b267fc640 10 monclient: get_auth_request con 0x7f9af803d450 auth_method 0 2026-02-13T18:13:06.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.877+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f9b1c017720 con 0x7f9b2808c2f0 2026-02-13T18:13:06.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.877+0000 7f9afffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:06.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.877+0000 7f9afffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:06.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b28090810 con 0x7f9b2808c2f0 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9afffff640 1 -- 10.20.193.78:0/3450803933 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 1882420253) 0x7f9b1c017000 con 0x7f9b2808c2f0 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9afffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9afffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:06.995 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":24,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9af803d450 legacy=0x7f9af805d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 10 monclient: shutdown 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 >> v1:10.20.193.78:6789/0 conn(0x7f9b2808c2f0 legacy=0x7f9b28153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 shutdown_connections 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 >> 10.20.193.78:0/3450803933 conn(0x7f9b28091720 msgr2=0x7f9b28058be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 shutdown_connections 2026-02-13T18:13:06.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:06.993+0000 7f9b2d9cc640 1 -- 10.20.193.78:0/3450803933 wait complete. 2026-02-13T18:13:10.006 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient: get_monmap_and_config 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient: build_initial_monmap 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient: monmap: 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:10.076165+0000 2026-02-13T18:13:10.077 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:10.076165+0000 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 1 Processor -- start 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 1 -- start start 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient: init 2026-02-13T18:13:10.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient(hunting): picked mon.noname-a con 0x7f9838085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient(hunting): picked mon.noname-c con 0x7f9838085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient(hunting): picked mon.noname-b con 0x7f9838181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9838088400 con 0x7f9838085790 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9838088120 con 0x7f9838085b60 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983808c550 con 0x7f9838181d50 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f983d2bb640 10 monclient(hunting): authenticate will time out at 1021.131495s 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f9836ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9838085790 0x7f9838089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:41866/0 (socket says 10.20.193.78:41866) 2026-02-13T18:13:10.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.073+0000 7f9836ffd640 1 -- 10.20.193.78:0/548513625 learned_addr learned my addr 10.20.193.78:0/548513625 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:10.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f98377fe640 1 -- 10.20.193.78:0/548513625 >> v1:10.20.193.78:6790/0 conn(0x7f9838181d50 legacy=0x7f98381a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:10.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9836ffd640 1 -- 10.20.193.78:0/548513625 >> v1:10.20.193.78:6789/0 conn(0x7f9838085790 legacy=0x7f9838089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:10.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193072758 0 0) 0x7f982c002c60 con 0x7f9838085790 2026-02-13T18:13:10.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f98367fc640 1 -- 10.20.193.78:0/548513625 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 legacy=0x7f9838085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:10.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient(hunting): my global_id is 74181 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9824003620 con 0x7f9838085790 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2575285799 0 0) 0x7f9824003620 con 0x7f9838085790 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 >> v1:10.20.193.78:6790/0 conn(0x7f9838181d50 legacy=0x7f98381a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 legacy=0x7f9838085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 monclient: found mon.noname-a 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:10.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9838087540 con 0x7f9838085790 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: _finish_auth 0 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f982c0032e0 con 0x7f9838085790 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: dump: 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.087 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 5 monclient: authenticate success, global_id 74181 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f982c0049a0 con 0x7f9838085790 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 1 -- 10.20.193.78:0/548513625 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f982c004d30 con 0x7f9838085790 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:10.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9835ffb640 10 monclient: dump: 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:10.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 4 set_mon_vals no callback set 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: shutdown 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- 10.20.193.78:0/548513625 >> v1:10.20.193.78:6789/0 conn(0x7f9838085790 legacy=0x7f9838089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- 10.20.193.78:0/548513625 shutdown_connections 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- 10.20.193.78:0/548513625 >> 10.20.193.78:0/548513625 conn(0x7f9838091720 msgr2=0x7f9838091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- 10.20.193.78:0/548513625 shutdown_connections 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- 10.20.193.78:0/548513625 wait complete. 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: build_initial_monmap 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: monmap: 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:10.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 Processor -- start 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- start start 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: init 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:10.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient(hunting): picked mon.noname-a con 0x7f9838085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient(hunting): picked mon.noname-b con 0x7f9838085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient(hunting): picked mon.noname-c con 0x7f9838181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983807fba0 con 0x7f9838085790 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9838181b60 con 0x7f9838085b60 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9838088910 con 0x7f9838181d50 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f983d2bb640 10 monclient(hunting): authenticate will time out at 1021.135874s 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9836ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9838085790 0x7f983812fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:41878/0 (socket says 10.20.193.78:41878) 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.077+0000 7f9836ffd640 1 -- 10.20.193.78:0/462660836 learned_addr learned my addr 10.20.193.78:0/462660836 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:10.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f9836ffd640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.78:6789/0 conn(0x7f9838085790 legacy=0x7f983812fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98377fe640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.78:6790/0 conn(0x7f9838181d50 legacy=0x7f9838181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239912131 0 0) 0x7f983807fba0 con 0x7f9838085790 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): my global_id is 74184 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9804003620 con 0x7f9838085790 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98367fc640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 legacy=0x7f9838180d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1343981271 0 0) 0x7f9804003620 con 0x7f9838085790 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f983807fba0 con 0x7f9838085790 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f982c002b30 con 0x7f9838085790 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:10.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): dump: 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:10.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98367fc640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 legacy=0x7f9838180d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98367fc640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 legacy=0x7f9838180d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98367fc640 1 --1- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 0x7f9838180d40 :-1 s=OPENED pgs=352 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 363329910 0 0) 0x7f983807fba0 con 0x7f9838085790 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98367fc640 1 --1- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 0x7f9838180d40 :-1 s=OPENED pgs=352 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.78:6790/0 conn(0x7f9838181d50 legacy=0x7f9838181450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6789/0 conn(0x7f9838085b60 legacy=0x7f9838180d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: _finish_hunting 0 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 monclient: found mon.a 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:10.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98380850c0 con 0x7f9838085790 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: _finish_auth 0 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: _check_auth_tickets 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: ms_handle_reset stray mon v1:10.20.193.187:6789/0 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 5 monclient: authenticate success, global_id 74184 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 monclient: _renew_subs 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f983807d840 con 0x7f9838085790 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 monclient: _renew_subs 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f983807e3a0 con 0x7f9838085790 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f982c0049a0 con 0x7f9838085790 2026-02-13T18:13:10.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f982c0050a0 con 0x7f9838085790 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98357fa640 4 set_mon_vals no callback set 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 10 monclient: dump: 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:10.097 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983808f620 con 0x7f9838085790 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f982c011730 con 0x7f9838085790 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(389..389 src has 1..389) ==== 3931+0+0 (unknown 3560133422 0 0) 0x7f982c04c740 con 0x7f9838085790 2026-02-13T18:13:10.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.081+0000 7f98367fc640 10 monclient: get_auth_request con 0x7f980403d3e0 auth_method 0 2026-02-13T18:13:10.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.085+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f983808f620 con 0x7f9838085790 2026-02-13T18:13:10.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.085+0000 7f98177fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:10.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.085+0000 7f98177fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:10.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:10.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:10.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:10.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f98380510e0 con 0x7f9838085790 2026-02-13T18:13:10.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f98177fe640 1 -- 10.20.193.78:0/462660836 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 3293910985) 0x7f9838088400 con 0x7f9838085790 2026-02-13T18:13:10.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f98177fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:10.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f98177fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:10.207 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":24,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.187:6812/2668687789 conn(0x7f980403d3e0 legacy=0x7f980405d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 10 monclient: shutdown 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 >> v1:10.20.193.78:6789/0 conn(0x7f9838085790 legacy=0x7f983812fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 shutdown_connections 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 >> 10.20.193.78:0/462660836 conn(0x7f9838091720 msgr2=0x7f983805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 shutdown_connections 2026-02-13T18:13:10.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:10.205+0000 7f983d2bb640 1 -- 10.20.193.78:0/462660836 wait complete. 2026-02-13T18:13:13.217 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:13.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient: get_monmap_and_config 2026-02-13T18:13:13.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient: build_initial_monmap 2026-02-13T18:13:13.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient: monmap: 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:13.287764+0000 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:13.287764+0000 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:13.289 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 1 Processor -- start 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 1 -- start start 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient: init 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient(hunting): picked mon.noname-a con 0x7f583008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient(hunting): picked mon.noname-b con 0x7f583008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient(hunting): picked mon.noname-c con 0x7f583008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:13.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5830089e80 con 0x7f583008c2f0 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5830088c20 con 0x7f583008cdd0 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5830089ba0 con 0x7f583008dc80 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f5837b3b640 10 monclient(hunting): authenticate will time out at 1024.342897s 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f58358b0640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f583008c2f0 0x7f583008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:41892/0 (socket says 10.20.193.78:41892) 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f58350af640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f583008dc80 0x7f5830181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57244/0 (socket says 10.20.193.78:57244) 2026-02-13T18:13:13.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.284+0000 7f58358b0640 1 -- 10.20.193.78:0/370548468 learned_addr learned my addr 10.20.193.78:0/370548468 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58358b0640 1 -- 10.20.193.78:0/370548468 >> v1:10.20.193.78:6789/0 conn(0x7f583008c2f0 legacy=0x7f583008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58350af640 1 -- 10.20.193.78:0/370548468 >> v1:10.20.193.78:6790/0 conn(0x7f583008dc80 legacy=0x7f5830181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58360b1640 1 -- 10.20.193.78:0/370548468 >> v1:10.20.193.187:6789/0 conn(0x7f583008cdd0 legacy=0x7f58301a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266022373 0 0) 0x7f5830088c20 con 0x7f583008cdd0 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient(hunting): _negotiate 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient(hunting): my global_id is 84109 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5818003620 con 0x7f583008cdd0 2026-02-13T18:13:13.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3687815973 0 0) 0x7f5818003620 con 0x7f583008cdd0 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 >> v1:10.20.193.78:6790/0 conn(0x7f583008dc80 legacy=0x7f5830181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 >> v1:10.20.193.78:6789/0 conn(0x7f583008c2f0 legacy=0x7f583008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: _finish_hunting 0 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 monclient: found mon.noname-c 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583008d370 con 0x7f583008cdd0 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: _finish_auth 0 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: _check_auth_tickets 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f582c004670 con 0x7f583008cdd0 2026-02-13T18:13:13.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: dump: 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:13.297 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 5 monclient: authenticate success, global_id 84109 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f582c004940 con 0x7f583008cdd0 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 1 -- 10.20.193.78:0/370548468 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f582c004dd0 con 0x7f583008cdd0 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58348ae640 10 monclient: dump: 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:13.298 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:13.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 4 set_mon_vals no callback set 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: shutdown 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- 10.20.193.78:0/370548468 >> v1:10.20.193.187:6789/0 conn(0x7f583008cdd0 legacy=0x7f58301a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- 10.20.193.78:0/370548468 shutdown_connections 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- 10.20.193.78:0/370548468 >> 10.20.193.78:0/370548468 conn(0x7f5830091720 msgr2=0x7f5830091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- 10.20.193.78:0/370548468 shutdown_connections 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- 10.20.193.78:0/370548468 wait complete. 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: build_initial_monmap 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: monmap: 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:13.300 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 Processor -- start 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- start start 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: init 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:13.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient(hunting): picked mon.noname-c con 0x7f583008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient(hunting): picked mon.noname-a con 0x7f583008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient(hunting): picked mon.noname-b con 0x7f583008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58300865b0 con 0x7f583008cdd0 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f583005dc00 con 0x7f583008dc80 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5830088910 con 0x7f583008c2f0 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f5837b3b640 10 monclient(hunting): authenticate will time out at 1024.347927s 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58358b0640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f583008c2f0 0x7f5830085790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57246/0 (socket says 10.20.193.78:57246) 2026-02-13T18:13:13.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.288+0000 7f58358b0640 1 -- 10.20.193.78:0/4238148000 learned_addr learned my addr 10.20.193.78:0/4238148000 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f58358b0640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.78:6790/0 conn(0x7f583008c2f0 legacy=0x7f5830085790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f58350af640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.78:6789/0 conn(0x7f583008cdd0 legacy=0x7f5830085ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f58360b1640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.187:6789/0 conn(0x7f583008dc80 legacy=0x7f5830195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870687974 0 0) 0x7f583005dc00 con 0x7f583008dc80 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:13.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): my global_id is 84112 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5800003620 con 0x7f583008dc80 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f58360b1640 1 --1- 10.20.193.78:0/4238148000 >> v1:10.20.193.187:6789/0 conn(0x7f583008dc80 0x7f5830195670 :-1 s=OPENED pgs=354 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f5800003620 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3769676636 0 0) 0x7f5800003620 con 0x7f583008dc80 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f583005dc00 con 0x7f583008dc80 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f582c004c20 con 0x7f583008dc80 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): dump: 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:13.305 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:13.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:13.292+0000 7f581e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:14.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3223554584 0 0) 0x7f583005dc00 con 0x7f583008dc80 2026-02-13T18:13:14.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.78:6790/0 conn(0x7f583008c2f0 legacy=0x7f5830085790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:14.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.78:6789/0 conn(0x7f583008cdd0 legacy=0x7f5830085ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 monclient: found mon.b 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5830087170 con 0x7f583008dc80 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 5 monclient: authenticate success, global_id 84112 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 10 monclient: _renew_subs 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5830082670 con 0x7f583008dc80 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 10 monclient: _renew_subs 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5830081040 con 0x7f583008dc80 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f582c004910 con 0x7f583008dc80 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f582c005660 con 0x7f583008dc80 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581e7fc640 10 monclient: dump: 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:14.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f581ffff640 4 set_mon_vals no callback set 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.120+0000 7f5837b3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.124+0000 7f5837b3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.124+0000 7f5837b3b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.124+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583008f620 con 0x7f583008dc80 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.124+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f582c005930 con 0x7f583008dc80 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.124+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(389..389 src has 1..389) ==== 3931+0+0 (unknown 3560133422 0 0) 0x7f582c04db70 con 0x7f583008dc80 2026-02-13T18:13:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.124+0000 7f58358b0640 10 monclient: get_auth_request con 0x7f580003d400 auth_method 0 2026-02-13T18:13:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.128+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f583008f620 con 0x7f583008dc80 2026-02-13T18:13:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.128+0000 7f581e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.128+0000 7f581e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58300822f0 con 0x7f583008dc80 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f581e7fc640 1 -- 10.20.193.78:0/4238148000 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 1899095048) 0x7f58300822f0 con 0x7f583008dc80 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f581e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f581e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:14.246 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":24,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.187:6812/2668687789 conn(0x7f580003d400 legacy=0x7f580005d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 10 monclient: shutdown 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 >> v1:10.20.193.187:6789/0 conn(0x7f583008dc80 legacy=0x7f5830195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 shutdown_connections 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 >> 10.20.193.78:0/4238148000 conn(0x7f5830091720 msgr2=0x7f583008a380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 shutdown_connections 2026-02-13T18:13:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:14.244+0000 7f5837b3b640 1 -- 10.20.193.78:0/4238148000 wait complete. 2026-02-13T18:13:17.257 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient: get_monmap_and_config 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient: build_initial_monmap 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient: monmap: 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:17.330941+0000 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:17.330941+0000 2026-02-13T18:13:17.331 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:17.332 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:17.332 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:17.332 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:17.332 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:17.332 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:17.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 1 Processor -- start 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 1 -- start start 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient: init 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient(hunting): picked mon.noname-c con 0x7fd4f008e400 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient(hunting): picked mon.noname-b con 0x7fd4f008eee0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient(hunting): picked mon.noname-a con 0x7fd4f0057870 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f0056e90 con 0x7fd4f0057870 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f00565f0 con 0x7fd4f008e400 2026-02-13T18:13:17.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f00568d0 con 0x7fd4f008eee0 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f6931640 10 monclient(hunting): authenticate will time out at 1028.386363s 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f4ea7640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd4f0057870 0x7fd4f01a56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:41898/0 (socket says 10.20.193.78:41898) 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4f4ea7640 1 -- 10.20.193.78:0/1746926276 learned_addr learned my addr 10.20.193.78:0/1746926276 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.328+0000 7fd4ef7fe640 1 --1- 10.20.193.78:0/1746926276 >> v1:10.20.193.78:6790/0 conn(0x7fd4f008eee0 0x7fd4f0183fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57258/0 (socket says 10.20.193.78:57258) 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.332+0000 7fd4f4ea7640 1 -- 10.20.193.78:0/1746926276 >> v1:10.20.193.78:6789/0 conn(0x7fd4f0057870 legacy=0x7fd4f01a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:17.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.332+0000 7fd4ef7fe640 1 -- 10.20.193.78:0/1746926276 >> v1:10.20.193.78:6790/0 conn(0x7fd4f008eee0 legacy=0x7fd4f0183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:17.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.332+0000 7fd4effff640 1 -- 10.20.193.78:0/1746926276 >> v1:10.20.193.187:6789/0 conn(0x7fd4f008e400 legacy=0x7fd4f008e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364902422 0 0) 0x7fd4f0056e90 con 0x7fd4f0057870 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient(hunting): my global_id is 74187 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4d4003620 con 0x7fd4f0057870 2026-02-13T18:13:17.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116991256 0 0) 0x7fd4d4003620 con 0x7fd4f0057870 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 >> v1:10.20.193.78:6790/0 conn(0x7fd4f008eee0 legacy=0x7fd4f0183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 >> v1:10.20.193.187:6789/0 conn(0x7fd4f008e400 legacy=0x7fd4f008e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: _finish_hunting 0 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 monclient: found mon.noname-a 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f008f530 con 0x7fd4f0057870 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: _finish_auth 0 2026-02-13T18:13:17.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: _check_auth_tickets 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd4e4004620 con 0x7fd4f0057870 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 5 monclient: authenticate success, global_id 74187 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: dump: 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.871 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4e40048f0 con 0x7fd4f0057870 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 1 -- 10.20.193.78:0/1746926276 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd4e4006060 con 0x7fd4f0057870 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:17.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4eeffd640 10 monclient: dump: 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:17.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 4 set_mon_vals no callback set 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: shutdown 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- 10.20.193.78:0/1746926276 >> v1:10.20.193.78:6789/0 conn(0x7fd4f0057870 legacy=0x7fd4f01a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- 10.20.193.78:0/1746926276 shutdown_connections 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- 10.20.193.78:0/1746926276 >> 10.20.193.78:0/1746926276 conn(0x7fd4f0054e30 msgr2=0x7fd4f0093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- 10.20.193.78:0/1746926276 shutdown_connections 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- 10.20.193.78:0/1746926276 wait complete. 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: build_initial_monmap 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: monmap: 2026-02-13T18:13:17.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 Processor -- start 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- start start 2026-02-13T18:13:17.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: init 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient(hunting): picked mon.noname-b con 0x7fd4f0057870 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient(hunting): picked mon.noname-c con 0x7fd4f008e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient(hunting): picked mon.noname-a con 0x7fd4f008eee0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f008abf0 con 0x7fd4f008eee0 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f0140b10 con 0x7fd4f0057870 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f013f9f0 con 0x7fd4f008e400 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f6931640 10 monclient(hunting): authenticate will time out at 1028.922913s 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f4ea7640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd4f008eee0 0x7fd4f0195eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:41908/0 (socket says 10.20.193.78:41908) 2026-02-13T18:13:17.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4ef7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd4f008e400 0x7fd4f0194790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57270/0 (socket says 10.20.193.78:57270) 2026-02-13T18:13:17.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.864+0000 7fd4f4ea7640 1 -- 10.20.193.78:0/247674094 learned_addr learned my addr 10.20.193.78:0/247674094 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:17.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f4ea7640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.78:6789/0 conn(0x7fd4f008eee0 legacy=0x7fd4f0195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:17.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ef7fe640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.78:6790/0 conn(0x7fd4f008e400 legacy=0x7fd4f0194790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:17.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752940464 0 0) 0x7fd4f008f530 con 0x7fd4f008eee0 2026-02-13T18:13:17.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:17.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:17.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): my global_id is 74190 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4effff640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.187:6789/0 conn(0x7fd4f0057870 legacy=0x7fd4f0143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c0003620 con 0x7fd4f008eee0 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1808153 0 0) 0x7fd4c0003620 con 0x7fd4f008eee0 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4f008f530 con 0x7fd4f008eee0 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd4e4005df0 con 0x7fd4f008eee0 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): dump: 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:17.881 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2569869388 0 0) 0x7fd4f008f530 con 0x7fd4f008eee0 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.78:6790/0 conn(0x7fd4f008e400 legacy=0x7fd4f0194790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:17.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.187:6789/0 conn(0x7fd4f0057870 legacy=0x7fd4f0143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: _finish_hunting 0 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 monclient: found mon.a 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f0141a70 con 0x7fd4f008eee0 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: _finish_auth 0 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: _check_auth_tickets 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 5 monclient: authenticate success, global_id 74190 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 monclient: _renew_subs 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f0141160 con 0x7fd4f008eee0 2026-02-13T18:13:17.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 monclient: _renew_subs 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4f0143990 con 0x7fd4f008eee0 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4e4006030 con 0x7fd4f008eee0 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd4e4004a40 con 0x7fd4f008eee0 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 10 monclient: dump: 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.884 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ee7fc640 4 set_mon_vals no callback set 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd4e4012b70 con 0x7fd4f008eee0 2026-02-13T18:13:17.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f0088340 con 0x7fd4f008eee0 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(389..389 src has 1..389) ==== 3931+0+0 (unknown 3560133422 0 0) 0x7fd4e404db40 con 0x7fd4f008eee0 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.868+0000 7fd4effff640 10 monclient: get_auth_request con 0x7fd4c003d450 auth_method 0 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.872+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fd4f008abf0 con 0x7fd4f008eee0 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.872+0000 7fd4ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:17.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.872+0000 7fd4ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:1693: done (4 left) 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:1694: snap_create 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:1689: finishing rollback tid 0 to trial18717860-48 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:1689: finishing rollback tid 1 to trial18717860-48 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:1689: finishing rollback tid 2 to trial18717860-48 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 894 (ObjNum 558 snap 187 seq_num 558) dirty exists 2026-02-13T18:13:17.928 INFO:tasks.rados.rados.0.trial187.stdout:1690: finishing write tid 1 to trial18717860-49 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: finishing write tid 2 to trial18717860-49 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: finishing write tid 3 to trial18717860-49 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: finishing write tid 4 to trial18717860-49 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: finishing write tid 5 to trial18717860-49 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: oid 49 updating version 0 to 605 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: oid 49 version 605 is already newer than 602 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: oid 49 version 605 is already newer than 604 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: oid 49 version 605 is already newer than 603 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 605 (ObjNum 563 snap 189 seq_num 563) dirty exists 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: left oid 49 (ObjNum 563 snap 189 seq_num 563) 2026-02-13T18:13:17.929 INFO:tasks.rados.rados.0.trial187.stdout:1691: expect (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:13:17.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:17.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:17.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd4f01415c0 con 0x7fd4f008eee0 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4ecff9640 1 -- 10.20.193.78:0/247674094 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 901946349) 0x7fd4e4018b50 con 0x7fd4f008eee0 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4ecff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd4c003d450 legacy=0x7fd4c005d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 10 monclient: shutdown 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:17.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 >> v1:10.20.193.78:6789/0 conn(0x7fd4f008eee0 legacy=0x7fd4f0195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:18.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 shutdown_connections 2026-02-13T18:13:18.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 >> 10.20.193.78:0/247674094 conn(0x7fd4f0054e30 msgr2=0x7fd4f0088da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:18.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 shutdown_connections 2026-02-13T18:13:18.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:17.996+0000 7fd4f6931640 1 -- 10.20.193.78:0/247674094 wait complete. 2026-02-13T18:13:18.006 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: finishing write tid 1 to trial18717860-37 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: finishing write tid 2 to trial18717860-37 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: finishing write tid 3 to trial18717860-37 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: finishing write tid 4 to trial18717860-37 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: finishing write tid 5 to trial18717860-37 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: oid 37 updating version 0 to 895 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: oid 37 updating version 895 to 898 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: oid 37 version 898 is already newer than 896 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: oid 37 version 898 is already newer than 897 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 898 (ObjNum 564 snap 189 seq_num 564) dirty exists 2026-02-13T18:13:18.039 INFO:tasks.rados.rados.0.trial187.stdout:1692: left oid 37 (ObjNum 564 snap 189 seq_num 564) 2026-02-13T18:13:18.929 INFO:tasks.rados.rados.0.trial187.stdout:1689: done (4 left) 2026-02-13T18:13:18.929 INFO:tasks.rados.rados.0.trial187.stdout:1690: done (3 left) 2026-02-13T18:13:18.929 INFO:tasks.rados.rados.0.trial187.stdout:1691: done (2 left) 2026-02-13T18:13:18.929 INFO:tasks.rados.rados.0.trial187.stdout:1692: done (1 left) 2026-02-13T18:13:18.929 INFO:tasks.rados.rados.0.trial187.stdout:1694: done (0 left) 2026-02-13T18:13:18.929 INFO:tasks.rados.rados.0.trial187.stdout:1695: delete oid 9 current snap is 190 2026-02-13T18:13:18.931 INFO:tasks.rados.rados.0.trial187.stdout:1695: done (0 left) 2026-02-13T18:13:18.932 INFO:tasks.rados.rados.0.trial187.stdout:1696: snap_remove snap 185 2026-02-13T18:13:19.935 INFO:tasks.rados.rados.0.trial187.stdout:1696: done (0 left) 2026-02-13T18:13:19.935 INFO:tasks.rados.rados.0.trial187.stdout:1697: write (excl) oid 7 current snap is 190 2026-02-13T18:13:19.935 INFO:tasks.rados.rados.0.trial187.stdout:1697: seq_num 566 ranges {712762=401056,1537867=645855,2860355=652407} 2026-02-13T18:13:19.942 INFO:tasks.rados.rados.0.trial187.stdout:1697: writing trial18717860-7 from 712762 to 1113818 tid 1 2026-02-13T18:13:19.949 INFO:tasks.rados.rados.0.trial187.stdout:1697: writing trial18717860-7 from 1537867 to 2183722 tid 2 2026-02-13T18:13:19.958 INFO:tasks.rados.rados.0.trial187.stdout:1697: writing trial18717860-7 from 2860355 to 3512762 tid 3 2026-02-13T18:13:19.958 INFO:tasks.rados.rados.0.trial187.stdout:1698: write oid 22 current snap is 190 2026-02-13T18:13:19.958 INFO:tasks.rados.rados.0.trial187.stdout:1698: seq_num 567 ranges {729569=476305,1996349=505866,3004131=525438} 2026-02-13T18:13:19.966 INFO:tasks.rados.rados.0.trial187.stdout:1698: writing trial18717860-22 from 729569 to 1205874 tid 1 2026-02-13T18:13:19.975 INFO:tasks.rados.rados.0.trial187.stdout:1698: writing trial18717860-22 from 1996349 to 2502215 tid 2 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1698: writing trial18717860-22 from 3004131 to 3529569 tid 3 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1699: delete oid 20 current snap is 190 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1697: finishing write tid 1 to trial18717860-7 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1697: finishing write tid 2 to trial18717860-7 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1697: finishing write tid 3 to trial18717860-7 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1697: finishing write tid 4 to trial18717860-7 2026-02-13T18:13:19.981 INFO:tasks.rados.rados.0.trial187.stdout:1697: finishing write tid 5 to trial18717860-7 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1697: oid 7 updating version 0 to 593 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1697: oid 7 version 593 is already newer than 592 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1697: oid 7 updating version 593 to 594 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1697: oid 7 updating version 594 to 595 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 595 (ObjNum 566 snap 190 seq_num 566) dirty exists 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1697: left oid 7 (ObjNum 566 snap 190 seq_num 566) 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1698: finishing write tid 1 to trial18717860-22 2026-02-13T18:13:19.982 INFO:tasks.rados.rados.0.trial187.stdout:1698: finishing write tid 2 to trial18717860-22 2026-02-13T18:13:19.983 INFO:tasks.rados.rados.0.trial187.stdout:1697: done (2 left) 2026-02-13T18:13:19.983 INFO:tasks.rados.rados.0.trial187.stdout:1699: done (1 left) 2026-02-13T18:13:19.983 INFO:tasks.rados.rados.0.trial187.stdout:1700: copy_from oid 25 from oid 45 current snap is 190 2026-02-13T18:13:19.983 INFO:tasks.rados.rados.0.trial187.stdout:1701: read oid 17 snap -1 2026-02-13T18:13:19.983 INFO:tasks.rados.rados.0.trial187.stdout:1701: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:13:19.984 INFO:tasks.rados.rados.0.trial187.stdout:1702: read oid 31 snap -1 2026-02-13T18:13:19.984 INFO:tasks.rados.rados.0.trial187.stdout:1702: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:13:19.984 INFO:tasks.rados.rados.0.trial187.stdout:1703: snap_remove snap 187 2026-02-13T18:13:20.937 INFO:tasks.rados.rados.0.trial187.stdout:1703: done (4 left) 2026-02-13T18:13:20.938 INFO:tasks.rados.rados.0.trial187.stdout:1704: snap_create 2026-02-13T18:13:20.938 INFO:tasks.rados.rados.0.trial187.stdout:1700: finishing copy_from to trial18717860-25 2026-02-13T18:13:20.938 INFO:tasks.rados.rados.0.trial187.stdout:1700: got expected ENOENT (src dne) 2026-02-13T18:13:20.938 INFO:tasks.rados.rados.0.trial187.stdout:1698: finishing write tid 3 to trial18717860-22 2026-02-13T18:13:20.938 INFO:tasks.rados.rados.0.trial187.stdout:1700: finishing copy_from racing read to trial18717860-25 2026-02-13T18:13:20.938 INFO:tasks.rados.rados.0.trial187.stdout:1701: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:13:20.944 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1450559 2026-02-13T18:13:21.009 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:21.055 INFO:tasks.rados.rados.0.trial187.stdout:1698: finishing write tid 4 to trial18717860-22 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1698: finishing write tid 5 to trial18717860-22 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1698: oid 22 updating version 0 to 912 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1698: oid 22 version 912 is already newer than 911 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1698: oid 22 updating version 912 to 913 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1698: oid 22 version 913 is already newer than 910 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 913 (ObjNum 567 snap 190 seq_num 567) dirty exists 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1698: left oid 22 (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:13:21.056 INFO:tasks.rados.rados.0.trial187.stdout:1702: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:13:21.071 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2623594 2026-02-13T18:13:21.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient: get_monmap_and_config 2026-02-13T18:13:21.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient: build_initial_monmap 2026-02-13T18:13:21.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient: monmap: 2026-02-13T18:13:21.079 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:21.079 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:21.079 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:21.079341+0000 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:21.079341+0000 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:21.080 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 1 Processor -- start 2026-02-13T18:13:21.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 1 -- start start 2026-02-13T18:13:21.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient: init 2026-02-13T18:13:21.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient(hunting): picked mon.noname-c con 0x7f97e408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient(hunting): picked mon.noname-b con 0x7f97e408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient(hunting): picked mon.noname-a con 0x7f97e408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e4089e80 con 0x7f97e408cdd0 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e4088c20 con 0x7f97e408c2f0 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e4089ba0 con 0x7f97e408dc80 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e8b26640 10 monclient(hunting): authenticate will time out at 1032.134480s 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e2d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f97e408cdd0 0x7f97e41a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40544/0 (socket says 10.20.193.78:40544) 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e1d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f97e408dc80 0x7f97e4181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48984/0 (socket says 10.20.193.78:48984) 2026-02-13T18:13:21.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.076+0000 7f97e2d76640 1 -- 10.20.193.78:0/2649113948 learned_addr learned my addr 10.20.193.78:0/2649113948 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e2d76640 1 -- 10.20.193.78:0/2649113948 >> v1:10.20.193.78:6789/0 conn(0x7f97e408cdd0 legacy=0x7f97e41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1d74640 1 -- 10.20.193.78:0/2649113948 >> v1:10.20.193.78:6790/0 conn(0x7f97e408dc80 legacy=0x7f97e4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800577058 0 0) 0x7f97e4089e80 con 0x7f97e408cdd0 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): _negotiate 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:21.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): my global_id is 74193 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97d0003620 con 0x7f97e408cdd0 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36104680 0 0) 0x7f97e4089ba0 con 0x7f97e408dc80 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): _negotiate 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient(hunting): my global_id is 4754 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e4089e80 con 0x7f97e408dc80 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e2575640 1 -- 10.20.193.78:0/2649113948 >> v1:10.20.193.187:6789/0 conn(0x7f97e408c2f0 legacy=0x7f97e408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2808497502 0 0) 0x7f97d0003620 con 0x7f97e408cdd0 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 >> v1:10.20.193.78:6790/0 conn(0x7f97e408dc80 legacy=0x7f97e4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 >> v1:10.20.193.187:6789/0 conn(0x7f97e408c2f0 legacy=0x7f97e408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: _finish_hunting 0 2026-02-13T18:13:21.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 monclient: found mon.noname-a 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e408d370 con 0x7f97e408cdd0 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: _finish_auth 0 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: _check_auth_tickets 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f97d40046a0 con 0x7f97e408cdd0 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: dump: 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:21.088 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 5 monclient: authenticate success, global_id 74193 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97d4004930 con 0x7f97e408cdd0 2026-02-13T18:13:21.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 4 set_mon_vals no callback set 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 1 -- 10.20.193.78:0/2649113948 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f97d4006060 con 0x7f97e408cdd0 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e1573640 10 monclient: dump: 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:21.090 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: shutdown 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- 10.20.193.78:0/2649113948 >> v1:10.20.193.78:6789/0 conn(0x7f97e408cdd0 legacy=0x7f97e41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- 10.20.193.78:0/2649113948 shutdown_connections 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- 10.20.193.78:0/2649113948 >> 10.20.193.78:0/2649113948 conn(0x7f97e4091720 msgr2=0x7f97e4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- 10.20.193.78:0/2649113948 shutdown_connections 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- 10.20.193.78:0/2649113948 wait complete. 2026-02-13T18:13:21.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: build_initial_monmap 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: monmap: 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 Processor -- start 2026-02-13T18:13:21.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- start start 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: init 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient(hunting): picked mon.noname-c con 0x7f97e408c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient(hunting): picked mon.noname-a con 0x7f97e408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient(hunting): picked mon.noname-b con 0x7f97e408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e41540d0 con 0x7f97e408cdd0 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e4088910 con 0x7f97e408dc80 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e40824a0 con 0x7f97e408c2f0 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e8b26640 10 monclient(hunting): authenticate will time out at 1032.138959s 2026-02-13T18:13:21.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e2575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f97e408c2f0 0x7f97e40839d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49000/0 (socket says 10.20.193.78:49000) 2026-02-13T18:13:21.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.080+0000 7f97e2575640 1 -- 10.20.193.78:0/4076434969 learned_addr learned my addr 10.20.193.78:0/4076434969 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:21.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e2575640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.78:6790/0 conn(0x7f97e408c2f0 legacy=0x7f97e40839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:21.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e1d74640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.78:6789/0 conn(0x7f97e408cdd0 legacy=0x7f97e41944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633293637 0 0) 0x7f97e41540d0 con 0x7f97e408cdd0 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): my global_id is 74196 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b0003620 con 0x7f97e408cdd0 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661092683 0 0) 0x7f97e40824a0 con 0x7f97e408c2f0 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): my global_id is 4757 2026-02-13T18:13:21.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e41540d0 con 0x7f97e408c2f0 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e2d76640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.187:6789/0 conn(0x7f97e408dc80 legacy=0x7f97e4195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1520298276 0 0) 0x7f97b0003620 con 0x7f97e408cdd0 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97e40824a0 con 0x7f97e408cdd0 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f97cc0033a0 con 0x7f97e408cdd0 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): dump: 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.099 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2475626162 0 0) 0x7f97e41540d0 con 0x7f97e408c2f0 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97b0003620 con 0x7f97e408c2f0 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f97d8003420 con 0x7f97e408c2f0 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:21.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient(hunting): dump: 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3796605422 0 0) 0x7f97e40824a0 con 0x7f97e408cdd0 2026-02-13T18:13:21.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.78:6790/0 conn(0x7f97e408c2f0 legacy=0x7f97e40839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.187:6789/0 conn(0x7f97e408dc80 legacy=0x7f97e4195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: _finish_hunting 0 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 monclient: found mon.a 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e4080140 con 0x7f97e408cdd0 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: _finish_auth 0 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: _check_auth_tickets 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 5 monclient: authenticate success, global_id 74196 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 monclient: _renew_subs 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:21.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97e40821c0 con 0x7f97e408cdd0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 monclient: _renew_subs 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f97e40840e0 con 0x7f97e408cdd0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e408f5e0 con 0x7f97e408cdd0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97cc004b90 con 0x7f97e408cdd0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f97cc004ef0 con 0x7f97e408cdd0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:21.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 10 monclient: dump: 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:21.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f97cc005140 con 0x7f97e408cdd0 2026-02-13T18:13:21.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e0d72640 4 set_mon_vals no callback set 2026-02-13T18:13:21.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(393..393 src has 1..393) ==== 3959+0+0 (unknown 1185550868 0 0) 0x7f97cc04c6f0 con 0x7f97e408cdd0 2026-02-13T18:13:21.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.084+0000 7f97e2575640 10 monclient: get_auth_request con 0x7f97b003d6f0 auth_method 0 2026-02-13T18:13:21.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.088+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f97cc017610 con 0x7f97e408cdd0 2026-02-13T18:13:21.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.088+0000 7f97caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:21.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.088+0000 7f97caffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:21.132 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3089632 2026-02-13T18:13:21.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f97e4090810 con 0x7f97e408cdd0 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97caffd640 1 -- 10.20.193.78:0/4076434969 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 2175072313) 0x7f97cc01c930 con 0x7f97e408cdd0 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97caffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97caffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:21.206 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:21.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.187:6812/2668687789 conn(0x7f97b003d6f0 legacy=0x7f97b005dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 10 monclient: shutdown 2026-02-13T18:13:21.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:21.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 >> v1:10.20.193.78:6789/0 conn(0x7f97e408cdd0 legacy=0x7f97e41944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:21.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 shutdown_connections 2026-02-13T18:13:21.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 >> 10.20.193.78:0/4076434969 conn(0x7f97e4091720 msgr2=0x7f97e405b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:21.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 shutdown_connections 2026-02-13T18:13:21.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:21.204+0000 7f97e8b26640 1 -- 10.20.193.78:0/4076434969 wait complete. 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:1698: done (4 left) 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:1700: done (3 left) 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:1701: done (2 left) 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:1702: done (1 left) 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:1704: done (0 left) 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:1705: rollback oid 46 current snap is 191 2026-02-13T18:13:21.938 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 183 2026-02-13T18:13:21.939 INFO:tasks.rados.rados.0.trial187.stdout:1706: delete oid 31 current snap is 191 2026-02-13T18:13:21.943 INFO:tasks.rados.rados.0.trial187.stdout:1705: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:13:21.944 INFO:tasks.rados.rados.0.trial187.stdout:1705: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:13:21.944 INFO:tasks.rados.rados.0.trial187.stdout:1705: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:13:21.944 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 601 (ObjNum 437 snap 126 seq_num 437) dirty exists 2026-02-13T18:13:21.945 INFO:tasks.rados.rados.0.trial187.stdout:1705: done (1 left) 2026-02-13T18:13:21.945 INFO:tasks.rados.rados.0.trial187.stdout:1706: done (0 left) 2026-02-13T18:13:21.945 INFO:tasks.rados.rados.0.trial187.stdout:1707: read oid 10 snap -1 2026-02-13T18:13:21.945 INFO:tasks.rados.rados.0.trial187.stdout:1707: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:13:21.945 INFO:tasks.rados.rados.0.trial187.stdout:1708: read oid 4 snap 184 2026-02-13T18:13:21.946 INFO:tasks.rados.rados.0.trial187.stdout:1708: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:13:21.946 INFO:tasks.rados.rados.0.trial187.stdout:1709: delete oid 11 current snap is 191 2026-02-13T18:13:21.948 INFO:tasks.rados.rados.0.trial187.stdout:1709: done (2 left) 2026-02-13T18:13:21.948 INFO:tasks.rados.rados.0.trial187.stdout:1710: rollback oid 13 current snap is 191 2026-02-13T18:13:21.948 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 13 to 169 2026-02-13T18:13:21.948 INFO:tasks.rados.rados.0.trial187.stdout:1711: snap_remove snap 174 2026-02-13T18:13:22.944 INFO:tasks.rados.rados.0.trial187.stdout:1711: done (3 left) 2026-02-13T18:13:22.944 INFO:tasks.rados.rados.0.trial187.stdout:1712: snap_remove snap 189 2026-02-13T18:13:23.946 INFO:tasks.rados.rados.0.trial187.stdout:1712: done (3 left) 2026-02-13T18:13:23.946 INFO:tasks.rados.rados.0.trial187.stdout:1713: snap_remove snap 186 2026-02-13T18:13:24.217 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient: get_monmap_and_config 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient: monmap: 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:24.287620+0000 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:24.287620+0000 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.289 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 1 Processor -- start 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 1 -- start start 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient: init 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient(hunting): picked mon.noname-a con 0x7f9e7c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient(hunting): picked mon.noname-c con 0x7f9e7c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient(hunting): picked mon.noname-b con 0x7f9e7c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c089e80 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c088c20 con 0x7f9e7c08dc80 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c089ba0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e83d59640 10 monclient(hunting): authenticate will time out at 1035.342793s 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e81ace640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9e7c08c2f0 0x7f9e7c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40566/0 (socket says 10.20.193.78:40566) 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e81ace640 1 -- 10.20.193.78:0/3328360168 learned_addr learned my addr 10.20.193.78:0/3328360168 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.284+0000 7f9e822cf640 1 --1- 10.20.193.78:0/3328360168 >> v1:10.20.193.78:6790/0 conn(0x7f9e7c08cdd0 0x7f9e7c1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49014/0 (socket says 10.20.193.78:49014) 2026-02-13T18:13:24.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e822cf640 1 -- 10.20.193.78:0/3328360168 >> v1:10.20.193.78:6790/0 conn(0x7f9e7c08cdd0 legacy=0x7f9e7c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e81ace640 1 -- 10.20.193.78:0/3328360168 >> v1:10.20.193.78:6789/0 conn(0x7f9e7c08c2f0 legacy=0x7f9e7c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130564065 0 0) 0x7f9e7c089ba0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): my global_id is 4760 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e64003620 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082660094 0 0) 0x7f9e7c089e80 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient(hunting): my global_id is 74199 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e7c089ba0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e812cd640 1 -- 10.20.193.78:0/3328360168 >> v1:10.20.193.187:6789/0 conn(0x7f9e7c08dc80 legacy=0x7f9e7c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1289192867 0 0) 0x7f9e64003620 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 >> v1:10.20.193.187:6789/0 conn(0x7f9e7c08dc80 legacy=0x7f9e7c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 >> v1:10.20.193.78:6789/0 conn(0x7f9e7c08c2f0 legacy=0x7f9e7c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 monclient: found mon.noname-b 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c08d370 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e78004620 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: dump: 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 5 monclient: authenticate success, global_id 4760 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e822cf640 1 --1- 10.20.193.78:0/3328360168 >> v1:10.20.193.78:6790/0 conn(0x7f9e7c08cdd0 0x7f9e7c1a3410 :-1 s=OPENED pgs=382 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f9e78005fa0 mon_map magic: 0 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e780048f0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 4 set_mon_vals no callback set 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: shutdown 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- 10.20.193.78:0/3328360168 >> v1:10.20.193.78:6790/0 conn(0x7f9e7c08cdd0 legacy=0x7f9e7c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 1 -- 10.20.193.78:0/3328360168 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e78005fa0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e80acc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- 10.20.193.78:0/3328360168 shutdown_connections 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- 10.20.193.78:0/3328360168 >> 10.20.193.78:0/3328360168 conn(0x7f9e7c091720 msgr2=0x7f9e7c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- 10.20.193.78:0/3328360168 shutdown_connections 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- 10.20.193.78:0/3328360168 wait complete. 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: monmap: 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:24.304 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 Processor -- start 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- start start 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: init 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:13:24.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient(hunting): picked mon.noname-a con 0x7f9e7c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient(hunting): picked mon.noname-c con 0x7f9e7c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient(hunting): picked mon.noname-b con 0x7f9e7c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c0865b0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c088910 con 0x7f9e7c08dc80 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c0812e0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e83d59640 10 monclient(hunting): authenticate will time out at 1035.347327s 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e81ace640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9e7c08c2f0 0x7f9e7c085790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40582/0 (socket says 10.20.193.78:40582) 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.288+0000 7f9e81ace640 1 -- 10.20.193.78:0/2314799140 learned_addr learned my addr 10.20.193.78:0/2314799140 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e81ace640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.78:6789/0 conn(0x7f9e7c08c2f0 legacy=0x7f9e7c085790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e812cd640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.78:6790/0 conn(0x7f9e7c08cdd0 legacy=0x7f9e7c085ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198764050 0 0) 0x7f9e7c0865b0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): my global_id is 74202 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e4c003620 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e822cf640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.187:6789/0 conn(0x7f9e7c08dc80 legacy=0x7f9e7c195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191742499 0 0) 0x7f9e7c0812e0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): my global_id is 4763 2026-02-13T18:13:24.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e7c0865b0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3941079153 0 0) 0x7f9e4c003620 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e7c0812e0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e6c002f80 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): dump: 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.308 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893932610 0 0) 0x7f9e7c088910 con 0x7f9e7c08dc80 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): my global_id is 84115 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e4c003620 con 0x7f9e7c08dc80 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3339425310 0 0) 0x7f9e7c0865b0 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e7c088910 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e70003380 con 0x7f9e7c08cdd0 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient(hunting): dump: 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.310 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1671339855 0 0) 0x7f9e7c0812e0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.78:6790/0 conn(0x7f9e7c08cdd0 legacy=0x7f9e7c085ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.187:6789/0 conn(0x7f9e7c08dc80 legacy=0x7f9e7c195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 monclient: found mon.a 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c087100 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 5 monclient: authenticate success, global_id 74202 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 monclient: _renew_subs 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c082220 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 monclient: _renew_subs 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e7c080d00 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e6c004b90 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e6c004f30 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 10 monclient: dump: 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.313 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6bfff640 4 set_mon_vals no callback set 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7c08f5e0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9e6c005200 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(396..396 src has 1..396) ==== 3991+0+0 (unknown 435711125 0 0) 0x7f9e6c04c7c0 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.292+0000 7f9e812cd640 10 monclient: get_auth_request con 0x7f9e4c03d7e0 auth_method 0 2026-02-13T18:13:24.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.296+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f9e6c017720 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.296+0000 7f9e6a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.296+0000 7f9e6a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:24.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:24.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:24.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9e7c090810 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e6a7fc640 1 -- 10.20.193.78:0/2314799140 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2999349022) 0x7f9e6c017000 con 0x7f9e7c08c2f0 2026-02-13T18:13:24.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e6a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:24.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e6a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:24.421 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9e4c03d7e0 legacy=0x7f9e4c05dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 10 monclient: shutdown 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 >> v1:10.20.193.78:6789/0 conn(0x7f9e7c08c2f0 legacy=0x7f9e7c085790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 shutdown_connections 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 >> 10.20.193.78:0/2314799140 conn(0x7f9e7c091720 msgr2=0x7f9e7c058b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 shutdown_connections 2026-02-13T18:13:24.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.416+0000 7f9e83d59640 1 -- 10.20.193.78:0/2314799140 wait complete. 2026-02-13T18:13:24.431 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:13:24.431 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:13:24.432 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:13:24.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient: get_monmap_and_config 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient: monmap: 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:24.503545+0000 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:24.503545+0000 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:24.504 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:24.505 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 1 Processor -- start 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 1 -- start start 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient: init 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient(hunting): picked mon.noname-b con 0x7f544c13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient(hunting): picked mon.noname-c con 0x7f544c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient(hunting): picked mon.noname-a con 0x7f544c1853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c095530 con 0x7f544c1853c0 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c140390 con 0x7f544c05e4b0 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c05d230 con 0x7f544c13f8b0 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f545188c640 10 monclient(hunting): authenticate will time out at 1035.559104s 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f544affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f544c13f8b0 0x7f544c13fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49040/0 (socket says 10.20.193.78:49040) 2026-02-13T18:13:24.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.500+0000 7f544affd640 1 -- 10.20.193.78:0/2477322100 learned_addr learned my addr 10.20.193.78:0/2477322100 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f544b7fe640 1 -- 10.20.193.78:0/2477322100 >> v1:10.20.193.78:6789/0 conn(0x7f544c1853c0 legacy=0x7f544c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f544affd640 1 -- 10.20.193.78:0/2477322100 >> v1:10.20.193.78:6790/0 conn(0x7f544c13f8b0 legacy=0x7f544c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000115810 0 0) 0x7f543c0041c0 con 0x7f544c1853c0 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): my global_id is 74205 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5438003620 con 0x7f544c1853c0 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804929930 0 0) 0x7f544c05d230 con 0x7f544c13f8b0 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient(hunting): my global_id is 4766 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f543c0041c0 con 0x7f544c13f8b0 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f544a7fc640 1 -- 10.20.193.78:0/2477322100 >> v1:10.20.193.187:6789/0 conn(0x7f544c05e4b0 legacy=0x7f544c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3272654578 0 0) 0x7f5438003620 con 0x7f544c1853c0 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 >> v1:10.20.193.78:6790/0 conn(0x7f544c13f8b0 legacy=0x7f544c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 >> v1:10.20.193.187:6789/0 conn(0x7f544c05e4b0 legacy=0x7f544c183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 monclient: found mon.noname-a 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c05d510 con 0x7f544c1853c0 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f543c004840 con 0x7f544c1853c0 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: dump: 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.513 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 5 monclient: authenticate success, global_id 74205 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f544b7fe640 1 --1- 10.20.193.78:0/2477322100 >> v1:10.20.193.78:6789/0 conn(0x7f544c1853c0 0x7f544c1a57a0 :-1 s=OPENED pgs=211 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f543c004fb0 mon_map magic: 0 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f543c004c20 con 0x7f544c1853c0 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 4 set_mon_vals no callback set 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: shutdown 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- 10.20.193.78:0/2477322100 >> v1:10.20.193.78:6789/0 conn(0x7f544c1853c0 legacy=0x7f544c1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 1 -- 10.20.193.78:0/2477322100 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f543c004fb0 con 0x7f544c1853c0 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f5449ffb640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- 10.20.193.78:0/2477322100 shutdown_connections 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- 10.20.193.78:0/2477322100 >> 10.20.193.78:0/2477322100 conn(0x7f544c0545d0 msgr2=0x7f544c0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- 10.20.193.78:0/2477322100 shutdown_connections 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- 10.20.193.78:0/2477322100 wait complete. 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: monmap: 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 Processor -- start 2026-02-13T18:13:24.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- start start 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: init 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient(hunting): picked mon.noname-b con 0x7f544c05e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient(hunting): picked mon.noname-a con 0x7f544c13f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient(hunting): picked mon.noname-c con 0x7f544c1853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c112300 con 0x7f544c13f8b0 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c111490 con 0x7f544c05e4b0 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c10ffa0 con 0x7f544c1853c0 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f545188c640 10 monclient(hunting): authenticate will time out at 1035.563292s 2026-02-13T18:13:24.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f544b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f544c1853c0 0x7f544c181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49054/0 (socket says 10.20.193.78:49054) 2026-02-13T18:13:24.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.504+0000 7f544b7fe640 1 -- 10.20.193.78:0/611088720 learned_addr learned my addr 10.20.193.78:0/611088720 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f544a7fc640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c13f8b0 legacy=0x7f544c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f544b7fe640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6790/0 conn(0x7f544c1853c0 legacy=0x7f544c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25283750 0 0) 0x7f544c112300 con 0x7f544c13f8b0 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): my global_id is 74208 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f541c003620 con 0x7f544c13f8b0 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372420645 0 0) 0x7f544c10ffa0 con 0x7f544c1853c0 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): my global_id is 4769 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f544c112300 con 0x7f544c1853c0 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2906599026 0 0) 0x7f541c003620 con 0x7f544c13f8b0 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f544c10ffa0 con 0x7f544c13f8b0 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5434003380 con 0x7f544c13f8b0 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f544affd640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.187:6789/0 conn(0x7f544c05e4b0 legacy=0x7f544c13ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): dump: 2026-02-13T18:13:24.524 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3154655094 0 0) 0x7f544c112300 con 0x7f544c1853c0 2026-02-13T18:13:24.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f541c003620 con 0x7f544c1853c0 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f543c004690 con 0x7f544c1853c0 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient(hunting): dump: 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.526 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4008929683 0 0) 0x7f544c10ffa0 con 0x7f544c13f8b0 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6790/0 conn(0x7f544c1853c0 legacy=0x7f544c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.187:6789/0 conn(0x7f544c05e4b0 legacy=0x7f544c13ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 monclient: found mon.a 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c111a60 con 0x7f544c13f8b0 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 5 monclient: authenticate success, global_id 74208 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 10 monclient: _renew_subs 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f544c10f8c0 con 0x7f544c13f8b0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 10 monclient: _renew_subs 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f544c110cd0 con 0x7f544c13f8b0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54340039c0 con 0x7f544c13f8b0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5434003d20 con 0x7f544c13f8b0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 10 monclient: dump: 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f54497fa640 4 set_mon_vals no callback set 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f544c08f5b0 con 0x7f544c12d920 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5434003f40 con 0x7f544c13f8b0 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(396..396 src has 1..396) ==== 3991+0+0 (unknown 435711125 0 0) 0x7f543404c7e0 con 0x7f544c13f8b0 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.508+0000 7f544b7fe640 10 monclient: get_auth_request con 0x7f541c03d610 auth_method 0 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f544affd640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c12d920 legacy=0x7f544c08d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540043173 0 0) 0x7f544c08f5b0 con 0x7f544c12d920 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient(hunting): my global_id is 74211 2026-02-13T18:13:24.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f544c10ffa0 con 0x7f544c12d920 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2208030077 0 0) 0x7f544c10ffa0 con 0x7f544c12d920 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f544c08f5b0 con 0x7f544c12d920 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5440002c40 con 0x7f544c12d920 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient: dump: 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.531 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2448077735 0 0) 0x7f544c08f5b0 con 0x7f544c12d920 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f544c0008e0 con 0x7f544c12d920 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5440002eb0 con 0x7f544c12d920 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c12d920 legacy=0x7f544c08d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.512+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c12d920 legacy=0x7f544c08d020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f545188c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:24.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f544c12dcf0 con 0x7f544c184ba0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f544affd640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c184ba0 legacy=0x7f544c08bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919364716 0 0) 0x7f544c12dcf0 con 0x7f544c184ba0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient(hunting): my global_id is 74214 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f544c08f5b0 con 0x7f544c184ba0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 601842564 0 0) 0x7f544c08f5b0 con 0x7f544c184ba0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f544c12dcf0 con 0x7f544c184ba0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5440004d10 con 0x7f544c184ba0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient: dump: 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2190779097 0 0) 0x7f544c12dcf0 con 0x7f544c184ba0 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f544c111ed0 con 0x7f544c184ba0 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 2587917526) 0x7f5440006200 con 0x7f544c184ba0 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c184ba0 legacy=0x7f544c08bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.516+0000 7f5423fff640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c184ba0 legacy=0x7f544c08bea0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:24.535 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 28, 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 145373, 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:24.536 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.537 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.538 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:24.539 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.540 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.541 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:24.542 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.543 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.544 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.545 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:24.546 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:24.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.187:6812/2668687789 conn(0x7f541c03d610 legacy=0x7f541c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 10 monclient: shutdown 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 >> v1:10.20.193.78:6789/0 conn(0x7f544c13f8b0 legacy=0x7f544c180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f544b7fe640 1 -- 10.20.193.78:0/611088720 reap_dead start 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f544b7fe640 1 -- 10.20.193.78:0/611088720 reap_dead start 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 shutdown_connections 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 >> 10.20.193.78:0/611088720 conn(0x7f544c0545d0 msgr2=0x7f544c0965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 shutdown_connections 2026-02-13T18:13:24.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.520+0000 7f545188c640 1 -- 10.20.193.78:0/611088720 wait complete. 2026-02-13T18:13:24.548 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:13:24.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:13:24.549 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient: get_monmap_and_config 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient: monmap: 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:24.608150+0000 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:24.608150+0000 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.608 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:24.609 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:24.609 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 1 Processor -- start 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 1 -- start start 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient: init 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient(hunting): picked mon.noname-c con 0x7f29c008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient(hunting): picked mon.noname-a con 0x7f29c008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient(hunting): picked mon.noname-b con 0x7f29c008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c0089e80 con 0x7f29c008dc80 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c0088c20 con 0x7f29c008c2f0 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c0089ba0 con 0x7f29c008cdd0 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c7b29640 10 monclient(hunting): authenticate will time out at 1035.663277s 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c509d640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f29c008dc80 0x7f29c0181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40638/0 (socket says 10.20.193.78:40638) 2026-02-13T18:13:24.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.604+0000 7f29c509d640 1 -- 10.20.193.78:0/1864862694 learned_addr learned my addr 10.20.193.78:0/1864862694 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c509d640 1 -- 10.20.193.78:0/1864862694 >> v1:10.20.193.78:6789/0 conn(0x7f29c008dc80 legacy=0x7f29c0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c609f640 1 -- 10.20.193.78:0/1864862694 >> v1:10.20.193.78:6790/0 conn(0x7f29c008cdd0 legacy=0x7f29c01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c589e640 1 -- 10.20.193.78:0/1864862694 >> v1:10.20.193.187:6789/0 conn(0x7f29c008c2f0 legacy=0x7f29c008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681234756 0 0) 0x7f29c0089e80 con 0x7f29c008dc80 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): my global_id is 74217 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a8003620 con 0x7f29c008dc80 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441821700 0 0) 0x7f29c0089ba0 con 0x7f29c008cdd0 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): my global_id is 4772 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c0089e80 con 0x7f29c008cdd0 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028386144 0 0) 0x7f29c0088c20 con 0x7f29c008c2f0 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient(hunting): my global_id is 84124 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c0089ba0 con 0x7f29c008c2f0 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3046029933 0 0) 0x7f29a8003620 con 0x7f29c008dc80 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 >> v1:10.20.193.78:6790/0 conn(0x7f29c008cdd0 legacy=0x7f29c01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 >> v1:10.20.193.187:6789/0 conn(0x7f29c008c2f0 legacy=0x7f29c008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 monclient: found mon.noname-a 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c008d370 con 0x7f29c008dc80 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29b4003110 con 0x7f29c008dc80 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: dump: 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 5 monclient: authenticate success, global_id 74217 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29b40033e0 con 0x7f29c008dc80 2026-02-13T18:13:24.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 1 -- 10.20.193.78:0/1864862694 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29b4004b50 con 0x7f29c008dc80 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c489c640 10 monclient: dump: 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 4 set_mon_vals no callback set 2026-02-13T18:13:24.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: shutdown 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- 10.20.193.78:0/1864862694 >> v1:10.20.193.78:6789/0 conn(0x7f29c008dc80 legacy=0x7f29c0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- 10.20.193.78:0/1864862694 shutdown_connections 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- 10.20.193.78:0/1864862694 >> 10.20.193.78:0/1864862694 conn(0x7f29c0091720 msgr2=0x7f29c0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- 10.20.193.78:0/1864862694 shutdown_connections 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- 10.20.193.78:0/1864862694 wait complete. 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: monmap: 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:24.618 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 Processor -- start 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- start start 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: init 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient(hunting): picked mon.noname-a con 0x7f29c008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient(hunting): picked mon.noname-b con 0x7f29c008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient(hunting): picked mon.noname-c con 0x7f29c008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c0057680 con 0x7f29c008c2f0 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c005dde0 con 0x7f29c008cdd0 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c0082490 con 0x7f29c008dc80 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c7b29640 10 monclient(hunting): authenticate will time out at 1035.667883s 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c589e640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f29c008c2f0 0x7f29c007e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40644/0 (socket says 10.20.193.78:40644) 2026-02-13T18:13:24.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.608+0000 7f29c589e640 1 -- 10.20.193.78:0/415139604 learned_addr learned my addr 10.20.193.78:0/415139604 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c589e640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6789/0 conn(0x7f29c008c2f0 legacy=0x7f29c007e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c609f640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c008dc80 legacy=0x7f29c0195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620526854 0 0) 0x7f29c0089ba0 con 0x7f29c008c2f0 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): my global_id is 74220 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2990003620 con 0x7f29c008c2f0 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261890638 0 0) 0x7f29c0082490 con 0x7f29c008dc80 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): my global_id is 4775 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c0089ba0 con 0x7f29c008dc80 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 500037504 0 0) 0x7f2990003620 con 0x7f29c008c2f0 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29c0082490 con 0x7f29c008c2f0 2026-02-13T18:13:24.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29b00033f0 con 0x7f29c008c2f0 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c509d640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.187:6789/0 conn(0x7f29c008cdd0 legacy=0x7f29c007f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): dump: 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:24.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 41682284 0 0) 0x7f29c0089ba0 con 0x7f29c008dc80 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2990003620 con 0x7f29c008dc80 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29bc004900 con 0x7f29c008dc80 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient(hunting): dump: 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3051986681 0 0) 0x7f29c0082490 con 0x7f29c008c2f0 2026-02-13T18:13:24.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c008dc80 legacy=0x7f29c0195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.187:6789/0 conn(0x7f29c008cdd0 legacy=0x7f29c007f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 monclient: found mon.a 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c0082770 con 0x7f29c008c2f0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 5 monclient: authenticate success, global_id 74220 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 10 monclient: _renew_subs 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f29c007f810 con 0x7f29c008c2f0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 10 monclient: _renew_subs 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f29c00821b0 con 0x7f29c008c2f0 2026-02-13T18:13:24.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29b0003a30 con 0x7f29c008c2f0 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29b0003dd0 con 0x7f29c008c2f0 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 10 monclient: dump: 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29affff640 4 set_mon_vals no callback set 2026-02-13T18:13:24.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f29c0084230 con 0x7f29c0083e60 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f29b0004070 con 0x7f29c008c2f0 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.612+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(396..396 src has 1..396) ==== 3991+0+0 (unknown 435711125 0 0) 0x7f29b004c750 con 0x7f29c008c2f0 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29c609f640 10 monclient: get_auth_request con 0x7f299003d690 auth_method 0 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29c509d640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c0083e60 legacy=0x7f29c007a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115508521 0 0) 0x7f29c0084230 con 0x7f29c0083e60 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient(hunting): my global_id is 4778 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c0082490 con 0x7f29c0083e60 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1911770652 0 0) 0x7f29c0082490 con 0x7f29c0083e60 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29c0084230 con 0x7f29c0083e60 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29b4002b50 con 0x7f29c0083e60 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient: dump: 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1010873270 0 0) 0x7f29c0084230 con 0x7f29c0083e60 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29c008f620 con 0x7f29c0083e60 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f29b4002e70 con 0x7f29c0083e60 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:24.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c0083e60 legacy=0x7f29c007a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.616+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c0083e60 legacy=0x7f29c007a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.620+0000 7f29c7b29640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.620+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f29c005d660 con 0x7f29c007aae0 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c509d640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c007aae0 legacy=0x7f29c0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321798047 0 0) 0x7f29c005d660 con 0x7f29c007aae0 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient(hunting): my global_id is 4781 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c0084230 con 0x7f29c007aae0 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 763854151 0 0) 0x7f29c0084230 con 0x7f29c007aae0 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29c005d660 con 0x7f29c007aae0 2026-02-13T18:13:24.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f29b40034f0 con 0x7f29c007aae0 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient: dump: 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1363519004 0 0) 0x7f29c005d660 con 0x7f29c007aae0 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f29c0090810 con 0x7f29c007aae0 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4510 (unknown 0 0 3078036097) 0x7f29b4007120 con 0x7f29c007aae0 2026-02-13T18:13:24.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c007aae0 legacy=0x7f29c0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29ae7fc640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6790/0 conn(0x7f29c007aae0 legacy=0x7f29c0198550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 28, 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 486015, 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:24.633 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.634 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.635 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:24.636 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.637 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.638 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.639 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:24.640 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.641 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.642 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:24.643 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:24.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.187:6812/2668687789 conn(0x7f299003d690 legacy=0x7f299005db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 10 monclient: shutdown 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 >> v1:10.20.193.78:6789/0 conn(0x7f29c008c2f0 legacy=0x7f29c007e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c609f640 1 -- 10.20.193.78:0/415139604 reap_dead start 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c609f640 1 -- 10.20.193.78:0/415139604 reap_dead start 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 shutdown_connections 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 >> 10.20.193.78:0/415139604 conn(0x7f29c0091720 msgr2=0x7f29c0057bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 shutdown_connections 2026-02-13T18:13:24.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.624+0000 7f29c7b29640 1 -- 10.20.193.78:0/415139604 wait complete. 2026-02-13T18:13:24.644 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:13:24.644 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:13:24.645 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:13:24.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient: get_monmap_and_config 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient: monmap: 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:24.707836+0000 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:24.707836+0000 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:24.708 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 1 Processor -- start 2026-02-13T18:13:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 1 -- start start 2026-02-13T18:13:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient: init 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient(hunting): picked mon.noname-b con 0x7f9e44085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient(hunting): picked mon.noname-c con 0x7f9e44085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient(hunting): picked mon.noname-a con 0x7f9e44181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e44088400 con 0x7f9e44181d50 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e44088120 con 0x7f9e44085b60 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4408c550 con 0x7f9e44085790 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4ba25640 10 monclient(hunting): authenticate will time out at 1035.763291s 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4979a640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9e44085790 0x7f9e44089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49088/0 (socket says 10.20.193.78:49088) 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e4979a640 1 -- 10.20.193.78:0/512464487 learned_addr learned my addr 10.20.193.78:0/512464487 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.704+0000 7f9e49f9b640 1 --1- 10.20.193.78:0/512464487 >> v1:10.20.193.78:6789/0 conn(0x7f9e44181d50 0x7f9e441a2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40656/0 (socket says 10.20.193.78:40656) 2026-02-13T18:13:24.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4979a640 1 -- 10.20.193.78:0/512464487 >> v1:10.20.193.78:6790/0 conn(0x7f9e44085790 legacy=0x7f9e44089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e49f9b640 1 -- 10.20.193.78:0/512464487 >> v1:10.20.193.78:6789/0 conn(0x7f9e44181d50 legacy=0x7f9e441a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e48f99640 1 -- 10.20.193.78:0/512464487 >> v1:10.20.193.187:6789/0 conn(0x7f9e44085b60 legacy=0x7f9e44085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076528684 0 0) 0x7f9e4408c550 con 0x7f9e44085790 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): my global_id is 4784 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e2c0058b0 con 0x7f9e44085790 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753742422 0 0) 0x7f9e400040a0 con 0x7f9e44181d50 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): my global_id is 74223 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e4408c550 con 0x7f9e44181d50 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149499507 0 0) 0x7f9e44088120 con 0x7f9e44085b60 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient(hunting): my global_id is 84130 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e400040a0 con 0x7f9e44085b60 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2982647242 0 0) 0x7f9e4408c550 con 0x7f9e44181d50 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 >> v1:10.20.193.78:6790/0 conn(0x7f9e44085790 legacy=0x7f9e44089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4979a640 1 --1- 10.20.193.78:0/512464487 >> v1:10.20.193.78:6790/0 conn(0x7f9e44085790 0x7f9e44089100 :-1 s=OPENED pgs=390 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f9e34003110 mon_map magic: 0 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 >> v1:10.20.193.187:6789/0 conn(0x7f9e44085b60 legacy=0x7f9e44085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 monclient: found mon.noname-a 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e44087540 con 0x7f9e44181d50 2026-02-13T18:13:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e400046a0 con 0x7f9e44181d50 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: dump: 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e34003110 con 0x7f9e44085790 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 5 monclient: authenticate success, global_id 74223 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e40004970 con 0x7f9e44181d50 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 1 -- 10.20.193.78:0/512464487 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e40005fa0 con 0x7f9e44181d50 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e33fff640 10 monclient: dump: 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 4 set_mon_vals no callback set 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: shutdown 2026-02-13T18:13:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- 10.20.193.78:0/512464487 >> v1:10.20.193.78:6789/0 conn(0x7f9e44181d50 legacy=0x7f9e441a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- 10.20.193.78:0/512464487 shutdown_connections 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- 10.20.193.78:0/512464487 >> 10.20.193.78:0/512464487 conn(0x7f9e44091720 msgr2=0x7f9e44091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- 10.20.193.78:0/512464487 shutdown_connections 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- 10.20.193.78:0/512464487 wait complete. 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: monmap: 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 Processor -- start 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- start start 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: init 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient(hunting): picked mon.noname-b con 0x7f9e44085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient(hunting): picked mon.noname-c con 0x7f9e44085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient(hunting): picked mon.noname-a con 0x7f9e44181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4413f270 con 0x7f9e44181d50 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4413f550 con 0x7f9e44085790 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e44153e40 con 0x7f9e44085b60 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.708+0000 7f9e4ba25640 10 monclient(hunting): authenticate will time out at 1035.767987s 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e49f9b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9e44181d50 0x7f9e44175640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40672/0 (socket says 10.20.193.78:40672) 2026-02-13T18:13:24.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e49f9b640 1 -- 10.20.193.78:0/75421365 learned_addr learned my addr 10.20.193.78:0/75421365 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e49f9b640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.78:6789/0 conn(0x7f9e44181d50 legacy=0x7f9e44175640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e48f99640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.78:6790/0 conn(0x7f9e44085b60 legacy=0x7f9e44153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190106332 0 0) 0x7f9e4413f270 con 0x7f9e44181d50 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): my global_id is 74226 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e14003620 con 0x7f9e44181d50 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013117759 0 0) 0x7f9e44153e40 con 0x7f9e44085b60 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): my global_id is 4787 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e4413f270 con 0x7f9e44085b60 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4979a640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e44085790 legacy=0x7f9e44153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3250690554 0 0) 0x7f9e14003620 con 0x7f9e44181d50 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e44153e40 con 0x7f9e44181d50 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e40005fa0 con 0x7f9e44181d50 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): dump: 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1535109475 0 0) 0x7f9e4413f270 con 0x7f9e44085b60 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e14003620 con 0x7f9e44085b60 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e38003410 con 0x7f9e44085b60 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient(hunting): dump: 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3037983419 0 0) 0x7f9e44153e40 con 0x7f9e44181d50 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.78:6790/0 conn(0x7f9e44085b60 legacy=0x7f9e44153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e44085790 legacy=0x7f9e44153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 monclient: found mon.a 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4405d1d0 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 5 monclient: authenticate success, global_id 74226 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 10 monclient: _renew_subs 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e44089dc0 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 10 monclient: _renew_subs 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e4413ddb0 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e40004880 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e40006730 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 10 monclient: dump: 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e337fe640 4 set_mon_vals no callback set 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9e4408f600 con 0x7f9e4408cba0 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9e40012dc0 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(396..396 src has 1..396) ==== 3991+0+0 (unknown 435711125 0 0) 0x7f9e4004db70 con 0x7f9e44181d50 2026-02-13T18:13:24.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.712+0000 7f9e48f99640 10 monclient: get_auth_request con 0x7f9e1403d650 auth_method 0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e4979a640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e4408cba0 legacy=0x7f9e44137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3282555933 0 0) 0x7f9e4408f600 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient(hunting): my global_id is 84136 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e44153e40 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2116704242 0 0) 0x7f9e44153e40 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e4408f600 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e34002f40 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient: dump: 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 344842636 0 0) 0x7f9e4408f600 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e44090810 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9e340048e0 con 0x7f9e4408cba0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:24.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e4408cba0 legacy=0x7f9e44137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.716+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e4408cba0 legacy=0x7f9e44137970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:24.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.720+0000 7f9e4ba25640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:24.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.720+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9e4413ff90 con 0x7f9e4404d200 2026-02-13T18:13:24.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4979a640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e4404d200 legacy=0x7f9e4417f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795058644 0 0) 0x7f9e4413ff90 con 0x7f9e4404d200 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient(hunting): my global_id is 84139 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e4408f600 con 0x7f9e4404d200 2026-02-13T18:13:24.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2279150050 0 0) 0x7f9e4408f600 con 0x7f9e4404d200 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e4413ff90 con 0x7f9e4404d200 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9e34004ed0 con 0x7f9e4404d200 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient: dump: 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.729 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2347296821 0 0) 0x7f9e4413ff90 con 0x7f9e4404d200 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9e44181a90 con 0x7f9e4404d200 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 251965821) 0x7f9e34007220 con 0x7f9e4404d200 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e4404d200 legacy=0x7f9e4417f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e31ffb640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6789/0 conn(0x7f9e4404d200 legacy=0x7f9e4417f360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:24.730 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 28, 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 32890, 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.731 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.732 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:24.733 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:24.734 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:24.735 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:24.736 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.737 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.738 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:24.739 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:24.740 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:24.740 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:24.740 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:24.740 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:24.740 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9e1403d650 legacy=0x7f9e1405db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 10 monclient: shutdown 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 >> v1:10.20.193.78:6789/0 conn(0x7f9e44181d50 legacy=0x7f9e44175640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e49f9b640 1 -- 10.20.193.78:0/75421365 reap_dead start 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e49f9b640 1 -- 10.20.193.78:0/75421365 reap_dead start 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 shutdown_connections 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 >> 10.20.193.78:0/75421365 conn(0x7f9e44091720 msgr2=0x7f9e4408b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 shutdown_connections 2026-02-13T18:13:24.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.724+0000 7f9e4ba25640 1 -- 10.20.193.78:0/75421365 wait complete. 2026-02-13T18:13:24.741 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:13:24.742 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:13:24.742 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:13:24.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient: get_monmap_and_config 2026-02-13T18:13:24.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient: monmap: 2026-02-13T18:13:24.808 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.808 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:24.808088+0000 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:24.808088+0000 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:24.809 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 1 Processor -- start 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 1 -- start start 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient: init 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient(hunting): picked mon.noname-c con 0x7fea3c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient(hunting): picked mon.noname-b con 0x7fea3c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient(hunting): picked mon.noname-a con 0x7fea3c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c089e80 con 0x7fea3c08cdd0 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c088c20 con 0x7fea3c08c2f0 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c089ba0 con 0x7fea3c08dc80 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea40b13640 10 monclient(hunting): authenticate will time out at 1035.863615s 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea3ad76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fea3c08cdd0 0x7fea3c1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40682/0 (socket says 10.20.193.78:40682) 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea3ad76640 1 -- 10.20.193.78:0/2741506654 learned_addr learned my addr 10.20.193.78:0/2741506654 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.804+0000 7fea39d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fea3c08dc80 0x7fea3c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49104/0 (socket says 10.20.193.78:49104) 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea3ad76640 1 -- 10.20.193.78:0/2741506654 >> v1:10.20.193.78:6789/0 conn(0x7fea3c08cdd0 legacy=0x7fea3c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39d74640 1 -- 10.20.193.78:0/2741506654 >> v1:10.20.193.78:6790/0 conn(0x7fea3c08dc80 legacy=0x7fea3c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea3a575640 1 -- 10.20.193.78:0/2741506654 >> v1:10.20.193.187:6789/0 conn(0x7fea3c08c2f0 legacy=0x7fea3c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998613367 0 0) 0x7fea3c089e80 con 0x7fea3c08cdd0 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): my global_id is 74229 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea28003620 con 0x7fea3c08cdd0 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865080882 0 0) 0x7fea3c089ba0 con 0x7fea3c08dc80 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): my global_id is 4790 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea3c089e80 con 0x7fea3c08dc80 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720494733 0 0) 0x7fea3c088c20 con 0x7fea3c08c2f0 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient(hunting): my global_id is 84142 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea3c089ba0 con 0x7fea3c08c2f0 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 833504342 0 0) 0x7fea28003620 con 0x7fea3c08cdd0 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 >> v1:10.20.193.78:6790/0 conn(0x7fea3c08dc80 legacy=0x7fea3c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 >> v1:10.20.193.187:6789/0 conn(0x7fea3c08c2f0 legacy=0x7fea3c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 monclient: found mon.noname-a 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c08d370 con 0x7fea3c08cdd0 2026-02-13T18:13:24.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fea2c004620 con 0x7fea3c08cdd0 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 5 monclient: authenticate success, global_id 74229 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: dump: 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.817 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea2c0048f0 con 0x7fea3c08cdd0 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 1 -- 10.20.193.78:0/2741506654 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fea2c006060 con 0x7fea3c08cdd0 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea39573640 10 monclient: dump: 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.818 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 4 set_mon_vals no callback set 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 10 monclient: shutdown 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 -- 10.20.193.78:0/2741506654 >> v1:10.20.193.78:6789/0 conn(0x7fea3c08cdd0 legacy=0x7fea3c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 -- 10.20.193.78:0/2741506654 shutdown_connections 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 -- 10.20.193.78:0/2741506654 >> 10.20.193.78:0/2741506654 conn(0x7fea3c091720 msgr2=0x7fea3c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 -- 10.20.193.78:0/2741506654 shutdown_connections 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 -- 10.20.193.78:0/2741506654 wait complete. 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 10 monclient: build_initial_monmap 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 10 monclient: monmap: 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:24.819 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 Processor -- start 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 1 -- start start 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.808+0000 7fea40b13640 10 monclient: init 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient(hunting): picked mon.noname-c con 0x7fea3c08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient(hunting): picked mon.noname-b con 0x7fea3c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient(hunting): picked mon.noname-a con 0x7fea3c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c082380 con 0x7fea3c08dc80 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c082660 con 0x7fea3c08cdd0 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c05de10 con 0x7fea3c08c2f0 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:24.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient(hunting): authenticate will time out at 1035.868132s 2026-02-13T18:13:24.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea3a575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fea3c08c2f0 0x7fea3c153270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49116/0 (socket says 10.20.193.78:49116) 2026-02-13T18:13:24.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea3a575640 1 -- 10.20.193.78:0/181004611 learned_addr learned my addr 10.20.193.78:0/181004611 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea3ad76640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.78:6789/0 conn(0x7fea3c08dc80 legacy=0x7fea3c1955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea3a575640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.78:6790/0 conn(0x7fea3c08c2f0 legacy=0x7fea3c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea3ad76640 1 --1- 10.20.193.78:0/181004611 >> v1:10.20.193.78:6789/0 conn(0x7fea3c08dc80 0x7fea3c1955e0 :-1 s=OPENED pgs=221 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fea3c082380 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210232242 0 0) 0x7fea3c05de10 con 0x7fea3c08c2f0 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): my global_id is 4793 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea08003620 con 0x7fea3c08c2f0 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea39d74640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.187:6789/0 conn(0x7fea3c08cdd0 legacy=0x7fea3c083a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1832104862 0 0) 0x7fea08003620 con 0x7fea3c08c2f0 2026-02-13T18:13:24.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea3c05de10 con 0x7fea3c08c2f0 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fea300033f0 con 0x7fea3c08c2f0 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): dump: 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816207862 0 0) 0x7fea3c082660 con 0x7fea3c08cdd0 2026-02-13T18:13:24.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient(hunting): my global_id is 84145 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea08003620 con 0x7fea3c08cdd0 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1567672571 0 0) 0x7fea3c05de10 con 0x7fea3c08c2f0 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.187:6789/0 conn(0x7fea3c08cdd0 legacy=0x7fea3c083a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.78:6789/0 conn(0x7fea3c08dc80 legacy=0x7fea3c1955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 monclient: found mon.c 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c080300 con 0x7fea3c08c2f0 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: _finish_auth 0 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2098669427 0 0) 0x7fea3c082380 con 0x7fea3c08dc80 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:13:24.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 5 monclient: authenticate success, global_id 4793 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _renew_subs 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea3c081dc0 con 0x7fea3c08c2f0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _renew_subs 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fea3c080e60 con 0x7fea3c08c2f0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea300039c0 con 0x7fea3c08c2f0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fea30003d60 con 0x7fea3c08c2f0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 10 monclient: dump: 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:24.826 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea38d72640 4 set_mon_vals no callback set 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fea30004000 con 0x7fea3c08c2f0 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3c08f620 con 0x7fea3c08c2f0 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.812+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(396..396 src has 1..396) ==== 3991+0+0 (unknown 435711125 0 0) 0x7fea3004c7e0 con 0x7fea3c08c2f0 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.816+0000 7fea39d74640 10 monclient: get_auth_request con 0x7fea0803d4b0 auth_method 0 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.816+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fea3c08f620 con 0x7fea3c08c2f0 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.816+0000 7fea22ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:24.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.816+0000 7fea22ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:24.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:13:24.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:13:24.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:24.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fea3c090810 con 0x7fea3c08c2f0 2026-02-13T18:13:24.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea22ffd640 1 -- 10.20.193.78:0/181004611 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fea30017740 con 0x7fea3c08c2f0 2026-02-13T18:13:24.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea22ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:13:24.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea22ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:24.941 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.941 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=1,health=13,kv=11,logm=59} crc {auth=3736048973,config=2457401934,health=481669536,kv=4087868365,logm=2150376683}) 2026-02-13T18:13:24.941 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=13,kv=10,logm=59} crc {auth=3736048973,config=1618278320,health=3626696391,kv=2475567949,logm=1454285700}) 2026-02-13T18:13:24.941 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.941 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=1,health=13,kv=11,logm=59} crc {auth=3736048973,config=2457401934,health=481669536,kv=4087868365,logm=2150376683}) 2026-02-13T18:13:24.942 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=11,logm=59} crc {auth=2125235661,config=1618278320,health=481669536,kv=4087868365,logm=376117019}) 2026-02-13T18:13:24.942 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.942 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1718106006}) 2026-02-13T18:13:24.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.187:6812/2668687789 conn(0x7fea0803d4b0 legacy=0x7fea0805d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 10 monclient: shutdown 2026-02-13T18:13:24.942 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=655656515}) 2026-02-13T18:13:24.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:24.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 >> v1:10.20.193.78:6790/0 conn(0x7fea3c08c2f0 legacy=0x7fea3c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:24.943 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.943 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1718106006}) 2026-02-13T18:13:24.943 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.936+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2037515557}) 2026-02-13T18:13:24.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 shutdown_connections 2026-02-13T18:13:24.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 >> 10.20.193.78:0/181004611 conn(0x7fea3c091720 msgr2=0x7fea3c085790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:24.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 shutdown_connections 2026-02-13T18:13:24.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:24.936+0000 7fea40b13640 1 -- 10.20.193.78:0/181004611 wait complete. 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4036945680}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360121574}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4036945680}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=998167647}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2806811181}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400608024}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2806811181}) 2026-02-13T18:13:24.944 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2446716741}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1822841125}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=365937309}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1822841125}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4248217694}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=497611239}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1167335423}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=497611239}) 2026-02-13T18:13:24.945 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3470092531}) 2026-02-13T18:13:24.946 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.946 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=678863883}) 2026-02-13T18:13:24.946 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4036760181}) 2026-02-13T18:13:24.946 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.946 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=678863883}) 2026-02-13T18:13:24.946 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.940+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2764056657}) 2026-02-13T18:13:24.947 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.944+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.947 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.944+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2997731068}) 2026-02-13T18:13:24.947 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.944+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1739775185}) 2026-02-13T18:13:24.947 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.944+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.947 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.944+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2997731068}) 2026-02-13T18:13:24.947 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.944+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2968146310}) 2026-02-13T18:13:24.952 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:13:24.952 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.952 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4013213590}) 2026-02-13T18:13:24.952 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4236899814}) 2026-02-13T18:13:24.952 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.952 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4013213590}) 2026-02-13T18:13:24.952 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1190727156}) 2026-02-13T18:13:24.953 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.953 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1975465712}) 2026-02-13T18:13:24.953 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1317561358}) 2026-02-13T18:13:24.953 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.953 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1975465712}) 2026-02-13T18:13:24.953 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.948+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3178599274}) 2026-02-13T18:13:24.954 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.954 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3935404841}) 2026-02-13T18:13:24.954 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081212000}) 2026-02-13T18:13:24.954 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.954 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3935404841}) 2026-02-13T18:13:24.954 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3161978546}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193490133}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665807972}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193490133}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=632767330}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3973248141}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=832345108}) 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.955 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3973248141}) 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1046397577}) 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1745717690}) 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2577629394}) 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1745717690}) 2026-02-13T18:13:24.956 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:24.952+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1756494311}) 2026-02-13T18:13:25.458 INFO:tasks.rados.rados.0.trial187.stdout:1713: done (3 left) 2026-02-13T18:13:25.458 INFO:tasks.rados.rados.0.trial187.stdout:1714: snap_remove snap 183 2026-02-13T18:13:25.526 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.512+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.526 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.512+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2575334339}) 2026-02-13T18:13:25.526 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.512+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2896675281}) 2026-02-13T18:13:25.526 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.512+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.527 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.512+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2575334339}) 2026-02-13T18:13:25.527 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.512+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4143770111}) 2026-02-13T18:13:25.527 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.527 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3482326398}) 2026-02-13T18:13:25.527 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3455020240}) 2026-02-13T18:13:25.527 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.528 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3482326398}) 2026-02-13T18:13:25.528 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3747269917}) 2026-02-13T18:13:25.528 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.528 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4097453629}) 2026-02-13T18:13:25.528 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2615161619}) 2026-02-13T18:13:25.528 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4097453629}) 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1904959203}) 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=45} crc {logm=3870987824,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=4170841978,mon_config_key=3256534467,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3251215256,osd_pg_creating=4074565511,osd_snap=3175055335}) 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=47} crc {logm=786845255,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=919524273,mon_config_key=2172609631,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3492138135,osd_pg_creating=4074565511,osd_snap=1818018449}) 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.529 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=45} crc {logm=3870987824,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=4170841978,mon_config_key=3256534467,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3251215256,osd_pg_creating=4074565511,osd_snap=3175055335}) 2026-02-13T18:13:25.530 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=10,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=45} crc {logm=1590114728,mdsmap=685858242,mgr=729255076,mgr_command_descs=2141687500,mgr_metadata=3546443502,mgrstat=4170841978,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=4074565511,osd_snap=2757608348}) 2026-02-13T18:13:25.530 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.530 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=31,osdmap=69} crc {osd_snap=2469992845,osdmap=3085278372}) 2026-02-13T18:13:25.530 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=30,osdmap=70} crc {osd_snap=2166827636,osdmap=2608431438}) 2026-02-13T18:13:25.530 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.530 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=31,osdmap=69} crc {osd_snap=2469992845,osdmap=3085278372}) 2026-02-13T18:13:25.531 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.516+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=33,osdmap=67} crc {osd_snap=1572781689,osdmap=286400105}) 2026-02-13T18:13:25.531 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.531 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2741695954}) 2026-02-13T18:13:25.531 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=752063951}) 2026-02-13T18:13:25.531 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.531 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2741695954}) 2026-02-13T18:13:25.532 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2635955812}) 2026-02-13T18:13:25.532 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.532 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2752466667}) 2026-02-13T18:13:25.532 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1952978364}) 2026-02-13T18:13:25.532 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.532 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2752466667}) 2026-02-13T18:13:25.533 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=929946571}) 2026-02-13T18:13:25.533 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.533 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=39159524}) 2026-02-13T18:13:25.533 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3749400378}) 2026-02-13T18:13:25.533 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.533 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=39159524}) 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2823428161}) 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=58155482}) 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1107907853}) 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=58155482}) 2026-02-13T18:13:25.534 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.520+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1246275538}) 2026-02-13T18:13:25.537 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.538 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3507428986}) 2026-02-13T18:13:25.538 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3811078528}) 2026-02-13T18:13:25.538 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.538 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3507428986}) 2026-02-13T18:13:25.538 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2939274456}) 2026-02-13T18:13:25.539 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.539 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=14} crc {osdmap=3565302483}) 2026-02-13T18:13:25.539 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=15} crc {osdmap=1959338821}) 2026-02-13T18:13:25.539 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:13:25.539 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=14} crc {osdmap=3565302483}) 2026-02-13T18:13:25.539 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:13:25.524+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=15} crc {osdmap=1959338821}) 2026-02-13T18:13:25.953 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:13:25.953 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:25.959 INFO:tasks.rados.rados.0.trial187.stdout:1714: done (3 left) 2026-02-13T18:13:25.960 INFO:tasks.rados.rados.0.trial187.stdout:1715: write (excl) oid 28 current snap is 191 2026-02-13T18:13:25.960 INFO:tasks.rados.rados.0.trial187.stdout:1715: seq_num 571 ranges {796797=493654,1830277=796851,3397470=199327} 2026-02-13T18:13:25.968 INFO:tasks.rados.rados.0.trial187.stdout:1715: writing trial18717860-28 from 796797 to 1290451 tid 1 2026-02-13T18:13:25.977 INFO:tasks.rados.rados.0.trial187.stdout:1715: writing trial18717860-28 from 1830277 to 2627128 tid 2 2026-02-13T18:13:25.984 INFO:tasks.rados.rados.0.trial187.stdout:1715: writing trial18717860-28 from 3397470 to 3596797 tid 3 2026-02-13T18:13:25.984 INFO:tasks.rados.rados.0.trial187.stdout:1716: copy_from oid 35 from oid 12 current snap is 191 2026-02-13T18:13:25.984 INFO:tasks.rados.rados.0.trial187.stdout:1707: expect (ObjNum 490 snap 147 seq_num 490) 2026-02-13T18:13:25.997 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1786602 2026-02-13T18:13:26.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient: get_monmap_and_config 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient: monmap: 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:26.015480+0000 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:26.015480+0000 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.016 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:26.017 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:26.017 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 1 Processor -- start 2026-02-13T18:13:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 1 -- start start 2026-02-13T18:13:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient: init 2026-02-13T18:13:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient(hunting): picked mon.noname-c con 0x7f234413f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient(hunting): picked mon.noname-b con 0x7f2344095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient(hunting): picked mon.noname-a con 0x7f23441851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2344140290 con 0x7f23441851c0 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2344094750 con 0x7f234413f7b0 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2344093c80 con 0x7f2344095410 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2348d52640 10 monclient(hunting): authenticate will time out at 1037.070924s 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2342ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2344095410 0x7f2344183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49146/0 (socket says 10.20.193.78:49146) 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2342ffd640 1 -- 10.20.193.78:0/4044477276 learned_addr learned my addr 10.20.193.78:0/4044477276 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.012+0000 7f2343fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f23441851c0 0x7f23441a55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40696/0 (socket says 10.20.193.78:40696) 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2342ffd640 1 -- 10.20.193.78:0/4044477276 >> v1:10.20.193.78:6790/0 conn(0x7f2344095410 legacy=0x7f2344183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2343fff640 1 -- 10.20.193.78:0/4044477276 >> v1:10.20.193.78:6789/0 conn(0x7f23441851c0 legacy=0x7f23441a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425941268 0 0) 0x7f23380040a0 con 0x7f23441851c0 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23437fe640 1 -- 10.20.193.78:0/4044477276 >> v1:10.20.193.187:6789/0 conn(0x7f234413f7b0 legacy=0x7f234413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): my global_id is 74235 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2328003620 con 0x7f23441851c0 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806122594 0 0) 0x7f2344093c80 con 0x7f2344095410 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient(hunting): my global_id is 4796 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23380040a0 con 0x7f2344095410 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2312388651 0 0) 0x7f23380040a0 con 0x7f2344095410 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 >> v1:10.20.193.187:6789/0 conn(0x7f234413f7b0 legacy=0x7f234413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 >> v1:10.20.193.78:6789/0 conn(0x7f23441851c0 legacy=0x7f23441a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 monclient: found mon.noname-b 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2344094190 con 0x7f2344095410 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2334003090 con 0x7f2344095410 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: dump: 2026-02-13T18:13:26.026 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 5 monclient: authenticate success, global_id 4796 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2334003360 con 0x7f2344095410 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 1 -- 10.20.193.78:0/4044477276 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23340049a0 con 0x7f2344095410 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23427fc640 10 monclient: dump: 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.028 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 4 set_mon_vals no callback set 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: shutdown 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- 10.20.193.78:0/4044477276 >> v1:10.20.193.78:6790/0 conn(0x7f2344095410 legacy=0x7f2344183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- 10.20.193.78:0/4044477276 shutdown_connections 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- 10.20.193.78:0/4044477276 >> 10.20.193.78:0/4044477276 conn(0x7f2344054400 msgr2=0x7f2344054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- 10.20.193.78:0/4044477276 shutdown_connections 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- 10.20.193.78:0/4044477276 wait complete. 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: monmap: 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:26.030 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 Processor -- start 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- start start 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: init 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient(hunting): picked mon.noname-c con 0x7f2344095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient(hunting): picked mon.noname-b con 0x7f234413f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient(hunting): picked mon.noname-a con 0x7f23441851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23441119c0 con 0x7f23441851c0 2026-02-13T18:13:26.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2344130ee0 con 0x7f234413f7b0 2026-02-13T18:13:26.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2344110b50 con 0x7f2344095410 2026-02-13T18:13:26.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f2348d52640 10 monclient(hunting): authenticate will time out at 1037.075663s 2026-02-13T18:13:26.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23437fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2344095410 0x7f23441300c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49154/0 (socket says 10.20.193.78:49154) 2026-02-13T18:13:26.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.016+0000 7f23437fe640 1 -- 10.20.193.78:0/1950753734 learned_addr learned my addr 10.20.193.78:0/1950753734 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2343fff640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.78:6789/0 conn(0x7f23441851c0 legacy=0x7f23441814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f23437fe640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.78:6790/0 conn(0x7f2344095410 legacy=0x7f23441300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141937036 0 0) 0x7f2344110b50 con 0x7f2344095410 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): my global_id is 4799 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2314003620 con 0x7f2344095410 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656950152 0 0) 0x7f23441119c0 con 0x7f23441851c0 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): my global_id is 74238 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2344110b50 con 0x7f23441851c0 2026-02-13T18:13:26.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2342ffd640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.187:6789/0 conn(0x7f234413f7b0 legacy=0x7f23441307d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1457305530 0 0) 0x7f2314003620 con 0x7f2344095410 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23441119c0 con 0x7f2344095410 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2330003400 con 0x7f2344095410 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): dump: 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.037 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2847521366 0 0) 0x7f2344110b50 con 0x7f23441851c0 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2314003620 con 0x7f23441851c0 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2338005df0 con 0x7f23441851c0 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:26.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient(hunting): dump: 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3702274288 0 0) 0x7f23441119c0 con 0x7f2344095410 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.187:6789/0 conn(0x7f234413f7b0 legacy=0x7f23441307d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.78:6789/0 conn(0x7f23441851c0 legacy=0x7f23441814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 monclient: found mon.c 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234410f660 con 0x7f2344095410 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 5 monclient: authenticate success, global_id 4799 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 monclient: _renew_subs 2026-02-13T18:13:26.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2344111120 con 0x7f2344095410 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 monclient: _renew_subs 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f23441101c0 con 0x7f2344095410 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2330003a30 con 0x7f2344095410 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2330003d90 con 0x7f2344095410 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 10 monclient: dump: 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.041 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2341ffb640 4 set_mon_vals no callback set 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2344110500 con 0x7f2344095410 2026-02-13T18:13:26.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f2330004020 con 0x7f2344095410 2026-02-13T18:13:26.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(398..398 src has 1..398) ==== 3991+0+0 (unknown 557775482 0 0) 0x7f233004c780 con 0x7f2344095410 2026-02-13T18:13:26.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.020+0000 7f2342ffd640 10 monclient: get_auth_request con 0x7f231403d610 auth_method 0 2026-02-13T18:13:26.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.024+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f2330017740 con 0x7f2344095410 2026-02-13T18:13:26.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.024+0000 7f231ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.024+0000 7f231ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:26.069 INFO:tasks.rados.rados.0.trial187.stdout:1708: expect (ObjNum 422 snap 122 seq_num 422) 2026-02-13T18:13:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f23441a6bb0 con 0x7f2344095410 2026-02-13T18:13:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f231ffff640 1 -- 10.20.193.78:0/1950753734 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3739504210) 0x7f2330017020 con 0x7f2344095410 2026-02-13T18:13:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f231ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f231ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:26.147 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.187:6812/2668687789 conn(0x7f231403d610 legacy=0x7f231405dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 10 monclient: shutdown 2026-02-13T18:13:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 >> v1:10.20.193.78:6790/0 conn(0x7f2344095410 legacy=0x7f23441300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 shutdown_connections 2026-02-13T18:13:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 >> 10.20.193.78:0/1950753734 conn(0x7f2344054400 msgr2=0x7f23441a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 shutdown_connections 2026-02-13T18:13:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.144+0000 7f2348d52640 1 -- 10.20.193.78:0/1950753734 wait complete. 2026-02-13T18:13:26.152 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:26.157 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:13:26.157 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:13:26.157 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:13:26.158 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:13:26.194 INFO:tasks.rados.rados.0.trial187.stdout:1710: finishing rollback tid 0 to trial18717860-13 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1710: finishing rollback tid 1 to trial18717860-13 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1707: done (4 left) 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1708: done (3 left) 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1717: snap_create 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1710: finishing rollback tid 2 to trial18717860-13 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 491 (ObjNum 482 snap 146 seq_num 482) dirty exists 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1715: finishing write tid 1 to trial18717860-28 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1715: finishing write tid 2 to trial18717860-28 2026-02-13T18:13:26.195 INFO:tasks.rados.rados.0.trial187.stdout:1715: finishing write tid 3 to trial18717860-28 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: finishing write tid 4 to trial18717860-28 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: finishing write tid 5 to trial18717860-28 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: oid 28 updating version 0 to 773 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: oid 28 updating version 773 to 774 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: oid 28 version 774 is already newer than 772 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: oid 28 version 774 is already newer than 771 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 774 (ObjNum 571 snap 191 seq_num 571) dirty exists 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1715: left oid 28 (ObjNum 571 snap 191 seq_num 571) 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1716: finishing copy_from racing read to trial18717860-35 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:1716: finishing copy_from to trial18717860-35 2026-02-13T18:13:26.196 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 459 (ObjNum 486 snap 146 seq_num 486) dirty exists 2026-02-13T18:13:26.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient: get_monmap_and_config 2026-02-13T18:13:26.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient: monmap: 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:26.220318+0000 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:26.220318+0000 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:26.221 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 1 Processor -- start 2026-02-13T18:13:26.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 1 -- start start 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient: init 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient(hunting): picked mon.noname-a con 0x7f4c5c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient(hunting): picked mon.noname-c con 0x7f4c5c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient(hunting): picked mon.noname-b con 0x7f4c5c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c089e80 con 0x7f4c5c08c2f0 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c088c20 con 0x7f4c5c08dc80 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c089ba0 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c628ef640 10 monclient(hunting): authenticate will time out at 1037.275566s 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c60e65640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4c5c08cdd0 0x7f4c5c1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49156/0 (socket says 10.20.193.78:49156) 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c60e65640 1 -- 10.20.193.78:0/542662647 learned_addr learned my addr 10.20.193.78:0/542662647 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.216+0000 7f4c5bfff640 1 --1- 10.20.193.78:0/542662647 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c08c2f0 0x7f4c5c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40708/0 (socket says 10.20.193.78:40708) 2026-02-13T18:13:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c60e65640 1 -- 10.20.193.78:0/542662647 >> v1:10.20.193.78:6790/0 conn(0x7f4c5c08cdd0 legacy=0x7f4c5c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5bfff640 1 -- 10.20.193.78:0/542662647 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c08c2f0 legacy=0x7f4c5c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592813714 0 0) 0x7f4c5c089ba0 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): my global_id is 4802 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c40003620 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186136964 0 0) 0x7f4c5c089e80 con 0x7f4c5c08c2f0 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient(hunting): my global_id is 74241 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c5c089ba0 con 0x7f4c5c08c2f0 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5b7fe640 1 -- 10.20.193.78:0/542662647 >> v1:10.20.193.187:6789/0 conn(0x7f4c5c08dc80 legacy=0x7f4c5c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1720636400 0 0) 0x7f4c40003620 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 >> v1:10.20.193.187:6789/0 conn(0x7f4c5c08dc80 legacy=0x7f4c5c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c08c2f0 legacy=0x7f4c5c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 monclient: found mon.noname-b 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c08d370 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 5 monclient: authenticate success, global_id 4802 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c50004620 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: dump: 2026-02-13T18:13:26.238 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c500048f0 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 1 -- 10.20.193.78:0/542662647 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c50006060 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5affd640 10 monclient: dump: 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.241 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 4 set_mon_vals no callback set 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: shutdown 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- 10.20.193.78:0/542662647 >> v1:10.20.193.78:6790/0 conn(0x7f4c5c08cdd0 legacy=0x7f4c5c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- 10.20.193.78:0/542662647 shutdown_connections 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- 10.20.193.78:0/542662647 >> 10.20.193.78:0/542662647 conn(0x7f4c5c091720 msgr2=0x7f4c5c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- 10.20.193.78:0/542662647 shutdown_connections 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- 10.20.193.78:0/542662647 wait complete. 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: monmap: 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:26.243 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 Processor -- start 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- start start 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: init 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient(hunting): picked mon.noname-b con 0x7f4c5c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient(hunting): picked mon.noname-c con 0x7f4c5c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient(hunting): picked mon.noname-a con 0x7f4c5c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c082230 con 0x7f4c5c08dc80 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c088910 con 0x7f4c5c08c2f0 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c0812d0 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c628ef640 10 monclient(hunting): authenticate will time out at 1037.279701s 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4c5c08cdd0 0x7f4c5c083a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49160/0 (socket says 10.20.193.78:49160) 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.220+0000 7f4c5b7fe640 1 -- 10.20.193.78:0/1446526432 learned_addr learned my addr 10.20.193.78:0/1446526432 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c5b7fe640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6790/0 conn(0x7f4c5c08cdd0 legacy=0x7f4c5c083a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c60e65640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c08dc80 legacy=0x7f4c5c1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862798524 0 0) 0x7f4c5c0812d0 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): my global_id is 4805 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c2c003620 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c5bfff640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.187:6789/0 conn(0x7f4c5c08c2f0 legacy=0x7f4c5c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996688442 0 0) 0x7f4c5c082230 con 0x7f4c5c08dc80 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): my global_id is 74244 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c5c0812d0 con 0x7f4c5c08dc80 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3677312024 0 0) 0x7f4c2c003620 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c5c082230 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c4c003420 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): dump: 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.249 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384726080 0 0) 0x7f4c5c088910 con 0x7f4c5c08c2f0 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): my global_id is 84157 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c2c003620 con 0x7f4c5c08c2f0 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4217561892 0 0) 0x7f4c5c0812d0 con 0x7f4c5c08dc80 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c5c088910 con 0x7f4c5c08dc80 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c50004080 con 0x7f4c5c08dc80 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient(hunting): dump: 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.251 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 165315299 0 0) 0x7f4c5c082230 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.187:6789/0 conn(0x7f4c5c08c2f0 legacy=0x7f4c5c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c08dc80 legacy=0x7f4c5c1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 monclient: found mon.c 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c080d10 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 5 monclient: authenticate success, global_id 4805 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 10 monclient: _renew_subs 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c081920 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 10 monclient: _renew_subs 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c5c084150 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c4c003a30 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c4c003d90 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c5a7fc640 4 set_mon_vals no callback set 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 10 monclient: dump: 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.255 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4c5c08f5e0 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4c4c004020 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(398..398 src has 1..398) ==== 3991+0+0 (unknown 557775482 0 0) 0x7f4c4c04c750 con 0x7f4c5c08cdd0 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.224+0000 7f4c60e65640 10 monclient: get_auth_request con 0x7f4c2c03d880 auth_method 0 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c5bfff640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c07a3d0 legacy=0x7f4c5c07a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272054144 0 0) 0x7f4c5c08f5e0 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient(hunting): my global_id is 74247 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c5c082230 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 365526038 0 0) 0x7f4c5c082230 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c5c08f5e0 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c480032a0 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient: dump: 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.257 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 968261592 0 0) 0x7f4c5c08f5e0 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c5c081e90 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4c480048e0 con 0x7f4c5c07a3d0 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c07a3d0 legacy=0x7f4c5c07a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.228+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c07a3d0 legacy=0x7f4c5c07a7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.232+0000 7f4c628ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.232+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4c5c090810 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c5bfff640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c07aeb0 legacy=0x7f4c5c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170768936 0 0) 0x7f4c5c090810 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient(hunting): my global_id is 74250 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c5c08f5e0 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1272063697 0 0) 0x7f4c5c08f5e0 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c5c090810 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4c48004f00 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient: dump: 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.260 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1862206598 0 0) 0x7f4c5c090810 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4c5c0510e0 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 5052444) 0x7f4c48005270 con 0x7f4c5c07aeb0 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c07aeb0 legacy=0x7f4c5c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c58ff9640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6789/0 conn(0x7f4c5c07aeb0 legacy=0x7f4c5c197c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:26.261 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 28, 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 147093, 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 3, 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.262 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.263 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:26.264 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:26.265 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:26.266 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.267 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:26.268 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:26.269 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.187:6812/2668687789 conn(0x7f4c2c03d880 legacy=0x7f4c2c05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 10 monclient: shutdown 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 >> v1:10.20.193.78:6790/0 conn(0x7f4c5c08cdd0 legacy=0x7f4c5c083a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c60e65640 1 -- 10.20.193.78:0/1446526432 reap_dead start 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 shutdown_connections 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 >> 10.20.193.78:0/1446526432 conn(0x7f4c5c091720 msgr2=0x7f4c5c057a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 shutdown_connections 2026-02-13T18:13:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.236+0000 7f4c628ef640 1 -- 10.20.193.78:0/1446526432 wait complete. 2026-02-13T18:13:26.271 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:13:26.271 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:13:26.271 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:13:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.336+0000 7fb6d9386640 10 monclient: get_monmap_and_config 2026-02-13T18:13:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.336+0000 7fb6d9386640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.336+0000 7fb6d9386640 10 monclient: monmap: 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:26.340915+0000 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:26.340915+0000 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.336+0000 7fb6d9386640 1 Processor -- start 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.336+0000 7fb6d9386640 1 -- start start 2026-02-13T18:13:26.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.336+0000 7fb6d9386640 10 monclient: init 2026-02-13T18:13:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:13:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient(hunting): picked mon.noname-b con 0x7fb6d4084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient(hunting): picked mon.noname-a con 0x7fb6d408d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient(hunting): picked mon.noname-c con 0x7fb6d41831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d408da30 con 0x7fb6d408d5f0 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d4089e60 con 0x7fb6d41831f0 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d4085410 con 0x7fb6d4084930 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient(hunting): authenticate will time out at 1037.396351s 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d27fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb6d408d5f0 0x7fb6d4181ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40750/0 (socket says 10.20.193.78:40750) 2026-02-13T18:13:26.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d27fc640 1 -- 10.20.193.78:0/2782535255 learned_addr learned my addr 10.20.193.78:0/2782535255 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d2ffd640 1 -- 10.20.193.78:0/2782535255 >> v1:10.20.193.78:6790/0 conn(0x7fb6d4084930 legacy=0x7fb6d4084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d27fc640 1 -- 10.20.193.78:0/2782535255 >> v1:10.20.193.78:6789/0 conn(0x7fb6d408d5f0 legacy=0x7fb6d4181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271136359 0 0) 0x7fb6d4085410 con 0x7fb6d4084930 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d37fe640 1 -- 10.20.193.78:0/2782535255 >> v1:10.20.193.187:6789/0 conn(0x7fb6d41831f0 legacy=0x7fb6d41a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): my global_id is 4808 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6c0003620 con 0x7fb6d4084930 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530839653 0 0) 0x7fb6bc002c60 con 0x7fb6d408d5f0 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient(hunting): my global_id is 74253 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6d4085410 con 0x7fb6d408d5f0 2026-02-13T18:13:26.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3506463045 0 0) 0x7fb6c0003620 con 0x7fb6d4084930 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 >> v1:10.20.193.187:6789/0 conn(0x7fb6d41831f0 legacy=0x7fb6d41a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 >> v1:10.20.193.78:6789/0 conn(0x7fb6d408d5f0 legacy=0x7fb6d4181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 monclient: found mon.noname-b 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d4089b80 con 0x7fb6d4084930 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 5 monclient: authenticate success, global_id 4808 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6c8003160 con 0x7fb6d4084930 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:26.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: dump: 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6c8003430 con 0x7fb6d4084930 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 1 -- 10.20.193.78:0/2782535255 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6c80038c0 con 0x7fb6d4084930 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:26.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 4 set_mon_vals no callback set 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d1ffb640 10 monclient: dump: 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 10 monclient: shutdown 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- 10.20.193.78:0/2782535255 >> v1:10.20.193.78:6790/0 conn(0x7fb6d4084930 legacy=0x7fb6d4084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- 10.20.193.78:0/2782535255 shutdown_connections 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- 10.20.193.78:0/2782535255 >> 10.20.193.78:0/2782535255 conn(0x7fb6d4091720 msgr2=0x7fb6d4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- 10.20.193.78:0/2782535255 shutdown_connections 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.340+0000 7fb6d9386640 1 -- 10.20.193.78:0/2782535255 wait complete. 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: monmap: 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 Processor -- start 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 -- start start 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: init 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient(hunting): picked mon.noname-b con 0x7fb6d4084930 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient(hunting): picked mon.noname-c con 0x7fb6d408d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient(hunting): picked mon.noname-a con 0x7fb6d41831f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d405c8d0 con 0x7fb6d41831f0 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d407c6d0 con 0x7fb6d4084930 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d407b1f0 con 0x7fb6d408d5f0 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient(hunting): authenticate will time out at 1037.400969s 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d37fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb6d41831f0 0x7fb6d4171be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40754/0 (socket says 10.20.193.78:40754) 2026-02-13T18:13:26.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d37fe640 1 -- 10.20.193.78:0/451001869 learned_addr learned my addr 10.20.193.78:0/451001869 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6789/0 conn(0x7fb6d41831f0 legacy=0x7fb6d4171be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d27fc640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d408d5f0 legacy=0x7fb6d407aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d2ffd640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.187:6789/0 conn(0x7fb6d4084930 legacy=0x7fb6d407a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461654404 0 0) 0x7fb6d405c8d0 con 0x7fb6d41831f0 2026-02-13T18:13:26.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): my global_id is 74256 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a0003620 con 0x7fb6d41831f0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065485213 0 0) 0x7fb6d407b1f0 con 0x7fb6d408d5f0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): my global_id is 4811 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6d405c8d0 con 0x7fb6d408d5f0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2954043833 0 0) 0x7fb6a0003620 con 0x7fb6d41831f0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6d407b1f0 con 0x7fb6d41831f0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6c40048e0 con 0x7fb6d41831f0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:13:26.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): dump: 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092897126 0 0) 0x7fb6d407c6d0 con 0x7fb6d4084930 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): my global_id is 84163 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a0003620 con 0x7fb6d4084930 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 319877178 0 0) 0x7fb6d405c8d0 con 0x7fb6d408d5f0 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6d407c6d0 con 0x7fb6d408d5f0 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6bc002c30 con 0x7fb6d408d5f0 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient(hunting): dump: 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.359 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3872452182 0 0) 0x7fb6d407b1f0 con 0x7fb6d41831f0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d408d5f0 legacy=0x7fb6d407aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.187:6789/0 conn(0x7fb6d4084930 legacy=0x7fb6d407a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 monclient: found mon.a 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d407c9b0 con 0x7fb6d41831f0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 5 monclient: authenticate success, global_id 74256 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: _renew_subs 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d405d630 con 0x7fb6d41831f0 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: _renew_subs 2026-02-13T18:13:26.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6d4083080 con 0x7fb6d41831f0 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6c4004ed0 con 0x7fb6d41831f0 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6c4005260 con 0x7fb6d41831f0 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6b37fe640 10 monclient: dump: 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.361 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.344+0000 7fb6d17fa640 4 set_mon_vals no callback set 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6d9386640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb6d40389c0 con 0x7fb6d4058010 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb6c40054f0 con 0x7fb6d41831f0 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(398..398 src has 1..398) ==== 3991+0+0 (unknown 557775482 0 0) 0x7fb6c404db70 con 0x7fb6d41831f0 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6d27fc640 10 monclient: get_auth_request con 0x7fb6a003d880 auth_method 0 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6d2ffd640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d4058010 legacy=0x7fb6d404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101761856 0 0) 0x7fb6d40389c0 con 0x7fb6d4058010 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient(hunting): my global_id is 4814 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6d407b1f0 con 0x7fb6d4058010 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1700248388 0 0) 0x7fb6d407b1f0 con 0x7fb6d4058010 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6d40389c0 con 0x7fb6d4058010 2026-02-13T18:13:26.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6c8002bc0 con 0x7fb6d4058010 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient: dump: 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3247402600 0 0) 0x7fb6d40389c0 con 0x7fb6d4058010 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6d408f620 con 0x7fb6d4058010 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb6c8003080 con 0x7fb6d4058010 2026-02-13T18:13:26.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:26.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d4058010 legacy=0x7fb6d404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.348+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d4058010 legacy=0x7fb6d404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:26.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.352+0000 7fb6d9386640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:26.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.352+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb6d4090810 con 0x7fb6d40583e0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d2ffd640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d40583e0 legacy=0x7fb6d4174310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336440816 0 0) 0x7fb6d4090810 con 0x7fb6d40583e0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient(hunting): my global_id is 4817 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6d40389c0 con 0x7fb6d40583e0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1290163187 0 0) 0x7fb6d40389c0 con 0x7fb6d40583e0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6d4090810 con 0x7fb6d40583e0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb6c8003c30 con 0x7fb6d40583e0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient: dump: 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 508345244 0 0) 0x7fb6d4090810 con 0x7fb6d40583e0 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6d40510e0 con 0x7fb6d40583e0 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4510 (unknown 0 0 3712288710) 0x7fb6c8004060 con 0x7fb6d40583e0 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:26.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d40583e0 legacy=0x7fb6d4174310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6b37fe640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6790/0 conn(0x7fb6d40583e0 legacy=0x7fb6d4174310 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 28, 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 487747, 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:26.367 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 4, 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.368 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.369 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:26.370 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.371 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.372 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.373 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.374 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.375 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:26.376 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:26.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb6a003d880 legacy=0x7fb6a005dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 10 monclient: shutdown 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 >> v1:10.20.193.78:6789/0 conn(0x7fb6d41831f0 legacy=0x7fb6d4171be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d37fe640 1 -- 10.20.193.78:0/451001869 reap_dead start 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d37fe640 1 -- 10.20.193.78:0/451001869 reap_dead start 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 shutdown_connections 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 >> 10.20.193.78:0/451001869 conn(0x7fb6d4091720 msgr2=0x7fb6d41a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 shutdown_connections 2026-02-13T18:13:26.378 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.356+0000 7fb6d9386640 1 -- 10.20.193.78:0/451001869 wait complete. 2026-02-13T18:13:26.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:13:26.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:13:26.378 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:13:26.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.432+0000 7f0518373640 10 monclient: get_monmap_and_config 2026-02-13T18:13:26.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.432+0000 7f0518373640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.432+0000 7f0518373640 10 monclient: monmap: 2026-02-13T18:13:26.438 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:26.437247+0000 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:26.437247+0000 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 Processor -- start 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- start start 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient: init 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:13:26.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient(hunting): picked mon.noname-b con 0x7f051005e570 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient(hunting): picked mon.noname-a con 0x7f051008cad0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient(hunting): picked mon.noname-c con 0x7f051008cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051005e940 con 0x7f051008cad0 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051008e000 con 0x7f051008cf30 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0510084e70 con 0x7f051005e570 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient(hunting): authenticate will time out at 1037.492435s 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05160e8640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f051005e570 0x7f051008c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49192/0 (socket says 10.20.193.78:49192) 2026-02-13T18:13:26.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05160e8640 1 -- 10.20.193.78:0/3658238329 learned_addr learned my addr 10.20.193.78:0/3658238329 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05160e8640 1 -- 10.20.193.78:0/3658238329 >> v1:10.20.193.78:6790/0 conn(0x7f051005e570 legacy=0x7f051008c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05158e7640 1 -- 10.20.193.78:0/3658238329 >> v1:10.20.193.78:6789/0 conn(0x7f051008cad0 legacy=0x7f0510188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720570233 0 0) 0x7f0510084e70 con 0x7f051005e570 2026-02-13T18:13:26.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): my global_id is 4820 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05168e9640 1 -- 10.20.193.78:0/3658238329 >> v1:10.20.193.187:6789/0 conn(0x7f051008cf30 legacy=0x7f05101aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f8003620 con 0x7f051005e570 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670973468 0 0) 0x7f051005e940 con 0x7f051008cad0 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient(hunting): my global_id is 74259 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0510084e70 con 0x7f051008cad0 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1900919426 0 0) 0x7f04f8003620 con 0x7f051005e570 2026-02-13T18:13:26.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 >> v1:10.20.193.187:6789/0 conn(0x7f051008cf30 legacy=0x7f05101aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 >> v1:10.20.193.78:6789/0 conn(0x7f051008cad0 legacy=0x7f0510188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 monclient: found mon.noname-b 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05100845d0 con 0x7f051005e570 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 5 monclient: authenticate success, global_id 4820 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0500003110 con 0x7f051005e570 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:26.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: dump: 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05000033e0 con 0x7f051005e570 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 1 -- 10.20.193.78:0/3658238329 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0500004b50 con 0x7f051005e570 2026-02-13T18:13:26.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f05150e6640 10 monclient: dump: 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 4 set_mon_vals no callback set 2026-02-13T18:13:26.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 10 monclient: shutdown 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- 10.20.193.78:0/3658238329 >> v1:10.20.193.78:6790/0 conn(0x7f051005e570 legacy=0x7f051008c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- 10.20.193.78:0/3658238329 shutdown_connections 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- 10.20.193.78:0/3658238329 >> 10.20.193.78:0/3658238329 conn(0x7f0510091720 msgr2=0x7f0510091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- 10.20.193.78:0/3658238329 shutdown_connections 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.436+0000 7f0518373640 1 -- 10.20.193.78:0/3658238329 wait complete. 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: build_initial_monmap 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: monmap: 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:26.452 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 1 Processor -- start 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 1 -- start start 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: init 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient(hunting): picked mon.noname-a con 0x7f051005e570 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient(hunting): picked mon.noname-c con 0x7f051008cad0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient(hunting): picked mon.noname-b con 0x7f051008cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05101bfdd0 con 0x7f051005e570 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05101c00b0 con 0x7f051008cf30 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05101df6a0 con 0x7f051008cad0 2026-02-13T18:13:26.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient(hunting): authenticate will time out at 1037.497321s 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f05160e8640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f051005e570 0x7f05101def90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40778/0 (socket says 10.20.193.78:40778) 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f05160e8640 1 -- 10.20.193.78:0/392991880 learned_addr learned my addr 10.20.193.78:0/392991880 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f05158e7640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.78:6790/0 conn(0x7f051008cad0 legacy=0x7f051021faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f05160e8640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.78:6789/0 conn(0x7f051005e570 legacy=0x7f05101def90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287257179 0 0) 0x7f05101df6a0 con 0x7f051008cad0 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 4823 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e0003620 con 0x7f051008cad0 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782524250 0 0) 0x7f05101bfdd0 con 0x7f051005e570 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 74262 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05101df6a0 con 0x7f051005e570 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f05168e9640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f051008cf30 legacy=0x7f0510241220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1749541971 0 0) 0x7f04e0003620 con 0x7f051008cad0 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05101bfdd0 con 0x7f051008cad0 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f05040033f0 con 0x7f051008cad0 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): dump: 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.455 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 621106402 0 0) 0x7f05101df6a0 con 0x7f051005e570 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04e0003620 con 0x7f051005e570 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f05000048e0 con 0x7f051005e570 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient(hunting): dump: 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.456 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 260766205 0 0) 0x7f05101bfdd0 con 0x7f051008cad0 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f051008cf30 legacy=0x7f0510241220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.78:6789/0 conn(0x7f051005e570 legacy=0x7f05101def90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 monclient: found mon.c 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051005cda0 con 0x7f051008cad0 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:13:26.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f04f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 5 monclient: authenticate success, global_id 4823 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: _renew_subs 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.440+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05101becd0 con 0x7f051008cad0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f0518373640 10 monclient: _renew_subs 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f0518373640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f05101d8d70 con 0x7f051008cad0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05040039c0 con 0x7f051008cad0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0504003d20 con 0x7f051008cad0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f05148e5640 4 set_mon_vals no callback set 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: dump: 2026-02-13T18:13:26.458 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f0518373640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f051005c6c0 con 0x7f051005c2f0 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0504003f40 con 0x7f051008cad0 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(398..398 src has 1..398) ==== 3991+0+0 (unknown 557775482 0 0) 0x7f050404c7e0 con 0x7f051008cad0 2026-02-13T18:13:26.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f05168e9640 10 monclient: get_auth_request con 0x7f04e003d650 auth_method 0 2026-02-13T18:13:26.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f05160e8640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f051005c2f0 legacy=0x7f0510058030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014230757 0 0) 0x7f051005c6c0 con 0x7f051005c2f0 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 84172 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05101bfdd0 con 0x7f051005c2f0 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2354093348 0 0) 0x7f05101bfdd0 con 0x7f051005c2f0 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f051005c6c0 con 0x7f051005c2f0 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0500004e80 con 0x7f051005c2f0 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.444+0000 7f04f6ffd640 10 monclient: dump: 2026-02-13T18:13:26.462 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 438851174 0 0) 0x7f051005c6c0 con 0x7f051005c2f0 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f051008f620 con 0x7f051005c2f0 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0500007a20 con 0x7f051005c2f0 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:26.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f051005c2f0 legacy=0x7f0510058030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f051005c2f0 legacy=0x7f0510058030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f0518373640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.448+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f05101bf960 con 0x7f0510058740 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f05160e8640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f0510058740 legacy=0x7f0510263960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709947865 0 0) 0x7f05101bf960 con 0x7f0510058740 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 84175 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f051005c6c0 con 0x7f0510058740 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 467886023 0 0) 0x7f051005c6c0 con 0x7f0510058740 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05101bf960 con 0x7f0510058740 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0500005420 con 0x7f0510058740 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:26.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient: dump: 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4250041420 0 0) 0x7f05101bf960 con 0x7f0510058740 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0510090810 con 0x7f0510058740 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 2963347579) 0x7f0500007830 con 0x7f0510058740 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:26.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f0510058740 legacy=0x7f0510263960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f04f6ffd640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6789/0 conn(0x7f0510058740 legacy=0x7f0510263960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 28, 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 34618, 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:26.466 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 4, 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.467 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.468 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:26.469 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:26.470 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:26.471 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.472 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.473 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:26.474 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:26.475 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:26.476 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:26.476 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:26.476 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:26.476 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:26.476 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:26.476 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.187:6812/2668687789 conn(0x7f04e003d650 legacy=0x7f04e005db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 10 monclient: shutdown 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 >> v1:10.20.193.78:6790/0 conn(0x7f051008cad0 legacy=0x7f051021faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f05168e9640 1 -- 10.20.193.78:0/392991880 reap_dead start 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f05168e9640 1 -- 10.20.193.78:0/392991880 reap_dead start 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 shutdown_connections 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 >> 10.20.193.78:0/392991880 conn(0x7f0510091720 msgr2=0x7f051008e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 shutdown_connections 2026-02-13T18:13:26.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:26.452+0000 7f0518373640 1 -- 10.20.193.78:0/392991880 wait complete. 2026-02-13T18:13:26.478 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:13:26.478 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T18:13:26.478 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-13T18:13:26.478 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T18:13:26.478 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T18:13:26.478 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T18:13:26.478 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:13:26.491 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T18:13:26.491 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T18:13:26.491 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T18:13:26.491 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T18:13:26.491 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T18:13:41.492 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T18:13:41.492 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T18:13:41.493 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T18:13:41.493 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:13:41.493 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:13:41.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient: get_monmap_and_config 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient: build_initial_monmap 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient: monmap: 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:41.563486+0000 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:41.563486+0000 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:41.565 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:41.566 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:41.566 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:41.566 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:41.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 1 Processor -- start 2026-02-13T18:13:41.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 1 -- start start 2026-02-13T18:13:41.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient: init 2026-02-13T18:13:41.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:41.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:13:41.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient(hunting): picked mon.noname-c con 0x7f6120085b00 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:41.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient(hunting): picked mon.noname-b con 0x7f6120085ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:41.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient(hunting): picked mon.noname-a con 0x7f61200862a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612008d4e0 con 0x7f61200862a0 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6120054660 con 0x7f6120085b00 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61201a8b20 con 0x7f6120085ed0 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f6125d8a640 10 monclient(hunting): authenticate will time out at 1052.618961s 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f611ffff640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f61201a53e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f611effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f6120085ed0 0x7f6120183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38574/0 (socket says 10.20.193.78:38574) 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.560+0000 7f611effd640 1 -- 10.20.193.78:0/2661896669 learned_addr learned my addr 10.20.193.78:0/2661896669 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.564+0000 7f611effd640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6790/0 conn(0x7f6120085ed0 legacy=0x7f6120183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:41.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.564+0000 7f611f7fe640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.187:6789/0 conn(0x7f6120085b00 legacy=0x7f612008e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:41.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:41.764+0000 7f611ffff640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f61201a53e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:42.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:42.168+0000 7f611ffff640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f61201a53e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:42.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:42.972+0000 7f611ffff640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f61201a53e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:44.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): tick 2026-02-13T18:13:44.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 monclient(hunting): continuing hunt 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6790/0 conn(0x7f6120085ed0 legacy=0x7f6120183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.187:6789/0 conn(0x7f6120085b00 legacy=0x7f612008e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f61201a53e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f6120085ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f61200862a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f6120085b00 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:44.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 -- 10.20.193.78:0/2661896669 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61201a9d00 con 0x7f61200862a0 2026-02-13T18:13:44.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611effd640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f60fc0450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:44.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 -- 10.20.193.78:0/2661896669 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612008d4e0 con 0x7f6120085b00 2026-02-13T18:13:44.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 1 -- 10.20.193.78:0/2661896669 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60fc06a0f0 con 0x7f6120085ed0 2026-02-13T18:13:44.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611d7fa640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:44.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611f7fe640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6790/0 conn(0x7f6120085ed0 legacy=0x7f60fc0238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:44.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.563+0000 7f611ffff640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.187:6789/0 conn(0x7f6120085b00 legacy=0x7f60fc0668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:44.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:44.767+0000 7f611effd640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f60fc0450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:45.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:45.171+0000 7f611effd640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f60fc0450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:45.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:45.975+0000 7f611effd640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f60fc0450a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:46.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.539+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702459204 0 0) 0x7f612008d4e0 con 0x7f6120085b00 2026-02-13T18:13:46.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.539+0000 7f611e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.539+0000 7f611e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.539+0000 7f611e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.539+0000 7f611e7fc640 10 monclient(hunting): my global_id is 84178 2026-02-13T18:13:46.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.539+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6104003620 con 0x7f6120085b00 2026-02-13T18:13:46.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053803627 0 0) 0x7f60fc06a0f0 con 0x7f6120085ed0 2026-02-13T18:13:46.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient(hunting): my global_id is 4826 2026-02-13T18:13:46.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f612008d4e0 con 0x7f6120085ed0 2026-02-13T18:13:46.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1353503707 0 0) 0x7f612008d4e0 con 0x7f6120085ed0 2026-02-13T18:13:46.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.187:6789/0 conn(0x7f6120085b00 legacy=0x7f60fc0668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6789/0 conn(0x7f61200862a0 legacy=0x7f60fc0450a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:13:46.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:46.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 monclient: found mon.noname-b 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc06b450 con 0x7f6120085ed0 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f610c003120 con 0x7f6120085ed0 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:46.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: dump: 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 5 monclient: authenticate success, global_id 4826 2026-02-13T18:13:46.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:46.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f610c003460 con 0x7f6120085ed0 2026-02-13T18:13:46.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:46.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 1 -- 10.20.193.78:0/2661896669 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f610c0038c0 con 0x7f6120085ed0 2026-02-13T18:13:46.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f611e7fc640 10 monclient: dump: 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 4 set_mon_vals no callback set 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 10 monclient: shutdown 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 1 -- 10.20.193.78:0/2661896669 >> v1:10.20.193.78:6790/0 conn(0x7f6120085ed0 legacy=0x7f60fc0238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 1 -- 10.20.193.78:0/2661896669 shutdown_connections 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 1 -- 10.20.193.78:0/2661896669 >> 10.20.193.78:0/2661896669 conn(0x7f6120056aa0 msgr2=0x7f61200928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 1 -- 10.20.193.78:0/2661896669 shutdown_connections 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.543+0000 7f6125d8a640 1 -- 10.20.193.78:0/2661896669 wait complete. 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient: build_initial_monmap 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient: monmap: 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:46.555 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 1 Processor -- start 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 1 -- start start 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient: init 2026-02-13T18:13:46.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient(hunting): picked mon.noname-a con 0x7f6120085b00 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient(hunting): picked mon.noname-b con 0x7f6120085ed0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient(hunting): picked mon.noname-c con 0x7f61200862a0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61201a8830 con 0x7f6120085b00 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612007ff10 con 0x7f6120085ed0 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f611f7fe640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f6120085b00 legacy=0x7f61201da070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612007f670 con 0x7f61200862a0 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f6125d8a640 10 monclient(hunting): authenticate will time out at 1057.605448s 2026-02-13T18:13:46.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f611ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f61200862a0 0x7f612023c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38614/0 (socket says 10.20.193.78:38614) 2026-02-13T18:13:46.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f611ffff640 1 -- 10.20.193.78:0/1398347312 learned_addr learned my addr 10.20.193.78:0/1398347312 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f611ffff640 1 -- 10.20.193.78:0/1398347312 >> v1:10.20.193.78:6790/0 conn(0x7f61200862a0 legacy=0x7f612023c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489258960 0 0) 0x7f612007f670 con 0x7f61200862a0 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f60fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f60fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f60fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f60fbfff640 10 monclient(hunting): my global_id is 4829 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f0003620 con 0x7f61200862a0 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.547+0000 7f611effd640 1 -- 10.20.193.78:0/1398347312 >> v1:10.20.193.187:6789/0 conn(0x7f6120085ed0 legacy=0x7f612021b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3556648032 0 0) 0x7f60f0003620 con 0x7f61200862a0 2026-02-13T18:13:46.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f612007f670 con 0x7f61200862a0 2026-02-13T18:13:46.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6114005b80 con 0x7f61200862a0 2026-02-13T18:13:46.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:46.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:46.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): dump: 2026-02-13T18:13:46.562 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.562 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704369135 0 0) 0x7f612007ff10 con 0x7f6120085ed0 2026-02-13T18:13:46.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient(hunting): my global_id is 84181 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f0003620 con 0x7f6120085ed0 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 18200731 0 0) 0x7f612007f670 con 0x7f61200862a0 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 >> v1:10.20.193.187:6789/0 conn(0x7f6120085ed0 legacy=0x7f612021b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 >> v1:10.20.193.78:6789/0 conn(0x7f6120085b00 legacy=0x7f61201da070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: _finish_hunting 0 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 monclient: found mon.c 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:46.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612007e710 con 0x7f61200862a0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: _finish_auth 0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: _check_auth_tickets 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 5 monclient: authenticate success, global_id 4829 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 monclient: _renew_subs 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f612007dc30 con 0x7f61200862a0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 monclient: _renew_subs 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f612007d590 con 0x7f61200862a0 2026-02-13T18:13:46.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6114005da0 con 0x7f61200862a0 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6114006130 con 0x7f61200862a0 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 10 monclient: dump: 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.566 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f611dffb640 4 set_mon_vals no callback set 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f6114006400 con 0x7f61200862a0 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61200008e0 con 0x7f61200862a0 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(399..399 src has 1..399) ==== 3963+0+0 (unknown 4283305560 0 0) 0x7f611404dcd0 con 0x7f61200862a0 2026-02-13T18:13:46.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.551+0000 7f611f7fe640 10 monclient: get_auth_request con 0x7f60f003d4d0 auth_method 0 2026-02-13T18:13:46.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.555+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f6114018c50 con 0x7f61200862a0 2026-02-13T18:13:46.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.555+0000 7f60fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.555+0000 7f60fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f6125d8a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f6125d8a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f6125d8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61200907f0 con 0x7f61200862a0 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f60fbfff640 1 -- 10.20.193.78:0/1398347312 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 3211481036) 0x7f611401df10 con 0x7f61200862a0 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f60fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.667+0000 7f60fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:46.674 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":32,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 >> v1:10.20.193.187:6812/2668687789 conn(0x7f60f003d4d0 legacy=0x7f60f005d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 10 monclient: shutdown 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 >> v1:10.20.193.78:6790/0 conn(0x7f61200862a0 legacy=0x7f612023c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 shutdown_connections 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 >> 10.20.193.78:0/1398347312 conn(0x7f6120056aa0 msgr2=0x7f6120083e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 shutdown_connections 2026-02-13T18:13:46.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.671+0000 7f6125d8a640 1 -- 10.20.193.78:0/1398347312 wait complete. 2026-02-13T18:13:46.684 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:13:46.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:13:46.684 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:13:46.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient: get_monmap_and_config 2026-02-13T18:13:46.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient: build_initial_monmap 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient: monmap: 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:46.748506+0000 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:46.748506+0000 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:46.751 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 1 Processor -- start 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 1 -- start start 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient: init 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient(hunting): picked mon.noname-b con 0x7fdf9008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient(hunting): picked mon.noname-c con 0x7fdf9008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient(hunting): picked mon.noname-a con 0x7fdf9008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf90089e80 con 0x7fdf9008cdd0 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf90088c20 con 0x7fdf9008dc80 2026-02-13T18:13:46.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf90089ba0 con 0x7fdf9008c2f0 2026-02-13T18:13:46.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:46.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf96646640 10 monclient(hunting): authenticate will time out at 1057.803644s 2026-02-13T18:13:46.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf94bbc640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fdf9008cdd0 legacy=0x7fdf901a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:46.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf8ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fdf9008c2f0 0x7fdf9008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38630/0 (socket says 10.20.193.78:38630) 2026-02-13T18:13:46.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.743+0000 7fdf8ffff640 1 -- 10.20.193.78:0/1341846388 learned_addr learned my addr 10.20.193.78:0/1341846388 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:46.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8ffff640 1 -- 10.20.193.78:0/1341846388 >> v1:10.20.193.78:6790/0 conn(0x7fdf9008c2f0 legacy=0x7fdf9008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298377685 0 0) 0x7fdf90089ba0 con 0x7fdf9008c2f0 2026-02-13T18:13:46.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient(hunting): my global_id is 4832 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf74003620 con 0x7fdf9008c2f0 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8f7fe640 1 -- 10.20.193.78:0/1341846388 >> v1:10.20.193.187:6789/0 conn(0x7fdf9008dc80 legacy=0x7fdf90181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881519053 0 0) 0x7fdf74003620 con 0x7fdf9008c2f0 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 >> v1:10.20.193.187:6789/0 conn(0x7fdf9008dc80 legacy=0x7fdf90181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 >> v1:10.20.193.78:6789/0 conn(0x7fdf9008cdd0 legacy=0x7fdf901a3410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: _finish_hunting 0 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 monclient: found mon.noname-b 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:46.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9008d370 con 0x7fdf9008c2f0 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: _finish_auth 0 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: _check_auth_tickets 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 5 monclient: authenticate success, global_id 4832 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf7c003110 con 0x7fdf9008c2f0 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: dump: 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.758 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf7c0033e0 con 0x7fdf9008c2f0 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:46.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 1 -- 10.20.193.78:0/1341846388 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf7c004b50 con 0x7fdf9008c2f0 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf8effd640 10 monclient: dump: 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.760 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 4 set_mon_vals no callback set 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 10 monclient: shutdown 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 -- 10.20.193.78:0/1341846388 >> v1:10.20.193.78:6790/0 conn(0x7fdf9008c2f0 legacy=0x7fdf9008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 -- 10.20.193.78:0/1341846388 shutdown_connections 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 -- 10.20.193.78:0/1341846388 >> 10.20.193.78:0/1341846388 conn(0x7fdf90091720 msgr2=0x7fdf90091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 -- 10.20.193.78:0/1341846388 shutdown_connections 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 -- 10.20.193.78:0/1341846388 wait complete. 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 10 monclient: build_initial_monmap 2026-02-13T18:13:46.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 10 monclient: monmap: 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 Processor -- start 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 1 -- start start 2026-02-13T18:13:46.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.747+0000 7fdf96646640 10 monclient: init 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient(hunting): picked mon.noname-c con 0x7fdf9008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient(hunting): picked mon.noname-b con 0x7fdf9008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient(hunting): picked mon.noname-a con 0x7fdf9008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf90081e60 con 0x7fdf9008dc80 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9005d570 con 0x7fdf9008cdd0 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf90057910 con 0x7fdf9008c2f0 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient(hunting): authenticate will time out at 1057.808403s 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fdf9008c2f0 0x7fdf90153070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38634/0 (socket says 10.20.193.78:38634) 2026-02-13T18:13:46.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8ffff640 1 -- 10.20.193.78:0/3172824907 learned_addr learned my addr 10.20.193.78:0/3172824907 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:46.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf94bbc640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6789/0 conn(0x7fdf9008dc80 legacy=0x7fdf90195400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8ffff640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9008c2f0 legacy=0x7fdf90153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8f7fe640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.187:6789/0 conn(0x7fdf9008cdd0 legacy=0x7fdf90083930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80882097 0 0) 0x7fdf90057910 con 0x7fdf9008c2f0 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): my global_id is 4835 2026-02-13T18:13:46.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf60003620 con 0x7fdf9008c2f0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329683112 0 0) 0x7fdf9005d570 con 0x7fdf9008cdd0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): my global_id is 84187 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf90057910 con 0x7fdf9008cdd0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3815188590 0 0) 0x7fdf60003620 con 0x7fdf9008c2f0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf9005d570 con 0x7fdf9008c2f0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf7c0048e0 con 0x7fdf9008c2f0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:13:46.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): dump: 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:46.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4208976776 0 0) 0x7fdf90057910 con 0x7fdf9008cdd0 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf60003620 con 0x7fdf9008cdd0 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf80003380 con 0x7fdf9008cdd0 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient(hunting): dump: 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.772 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2686007505 0 0) 0x7fdf9005d570 con 0x7fdf9008c2f0 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.187:6789/0 conn(0x7fdf9008cdd0 legacy=0x7fdf90083930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6789/0 conn(0x7fdf9008dc80 legacy=0x7fdf90195400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: _finish_hunting 0 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 monclient: found mon.c 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf90080970 con 0x7fdf9008c2f0 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: _finish_auth 0 2026-02-13T18:13:46.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: _check_auth_tickets 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 5 monclient: authenticate success, global_id 4835 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient: _renew_subs 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdf90084040 con 0x7fdf9008c2f0 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient: _renew_subs 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdf90196cf0 con 0x7fdf9008c2f0 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf7c004b80 con 0x7fdf9008c2f0 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf7c005170 con 0x7fdf9008c2f0 2026-02-13T18:13:46.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8e7fc640 4 set_mon_vals no callback set 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 10 monclient: dump: 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.775 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdf9008f600 con 0x7fdf9005ad10 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.751+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fdf7c011800 con 0x7fdf9008c2f0 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(399..399 src has 1..399) ==== 3963+0+0 (unknown 4283305560 0 0) 0x7fdf7c04c840 con 0x7fdf9008c2f0 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf94bbc640 10 monclient: get_auth_request con 0x7fdf6003d5c0 auth_method 0 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8f7fe640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9005ad10 legacy=0x7fdf9004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822543220 0 0) 0x7fdf9008f600 con 0x7fdf9005ad10 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient(hunting): my global_id is 4838 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf9005d570 con 0x7fdf9005ad10 2026-02-13T18:13:46.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2893616861 0 0) 0x7fdf9005d570 con 0x7fdf9005ad10 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf9008f600 con 0x7fdf9005ad10 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf80003af0 con 0x7fdf9005ad10 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient: dump: 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.777 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1509351490 0 0) 0x7fdf9008f600 con 0x7fdf9005ad10 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf90087280 con 0x7fdf9005ad10 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fdf800058c0 con 0x7fdf9005ad10 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9005ad10 legacy=0x7fdf9004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.755+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9005ad10 legacy=0x7fdf9004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.759+0000 7fdf96646640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.759+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdf90090810 con 0x7fdf9005b0e0 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8f7fe640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9005b0e0 legacy=0x7fdf90198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074342869 0 0) 0x7fdf90090810 con 0x7fdf9005b0e0 2026-02-13T18:13:46.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient(hunting): my global_id is 4841 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf9008f600 con 0x7fdf9005b0e0 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1643535332 0 0) 0x7fdf9008f600 con 0x7fdf9005b0e0 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf90090810 con 0x7fdf9005b0e0 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fdf800041c0 con 0x7fdf9005b0e0 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient: dump: 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.779 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2324548732 0 0) 0x7fdf90090810 con 0x7fdf9005b0e0 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf900510e0 con 0x7fdf9005b0e0 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4499 (unknown 0 0 3519749801) 0x7fdf80004570 con 0x7fdf9005b0e0 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9005b0e0 legacy=0x7fdf90198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf8cff9640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9005b0e0 legacy=0x7fdf90198040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 32, 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 508155, 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:13:46.781 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:46.782 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.783 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:46.784 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.785 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:46.786 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:46.787 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:46.788 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.789 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.790 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:13:46.790 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.790 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.790 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.790 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:46.790 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.187:6812/2668687789 conn(0x7fdf6003d5c0 legacy=0x7fdf6005da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 10 monclient: shutdown 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 >> v1:10.20.193.78:6790/0 conn(0x7fdf9008c2f0 legacy=0x7fdf90153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf94bbc640 1 -- 10.20.193.78:0/3172824907 reap_dead start 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 shutdown_connections 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 >> 10.20.193.78:0/3172824907 conn(0x7fdf90091720 msgr2=0x7fdf9005dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 shutdown_connections 2026-02-13T18:13:46.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.763+0000 7fdf96646640 1 -- 10.20.193.78:0/3172824907 wait complete. 2026-02-13T18:13:46.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:13:46.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:13:46.792 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:13:46.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.859+0000 7fe085ce4640 10 monclient: get_monmap_and_config 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.859+0000 7fe085ce4640 10 monclient: build_initial_monmap 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.859+0000 7fe085ce4640 10 monclient: monmap: 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:13:46.864914+0000 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:13:46.864914+0000 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.866 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:46.867 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:13:46.867 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:13:46.867 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 Processor -- start 2026-02-13T18:13:46.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- start start 2026-02-13T18:13:46.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient: init 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient(hunting): picked mon.noname-b con 0x7fe08013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient(hunting): picked mon.noname-a con 0x7fe08005e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient(hunting): picked mon.noname-c con 0x7fe0801853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe080095530 con 0x7fe08005e4b0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe080140390 con 0x7fe0801853c0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07effd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fe08005e4b0 legacy=0x7fe080183ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08005d230 con 0x7fe08013f8b0 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient(hunting): authenticate will time out at 1057.920664s 2026-02-13T18:13:46.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07f7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 0x7fe08013fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38650/0 (socket says 10.20.193.78:38650) 2026-02-13T18:13:46.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07f7fe640 1 -- 10.20.193.78:0/1805008639 learned_addr learned my addr 10.20.193.78:0/1805008639 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:46.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07f7fe640 1 -- 10.20.193.78:0/1805008639 >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 legacy=0x7fe08013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272634026 0 0) 0x7fe08005d230 con 0x7fe08013f8b0 2026-02-13T18:13:46.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient(hunting): my global_id is 4844 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe064003620 con 0x7fe08013f8b0 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07ffff640 1 -- 10.20.193.78:0/1805008639 >> v1:10.20.193.187:6789/0 conn(0x7fe0801853c0 legacy=0x7fe0801a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1059871891 0 0) 0x7fe064003620 con 0x7fe08013f8b0 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 >> v1:10.20.193.187:6789/0 conn(0x7fe0801853c0 legacy=0x7fe0801a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 >> v1:10.20.193.78:6789/0 conn(0x7fe08005e4b0 legacy=0x7fe080183ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 monclient: found mon.noname-b 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:13:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08005d510 con 0x7fe08013f8b0 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 5 monclient: authenticate success, global_id 4844 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe06c003110 con 0x7fe08013f8b0 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: dump: 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.874 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe06c0033e0 con 0x7fe08013f8b0 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 1 -- 10.20.193.78:0/1805008639 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe06c004b50 con 0x7fe08013f8b0 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe07e7fc640 10 monclient: dump: 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.875 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient: get_monmap_and_config success 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 4 set_mon_vals no callback set 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 10 monclient: shutdown 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- 10.20.193.78:0/1805008639 >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 legacy=0x7fe08013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- 10.20.193.78:0/1805008639 shutdown_connections 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- 10.20.193.78:0/1805008639 >> 10.20.193.78:0/1805008639 conn(0x7fe0800545d0 msgr2=0x7fe0800549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- 10.20.193.78:0/1805008639 shutdown_connections 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.863+0000 7fe085ce4640 1 -- 10.20.193.78:0/1805008639 wait complete. 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: build_initial_monmap 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: monmap: 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:13:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 Processor -- start 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 -- start start 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: init 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: _reopen_session rank -1 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient(hunting): picked mon.noname-a con 0x7fe08005e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient(hunting): picked mon.noname-c con 0x7fe08013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient(hunting): picked mon.noname-b con 0x7fe0801853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe080111d10 con 0x7fe08005e4b0 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe080110ea0 con 0x7fe0801853c0 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08010f9b0 con 0x7fe08013f8b0 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient(hunting): _renew_subs 2026-02-13T18:13:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient(hunting): authenticate will time out at 1057.924760s 2026-02-13T18:13:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe07f7fe640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fe08005e4b0 legacy=0x7fe08013e820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:13:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe07effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 0x7fe08013ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38654/0 (socket says 10.20.193.78:38654) 2026-02-13T18:13:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe07effd640 1 -- 10.20.193.78:0/1412913045 learned_addr learned my addr 10.20.193.78:0/1412913045 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:13:46.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe07effd640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 legacy=0x7fe08013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe07effd640 1 --1- 10.20.193.78:0/1412913045 >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 0x7fe08013ef30 :-1 s=OPENED pgs=424 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fe08010f9b0 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:13:46.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe07ffff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe0801853c0 legacy=0x7fe0801815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143292682 0 0) 0x7fe080110ea0 con 0x7fe0801853c0 2026-02-13T18:13:46.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): my global_id is 84193 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe050003620 con 0x7fe0801853c0 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3125117876 0 0) 0x7fe050003620 con 0x7fe0801853c0 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe080110ea0 con 0x7fe0801853c0 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe074004890 con 0x7fe0801853c0 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): dump: 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.883 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1016347029 0 0) 0x7fe080110ea0 con 0x7fe0801853c0 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.78:6790/0 conn(0x7fe08013f8b0 legacy=0x7fe08013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.78:6789/0 conn(0x7fe08005e4b0 legacy=0x7fe08013e820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 monclient: found mon.b 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:13:46.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe080111470 con 0x7fe0801853c0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient: _finish_auth 0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062629397 0 0) 0x7fe08010f9b0 con 0x7fe08013f8b0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 5 monclient: authenticate success, global_id 84193 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: _renew_subs 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe08010f360 con 0x7fe0801853c0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe05bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: _renew_subs 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.867+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe080110740 con 0x7fe0801853c0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe074004ed0 con 0x7fe0801853c0 2026-02-13T18:13:46.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0740052a0 con 0x7fe0801853c0 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: dump: 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.886 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe07dffb640 4 set_mon_vals no callback set 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe085ce4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe08012d780 con 0x7fe08012d3b0 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe074005480 con 0x7fe0801853c0 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(399..399 src has 1..399) ==== 3963+0+0 (unknown 4283305560 0 0) 0x7fe07404db10 con 0x7fe0801853c0 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe07effd640 10 monclient: get_auth_request con 0x7fe05003d320 auth_method 0 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe07f7fe640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe08012d3b0 legacy=0x7fe08008cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515598399 0 0) 0x7fe08012d780 con 0x7fe08012d3b0 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient(hunting): my global_id is 84196 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08010f9b0 con 0x7fe08012d3b0 2026-02-13T18:13:46.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 879693839 0 0) 0x7fe08010f9b0 con 0x7fe08012d3b0 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe08012d780 con 0x7fe08012d3b0 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe06c002d90 con 0x7fe08012d3b0 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 10 monclient: dump: 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.888 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4227539724 0 0) 0x7fe08012d780 con 0x7fe08012d3b0 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.871+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0800008e0 con 0x7fe08012d3b0 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe06c003440 con 0x7fe08012d3b0 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe05bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe05bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe08012d3b0 legacy=0x7fe08008cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe08012d3b0 legacy=0x7fe08008cde0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe085ce4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:13:46.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.875+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe080093020 con 0x7fe08004d200 2026-02-13T18:13:46.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe07f7fe640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe08004d200 legacy=0x7fe080183cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556525907 0 0) 0x7fe080093020 con 0x7fe08004d200 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient(hunting): my global_id is 84199 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08012d780 con 0x7fe08004d200 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3226612956 0 0) 0x7fe08012d780 con 0x7fe08004d200 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe080093020 con 0x7fe08004d200 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe06c003190 con 0x7fe08004d200 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient: dump: 2026-02-13T18:13:46.891 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2350045619 0 0) 0x7fe080093020 con 0x7fe08004d200 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe080111750 con 0x7fe08004d200 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 268573683) 0x7fe06c007250 con 0x7fe08004d200 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:13:46.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe08004d200 legacy=0x7fe080183cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe05bfff640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe08004d200 legacy=0x7fe080183cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 32, 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 55046, 2026-02-13T18:13:46.893 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:46.894 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:46.895 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:13:46.896 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:13:46.897 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.898 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:13:46.899 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:13:46.901 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.902 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:13:46.903 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:13:46.904 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe05003d320 legacy=0x7fe05005d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 10 monclient: shutdown 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 >> v1:10.20.193.187:6789/0 conn(0x7fe0801853c0 legacy=0x7fe0801815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe07ffff640 1 -- 10.20.193.78:0/1412913045 reap_dead start 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe07ffff640 1 -- 10.20.193.78:0/1412913045 reap_dead start 2026-02-13T18:13:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 shutdown_connections 2026-02-13T18:13:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 >> 10.20.193.78:0/1412913045 conn(0x7fe0800545d0 msgr2=0x7fe0800965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:13:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 shutdown_connections 2026-02-13T18:13:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:13:46.879+0000 7fe085ce4640 1 -- 10.20.193.78:0/1412913045 wait complete. 2026-02-13T18:13:46.906 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:13:46.906 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:13:47.532 INFO:tasks.rados.rados.0.trial187.stdout:1710: done (3 left) 2026-02-13T18:13:47.532 INFO:tasks.rados.rados.0.trial187.stdout:1715: done (2 left) 2026-02-13T18:13:47.532 INFO:tasks.rados.rados.0.trial187.stdout:1716: done (1 left) 2026-02-13T18:13:47.532 INFO:tasks.rados.rados.0.trial187.stdout:1717: done (0 left) 2026-02-13T18:13:47.532 INFO:tasks.rados.rados.0.trial187.stdout:1718: delete oid 5 current snap is 192 2026-02-13T18:13:47.536 INFO:tasks.rados.rados.0.trial187.stdout:1718: done (0 left) 2026-02-13T18:13:47.536 INFO:tasks.rados.rados.0.trial187.stdout:1719: write oid 8 current snap is 192 2026-02-13T18:13:47.536 INFO:tasks.rados.rados.0.trial187.stdout:1719: seq_num 573 ranges {430411=644152,1830888=400520,2935963=402981} 2026-02-13T18:13:47.543 INFO:tasks.rados.rados.0.trial187.stdout:1719: writing trial18717860-8 from 430411 to 1074563 tid 1 2026-02-13T18:13:47.551 INFO:tasks.rados.rados.0.trial187.stdout:1719: writing trial18717860-8 from 1830888 to 2231408 tid 2 2026-02-13T18:13:47.558 INFO:tasks.rados.rados.0.trial187.stdout:1719: writing trial18717860-8 from 2935963 to 3338944 tid 3 2026-02-13T18:13:47.559 INFO:tasks.rados.rados.0.trial187.stdout:1720: snap_create 2026-02-13T18:13:47.559 INFO:tasks.rados.rados.0.trial187.stdout:1719: finishing write tid 1 to trial18717860-8 2026-02-13T18:13:47.559 INFO:tasks.rados.rados.0.trial187.stdout:1719: finishing write tid 2 to trial18717860-8 2026-02-13T18:13:47.560 INFO:tasks.rados.rados.0.trial187.stdout:1719: finishing write tid 3 to trial18717860-8 2026-02-13T18:13:47.560 INFO:tasks.rados.rados.0.trial187.stdout:1719: finishing write tid 4 to trial18717860-8 2026-02-13T18:13:47.560 INFO:tasks.rados.rados.0.trial187.stdout:1719: finishing write tid 5 to trial18717860-8 2026-02-13T18:13:47.560 INFO:tasks.rados.rados.0.trial187.stdout:1719: oid 8 updating version 0 to 773 2026-02-13T18:13:47.561 INFO:tasks.rados.rados.0.trial187.stdout:1719: oid 8 updating version 773 to 776 2026-02-13T18:13:47.561 INFO:tasks.rados.rados.0.trial187.stdout:1719: oid 8 version 776 is already newer than 775 2026-02-13T18:13:47.561 INFO:tasks.rados.rados.0.trial187.stdout:1719: oid 8 version 776 is already newer than 774 2026-02-13T18:13:47.561 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 776 (ObjNum 573 snap 192 seq_num 573) dirty exists 2026-02-13T18:13:47.561 INFO:tasks.rados.rados.0.trial187.stdout:1719: left oid 8 (ObjNum 573 snap 192 seq_num 573) 2026-02-13T18:13:48.533 INFO:tasks.rados.rados.0.trial187.stdout:1719: done (1 left) 2026-02-13T18:13:48.534 INFO:tasks.rados.rados.0.trial187.stdout:1720: done (0 left) 2026-02-13T18:13:48.534 INFO:tasks.rados.rados.0.trial187.stdout:1721: snap_create 2026-02-13T18:13:49.534 INFO:tasks.rados.rados.0.trial187.stdout:1721: done (0 left) 2026-02-13T18:13:49.534 INFO:tasks.rados.rados.0.trial187.stdout:1722: delete oid 27 current snap is 194 2026-02-13T18:13:49.538 INFO:tasks.rados.rados.0.trial187.stdout:1722: done (0 left) 2026-02-13T18:13:49.538 INFO:tasks.rados.rados.0.trial187.stdout:1723: rollback oid 20 current snap is 194 2026-02-13T18:13:49.538 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 193 2026-02-13T18:13:49.538 INFO:tasks.rados.rados.0.trial187.stdout:1724: snap_create 2026-02-13T18:13:49.540 INFO:tasks.rados.rados.0.trial187.stdout:1723: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:13:49.540 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 0 (ObjNum 225 snap 0 seq_num 3013907872) dirty dne 2026-02-13T18:13:50.540 INFO:tasks.rados.rados.0.trial187.stdout:1723: done (1 left) 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1724: done (0 left) 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1725: read oid 2 snap -1 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1725: expect (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1726: read oid 48 snap 188 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1726: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1727: read oid 3 snap -1 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1727: expect (ObjNum 515 snap 156 seq_num 515) 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1728: read oid 22 snap -1 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1728: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1729: read oid 27 snap -1 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1729: expect deleted 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1730: copy_from oid 34 from oid 18 current snap is 195 2026-02-13T18:13:50.541 INFO:tasks.rados.rados.0.trial187.stdout:1731: snap_remove snap 192 2026-02-13T18:13:51.499 INFO:tasks.rados.rados.0.trial187.stdout:1731: done (6 left) 2026-02-13T18:13:51.500 INFO:tasks.rados.rados.0.trial187.stdout:1732: snap_remove snap 190 2026-02-13T18:13:52.501 INFO:tasks.rados.rados.0.trial187.stdout:1732: done (6 left) 2026-02-13T18:13:52.501 INFO:tasks.rados.rados.0.trial187.stdout:1733: read oid 7 snap 178 2026-02-13T18:13:52.501 INFO:tasks.rados.rados.0.trial187.stdout:1733: expect (ObjNum 538 snap 168 seq_num 538) 2026-02-13T18:13:52.501 INFO:tasks.rados.rados.0.trial187.stdout:1734: read oid 17 snap -1 2026-02-13T18:13:52.501 INFO:tasks.rados.rados.0.trial187.stdout:1734: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:13:52.501 INFO:tasks.rados.rados.0.trial187.stdout:1735: write oid 40 current snap is 195 2026-02-13T18:13:52.502 INFO:tasks.rados.rados.0.trial187.stdout:1735: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2026-02-13T18:13:52.509 INFO:tasks.rados.rados.0.trial187.stdout:1735: writing trial18717860-40 from 464025 to 1258675 tid 1 2026-02-13T18:13:52.516 INFO:tasks.rados.rados.0.trial187.stdout:1735: writing trial18717860-40 from 1947852 to 2352041 tid 2 2026-02-13T18:13:52.524 INFO:tasks.rados.rados.0.trial187.stdout:1735: writing trial18717860-40 from 2990809 to 3416334 tid 3 2026-02-13T18:13:52.524 INFO:tasks.rados.rados.0.trial187.stdout:1736: write oid 36 current snap is 195 2026-02-13T18:13:52.524 INFO:tasks.rados.rados.0.trial187.stdout:1730: finishing copy_from to trial18717860-34 2026-02-13T18:13:52.524 INFO:tasks.rados.rados.0.trial187.stdout:1730: got expected ENOENT (src dne) 2026-02-13T18:13:52.524 INFO:tasks.rados.rados.0.trial187.stdout:1730: finishing copy_from racing read to trial18717860-34 2026-02-13T18:13:52.525 INFO:tasks.rados.rados.0.trial187.stdout:1725: expect (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:13:52.525 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:52.580 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1936866 2026-02-13T18:13:52.596 INFO:tasks.rados.rados.0.trial187.stdout:1727: expect (ObjNum 515 snap 156 seq_num 515) 2026-02-13T18:13:52.602 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2464776 2026-02-13T18:13:52.607 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:52.630 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 823786 2026-02-13T18:13:52.643 INFO:tasks.rados.rados.0.trial187.stdout:1726: expect (ObjNum 437 snap 126 seq_num 437) 2026-02-13T18:13:52.646 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1629349 2026-02-13T18:13:52.728 INFO:tasks.rados.rados.0.trial187.stdout:1728: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:13:52.728 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:52.797 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:52.936 INFO:tasks.rados.rados.0.trial187.stdout:1734: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:13:53.055 INFO:tasks.rados.rados.0.trial187.stdout:1733: expect (ObjNum 538 snap 168 seq_num 538) 2026-02-13T18:13:53.083 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1941683 2026-02-13T18:13:53.091 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:13:53.114 INFO:tasks.rados.rados.0.trial187.stdout:1735: finishing write tid 1 to trial18717860-40 2026-02-13T18:13:53.114 INFO:tasks.rados.rados.0.trial187.stdout:1735: finishing write tid 2 to trial18717860-40 2026-02-13T18:13:53.114 INFO:tasks.rados.rados.0.trial187.stdout:1735: finishing write tid 3 to trial18717860-40 2026-02-13T18:13:53.114 INFO:tasks.rados.rados.0.trial187.stdout:1735: finishing write tid 4 to trial18717860-40 2026-02-13T18:13:53.114 INFO:tasks.rados.rados.0.trial187.stdout:1735: finishing write tid 5 to trial18717860-40 2026-02-13T18:13:53.114 INFO:tasks.rados.rados.0.trial187.stdout:1735: oid 40 updating version 0 to 444 2026-02-13T18:13:53.115 INFO:tasks.rados.rados.0.trial187.stdout:1735: oid 40 version 444 is already newer than 442 2026-02-13T18:13:53.115 INFO:tasks.rados.rados.0.trial187.stdout:1735: oid 40 version 444 is already newer than 443 2026-02-13T18:13:53.115 INFO:tasks.rados.rados.0.trial187.stdout:1735: oid 40 updating version 444 to 445 2026-02-13T18:13:53.115 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 445 (ObjNum 575 snap 195 seq_num 575) dirty exists 2026-02-13T18:13:53.115 INFO:tasks.rados.rados.0.trial187.stdout:1735: left oid 40 (ObjNum 575 snap 195 seq_num 575) 2026-02-13T18:13:53.115 INFO:tasks.rados.rados.0.trial187.stdout:1736: seq_num 576 ranges {480832=469899,1606334=664200,3018232=662600} 2026-02-13T18:13:53.120 INFO:tasks.rados.rados.0.trial187.stdout:1736: writing trial18717860-36 from 480832 to 950731 tid 1 2026-02-13T18:13:53.129 INFO:tasks.rados.rados.0.trial187.stdout:1736: writing trial18717860-36 from 1606334 to 2270534 tid 2 2026-02-13T18:13:53.140 INFO:tasks.rados.rados.0.trial187.stdout:1736: writing trial18717860-36 from 3018232 to 3680832 tid 3 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1725: done (9 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1726: done (8 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1727: done (7 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1728: done (6 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1729: done (5 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1730: done (4 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1733: done (3 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1734: done (2 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1735: done (1 left) 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1737: copy_from oid 5 from oid 29 current snap is 195 2026-02-13T18:13:53.141 INFO:tasks.rados.rados.0.trial187.stdout:1736: finishing write tid 1 to trial18717860-36 2026-02-13T18:13:53.142 INFO:tasks.rados.rados.0.trial187.stdout:1736: finishing write tid 2 to trial18717860-36 2026-02-13T18:13:53.142 INFO:tasks.rados.rados.0.trial187.stdout:1738: write (excl) oid 3 current snap is 195 2026-02-13T18:13:53.142 INFO:tasks.rados.rados.0.trial187.stdout:1738: seq_num 577 ranges {497639=545148,1548463=407858,2529302=564422,3528143=169496} 2026-02-13T18:13:53.147 INFO:tasks.rados.rados.0.trial187.stdout:1738: writing trial18717860-3 from 497639 to 1042787 tid 1 2026-02-13T18:13:53.153 INFO:tasks.rados.rados.0.trial187.stdout:1738: writing trial18717860-3 from 1548463 to 1956321 tid 2 2026-02-13T18:13:53.161 INFO:tasks.rados.rados.0.trial187.stdout:1738: writing trial18717860-3 from 2529302 to 3093724 tid 3 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1738: writing trial18717860-3 from 3528143 to 3697639 tid 4 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1739: rollback oid 20 current snap is 195 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 193 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: finishing write tid 3 to trial18717860-36 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: finishing write tid 4 to trial18717860-36 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: finishing write tid 5 to trial18717860-36 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: oid 36 updating version 0 to 544 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: oid 36 version 544 is already newer than 543 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: oid 36 updating version 544 to 545 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: oid 36 version 545 is already newer than 542 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 545 (ObjNum 576 snap 195 seq_num 576) dirty exists 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: left oid 36 (ObjNum 576 snap 195 seq_num 576) 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1737: finishing copy_from racing read to trial18717860-5 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1737: finishing copy_from to trial18717860-5 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 611 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1738: finishing write tid 1 to trial18717860-3 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1738: finishing write tid 2 to trial18717860-3 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1738: finishing write tid 3 to trial18717860-3 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1736: done (3 left) 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1737: done (2 left) 2026-02-13T18:13:53.165 INFO:tasks.rados.rados.0.trial187.stdout:1740: snap_remove snap 181 2026-02-13T18:13:53.543 INFO:tasks.rados.rados.0.trial187.stdout:1740: done (2 left) 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1741: read oid 22 snap 184 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1741: expect (ObjNum 535 snap 168 seq_num 535) 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1742: copy_from oid 7 from oid 48 current snap is 195 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1739: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 0 (ObjNum 129 snap 0 seq_num 3013039224) dirty dne 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: finishing write tid 4 to trial18717860-3 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: finishing write tid 5 to trial18717860-3 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: finishing write tid 6 to trial18717860-3 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: oid 3 updating version 0 to 851 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: oid 3 updating version 851 to 852 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: oid 3 version 852 is already newer than 850 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: oid 3 updating version 852 to 853 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: oid 3 updating version 853 to 854 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 854 (ObjNum 577 snap 195 seq_num 577) dirty exists 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: left oid 3 (ObjNum 577 snap 195 seq_num 577) 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1738: done (3 left) 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1739: done (2 left) 2026-02-13T18:13:53.544 INFO:tasks.rados.rados.0.trial187.stdout:1743: snap_create 2026-02-13T18:13:53.549 INFO:tasks.rados.rados.0.trial187.stdout:1741: expect (ObjNum 535 snap 168 seq_num 535) 2026-02-13T18:13:53.596 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1901702 2026-02-13T18:13:53.747 INFO:tasks.rados.rados.0.trial187.stdout:1742: finishing copy_from racing read to trial18717860-7 2026-02-13T18:13:53.747 INFO:tasks.rados.rados.0.trial187.stdout:1742: finishing copy_from to trial18717860-7 2026-02-13T18:13:53.747 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 894 (ObjNum 558 snap 187 seq_num 558) dirty exists 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:1741: done (2 left) 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:1742: done (1 left) 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:1743: done (0 left) 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:1744: rollback oid 30 current snap is 196 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 170 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:1745: write (excl) oid 27 current snap is 196 2026-02-13T18:13:54.548 INFO:tasks.rados.rados.0.trial187.stdout:1745: seq_num 578 ranges {514446=736750,1723298=667869,3073078=641368} 2026-02-13T18:13:54.556 INFO:tasks.rados.rados.0.trial187.stdout:1745: writing trial18717860-27 from 514446 to 1251196 tid 1 2026-02-13T18:13:54.564 INFO:tasks.rados.rados.0.trial187.stdout:1745: writing trial18717860-27 from 1723298 to 2391167 tid 2 2026-02-13T18:13:54.573 INFO:tasks.rados.rados.0.trial187.stdout:1745: writing trial18717860-27 from 3073078 to 3714446 tid 3 2026-02-13T18:13:54.573 INFO:tasks.rados.rados.0.trial187.stdout:1746: read oid 44 snap -1 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1746: expect (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1747: delete oid 6 current snap is 196 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1744: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1744: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1744: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 779 (ObjNum 503 snap 152 seq_num 503) dirty exists 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1745: finishing write tid 1 to trial18717860-27 2026-02-13T18:13:54.574 INFO:tasks.rados.rados.0.trial187.stdout:1745: finishing write tid 2 to trial18717860-27 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: finishing write tid 3 to trial18717860-27 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: finishing write tid 4 to trial18717860-27 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: finishing write tid 5 to trial18717860-27 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: oid 27 updating version 0 to 611 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: oid 27 updating version 611 to 613 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: oid 27 updating version 613 to 614 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: oid 27 version 614 is already newer than 612 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 614 (ObjNum 578 snap 196 seq_num 578) dirty exists 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: left oid 27 (ObjNum 578 snap 196 seq_num 578) 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1744: done (3 left) 2026-02-13T18:13:54.577 INFO:tasks.rados.rados.0.trial187.stdout:1745: done (2 left) 2026-02-13T18:13:54.578 INFO:tasks.rados.rados.0.trial187.stdout:1747: done (1 left) 2026-02-13T18:13:54.578 INFO:tasks.rados.rados.0.trial187.stdout:1748: snap_create 2026-02-13T18:13:54.585 INFO:tasks.rados.rados.0.trial187.stdout:1746: expect (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:13:54.631 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1071042 2026-02-13T18:13:55.548 INFO:tasks.rados.rados.0.trial187.stdout:1746: done (1 left) 2026-02-13T18:13:55.548 INFO:tasks.rados.rados.0.trial187.stdout:1748: done (0 left) 2026-02-13T18:13:55.548 INFO:tasks.rados.rados.0.trial187.stdout:1749: snap_remove snap 167 2026-02-13T18:13:56.500 INFO:tasks.rados.rados.0.trial187.stdout:1749: done (0 left) 2026-02-13T18:13:56.501 INFO:tasks.rados.rados.0.trial187.stdout:1750: read oid 22 snap -1 2026-02-13T18:13:56.501 INFO:tasks.rados.rados.0.trial187.stdout:1750: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:13:56.501 INFO:tasks.rados.rados.0.trial187.stdout:1751: write oid 38 current snap is 197 2026-02-13T18:13:56.501 INFO:tasks.rados.rados.0.trial187.stdout:1751: seq_num 580 ranges {548060=487248,1440262=671538,2844277=798238} 2026-02-13T18:13:56.507 INFO:tasks.rados.rados.0.trial187.stdout:1751: writing trial18717860-38 from 548060 to 1035308 tid 1 2026-02-13T18:13:56.515 INFO:tasks.rados.rados.0.trial187.stdout:1751: writing trial18717860-38 from 1440262 to 2111800 tid 2 2026-02-13T18:13:56.525 INFO:tasks.rados.rados.0.trial187.stdout:1751: writing trial18717860-38 from 2844277 to 3642515 tid 3 2026-02-13T18:13:56.525 INFO:tasks.rados.rados.0.trial187.stdout:1752: snap_create 2026-02-13T18:13:56.525 INFO:tasks.rados.rados.0.trial187.stdout:1750: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:13:56.576 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1819296 2026-02-13T18:13:56.648 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2712822 2026-02-13T18:13:56.738 INFO:tasks.rados.rados.0.trial187.stdout:1751: finishing write tid 1 to trial18717860-38 2026-02-13T18:13:56.738 INFO:tasks.rados.rados.0.trial187.stdout:1751: finishing write tid 2 to trial18717860-38 2026-02-13T18:13:56.738 INFO:tasks.rados.rados.0.trial187.stdout:1751: finishing write tid 3 to trial18717860-38 2026-02-13T18:13:56.738 INFO:tasks.rados.rados.0.trial187.stdout:1751: finishing write tid 4 to trial18717860-38 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:1751: finishing write tid 5 to trial18717860-38 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:1751: oid 38 updating version 0 to 839 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:1751: oid 38 updating version 839 to 842 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:1751: oid 38 version 842 is already newer than 841 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:1751: oid 38 version 842 is already newer than 840 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 842 (ObjNum 580 snap 197 seq_num 580) dirty exists 2026-02-13T18:13:56.739 INFO:tasks.rados.rados.0.trial187.stdout:1751: left oid 38 (ObjNum 580 snap 197 seq_num 580) 2026-02-13T18:13:57.502 INFO:tasks.rados.rados.0.trial187.stdout:1750: done (2 left) 2026-02-13T18:13:57.502 INFO:tasks.rados.rados.0.trial187.stdout:1751: done (1 left) 2026-02-13T18:13:57.503 INFO:tasks.rados.rados.0.trial187.stdout:1752: done (0 left) 2026-02-13T18:13:57.503 INFO:tasks.rados.rados.0.trial187.stdout:1753: snap_create 2026-02-13T18:13:58.503 INFO:tasks.rados.rados.0.trial187.stdout:1753: done (0 left) 2026-02-13T18:13:58.503 INFO:tasks.rados.rados.0.trial187.stdout:1754: copy_from oid 34 from oid 37 current snap is 199 2026-02-13T18:13:58.503 INFO:tasks.rados.rados.0.trial187.stdout:1755: copy_from oid 4 from oid 42 current snap is 199 2026-02-13T18:13:58.503 INFO:tasks.rados.rados.0.trial187.stdout:1756: write (excl) oid 2 current snap is 199 2026-02-13T18:13:58.503 INFO:tasks.rados.rados.0.trial187.stdout:1756: seq_num 581 ranges {564867=562497,1898744=415196,2755347=725863} 2026-02-13T18:13:58.511 INFO:tasks.rados.rados.0.trial187.stdout:1756: writing trial18717860-2 from 564867 to 1127364 tid 1 2026-02-13T18:13:58.519 INFO:tasks.rados.rados.0.trial187.stdout:1756: writing trial18717860-2 from 1898744 to 2313940 tid 2 2026-02-13T18:13:58.527 INFO:tasks.rados.rados.0.trial187.stdout:1756: writing trial18717860-2 from 2755347 to 3481210 tid 3 2026-02-13T18:13:58.527 INFO:tasks.rados.rados.0.trial187.stdout:1757: snap_remove snap 195 2026-02-13T18:13:59.507 INFO:tasks.rados.rados.0.trial187.stdout:1757: done (3 left) 2026-02-13T18:13:59.507 INFO:tasks.rados.rados.0.trial187.stdout:1758: rollback oid 16 current snap is 199 2026-02-13T18:13:59.507 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 198 2026-02-13T18:13:59.507 INFO:tasks.rados.rados.0.trial187.stdout:1755: finishing copy_from racing read to trial18717860-4 2026-02-13T18:13:59.507 INFO:tasks.rados.rados.0.trial187.stdout:1755: finishing copy_from to trial18717860-4 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 426 (ObjNum 524 snap 164 seq_num 524) dirty exists 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: finishing write tid 1 to trial18717860-2 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1754: finishing copy_from racing read to trial18717860-34 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1754: finishing copy_from to trial18717860-34 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 898 (ObjNum 564 snap 189 seq_num 564) dirty exists 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: finishing write tid 2 to trial18717860-2 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: finishing write tid 3 to trial18717860-2 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: finishing write tid 4 to trial18717860-2 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: finishing write tid 5 to trial18717860-2 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: oid 2 updating version 0 to 512 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: oid 2 version 512 is already newer than 511 2026-02-13T18:13:59.508 INFO:tasks.rados.rados.0.trial187.stdout:1756: oid 2 version 512 is already newer than 509 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1756: oid 2 version 512 is already newer than 510 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 512 (ObjNum 581 snap 199 seq_num 581) dirty exists 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1756: left oid 2 (ObjNum 581 snap 199 seq_num 581) 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1754: done (3 left) 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1755: done (2 left) 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1756: done (1 left) 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1759: write oid 3 current snap is 199 2026-02-13T18:13:59.509 INFO:tasks.rados.rados.0.trial187.stdout:1759: seq_num 582 ranges {581674=637746,1840873=558854,3066417=537135} 2026-02-13T18:13:59.514 INFO:tasks.rados.rados.0.trial187.stdout:1759: writing trial18717860-3 from 581674 to 1219420 tid 1 2026-02-13T18:13:59.522 INFO:tasks.rados.rados.0.trial187.stdout:1759: writing trial18717860-3 from 1840873 to 2399727 tid 2 2026-02-13T18:13:59.530 INFO:tasks.rados.rados.0.trial187.stdout:1759: writing trial18717860-3 from 3066417 to 3603552 tid 3 2026-02-13T18:13:59.530 INFO:tasks.rados.rados.0.trial187.stdout:1760: write (excl) oid 29 current snap is 199 2026-02-13T18:13:59.531 INFO:tasks.rados.rados.0.trial187.stdout:1760: seq_num 583 ranges {598481=712995,1899355=418865,3093840=704641} 2026-02-13T18:13:59.539 INFO:tasks.rados.rados.0.trial187.stdout:1760: writing trial18717860-29 from 598481 to 1311476 tid 1 2026-02-13T18:13:59.546 INFO:tasks.rados.rados.0.trial187.stdout:1760: writing trial18717860-29 from 1899355 to 2318220 tid 2 2026-02-13T18:13:59.554 INFO:tasks.rados.rados.0.trial187.stdout:1760: writing trial18717860-29 from 3093840 to 3798481 tid 3 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1761: snap_create 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1758: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 0 (ObjNum 129 snap 0 seq_num 3014064080) dirty dne 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: finishing write tid 1 to trial18717860-3 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: finishing write tid 2 to trial18717860-3 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: finishing write tid 3 to trial18717860-3 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: finishing write tid 4 to trial18717860-3 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: finishing write tid 5 to trial18717860-3 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: oid 3 updating version 0 to 869 2026-02-13T18:13:59.555 INFO:tasks.rados.rados.0.trial187.stdout:1759: oid 3 updating version 869 to 871 2026-02-13T18:13:59.556 INFO:tasks.rados.rados.0.trial187.stdout:1759: oid 3 version 871 is already newer than 870 2026-02-13T18:13:59.556 INFO:tasks.rados.rados.0.trial187.stdout:1759: oid 3 version 871 is already newer than 868 2026-02-13T18:13:59.556 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 871 (ObjNum 582 snap 199 seq_num 582) dirty exists 2026-02-13T18:13:59.556 INFO:tasks.rados.rados.0.trial187.stdout:1759: left oid 3 (ObjNum 582 snap 199 seq_num 582) 2026-02-13T18:13:59.556 INFO:tasks.rados.rados.0.trial187.stdout:1760: finishing write tid 1 to trial18717860-29 2026-02-13T18:13:59.556 INFO:tasks.rados.rados.0.trial187.stdout:1760: finishing write tid 2 to trial18717860-29 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: finishing write tid 3 to trial18717860-29 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: finishing write tid 4 to trial18717860-29 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: finishing write tid 5 to trial18717860-29 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: oid 29 updating version 0 to 621 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: oid 29 updating version 621 to 623 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: oid 29 updating version 623 to 624 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:1760: oid 29 version 624 is already newer than 622 2026-02-13T18:13:59.557 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 624 (ObjNum 583 snap 199 seq_num 583) dirty exists 2026-02-13T18:13:59.558 INFO:tasks.rados.rados.0.trial187.stdout:1760: left oid 29 (ObjNum 583 snap 199 seq_num 583) 2026-02-13T18:14:00.510 INFO:tasks.rados.rados.0.trial187.stdout:1758: done (3 left) 2026-02-13T18:14:00.510 INFO:tasks.rados.rados.0.trial187.stdout:1759: done (2 left) 2026-02-13T18:14:00.511 INFO:tasks.rados.rados.0.trial187.stdout:1760: done (1 left) 2026-02-13T18:14:00.511 INFO:tasks.rados.rados.0.trial187.stdout:1761: done (0 left) 2026-02-13T18:14:00.511 INFO:tasks.rados.rados.0.trial187.stdout:1762: snap_remove snap 198 2026-02-13T18:14:01.502 INFO:tasks.rados.rados.0.trial187.stdout:1762: done (0 left) 2026-02-13T18:14:01.502 INFO:tasks.rados.rados.0.trial187.stdout:1763: read oid 20 snap -1 2026-02-13T18:14:01.502 INFO:tasks.rados.rados.0.trial187.stdout:1763: expect deleted 2026-02-13T18:14:01.502 INFO:tasks.rados.rados.0.trial187.stdout:1764: write (excl) oid 16 current snap is 200 2026-02-13T18:14:01.502 INFO:tasks.rados.rados.0.trial187.stdout:1764: seq_num 584 ranges {615288=788244,1957837=562523,3121263=559679} 2026-02-13T18:14:01.511 INFO:tasks.rados.rados.0.trial187.stdout:1764: writing trial18717860-16 from 615288 to 1403532 tid 1 2026-02-13T18:14:01.518 INFO:tasks.rados.rados.0.trial187.stdout:1764: writing trial18717860-16 from 1957837 to 2520360 tid 2 2026-02-13T18:14:01.527 INFO:tasks.rados.rados.0.trial187.stdout:1764: writing trial18717860-16 from 3121263 to 3680942 tid 3 2026-02-13T18:14:01.527 INFO:tasks.rados.rados.0.trial187.stdout:1765: snap_remove snap 193 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1765: done (2 left) 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1766: rollback oid 40 current snap is 200 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 188 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1764: finishing write tid 1 to trial18717860-16 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1764: finishing write tid 2 to trial18717860-16 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1764: finishing write tid 3 to trial18717860-16 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1764: finishing write tid 4 to trial18717860-16 2026-02-13T18:14:03.311 INFO:tasks.rados.rados.0.trial187.stdout:1764: finishing write tid 5 to trial18717860-16 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1764: oid 16 updating version 0 to 464 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1764: oid 16 updating version 464 to 466 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1764: oid 16 version 466 is already newer than 463 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1764: oid 16 version 466 is already newer than 465 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 466 (ObjNum 584 snap 200 seq_num 584) dirty exists 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1764: left oid 16 (ObjNum 584 snap 200 seq_num 584) 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1763: done (2 left) 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1764: done (1 left) 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1767: read oid 26 snap -1 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1767: expect (ObjNum 543 snap 174 seq_num 543) 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1768: rollback oid 24 current snap is 200 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 194 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1769: write (excl) oid 18 current snap is 200 2026-02-13T18:14:03.312 INFO:tasks.rados.rados.0.trial187.stdout:1769: seq_num 585 ranges {632095=463493,1616319=422534,2748686=487304} 2026-02-13T18:14:03.318 INFO:tasks.rados.rados.0.trial187.stdout:1769: writing trial18717860-18 from 632095 to 1095588 tid 1 2026-02-13T18:14:03.324 INFO:tasks.rados.rados.0.trial187.stdout:1769: writing trial18717860-18 from 1616319 to 2038853 tid 2 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:1769: writing trial18717860-18 from 2748686 to 3235990 tid 3 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:1770: snap_create 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:1768: finishing rollback tid 0 to trial18717860-24 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:1768: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:1768: finishing rollback tid 2 to trial18717860-24 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 778 (ObjNum 498 snap 150 seq_num 498) dirty exists 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:1767: expect (ObjNum 543 snap 174 seq_num 543) 2026-02-13T18:14:03.333 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 609331 2026-02-13T18:14:03.383 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:03.449 INFO:tasks.rados.rados.0.trial187.stdout:1766: finishing rollback tid 0 to trial18717860-40 2026-02-13T18:14:03.449 INFO:tasks.rados.rados.0.trial187.stdout:1766: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:14:03.449 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 613 (ObjNum 49 snap 0 seq_num 1559968294) dirty dne 2026-02-13T18:14:03.449 INFO:tasks.rados.rados.0.trial187.stdout:1769: finishing write tid 1 to trial18717860-18 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: finishing write tid 2 to trial18717860-18 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: finishing write tid 3 to trial18717860-18 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: finishing write tid 4 to trial18717860-18 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: finishing write tid 5 to trial18717860-18 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: oid 18 updating version 0 to 521 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: oid 18 version 521 is already newer than 519 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: oid 18 version 521 is already newer than 520 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: oid 18 updating version 521 to 522 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 522 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:14:03.450 INFO:tasks.rados.rados.0.trial187.stdout:1769: left oid 18 (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:14:04.312 INFO:tasks.rados.rados.0.trial187.stdout:1766: done (4 left) 2026-02-13T18:14:04.312 INFO:tasks.rados.rados.0.trial187.stdout:1767: done (3 left) 2026-02-13T18:14:04.313 INFO:tasks.rados.rados.0.trial187.stdout:1768: done (2 left) 2026-02-13T18:14:04.313 INFO:tasks.rados.rados.0.trial187.stdout:1769: done (1 left) 2026-02-13T18:14:04.313 INFO:tasks.rados.rados.0.trial187.stdout:1770: done (0 left) 2026-02-13T18:14:04.313 INFO:tasks.rados.rados.0.trial187.stdout:1771: read oid 22 snap -1 2026-02-13T18:14:04.313 INFO:tasks.rados.rados.0.trial187.stdout:1771: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:14:04.313 INFO:tasks.rados.rados.0.trial187.stdout:1772: snap_create 2026-02-13T18:14:04.319 INFO:tasks.rados.rados.0.trial187.stdout:1771: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:14:04.419 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2317701 2026-02-13T18:14:05.313 INFO:tasks.rados.rados.0.trial187.stdout:1771: done (1 left) 2026-02-13T18:14:05.313 INFO:tasks.rados.rados.0.trial187.stdout:1772: done (0 left) 2026-02-13T18:14:05.314 INFO:tasks.rados.rados.0.trial187.stdout:1773: copy_from oid 18 from oid 20 current snap is 202 2026-02-13T18:14:05.314 INFO:tasks.rados.rados.0.trial187.stdout:1774: snap_remove snap 188 2026-02-13T18:14:06.314 INFO:tasks.rados.rados.0.trial187.stdout:1774: done (1 left) 2026-02-13T18:14:06.315 INFO:tasks.rados.rados.0.trial187.stdout:1775: snap_create 2026-02-13T18:14:06.315 INFO:tasks.rados.rados.0.trial187.stdout:1773: finishing copy_from to trial18717860-18 2026-02-13T18:14:06.315 INFO:tasks.rados.rados.0.trial187.stdout:1773: got expected ENOENT (src dne) 2026-02-13T18:14:06.315 INFO:tasks.rados.rados.0.trial187.stdout:1773: finishing copy_from racing read to trial18717860-18 2026-02-13T18:14:06.503 INFO:tasks.rados.rados.0.trial187.stdout:1773: done (1 left) 2026-02-13T18:14:06.503 INFO:tasks.rados.rados.0.trial187.stdout:1775: done (0 left) 2026-02-13T18:14:06.503 INFO:tasks.rados.rados.0.trial187.stdout:1776: snap_create 2026-02-13T18:14:07.504 INFO:tasks.rados.rados.0.trial187.stdout:1776: done (0 left) 2026-02-13T18:14:07.504 INFO:tasks.rados.rados.0.trial187.stdout:1777: read oid 40 snap -1 2026-02-13T18:14:07.504 INFO:tasks.rados.rados.0.trial187.stdout:1777: expect deleted 2026-02-13T18:14:07.504 INFO:tasks.rados.rados.0.trial187.stdout:1778: write oid 33 current snap is 204 2026-02-13T18:14:07.505 INFO:tasks.rados.rados.0.trial187.stdout:1778: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2026-02-13T18:14:07.513 INFO:tasks.rados.rados.0.trial187.stdout:1778: writing trial18717860-33 from 648902 to 1303997 tid 1 2026-02-13T18:14:07.522 INFO:tasks.rados.rados.0.trial187.stdout:1778: writing trial18717860-33 from 2074801 to 2640993 tid 2 2026-02-13T18:14:07.531 INFO:tasks.rados.rados.0.trial187.stdout:1778: writing trial18717860-33 from 3176109 to 3848902 tid 3 2026-02-13T18:14:07.531 INFO:tasks.rados.rados.0.trial187.stdout:1779: snap_remove snap 170 2026-02-13T18:14:08.507 INFO:tasks.rados.rados.0.trial187.stdout:1779: done (2 left) 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1780: copy_from oid 38 from oid 42 current snap is 204 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: finishing write tid 1 to trial18717860-33 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: finishing write tid 2 to trial18717860-33 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: finishing write tid 3 to trial18717860-33 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: finishing write tid 4 to trial18717860-33 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: finishing write tid 5 to trial18717860-33 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: oid 33 updating version 0 to 953 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: oid 33 updating version 953 to 954 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: oid 33 version 954 is already newer than 952 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: oid 33 updating version 954 to 955 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 955 (ObjNum 586 snap 204 seq_num 586) dirty exists 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: left oid 33 (ObjNum 586 snap 204 seq_num 586) 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1777: done (2 left) 2026-02-13T18:14:08.508 INFO:tasks.rados.rados.0.trial187.stdout:1778: done (1 left) 2026-02-13T18:14:08.509 INFO:tasks.rados.rados.0.trial187.stdout:1781: write oid 35 current snap is 204 2026-02-13T18:14:08.509 INFO:tasks.rados.rados.0.trial187.stdout:1781: seq_num 587 ranges {665709=730344,2133283=426203,3203532=509848} 2026-02-13T18:14:08.516 INFO:tasks.rados.rados.0.trial187.stdout:1781: writing trial18717860-35 from 665709 to 1396053 tid 1 2026-02-13T18:14:08.524 INFO:tasks.rados.rados.0.trial187.stdout:1781: writing trial18717860-35 from 2133283 to 2559486 tid 2 2026-02-13T18:14:08.532 INFO:tasks.rados.rados.0.trial187.stdout:1781: writing trial18717860-35 from 3203532 to 3713380 tid 3 2026-02-13T18:14:08.532 INFO:tasks.rados.rados.0.trial187.stdout:1782: snap_remove snap 180 2026-02-13T18:14:09.510 INFO:tasks.rados.rados.0.trial187.stdout:1782: done (2 left) 2026-02-13T18:14:09.510 INFO:tasks.rados.rados.0.trial187.stdout:1783: write (excl) oid 44 current snap is 204 2026-02-13T18:14:09.510 INFO:tasks.rados.rados.0.trial187.stdout:1783: seq_num 588 ranges {682516=405593,1791765=569861,2830955=721120} 2026-02-13T18:14:09.517 INFO:tasks.rados.rados.0.trial187.stdout:1783: writing trial18717860-44 from 682516 to 1088109 tid 1 2026-02-13T18:14:09.525 INFO:tasks.rados.rados.0.trial187.stdout:1783: writing trial18717860-44 from 1791765 to 2361626 tid 2 2026-02-13T18:14:09.534 INFO:tasks.rados.rados.0.trial187.stdout:1783: writing trial18717860-44 from 2830955 to 3552075 tid 3 2026-02-13T18:14:09.534 INFO:tasks.rados.rados.0.trial187.stdout:1784: read oid 28 snap -1 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1784: expect (ObjNum 571 snap 191 seq_num 571) 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1785: copy_from oid 26 from oid 25 current snap is 204 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1780: finishing copy_from racing read to trial18717860-38 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1780: finishing copy_from to trial18717860-38 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 426 (ObjNum 524 snap 164 seq_num 524) dirty exists 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1781: finishing write tid 1 to trial18717860-35 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1781: finishing write tid 2 to trial18717860-35 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1781: finishing write tid 3 to trial18717860-35 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1781: finishing write tid 4 to trial18717860-35 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1781: finishing write tid 5 to trial18717860-35 2026-02-13T18:14:09.535 INFO:tasks.rados.rados.0.trial187.stdout:1781: oid 35 updating version 0 to 845 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1781: oid 35 updating version 845 to 846 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1781: oid 35 version 846 is already newer than 844 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1781: oid 35 version 846 is already newer than 843 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 846 (ObjNum 587 snap 204 seq_num 587) dirty exists 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1781: left oid 35 (ObjNum 587 snap 204 seq_num 587) 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1783: finishing write tid 1 to trial18717860-44 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1783: finishing write tid 2 to trial18717860-44 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1780: done (4 left) 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1781: done (3 left) 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1786: read oid 2 snap 191 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1786: expect (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:14:09.536 INFO:tasks.rados.rados.0.trial187.stdout:1787: write oid 8 current snap is 204 2026-02-13T18:14:09.537 INFO:tasks.rados.rados.0.trial187.stdout:1787: seq_num 589 ranges {699323=480842,1850247=429872,2858378=532392} 2026-02-13T18:14:09.541 INFO:tasks.rados.rados.0.trial187.stdout:1787: writing trial18717860-8 from 699323 to 1180165 tid 1 2026-02-13T18:14:09.549 INFO:tasks.rados.rados.0.trial187.stdout:1787: writing trial18717860-8 from 1850247 to 2280119 tid 2 2026-02-13T18:14:09.556 INFO:tasks.rados.rados.0.trial187.stdout:1787: writing trial18717860-8 from 2858378 to 3390770 tid 3 2026-02-13T18:14:09.556 INFO:tasks.rados.rados.0.trial187.stdout:1788: copy_from oid 12 from oid 17 current snap is 204 2026-02-13T18:14:09.556 INFO:tasks.rados.rados.0.trial187.stdout:1783: finishing write tid 3 to trial18717860-44 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: finishing write tid 4 to trial18717860-44 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: finishing write tid 5 to trial18717860-44 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: oid 44 updating version 0 to 972 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: oid 44 version 972 is already newer than 970 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: oid 44 version 972 is already newer than 969 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: oid 44 version 972 is already newer than 971 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 972 (ObjNum 588 snap 204 seq_num 588) dirty exists 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1783: left oid 44 (ObjNum 588 snap 204 seq_num 588) 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:1786: expect (ObjNum 486 snap 146 seq_num 486) 2026-02-13T18:14:09.557 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:09.640 INFO:tasks.rados.rados.0.trial187.stdout:1785: finishing copy_from to trial18717860-26 2026-02-13T18:14:09.641 INFO:tasks.rados.rados.0.trial187.stdout:1785: got expected ENOENT (src dne) 2026-02-13T18:14:09.641 INFO:tasks.rados.rados.0.trial187.stdout:1785: finishing copy_from racing read to trial18717860-26 2026-02-13T18:14:09.641 INFO:tasks.rados.rados.0.trial187.stdout:1784: expect (ObjNum 571 snap 191 seq_num 571) 2026-02-13T18:14:09.648 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 822696 2026-02-13T18:14:09.700 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:09.763 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1787: finishing write tid 1 to trial18717860-8 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1787: finishing write tid 2 to trial18717860-8 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1787: finishing write tid 3 to trial18717860-8 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1787: finishing write tid 4 to trial18717860-8 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1783: done (5 left) 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1784: done (4 left) 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1785: done (3 left) 2026-02-13T18:14:09.826 INFO:tasks.rados.rados.0.trial187.stdout:1786: done (2 left) 2026-02-13T18:14:09.827 INFO:tasks.rados.rados.0.trial187.stdout:1789: write (excl) oid 37 current snap is 204 2026-02-13T18:14:09.827 INFO:tasks.rados.rados.0.trial187.stdout:1789: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2026-02-13T18:14:09.834 INFO:tasks.rados.rados.0.trial187.stdout:1789: writing trial18717860-37 from 716130 to 1272221 tid 1 2026-02-13T18:14:09.842 INFO:tasks.rados.rados.0.trial187.stdout:1789: writing trial18717860-37 from 1792376 to 2365906 tid 2 2026-02-13T18:14:09.848 INFO:tasks.rados.rados.0.trial187.stdout:1789: writing trial18717860-37 from 2769448 to 3229465 tid 3 2026-02-13T18:14:09.853 INFO:tasks.rados.rados.0.trial187.stdout:1789: writing trial18717860-37 from 3821956 to 3916130 tid 4 2026-02-13T18:14:09.853 INFO:tasks.rados.rados.0.trial187.stdout:1790: delete oid 21 current snap is 204 2026-02-13T18:14:09.853 INFO:tasks.rados.rados.0.trial187.stdout:1787: finishing write tid 5 to trial18717860-8 2026-02-13T18:14:09.853 INFO:tasks.rados.rados.0.trial187.stdout:1787: oid 8 updating version 0 to 783 2026-02-13T18:14:09.853 INFO:tasks.rados.rados.0.trial187.stdout:1787: oid 8 version 783 is already newer than 782 2026-02-13T18:14:09.853 INFO:tasks.rados.rados.0.trial187.stdout:1787: oid 8 version 783 is already newer than 781 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1787: oid 8 version 783 is already newer than 780 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 783 (ObjNum 589 snap 204 seq_num 589) dirty exists 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1787: left oid 8 (ObjNum 589 snap 204 seq_num 589) 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1788: finishing copy_from racing read to trial18717860-12 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1788: finishing copy_from to trial18717860-12 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1789: finishing write tid 1 to trial18717860-37 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1789: finishing write tid 2 to trial18717860-37 2026-02-13T18:14:09.854 INFO:tasks.rados.rados.0.trial187.stdout:1789: finishing write tid 3 to trial18717860-37 2026-02-13T18:14:09.855 INFO:tasks.rados.rados.0.trial187.stdout:1789: finishing write tid 4 to trial18717860-37 2026-02-13T18:14:09.855 INFO:tasks.rados.rados.0.trial187.stdout:1789: finishing write tid 5 to trial18717860-37 2026-02-13T18:14:09.855 INFO:tasks.rados.rados.0.trial187.stdout:1789: finishing write tid 6 to trial18717860-37 2026-02-13T18:14:09.855 INFO:tasks.rados.rados.0.trial187.stdout:1789: oid 37 updating version 0 to 976 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1789: oid 37 version 976 is already newer than 974 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1789: oid 37 updating version 976 to 978 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1789: oid 37 version 978 is already newer than 975 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1789: oid 37 version 978 is already newer than 977 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 978 (ObjNum 590 snap 204 seq_num 590) dirty exists 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1789: left oid 37 (ObjNum 590 snap 204 seq_num 590) 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1787: done (3 left) 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1788: done (2 left) 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1789: done (1 left) 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1790: done (0 left) 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1791: copy_from oid 26 from oid 18 current snap is 204 2026-02-13T18:14:09.856 INFO:tasks.rados.rados.0.trial187.stdout:1792: write (excl) oid 11 current snap is 204 2026-02-13T18:14:09.857 INFO:tasks.rados.rados.0.trial187.stdout:1792: seq_num 592 ranges {749744=706589,1909340=577199,3224294=482561} 2026-02-13T18:14:09.865 INFO:tasks.rados.rados.0.trial187.stdout:1792: writing trial18717860-11 from 749744 to 1456333 tid 1 2026-02-13T18:14:09.872 INFO:tasks.rados.rados.0.trial187.stdout:1792: writing trial18717860-11 from 1909340 to 2486539 tid 2 2026-02-13T18:14:09.880 INFO:tasks.rados.rados.0.trial187.stdout:1792: writing trial18717860-11 from 3224294 to 3706855 tid 3 2026-02-13T18:14:09.880 INFO:tasks.rados.rados.0.trial187.stdout:1793: write (excl) oid 4 current snap is 204 2026-02-13T18:14:09.881 INFO:tasks.rados.rados.0.trial187.stdout:1793: seq_num 593 ranges {766551=498191,1684175=720857,2851717=693833} 2026-02-13T18:14:09.885 INFO:tasks.rados.rados.0.trial187.stdout:1793: writing trial18717860-4 from 766551 to 1264742 tid 1 2026-02-13T18:14:09.889 INFO:tasks.rados.rados.0.trial187.stdout:1793: writing trial18717860-4 from 1684175 to 2405032 tid 2 2026-02-13T18:14:09.894 INFO:tasks.rados.rados.0.trial187.stdout:1793: writing trial18717860-4 from 2851717 to 3545550 tid 3 2026-02-13T18:14:09.894 INFO:tasks.rados.rados.0.trial187.stdout:1794: write oid 46 current snap is 204 2026-02-13T18:14:09.894 INFO:tasks.rados.rados.0.trial187.stdout:1794: seq_num 594 ranges {783358=573440,2026304=580868,3279140=621458} 2026-02-13T18:14:09.899 INFO:tasks.rados.rados.0.trial187.stdout:1794: writing trial18717860-46 from 783358 to 1356798 tid 1 2026-02-13T18:14:09.903 INFO:tasks.rados.rados.0.trial187.stdout:1794: writing trial18717860-46 from 2026304 to 2607172 tid 2 2026-02-13T18:14:09.909 INFO:tasks.rados.rados.0.trial187.stdout:1794: writing trial18717860-46 from 3279140 to 3900598 tid 3 2026-02-13T18:14:09.909 INFO:tasks.rados.rados.0.trial187.stdout:1795: snap_create 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: finishing write tid 1 to trial18717860-11 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1791: finishing copy_from racing read to trial18717860-26 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1791: finishing copy_from to trial18717860-26 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 522 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: finishing write tid 2 to trial18717860-11 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: finishing write tid 3 to trial18717860-11 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: finishing write tid 4 to trial18717860-11 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: finishing write tid 5 to trial18717860-11 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: oid 11 updating version 0 to 901 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: oid 11 updating version 901 to 902 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: oid 11 version 902 is already newer than 899 2026-02-13T18:14:09.910 INFO:tasks.rados.rados.0.trial187.stdout:1792: oid 11 version 902 is already newer than 900 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 902 (ObjNum 592 snap 204 seq_num 592) dirty exists 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1792: left oid 11 (ObjNum 592 snap 204 seq_num 592) 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: finishing write tid 1 to trial18717860-4 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: finishing write tid 2 to trial18717860-4 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: finishing write tid 3 to trial18717860-4 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: finishing write tid 4 to trial18717860-4 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: finishing write tid 5 to trial18717860-4 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: oid 4 updating version 0 to 430 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: oid 4 version 430 is already newer than 429 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: oid 4 version 430 is already newer than 428 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:1793: oid 4 version 430 is already newer than 427 2026-02-13T18:14:09.911 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 430 (ObjNum 593 snap 204 seq_num 593) dirty exists 2026-02-13T18:14:09.912 INFO:tasks.rados.rados.0.trial187.stdout:1793: left oid 4 (ObjNum 593 snap 204 seq_num 593) 2026-02-13T18:14:09.912 INFO:tasks.rados.rados.0.trial187.stdout:1794: finishing write tid 1 to trial18717860-46 2026-02-13T18:14:09.912 INFO:tasks.rados.rados.0.trial187.stdout:1794: finishing write tid 2 to trial18717860-46 2026-02-13T18:14:09.912 INFO:tasks.rados.rados.0.trial187.stdout:1794: finishing write tid 3 to trial18717860-46 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: finishing write tid 4 to trial18717860-46 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: finishing write tid 5 to trial18717860-46 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: oid 46 updating version 0 to 898 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: oid 46 updating version 898 to 899 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: oid 46 version 899 is already newer than 896 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: oid 46 version 899 is already newer than 897 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 899 (ObjNum 594 snap 204 seq_num 594) dirty exists 2026-02-13T18:14:09.913 INFO:tasks.rados.rados.0.trial187.stdout:1794: left oid 46 (ObjNum 594 snap 204 seq_num 594) 2026-02-13T18:14:10.520 INFO:tasks.rados.rados.0.trial187.stdout:1791: done (4 left) 2026-02-13T18:14:10.520 INFO:tasks.rados.rados.0.trial187.stdout:1792: done (3 left) 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1793: done (2 left) 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1794: done (1 left) 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1795: done (0 left) 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1796: rollback oid 1 current snap is 205 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 1 to 200 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1797: rollback oid 9 current snap is 205 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 204 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1798: write oid 7 current snap is 205 2026-02-13T18:14:10.521 INFO:tasks.rados.rados.0.trial187.stdout:1798: seq_num 595 ranges {400165=648689,1684786=315379} 2026-02-13T18:14:10.526 INFO:tasks.rados.rados.0.trial187.stdout:1798: writing trial18717860-7 from 400165 to 1048854 tid 1 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1798: writing trial18717860-7 from 1684786 to 2000165 tid 2 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1799: delete oid 39 current snap is 205 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1797: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 0 (ObjNum 1685355744 snap 32713 seq_num 304) dirty dne 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1796: finishing rollback tid 0 to trial18717860-1 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1796: finishing rollback tid 1 to trial18717860-1 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1796: finishing rollback tid 2 to trial18717860-1 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 627 (ObjNum 536 snap 168 seq_num 536) dirty exists 2026-02-13T18:14:10.530 INFO:tasks.rados.rados.0.trial187.stdout:1798: finishing write tid 1 to trial18717860-7 2026-02-13T18:14:10.531 INFO:tasks.rados.rados.0.trial187.stdout:1796: done (3 left) 2026-02-13T18:14:10.531 INFO:tasks.rados.rados.0.trial187.stdout:1797: done (2 left) 2026-02-13T18:14:10.532 INFO:tasks.rados.rados.0.trial187.stdout:1799: done (1 left) 2026-02-13T18:14:10.532 INFO:tasks.rados.rados.0.trial187.stdout:1800: copy_from oid 29 from oid 3 current snap is 205 2026-02-13T18:14:10.532 INFO:tasks.rados.rados.0.trial187.stdout:1801: snap_create 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: finishing write tid 2 to trial18717860-7 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: finishing write tid 3 to trial18717860-7 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: finishing write tid 4 to trial18717860-7 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: oid 7 updating version 0 to 902 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: oid 7 version 902 is already newer than 901 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: oid 7 version 902 is already newer than 900 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 902 (ObjNum 595 snap 205 seq_num 595) dirty exists 2026-02-13T18:14:10.533 INFO:tasks.rados.rados.0.trial187.stdout:1798: left oid 7 (ObjNum 595 snap 205 seq_num 595) 2026-02-13T18:14:10.541 INFO:tasks.rados.rados.0.trial187.stdout:1800: finishing copy_from racing read to trial18717860-29 2026-02-13T18:14:10.544 INFO:tasks.rados.rados.0.trial187.stdout:1800: finishing copy_from to trial18717860-29 2026-02-13T18:14:10.544 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 871 (ObjNum 582 snap 199 seq_num 582) dirty exists 2026-02-13T18:14:11.523 INFO:tasks.rados.rados.0.trial187.stdout:1798: done (2 left) 2026-02-13T18:14:11.523 INFO:tasks.rados.rados.0.trial187.stdout:1800: done (1 left) 2026-02-13T18:14:11.523 INFO:tasks.rados.rados.0.trial187.stdout:1801: done (0 left) 2026-02-13T18:14:11.523 INFO:tasks.rados.rados.0.trial187.stdout:1802: copy_from oid 13 from oid 31 current snap is 206 2026-02-13T18:14:11.523 INFO:tasks.rados.rados.0.trial187.stdout:1803: write oid 11 current snap is 206 2026-02-13T18:14:11.523 INFO:tasks.rados.rados.0.trial187.stdout:1803: seq_num 597 ranges {433779=799187,1801750=232029} 2026-02-13T18:14:11.530 INFO:tasks.rados.rados.0.trial187.stdout:1803: writing trial18717860-11 from 433779 to 1232966 tid 1 2026-02-13T18:14:11.536 INFO:tasks.rados.rados.0.trial187.stdout:1803: writing trial18717860-11 from 1801750 to 2033779 tid 2 2026-02-13T18:14:11.536 INFO:tasks.rados.rados.0.trial187.stdout:1804: write (excl) oid 49 current snap is 206 2026-02-13T18:14:11.536 INFO:tasks.rados.rados.0.trial187.stdout:1802: finishing copy_from to trial18717860-13 2026-02-13T18:14:11.537 INFO:tasks.rados.rados.0.trial187.stdout:1802: got expected ENOENT (src dne) 2026-02-13T18:14:11.537 INFO:tasks.rados.rados.0.trial187.stdout:1802: finishing copy_from racing read to trial18717860-13 2026-02-13T18:14:11.537 INFO:tasks.rados.rados.0.trial187.stdout:1804: seq_num 598 ranges {450586=474436,1343879=588206} 2026-02-13T18:14:11.542 INFO:tasks.rados.rados.0.trial187.stdout:1804: writing trial18717860-49 from 450586 to 925022 tid 1 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1804: writing trial18717860-49 from 1343879 to 1932085 tid 2 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1802: done (2 left) 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1805: rollback oid 48 current snap is 206 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 48 to 179 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1803: finishing write tid 1 to trial18717860-11 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1803: finishing write tid 2 to trial18717860-11 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1803: finishing write tid 3 to trial18717860-11 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1803: finishing write tid 4 to trial18717860-11 2026-02-13T18:14:11.550 INFO:tasks.rados.rados.0.trial187.stdout:1803: oid 11 updating version 0 to 904 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1803: oid 11 updating version 904 to 905 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1803: oid 11 version 905 is already newer than 903 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 905 (ObjNum 597 snap 206 seq_num 597) dirty exists 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1803: left oid 11 (ObjNum 597 snap 206 seq_num 597) 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1804: finishing write tid 1 to trial18717860-49 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1803: done (2 left) 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1806: copy_from oid 2 from oid 9 current snap is 206 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1807: snap_create 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1806: finishing copy_from to trial18717860-2 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1806: got expected ENOENT (src dne) 2026-02-13T18:14:11.551 INFO:tasks.rados.rados.0.trial187.stdout:1806: finishing copy_from racing read to trial18717860-2 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1805: finishing rollback tid 0 to trial18717860-48 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1805: finishing rollback tid 1 to trial18717860-48 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1804: finishing write tid 2 to trial18717860-49 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1805: finishing rollback tid 2 to trial18717860-48 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1804: finishing write tid 3 to trial18717860-49 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1804: finishing write tid 4 to trial18717860-49 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1804: oid 49 updating version 0 to 907 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1804: oid 49 updating version 907 to 908 2026-02-13T18:14:11.553 INFO:tasks.rados.rados.0.trial187.stdout:1804: oid 49 version 908 is already newer than 906 2026-02-13T18:14:11.554 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 908 (ObjNum 598 snap 206 seq_num 598) dirty exists 2026-02-13T18:14:11.554 INFO:tasks.rados.rados.0.trial187.stdout:1804: left oid 49 (ObjNum 598 snap 206 seq_num 598) 2026-02-13T18:14:12.526 INFO:tasks.rados.rados.0.trial187.stdout:1804: done (3 left) 2026-02-13T18:14:12.527 INFO:tasks.rados.rados.0.trial187.stdout:1805: done (2 left) 2026-02-13T18:14:12.527 INFO:tasks.rados.rados.0.trial187.stdout:1806: done (1 left) 2026-02-13T18:14:12.527 INFO:tasks.rados.rados.0.trial187.stdout:1807: done (0 left) 2026-02-13T18:14:12.527 INFO:tasks.rados.rados.0.trial187.stdout:1808: snap_create 2026-02-13T18:14:13.526 INFO:tasks.rados.rados.0.trial187.stdout:1808: done (0 left) 2026-02-13T18:14:13.526 INFO:tasks.rados.rados.0.trial187.stdout:1809: delete oid 34 current snap is 208 2026-02-13T18:14:13.528 INFO:tasks.rados.rados.0.trial187.stdout:1809: done (0 left) 2026-02-13T18:14:13.528 INFO:tasks.rados.rados.0.trial187.stdout:1810: snap_create 2026-02-13T18:14:14.532 INFO:tasks.rados.rados.0.trial187.stdout:1810: done (0 left) 2026-02-13T18:14:14.533 INFO:tasks.rados.rados.0.trial187.stdout:1811: write (excl) oid 36 current snap is 209 2026-02-13T18:14:14.533 INFO:tasks.rados.rados.0.trial187.stdout:1811: seq_num 600 ranges {484200=624934,1860843=223357} 2026-02-13T18:14:14.539 INFO:tasks.rados.rados.0.trial187.stdout:1811: writing trial18717860-36 from 484200 to 1109134 tid 1 2026-02-13T18:14:14.546 INFO:tasks.rados.rados.0.trial187.stdout:1811: writing trial18717860-36 from 1860843 to 2084200 tid 2 2026-02-13T18:14:14.546 INFO:tasks.rados.rados.0.trial187.stdout:1812: rollback oid 41 current snap is 209 2026-02-13T18:14:14.547 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 196 2026-02-13T18:14:14.547 INFO:tasks.rados.rados.0.trial187.stdout:1811: finishing write tid 1 to trial18717860-36 2026-02-13T18:14:14.547 INFO:tasks.rados.rados.0.trial187.stdout:1813: write oid 19 current snap is 209 2026-02-13T18:14:14.547 INFO:tasks.rados.rados.0.trial187.stdout:1813: seq_num 601 ranges {501007=416536,1635678=465329} 2026-02-13T18:14:14.552 INFO:tasks.rados.rados.0.trial187.stdout:1813: writing trial18717860-19 from 501007 to 917543 tid 1 2026-02-13T18:14:14.561 INFO:tasks.rados.rados.0.trial187.stdout:1813: writing trial18717860-19 from 1635678 to 2101007 tid 2 2026-02-13T18:14:14.561 INFO:tasks.rados.rados.0.trial187.stdout:1814: copy_from oid 38 from oid 18 current snap is 209 2026-02-13T18:14:14.561 INFO:tasks.rados.rados.0.trial187.stdout:1811: finishing write tid 2 to trial18717860-36 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1811: finishing write tid 3 to trial18717860-36 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1815: snap_create 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1811: finishing write tid 4 to trial18717860-36 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1811: oid 36 updating version 0 to 546 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1811: oid 36 updating version 546 to 547 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1811: oid 36 updating version 547 to 548 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 548 (ObjNum 600 snap 209 seq_num 600) dirty exists 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1811: left oid 36 (ObjNum 600 snap 209 seq_num 600) 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1812: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1812: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:14:14.562 INFO:tasks.rados.rados.0.trial187.stdout:1812: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:14:14.563 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 470 (ObjNum 536 snap 168 seq_num 536) dirty exists 2026-02-13T18:14:14.563 INFO:tasks.rados.rados.0.trial187.stdout:1813: finishing write tid 1 to trial18717860-19 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: finishing write tid 2 to trial18717860-19 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: finishing write tid 3 to trial18717860-19 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: finishing write tid 4 to trial18717860-19 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: oid 19 updating version 0 to 873 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: oid 19 updating version 873 to 874 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: oid 19 version 874 is already newer than 872 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 874 (ObjNum 601 snap 209 seq_num 601) dirty exists 2026-02-13T18:14:14.564 INFO:tasks.rados.rados.0.trial187.stdout:1813: left oid 19 (ObjNum 601 snap 209 seq_num 601) 2026-02-13T18:14:14.574 INFO:tasks.rados.rados.0.trial187.stdout:1814: finishing copy_from racing read to trial18717860-38 2026-02-13T18:14:14.574 INFO:tasks.rados.rados.0.trial187.stdout:1814: finishing copy_from to trial18717860-38 2026-02-13T18:14:14.575 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 522 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:14:15.536 INFO:tasks.rados.rados.0.trial187.stdout:1811: done (4 left) 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1812: done (3 left) 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1813: done (2 left) 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1814: done (1 left) 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1815: done (0 left) 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1816: read oid 31 snap -1 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1816: expect deleted 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1817: write (excl) oid 18 current snap is 210 2026-02-13T18:14:15.537 INFO:tasks.rados.rados.0.trial187.stdout:1817: seq_num 602 ranges {517814=491785,1577807=540007} 2026-02-13T18:14:15.542 INFO:tasks.rados.rados.0.trial187.stdout:1817: writing trial18717860-18 from 517814 to 1009599 tid 1 2026-02-13T18:14:15.550 INFO:tasks.rados.rados.0.trial187.stdout:1817: writing trial18717860-18 from 1577807 to 2117814 tid 2 2026-02-13T18:14:15.550 INFO:tasks.rados.rados.0.trial187.stdout:1818: read oid 16 snap 197 2026-02-13T18:14:15.550 INFO:tasks.rados.rados.0.trial187.stdout:1818: expect deleted 2026-02-13T18:14:15.551 INFO:tasks.rados.rados.0.trial187.stdout:1819: write oid 22 current snap is 210 2026-02-13T18:14:15.551 INFO:tasks.rados.rados.0.trial187.stdout:1819: seq_num 603 ranges {534621=567034,1636289=498332} 2026-02-13T18:14:15.557 INFO:tasks.rados.rados.0.trial187.stdout:1819: writing trial18717860-22 from 534621 to 1101655 tid 1 2026-02-13T18:14:15.564 INFO:tasks.rados.rados.0.trial187.stdout:1819: writing trial18717860-22 from 1636289 to 2134621 tid 2 2026-02-13T18:14:15.565 INFO:tasks.rados.rados.0.trial187.stdout:1820: write oid 28 current snap is 210 2026-02-13T18:14:15.565 INFO:tasks.rados.rados.0.trial187.stdout:1820: seq_num 604 ranges {551428=642283,1694771=456657} 2026-02-13T18:14:15.572 INFO:tasks.rados.rados.0.trial187.stdout:1820: writing trial18717860-28 from 551428 to 1193711 tid 1 2026-02-13T18:14:15.579 INFO:tasks.rados.rados.0.trial187.stdout:1820: writing trial18717860-28 from 1694771 to 2151428 tid 2 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1821: rollback oid 27 current snap is 210 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 203 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: finishing write tid 1 to trial18717860-18 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: finishing write tid 2 to trial18717860-18 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: finishing write tid 3 to trial18717860-18 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: finishing write tid 4 to trial18717860-18 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: oid 18 updating version 0 to 537 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: oid 18 updating version 537 to 538 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:1817: oid 18 version 538 is already newer than 536 2026-02-13T18:14:15.580 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 538 (ObjNum 602 snap 210 seq_num 602) dirty exists 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1817: left oid 18 (ObjNum 602 snap 210 seq_num 602) 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: finishing write tid 1 to trial18717860-22 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: finishing write tid 2 to trial18717860-22 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: finishing write tid 3 to trial18717860-22 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: finishing write tid 4 to trial18717860-22 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: oid 22 updating version 0 to 985 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: oid 22 updating version 985 to 986 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: oid 22 version 986 is already newer than 984 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 986 (ObjNum 603 snap 210 seq_num 603) dirty exists 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1819: left oid 22 (ObjNum 603 snap 210 seq_num 603) 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1820: finishing write tid 1 to trial18717860-28 2026-02-13T18:14:15.581 INFO:tasks.rados.rados.0.trial187.stdout:1816: done (5 left) 2026-02-13T18:14:15.582 INFO:tasks.rados.rados.0.trial187.stdout:1817: done (4 left) 2026-02-13T18:14:15.582 INFO:tasks.rados.rados.0.trial187.stdout:1818: done (3 left) 2026-02-13T18:14:15.582 INFO:tasks.rados.rados.0.trial187.stdout:1819: done (2 left) 2026-02-13T18:14:15.582 INFO:tasks.rados.rados.0.trial187.stdout:1822: delete oid 31 current snap is 210 2026-02-13T18:14:15.582 INFO:tasks.rados.rados.0.trial187.stdout:1822: done (2 left) 2026-02-13T18:14:15.583 INFO:tasks.rados.rados.0.trial187.stdout:1823: read oid 4 snap -1 2026-02-13T18:14:15.583 INFO:tasks.rados.rados.0.trial187.stdout:1823: expect (ObjNum 593 snap 204 seq_num 593) 2026-02-13T18:14:15.583 INFO:tasks.rados.rados.0.trial187.stdout:1824: write oid 30 current snap is 210 2026-02-13T18:14:15.583 INFO:tasks.rados.rados.0.trial187.stdout:1824: seq_num 606 ranges {585042=792781,2095382=89660} 2026-02-13T18:14:15.589 INFO:tasks.rados.rados.0.trial187.stdout:1824: writing trial18717860-30 from 585042 to 1377823 tid 1 2026-02-13T18:14:15.595 INFO:tasks.rados.rados.0.trial187.stdout:1824: writing trial18717860-30 from 2095382 to 2185042 tid 2 2026-02-13T18:14:15.595 INFO:tasks.rados.rados.0.trial187.stdout:1825: snap_remove snap 191 2026-02-13T18:14:16.505 INFO:tasks.rados.rados.0.trial187.stdout:1825: done (4 left) 2026-02-13T18:14:16.505 INFO:tasks.rados.rados.0.trial187.stdout:1826: write (excl) oid 34 current snap is 210 2026-02-13T18:14:16.506 INFO:tasks.rados.rados.0.trial187.stdout:1826: seq_num 607 ranges {601849=468030,1753864=447985} 2026-02-13T18:14:16.510 INFO:tasks.rados.rados.0.trial187.stdout:1826: writing trial18717860-34 from 601849 to 1069879 tid 1 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1826: writing trial18717860-34 from 1753864 to 2201849 tid 2 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1827: read oid 32 snap -1 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1827: expect (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1828: read oid 39 snap -1 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1828: expect deleted 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1829: rollback oid 14 current snap is 210 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 197 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1820: finishing write tid 2 to trial18717860-28 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1820: finishing write tid 3 to trial18717860-28 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1820: finishing write tid 4 to trial18717860-28 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1820: oid 28 updating version 0 to 780 2026-02-13T18:14:16.514 INFO:tasks.rados.rados.0.trial187.stdout:1820: oid 28 version 780 is already newer than 779 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1820: oid 28 updating version 780 to 781 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 781 (ObjNum 604 snap 210 seq_num 604) dirty exists 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1820: left oid 28 (ObjNum 604 snap 210 seq_num 604) 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1820: done (7 left) 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1830: read oid 24 snap -1 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1830: expect (ObjNum 498 snap 150 seq_num 498) 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1831: read oid 43 snap 200 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1831: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1832: delete oid 25 current snap is 210 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1821: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1821: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1821: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 617 (ObjNum 578 snap 196 seq_num 578) dirty exists 2026-02-13T18:14:16.515 INFO:tasks.rados.rados.0.trial187.stdout:1823: expect (ObjNum 593 snap 204 seq_num 593) 2026-02-13T18:14:16.539 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2042936 2026-02-13T18:14:16.578 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 245172 2026-02-13T18:14:16.626 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:16.675 INFO:tasks.rados.rados.0.trial187.stdout:1824: finishing write tid 1 to trial18717860-30 2026-02-13T18:14:16.675 INFO:tasks.rados.rados.0.trial187.stdout:1824: finishing write tid 2 to trial18717860-30 2026-02-13T18:14:16.675 INFO:tasks.rados.rados.0.trial187.stdout:1824: finishing write tid 3 to trial18717860-30 2026-02-13T18:14:16.675 INFO:tasks.rados.rados.0.trial187.stdout:1824: finishing write tid 4 to trial18717860-30 2026-02-13T18:14:16.675 INFO:tasks.rados.rados.0.trial187.stdout:1824: oid 30 updating version 0 to 786 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1824: oid 30 version 786 is already newer than 785 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1824: oid 30 version 786 is already newer than 784 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 786 (ObjNum 606 snap 210 seq_num 606) dirty exists 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1824: left oid 30 (ObjNum 606 snap 210 seq_num 606) 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1826: finishing write tid 1 to trial18717860-34 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1829: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1829: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1829: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 551 (ObjNum 561 snap 189 seq_num 561) dirty exists 2026-02-13T18:14:16.676 INFO:tasks.rados.rados.0.trial187.stdout:1827: expect (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:14:16.712 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:16.788 INFO:tasks.rados.rados.0.trial187.stdout:1826: finishing write tid 2 to trial18717860-34 2026-02-13T18:14:16.788 INFO:tasks.rados.rados.0.trial187.stdout:1826: finishing write tid 3 to trial18717860-34 2026-02-13T18:14:16.788 INFO:tasks.rados.rados.0.trial187.stdout:1826: finishing write tid 4 to trial18717860-34 2026-02-13T18:14:16.788 INFO:tasks.rados.rados.0.trial187.stdout:1826: oid 34 updating version 0 to 911 2026-02-13T18:14:16.788 INFO:tasks.rados.rados.0.trial187.stdout:1826: oid 34 updating version 911 to 912 2026-02-13T18:14:16.789 INFO:tasks.rados.rados.0.trial187.stdout:1826: oid 34 version 912 is already newer than 910 2026-02-13T18:14:16.789 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 912 (ObjNum 607 snap 210 seq_num 607) dirty exists 2026-02-13T18:14:16.789 INFO:tasks.rados.rados.0.trial187.stdout:1826: left oid 34 (ObjNum 607 snap 210 seq_num 607) 2026-02-13T18:14:16.789 INFO:tasks.rados.rados.0.trial187.stdout:1830: expect (ObjNum 498 snap 150 seq_num 498) 2026-02-13T18:14:16.789 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:16.815 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:16.871 INFO:tasks.rados.rados.0.trial187.stdout:1831: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:16.871 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:16.912 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1821: done (9 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1823: done (8 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1824: done (7 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1826: done (6 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1827: done (5 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1828: done (4 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1829: done (3 left) 2026-02-13T18:14:16.994 INFO:tasks.rados.rados.0.trial187.stdout:1830: done (2 left) 2026-02-13T18:14:16.995 INFO:tasks.rados.rados.0.trial187.stdout:1831: done (1 left) 2026-02-13T18:14:16.995 INFO:tasks.rados.rados.0.trial187.stdout:1832: done (0 left) 2026-02-13T18:14:16.995 INFO:tasks.rados.rados.0.trial187.stdout:1833: delete oid 31 current snap is 210 2026-02-13T18:14:16.995 INFO:tasks.rados.rados.0.trial187.stdout:1833: done (0 left) 2026-02-13T18:14:16.996 INFO:tasks.rados.rados.0.trial187.stdout:1834: read oid 35 snap -1 2026-02-13T18:14:16.996 INFO:tasks.rados.rados.0.trial187.stdout:1834: expect (ObjNum 587 snap 204 seq_num 587) 2026-02-13T18:14:16.996 INFO:tasks.rados.rados.0.trial187.stdout:1835: delete oid 50 current snap is 210 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1835: done (1 left) 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1836: read oid 17 snap -1 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1836: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1837: read oid 18 snap -1 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1837: expect (ObjNum 602 snap 210 seq_num 602) 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1838: read oid 12 snap -1 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1838: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:16.997 INFO:tasks.rados.rados.0.trial187.stdout:1839: snap_create 2026-02-13T18:14:16.999 INFO:tasks.rados.rados.0.trial187.stdout:1834: expect (ObjNum 587 snap 204 seq_num 587) 2026-02-13T18:14:17.068 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3678256 2026-02-13T18:14:17.121 INFO:tasks.rados.rados.0.trial187.stdout:1836: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:17.158 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:17.204 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 854142 2026-02-13T18:14:17.236 INFO:tasks.rados.rados.0.trial187.stdout:1837: expect (ObjNum 602 snap 210 seq_num 602) 2026-02-13T18:14:17.237 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:17.256 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 53209 2026-02-13T18:14:17.275 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:17.294 INFO:tasks.rados.rados.0.trial187.stdout:1838: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:17.294 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:17.376 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:17.540 INFO:tasks.rados.rados.0.trial187.stdout:1834: done (4 left) 2026-02-13T18:14:17.540 INFO:tasks.rados.rados.0.trial187.stdout:1836: done (3 left) 2026-02-13T18:14:17.540 INFO:tasks.rados.rados.0.trial187.stdout:1837: done (2 left) 2026-02-13T18:14:17.540 INFO:tasks.rados.rados.0.trial187.stdout:1838: done (1 left) 2026-02-13T18:14:17.540 INFO:tasks.rados.rados.0.trial187.stdout:1839: done (0 left) 2026-02-13T18:14:17.540 INFO:tasks.rados.rados.0.trial187.stdout:1840: rollback oid 10 current snap is 211 2026-02-13T18:14:17.541 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 10 to 179 2026-02-13T18:14:17.541 INFO:tasks.rados.rados.0.trial187.stdout:1841: write (excl) oid 38 current snap is 211 2026-02-13T18:14:17.541 INFO:tasks.rados.rados.0.trial187.stdout:1841: seq_num 611 ranges {669077=485379,1587792=681285} 2026-02-13T18:14:17.548 INFO:tasks.rados.rados.0.trial187.stdout:1841: writing trial18717860-38 from 669077 to 1154456 tid 1 2026-02-13T18:14:17.555 INFO:tasks.rados.rados.0.trial187.stdout:1841: writing trial18717860-38 from 1587792 to 2269077 tid 2 2026-02-13T18:14:17.555 INFO:tasks.rados.rados.0.trial187.stdout:1842: snap_remove snap 207 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1842: done (2 left) 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1843: copy_from oid 6 from oid 24 current snap is 211 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1840: finishing rollback tid 0 to trial18717860-10 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1840: finishing rollback tid 1 to trial18717860-10 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1840: finishing rollback tid 2 to trial18717860-10 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 841 (ObjNum 490 snap 147 seq_num 490) dirty exists 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: finishing write tid 1 to trial18717860-38 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: finishing write tid 2 to trial18717860-38 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: finishing write tid 3 to trial18717860-38 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: finishing write tid 4 to trial18717860-38 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: oid 38 updating version 0 to 849 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: oid 38 version 849 is already newer than 847 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: oid 38 version 849 is already newer than 848 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 849 (ObjNum 611 snap 211 seq_num 611) dirty exists 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1841: left oid 38 (ObjNum 611 snap 211 seq_num 611) 2026-02-13T18:14:18.543 INFO:tasks.rados.rados.0.trial187.stdout:1840: done (2 left) 2026-02-13T18:14:18.544 INFO:tasks.rados.rados.0.trial187.stdout:1841: done (1 left) 2026-02-13T18:14:18.544 INFO:tasks.rados.rados.0.trial187.stdout:1844: delete oid 28 current snap is 211 2026-02-13T18:14:18.546 INFO:tasks.rados.rados.0.trial187.stdout:1844: done (1 left) 2026-02-13T18:14:18.546 INFO:tasks.rados.rados.0.trial187.stdout:1845: read oid 43 snap -1 2026-02-13T18:14:18.546 INFO:tasks.rados.rados.0.trial187.stdout:1845: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:18.546 INFO:tasks.rados.rados.0.trial187.stdout:1846: write (excl) oid 49 current snap is 211 2026-02-13T18:14:18.546 INFO:tasks.rados.rados.0.trial187.stdout:1846: seq_num 613 ranges {702691=635877,2104756=197935} 2026-02-13T18:14:18.555 INFO:tasks.rados.rados.0.trial187.stdout:1846: writing trial18717860-49 from 702691 to 1338568 tid 1 2026-02-13T18:14:18.562 INFO:tasks.rados.rados.0.trial187.stdout:1846: writing trial18717860-49 from 2104756 to 2302691 tid 2 2026-02-13T18:14:18.562 INFO:tasks.rados.rados.0.trial187.stdout:1847: copy_from oid 38 from oid 39 current snap is 211 2026-02-13T18:14:18.562 INFO:tasks.rados.rados.0.trial187.stdout:1845: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:18.699 INFO:tasks.rados.rados.0.trial187.stdout:1843: finishing copy_from racing read to trial18717860-6 2026-02-13T18:14:18.699 INFO:tasks.rados.rados.0.trial187.stdout:1843: finishing copy_from to trial18717860-6 2026-02-13T18:14:18.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 778 (ObjNum 498 snap 150 seq_num 498) dirty exists 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1846: finishing write tid 1 to trial18717860-49 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1847: finishing copy_from to trial18717860-38 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1847: got expected ENOENT (src dne) 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1843: done (3 left) 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1845: done (2 left) 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1848: read oid 9 snap 197 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1848: expect deleted 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1849: copy_from oid 18 from oid 31 current snap is 211 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1847: finishing copy_from racing read to trial18717860-38 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1846: finishing write tid 2 to trial18717860-49 2026-02-13T18:14:18.700 INFO:tasks.rados.rados.0.trial187.stdout:1846: finishing write tid 3 to trial18717860-49 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1846: finishing write tid 4 to trial18717860-49 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1846: oid 49 updating version 0 to 915 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1846: oid 49 version 915 is already newer than 913 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1846: oid 49 version 915 is already newer than 914 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 915 (ObjNum 613 snap 211 seq_num 613) dirty exists 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1846: left oid 49 (ObjNum 613 snap 211 seq_num 613) 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1846: done (3 left) 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1847: done (2 left) 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1850: copy_from oid 49 from oid 43 current snap is 211 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1851: write (excl) oid 26 current snap is 211 2026-02-13T18:14:18.701 INFO:tasks.rados.rados.0.trial187.stdout:1851: seq_num 614 ranges {719498=711126,2046885=272613} 2026-02-13T18:14:18.708 INFO:tasks.rados.rados.0.trial187.stdout:1851: writing trial18717860-26 from 719498 to 1430624 tid 1 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1851: writing trial18717860-26 from 2046885 to 2319498 tid 2 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1852: delete oid 27 current snap is 211 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1849: finishing copy_from to trial18717860-18 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1849: got expected ENOENT (src dne) 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1849: finishing copy_from racing read to trial18717860-18 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1850: finishing copy_from racing read to trial18717860-49 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:1850: finishing copy_from to trial18717860-49 2026-02-13T18:14:18.715 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:14:18.716 INFO:tasks.rados.rados.0.trial187.stdout:1851: finishing write tid 1 to trial18717860-26 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1851: finishing write tid 2 to trial18717860-26 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1851: finishing write tid 3 to trial18717860-26 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1848: done (4 left) 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1849: done (3 left) 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1850: done (2 left) 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1852: done (1 left) 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1853: write (excl) oid 34 current snap is 211 2026-02-13T18:14:18.717 INFO:tasks.rados.rados.0.trial187.stdout:1853: seq_num 616 ranges {753112=577977,1880202=472910} 2026-02-13T18:14:18.725 INFO:tasks.rados.rados.0.trial187.stdout:1853: writing trial18717860-34 from 753112 to 1331089 tid 1 2026-02-13T18:14:18.732 INFO:tasks.rados.rados.0.trial187.stdout:1853: writing trial18717860-34 from 1880202 to 2353112 tid 2 2026-02-13T18:14:18.732 INFO:tasks.rados.rados.0.trial187.stdout:1854: snap_remove snap 206 2026-02-13T18:14:19.545 INFO:tasks.rados.rados.0.trial187.stdout:1854: done (2 left) 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1855: delete oid 5 current snap is 211 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1851: finishing write tid 4 to trial18717860-26 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1851: oid 26 updating version 0 to 903 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1851: oid 26 version 903 is already newer than 901 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1851: oid 26 version 903 is already newer than 902 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 903 (ObjNum 614 snap 211 seq_num 614) dirty exists 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1851: left oid 26 (ObjNum 614 snap 211 seq_num 614) 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1853: finishing write tid 1 to trial18717860-34 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1853: finishing write tid 2 to trial18717860-34 2026-02-13T18:14:19.546 INFO:tasks.rados.rados.0.trial187.stdout:1853: finishing write tid 3 to trial18717860-34 2026-02-13T18:14:19.547 INFO:tasks.rados.rados.0.trial187.stdout:1853: finishing write tid 4 to trial18717860-34 2026-02-13T18:14:19.547 INFO:tasks.rados.rados.0.trial187.stdout:1853: oid 34 updating version 0 to 916 2026-02-13T18:14:19.547 INFO:tasks.rados.rados.0.trial187.stdout:1853: oid 34 updating version 916 to 918 2026-02-13T18:14:19.547 INFO:tasks.rados.rados.0.trial187.stdout:1853: oid 34 version 918 is already newer than 917 2026-02-13T18:14:19.547 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 918 (ObjNum 616 snap 211 seq_num 616) dirty exists 2026-02-13T18:14:19.547 INFO:tasks.rados.rados.0.trial187.stdout:1853: left oid 34 (ObjNum 616 snap 211 seq_num 616) 2026-02-13T18:14:19.549 INFO:tasks.rados.rados.0.trial187.stdout:1851: done (2 left) 2026-02-13T18:14:19.549 INFO:tasks.rados.rados.0.trial187.stdout:1853: done (1 left) 2026-02-13T18:14:19.550 INFO:tasks.rados.rados.0.trial187.stdout:1855: done (0 left) 2026-02-13T18:14:19.550 INFO:tasks.rados.rados.0.trial187.stdout:1856: snap_remove snap 179 2026-02-13T18:14:20.549 INFO:tasks.rados.rados.0.trial187.stdout:1856: done (0 left) 2026-02-13T18:14:20.549 INFO:tasks.rados.rados.0.trial187.stdout:1857: copy_from oid 16 from oid 48 current snap is 211 2026-02-13T18:14:20.549 INFO:tasks.rados.rados.0.trial187.stdout:1858: write oid 50 current snap is 211 2026-02-13T18:14:20.549 INFO:tasks.rados.rados.0.trial187.stdout:1858: seq_num 618 ranges {786726=728475,2280813=105913} 2026-02-13T18:14:20.558 INFO:tasks.rados.rados.0.trial187.stdout:1858: writing trial18717860-50 from 786726 to 1515201 tid 1 2026-02-13T18:14:20.565 INFO:tasks.rados.rados.0.trial187.stdout:1858: writing trial18717860-50 from 2280813 to 2386726 tid 2 2026-02-13T18:14:20.565 INFO:tasks.rados.rados.0.trial187.stdout:1859: read oid 25 snap 199 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1859: expect deleted 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1860: rollback oid 9 current snap is 211 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 208 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1857: finishing copy_from racing read to trial18717860-16 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1857: finishing copy_from to trial18717860-16 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1858: finishing write tid 1 to trial18717860-50 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1857: done (3 left) 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1861: rollback oid 8 current snap is 211 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 209 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1862: read oid 47 snap -1 2026-02-13T18:14:20.566 INFO:tasks.rados.rados.0.trial187.stdout:1862: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:14:20.567 INFO:tasks.rados.rados.0.trial187.stdout:1863: snap_create 2026-02-13T18:14:20.568 INFO:tasks.rados.rados.0.trial187.stdout:1861: finishing rollback tid 0 to trial18717860-8 2026-02-13T18:14:20.568 INFO:tasks.rados.rados.0.trial187.stdout:1860: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 0 (ObjNum 129 snap 0 seq_num 3013778176) dirty dne 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: finishing write tid 2 to trial18717860-50 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1861: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: finishing write tid 3 to trial18717860-50 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: finishing write tid 4 to trial18717860-50 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: oid 50 updating version 0 to 481 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: oid 50 version 481 is already newer than 480 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: oid 50 updating version 481 to 482 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 482 (ObjNum 618 snap 211 seq_num 618) dirty exists 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1858: left oid 50 (ObjNum 618 snap 211 seq_num 618) 2026-02-13T18:14:20.569 INFO:tasks.rados.rados.0.trial187.stdout:1861: finishing rollback tid 2 to trial18717860-8 2026-02-13T18:14:20.570 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 789 (ObjNum 589 snap 204 seq_num 589) dirty exists 2026-02-13T18:14:20.570 INFO:tasks.rados.rados.0.trial187.stdout:1862: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:14:20.611 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2173933 2026-02-13T18:14:21.549 INFO:tasks.rados.rados.0.trial187.stdout:1858: done (5 left) 2026-02-13T18:14:21.549 INFO:tasks.rados.rados.0.trial187.stdout:1859: done (4 left) 2026-02-13T18:14:21.549 INFO:tasks.rados.rados.0.trial187.stdout:1860: done (3 left) 2026-02-13T18:14:21.549 INFO:tasks.rados.rados.0.trial187.stdout:1861: done (2 left) 2026-02-13T18:14:21.549 INFO:tasks.rados.rados.0.trial187.stdout:1862: done (1 left) 2026-02-13T18:14:21.550 INFO:tasks.rados.rados.0.trial187.stdout:1863: done (0 left) 2026-02-13T18:14:21.550 INFO:tasks.rados.rados.0.trial187.stdout:1864: write oid 2 current snap is 212 2026-02-13T18:14:21.550 INFO:tasks.rados.rados.0.trial187.stdout:1864: seq_num 619 ranges {403533=403724,1539295=652201} 2026-02-13T18:14:21.554 INFO:tasks.rados.rados.0.trial187.stdout:1864: writing trial18717860-2 from 403533 to 807257 tid 1 2026-02-13T18:14:21.563 INFO:tasks.rados.rados.0.trial187.stdout:1864: writing trial18717860-2 from 1539295 to 2191496 tid 2 2026-02-13T18:14:21.564 INFO:tasks.rados.rados.0.trial187.stdout:1865: write (excl) oid 43 current snap is 212 2026-02-13T18:14:21.564 INFO:tasks.rados.rados.0.trial187.stdout:1865: seq_num 620 ranges {420340=478973,1597777=512212} 2026-02-13T18:14:21.569 INFO:tasks.rados.rados.0.trial187.stdout:1865: writing trial18717860-43 from 420340 to 899313 tid 1 2026-02-13T18:14:21.578 INFO:tasks.rados.rados.0.trial187.stdout:1865: writing trial18717860-43 from 1597777 to 2109989 tid 2 2026-02-13T18:14:21.578 INFO:tasks.rados.rados.0.trial187.stdout:1866: delete oid 39 current snap is 212 2026-02-13T18:14:21.578 INFO:tasks.rados.rados.0.trial187.stdout:1864: finishing write tid 1 to trial18717860-2 2026-02-13T18:14:21.578 INFO:tasks.rados.rados.0.trial187.stdout:1864: finishing write tid 2 to trial18717860-2 2026-02-13T18:14:21.578 INFO:tasks.rados.rados.0.trial187.stdout:1864: finishing write tid 3 to trial18717860-2 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1864: finishing write tid 4 to trial18717860-2 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1864: oid 2 updating version 0 to 552 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1864: oid 2 version 552 is already newer than 551 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1864: oid 2 version 552 is already newer than 550 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 552 (ObjNum 619 snap 212 seq_num 619) dirty exists 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1864: left oid 2 (ObjNum 619 snap 212 seq_num 619) 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1865: finishing write tid 1 to trial18717860-43 2026-02-13T18:14:21.579 INFO:tasks.rados.rados.0.trial187.stdout:1864: done (2 left) 2026-02-13T18:14:21.580 INFO:tasks.rados.rados.0.trial187.stdout:1866: done (1 left) 2026-02-13T18:14:21.580 INFO:tasks.rados.rados.0.trial187.stdout:1867: snap_create 2026-02-13T18:14:21.582 INFO:tasks.rados.rados.0.trial187.stdout:1865: finishing write tid 2 to trial18717860-43 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:1865: finishing write tid 3 to trial18717860-43 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:1865: finishing write tid 4 to trial18717860-43 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:1865: oid 43 updating version 0 to 1008 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:1865: oid 43 updating version 1008 to 1010 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:1865: oid 43 version 1010 is already newer than 1009 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1010 (ObjNum 620 snap 212 seq_num 620) dirty exists 2026-02-13T18:14:21.583 INFO:tasks.rados.rados.0.trial187.stdout:1865: left oid 43 (ObjNum 620 snap 212 seq_num 620) 2026-02-13T18:14:22.556 INFO:tasks.rados.rados.0.trial187.stdout:1865: done (1 left) 2026-02-13T18:14:22.556 INFO:tasks.rados.rados.0.trial187.stdout:1867: done (0 left) 2026-02-13T18:14:22.556 INFO:tasks.rados.rados.0.trial187.stdout:1868: copy_from oid 41 from oid 46 current snap is 213 2026-02-13T18:14:22.556 INFO:tasks.rados.rados.0.trial187.stdout:1869: read oid 44 snap -1 2026-02-13T18:14:22.557 INFO:tasks.rados.rados.0.trial187.stdout:1869: expect (ObjNum 588 snap 204 seq_num 588) 2026-02-13T18:14:22.557 INFO:tasks.rados.rados.0.trial187.stdout:1870: read oid 28 snap -1 2026-02-13T18:14:22.557 INFO:tasks.rados.rados.0.trial187.stdout:1870: expect deleted 2026-02-13T18:14:22.557 INFO:tasks.rados.rados.0.trial187.stdout:1871: snap_create 2026-02-13T18:14:22.572 INFO:tasks.rados.rados.0.trial187.stdout:1868: finishing copy_from racing read to trial18717860-41 2026-02-13T18:14:22.573 INFO:tasks.rados.rados.0.trial187.stdout:1868: finishing copy_from to trial18717860-41 2026-02-13T18:14:22.573 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 899 (ObjNum 594 snap 204 seq_num 594) dirty exists 2026-02-13T18:14:22.575 INFO:tasks.rados.rados.0.trial187.stdout:1869: expect (ObjNum 588 snap 204 seq_num 588) 2026-02-13T18:14:22.594 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2785055 2026-02-13T18:14:22.626 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:22.666 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:23.558 INFO:tasks.rados.rados.0.trial187.stdout:1868: done (3 left) 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1869: done (2 left) 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1870: done (1 left) 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1871: done (0 left) 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1872: copy_from oid 7 from oid 17 current snap is 214 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1873: rollback oid 18 current snap is 214 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 202 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1874: read oid 22 snap 196 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1874: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1875: read oid 15 snap -1 2026-02-13T18:14:23.559 INFO:tasks.rados.rados.0.trial187.stdout:1875: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:14:23.560 INFO:tasks.rados.rados.0.trial187.stdout:1876: delete oid 9 current snap is 214 2026-02-13T18:14:23.563 INFO:tasks.rados.rados.0.trial187.stdout:1874: expect (ObjNum 567 snap 190 seq_num 567) 2026-02-13T18:14:23.619 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2005427 2026-02-13T18:14:23.744 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2332789 2026-02-13T18:14:23.770 INFO:tasks.rados.rados.0.trial187.stdout:1875: expect (ObjNum 373 snap 106 seq_num 373) 2026-02-13T18:14:23.780 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 414672 2026-02-13T18:14:23.812 INFO:tasks.rados.rados.0.trial187.stdout:1873: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1873: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1873: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 556 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1872: finishing copy_from racing read to trial18717860-7 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1872: finishing copy_from to trial18717860-7 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1872: done (4 left) 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1873: done (3 left) 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1874: done (2 left) 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1875: done (1 left) 2026-02-13T18:14:23.813 INFO:tasks.rados.rados.0.trial187.stdout:1876: done (0 left) 2026-02-13T18:14:23.814 INFO:tasks.rados.rados.0.trial187.stdout:1877: snap_remove snap 197 2026-02-13T18:14:24.566 INFO:tasks.rados.rados.0.trial187.stdout:1877: done (0 left) 2026-02-13T18:14:24.566 INFO:tasks.rados.rados.0.trial187.stdout:1878: write (excl) oid 35 current snap is 214 2026-02-13T18:14:24.566 INFO:tasks.rados.rados.0.trial187.stdout:1878: seq_num 623 ranges {470761=704720,1656870=659539} 2026-02-13T18:14:24.573 INFO:tasks.rados.rados.0.trial187.stdout:1878: writing trial18717860-35 from 470761 to 1175481 tid 1 2026-02-13T18:14:24.581 INFO:tasks.rados.rados.0.trial187.stdout:1878: writing trial18717860-35 from 1656870 to 2316409 tid 2 2026-02-13T18:14:24.581 INFO:tasks.rados.rados.0.trial187.stdout:1879: write (excl) oid 24 current snap is 214 2026-02-13T18:14:24.581 INFO:tasks.rados.rados.0.trial187.stdout:1879: seq_num 624 ranges {487568=496322,1431705=519550} 2026-02-13T18:14:24.588 INFO:tasks.rados.rados.0.trial187.stdout:1879: writing trial18717860-24 from 487568 to 983890 tid 1 2026-02-13T18:14:24.594 INFO:tasks.rados.rados.0.trial187.stdout:1879: writing trial18717860-24 from 1431705 to 1951255 tid 2 2026-02-13T18:14:24.594 INFO:tasks.rados.rados.0.trial187.stdout:1880: snap_remove snap 202 2026-02-13T18:14:25.567 INFO:tasks.rados.rados.0.trial187.stdout:1880: done (2 left) 2026-02-13T18:14:25.567 INFO:tasks.rados.rados.0.trial187.stdout:1881: write oid 33 current snap is 214 2026-02-13T18:14:25.568 INFO:tasks.rados.rados.0.trial187.stdout:1881: seq_num 625 ranges {504375=571571,1490187=663208} 2026-02-13T18:14:25.574 INFO:tasks.rados.rados.0.trial187.stdout:1881: writing trial18717860-33 from 504375 to 1075946 tid 1 2026-02-13T18:14:25.578 INFO:tasks.rados.rados.0.trial187.stdout:1881: writing trial18717860-33 from 1490187 to 2153395 tid 2 2026-02-13T18:14:25.578 INFO:tasks.rados.rados.0.trial187.stdout:1882: write oid 15 current snap is 214 2026-02-13T18:14:25.578 INFO:tasks.rados.rados.0.trial187.stdout:1882: seq_num 626 ranges {521182=646820,1948669=523219} 2026-02-13T18:14:25.584 INFO:tasks.rados.rados.0.trial187.stdout:1882: writing trial18717860-15 from 521182 to 1168002 tid 1 2026-02-13T18:14:25.594 INFO:tasks.rados.rados.0.trial187.stdout:1882: writing trial18717860-15 from 1948669 to 2471888 tid 2 2026-02-13T18:14:25.594 INFO:tasks.rados.rados.0.trial187.stdout:1883: copy_from oid 5 from oid 17 current snap is 214 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: finishing write tid 1 to trial18717860-35 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: finishing write tid 2 to trial18717860-35 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: finishing write tid 3 to trial18717860-35 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: finishing write tid 4 to trial18717860-35 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: oid 35 updating version 0 to 852 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: oid 35 version 852 is already newer than 851 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: oid 35 version 852 is already newer than 850 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 852 (ObjNum 623 snap 214 seq_num 623) dirty exists 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1878: left oid 35 (ObjNum 623 snap 214 seq_num 623) 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1879: finishing write tid 1 to trial18717860-24 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1879: finishing write tid 2 to trial18717860-24 2026-02-13T18:14:25.595 INFO:tasks.rados.rados.0.trial187.stdout:1879: finishing write tid 3 to trial18717860-24 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1879: finishing write tid 4 to trial18717860-24 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1879: oid 24 updating version 0 to 783 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1879: oid 24 updating version 783 to 784 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1879: oid 24 updating version 784 to 785 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 785 (ObjNum 624 snap 214 seq_num 624) dirty exists 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1879: left oid 24 (ObjNum 624 snap 214 seq_num 624) 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1881: finishing write tid 1 to trial18717860-33 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1881: finishing write tid 2 to trial18717860-33 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1881: finishing write tid 3 to trial18717860-33 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1881: finishing write tid 4 to trial18717860-33 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1881: oid 33 updating version 0 to 1034 2026-02-13T18:14:25.596 INFO:tasks.rados.rados.0.trial187.stdout:1881: oid 33 version 1034 is already newer than 1033 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1881: oid 33 version 1034 is already newer than 1032 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1034 (ObjNum 625 snap 214 seq_num 625) dirty exists 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1881: left oid 33 (ObjNum 625 snap 214 seq_num 625) 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1882: finishing write tid 1 to trial18717860-15 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1878: done (4 left) 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1879: done (3 left) 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1881: done (2 left) 2026-02-13T18:14:25.597 INFO:tasks.rados.rados.0.trial187.stdout:1884: snap_remove snap 204 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1884: done (2 left) 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1885: read oid 13 snap 209 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1885: expect (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1886: read oid 25 snap -1 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1886: expect deleted 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1887: delete oid 40 current snap is 214 2026-02-13T18:14:26.511 INFO:tasks.rados.rados.0.trial187.stdout:1882: finishing write tid 2 to trial18717860-15 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1882: finishing write tid 3 to trial18717860-15 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1882: finishing write tid 4 to trial18717860-15 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1882: oid 15 updating version 0 to 877 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1882: oid 15 version 877 is already newer than 875 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1882: oid 15 version 877 is already newer than 876 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 877 (ObjNum 626 snap 214 seq_num 626) dirty exists 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1882: left oid 15 (ObjNum 626 snap 214 seq_num 626) 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1883: finishing copy_from racing read to trial18717860-5 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:1883: finishing copy_from to trial18717860-5 2026-02-13T18:14:26.512 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 838 (ObjNum 537 snap 168 seq_num 537) dirty exists 2026-02-13T18:14:26.514 INFO:tasks.rados.rados.0.trial187.stdout:1882: done (4 left) 2026-02-13T18:14:26.514 INFO:tasks.rados.rados.0.trial187.stdout:1883: done (3 left) 2026-02-13T18:14:26.514 INFO:tasks.rados.rados.0.trial187.stdout:1886: done (2 left) 2026-02-13T18:14:26.514 INFO:tasks.rados.rados.0.trial187.stdout:1887: done (1 left) 2026-02-13T18:14:26.515 INFO:tasks.rados.rados.0.trial187.stdout:1888: read oid 22 snap -1 2026-02-13T18:14:26.515 INFO:tasks.rados.rados.0.trial187.stdout:1888: expect (ObjNum 603 snap 210 seq_num 603) 2026-02-13T18:14:26.515 INFO:tasks.rados.rados.0.trial187.stdout:1889: write (excl) oid 21 current snap is 214 2026-02-13T18:14:26.515 INFO:tasks.rados.rados.0.trial187.stdout:1889: seq_num 628 ranges {554796=797318,1949280=526888} 2026-02-13T18:14:26.523 INFO:tasks.rados.rados.0.trial187.stdout:1889: writing trial18717860-21 from 554796 to 1352114 tid 1 2026-02-13T18:14:26.531 INFO:tasks.rados.rados.0.trial187.stdout:1889: writing trial18717860-21 from 1949280 to 2476168 tid 2 2026-02-13T18:14:26.531 INFO:tasks.rados.rados.0.trial187.stdout:1890: delete oid 45 current snap is 214 2026-02-13T18:14:26.531 INFO:tasks.rados.rados.0.trial187.stdout:1885: expect (ObjNum 482 snap 146 seq_num 482) 2026-02-13T18:14:26.572 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 781645 2026-02-13T18:14:26.594 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 543 2026-02-13T18:14:26.620 INFO:tasks.rados.rados.0.trial187.stdout:1888: expect (ObjNum 603 snap 210 seq_num 603) 2026-02-13T18:14:26.620 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:26.657 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1889: finishing write tid 1 to trial18717860-21 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1889: finishing write tid 2 to trial18717860-21 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1889: finishing write tid 3 to trial18717860-21 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1885: done (3 left) 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1888: done (2 left) 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1890: done (1 left) 2026-02-13T18:14:26.732 INFO:tasks.rados.rados.0.trial187.stdout:1891: read oid 23 snap -1 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1891: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1892: rollback oid 44 current snap is 214 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 203 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1889: finishing write tid 4 to trial18717860-21 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1889: oid 21 updating version 0 to 904 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1889: oid 21 updating version 904 to 905 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1889: oid 21 version 905 is already newer than 903 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 905 (ObjNum 628 snap 214 seq_num 628) dirty exists 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1889: left oid 21 (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1889: done (2 left) 2026-02-13T18:14:26.733 INFO:tasks.rados.rados.0.trial187.stdout:1893: delete oid 31 current snap is 214 2026-02-13T18:14:26.734 INFO:tasks.rados.rados.0.trial187.stdout:1892: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:14:26.734 INFO:tasks.rados.rados.0.trial187.stdout:1893: done (2 left) 2026-02-13T18:14:26.734 INFO:tasks.rados.rados.0.trial187.stdout:1894: write (excl) oid 24 current snap is 214 2026-02-13T18:14:26.735 INFO:tasks.rados.rados.0.trial187.stdout:1894: seq_num 631 ranges {605217=739418,2124726=480491} 2026-02-13T18:14:26.743 INFO:tasks.rados.rados.0.trial187.stdout:1894: writing trial18717860-24 from 605217 to 1344635 tid 1 2026-02-13T18:14:26.753 INFO:tasks.rados.rados.0.trial187.stdout:1894: writing trial18717860-24 from 2124726 to 2605217 tid 2 2026-02-13T18:14:26.753 INFO:tasks.rados.rados.0.trial187.stdout:1895: delete oid 12 current snap is 214 2026-02-13T18:14:26.753 INFO:tasks.rados.rados.0.trial187.stdout:1892: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:14:26.753 INFO:tasks.rados.rados.0.trial187.stdout:1892: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:14:26.753 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1046 (ObjNum 547 snap 176 seq_num 547) dirty exists 2026-02-13T18:14:26.753 INFO:tasks.rados.rados.0.trial187.stdout:1891: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:14:26.802 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:26.828 INFO:tasks.rados.rados.0.trial187.stdout:1894: finishing write tid 1 to trial18717860-24 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: finishing write tid 2 to trial18717860-24 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: finishing write tid 3 to trial18717860-24 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: finishing write tid 4 to trial18717860-24 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: oid 24 updating version 0 to 786 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: oid 24 updating version 786 to 787 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: oid 24 updating version 787 to 788 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 788 (ObjNum 631 snap 214 seq_num 631) dirty exists 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1894: left oid 24 (ObjNum 631 snap 214 seq_num 631) 2026-02-13T18:14:26.829 INFO:tasks.rados.rados.0.trial187.stdout:1891: done (3 left) 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1892: done (2 left) 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1894: done (1 left) 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1895: done (0 left) 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1896: copy_from oid 42 from oid 16 current snap is 214 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1897: read oid 49 snap -1 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1897: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1898: write oid 26 current snap is 214 2026-02-13T18:14:26.830 INFO:tasks.rados.rados.0.trial187.stdout:1898: seq_num 633 ranges {638831=489916,1841690=677884} 2026-02-13T18:14:26.836 INFO:tasks.rados.rados.0.trial187.stdout:1898: writing trial18717860-26 from 638831 to 1128747 tid 1 2026-02-13T18:14:26.846 INFO:tasks.rados.rados.0.trial187.stdout:1898: writing trial18717860-26 from 1841690 to 2519574 tid 2 2026-02-13T18:14:26.846 INFO:tasks.rados.rados.0.trial187.stdout:1899: snap_remove snap 200 2026-02-13T18:14:27.731 INFO:tasks.rados.rados.0.trial187.stdout:1899: done (3 left) 2026-02-13T18:14:27.732 INFO:tasks.rados.rados.0.trial187.stdout:1900: read oid 18 snap -1 2026-02-13T18:14:27.732 INFO:tasks.rados.rados.0.trial187.stdout:1900: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:14:27.732 INFO:tasks.rados.rados.0.trial187.stdout:1901: rollback oid 13 current snap is 214 2026-02-13T18:14:27.732 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 13 to 184 2026-02-13T18:14:27.732 INFO:tasks.rados.rados.0.trial187.stdout:1897: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:27.771 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2328550 2026-02-13T18:14:27.790 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 757291 2026-02-13T18:14:27.829 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1104038 2026-02-13T18:14:27.860 INFO:tasks.rados.rados.0.trial187.stdout:1896: finishing copy_from racing read to trial18717860-42 2026-02-13T18:14:27.860 INFO:tasks.rados.rados.0.trial187.stdout:1896: finishing copy_from to trial18717860-42 2026-02-13T18:14:27.860 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:14:27.860 INFO:tasks.rados.rados.0.trial187.stdout:1898: finishing write tid 1 to trial18717860-26 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: finishing write tid 2 to trial18717860-26 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: finishing write tid 3 to trial18717860-26 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: finishing write tid 4 to trial18717860-26 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: oid 26 updating version 0 to 932 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: oid 26 updating version 932 to 933 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: oid 26 updating version 933 to 934 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 934 (ObjNum 633 snap 214 seq_num 633) dirty exists 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1898: left oid 26 (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:14:27.861 INFO:tasks.rados.rados.0.trial187.stdout:1900: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:14:27.862 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1324498 2026-02-13T18:14:27.913 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:27.942 INFO:tasks.rados.rados.0.trial187.stdout:1901: finishing rollback tid 0 to trial18717860-13 2026-02-13T18:14:27.942 INFO:tasks.rados.rados.0.trial187.stdout:1901: finishing rollback tid 1 to trial18717860-13 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1901: finishing rollback tid 2 to trial18717860-13 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 570 (ObjNum 542 snap 174 seq_num 542) dirty exists 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1896: done (4 left) 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1897: done (3 left) 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1898: done (2 left) 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1900: done (1 left) 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1901: done (0 left) 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1902: read oid 19 snap -1 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1902: expect (ObjNum 601 snap 209 seq_num 601) 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:1903: rollback oid 9 current snap is 214 2026-02-13T18:14:27.943 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 205 2026-02-13T18:14:27.944 INFO:tasks.rados.rados.0.trial187.stdout:1904: delete oid 5 current snap is 214 2026-02-13T18:14:27.945 INFO:tasks.rados.rados.0.trial187.stdout:1902: expect (ObjNum 601 snap 209 seq_num 601) 2026-02-13T18:14:27.964 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 287943 2026-02-13T18:14:27.993 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1189791 2026-02-13T18:14:28.007 INFO:tasks.rados.rados.0.trial187.stdout:1903: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:14:28.007 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:14:28.007 INFO:tasks.rados.rados.0.trial187.stdout:1902: done (2 left) 2026-02-13T18:14:28.007 INFO:tasks.rados.rados.0.trial187.stdout:1903: done (1 left) 2026-02-13T18:14:28.007 INFO:tasks.rados.rados.0.trial187.stdout:1904: done (0 left) 2026-02-13T18:14:28.007 INFO:tasks.rados.rados.0.trial187.stdout:1905: read oid 21 snap -1 2026-02-13T18:14:28.008 INFO:tasks.rados.rados.0.trial187.stdout:1905: expect (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:28.008 INFO:tasks.rados.rados.0.trial187.stdout:1906: snap_remove snap 199 2026-02-13T18:14:28.738 INFO:tasks.rados.rados.0.trial187.stdout:1906: done (1 left) 2026-02-13T18:14:28.738 INFO:tasks.rados.rados.0.trial187.stdout:1907: snap_remove snap 213 2026-02-13T18:14:30.081 INFO:tasks.rados.rados.0.trial187.stdout:1907: done (1 left) 2026-02-13T18:14:30.081 INFO:tasks.rados.rados.0.trial187.stdout:1908: write (excl) oid 30 current snap is 214 2026-02-13T18:14:30.082 INFO:tasks.rados.rados.0.trial187.stdout:1908: seq_num 635 ranges {672445=640414,1842301=681553} 2026-02-13T18:14:30.090 INFO:tasks.rados.rados.0.trial187.stdout:1908: writing trial18717860-30 from 672445 to 1312859 tid 1 2026-02-13T18:14:30.098 INFO:tasks.rados.rados.0.trial187.stdout:1908: writing trial18717860-30 from 1842301 to 2523854 tid 2 2026-02-13T18:14:30.098 INFO:tasks.rados.rados.0.trial187.stdout:1909: snap_create 2026-02-13T18:14:30.098 INFO:tasks.rados.rados.0.trial187.stdout:1905: expect (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:30.156 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2111074 2026-02-13T18:14:30.159 INFO:tasks.rados.rados.0.trial187.stdout:1908: finishing write tid 1 to trial18717860-30 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: finishing write tid 2 to trial18717860-30 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: finishing write tid 3 to trial18717860-30 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: finishing write tid 4 to trial18717860-30 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: oid 30 updating version 0 to 790 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: oid 30 updating version 790 to 792 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: oid 30 version 792 is already newer than 791 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 792 (ObjNum 635 snap 214 seq_num 635) dirty exists 2026-02-13T18:14:30.160 INFO:tasks.rados.rados.0.trial187.stdout:1908: left oid 30 (ObjNum 635 snap 214 seq_num 635) 2026-02-13T18:14:30.744 INFO:tasks.rados.rados.0.trial187.stdout:1905: done (2 left) 2026-02-13T18:14:30.744 INFO:tasks.rados.rados.0.trial187.stdout:1908: done (1 left) 2026-02-13T18:14:30.745 INFO:tasks.rados.rados.0.trial187.stdout:1909: done (0 left) 2026-02-13T18:14:30.745 INFO:tasks.rados.rados.0.trial187.stdout:1910: delete oid 35 current snap is 215 2026-02-13T18:14:30.748 INFO:tasks.rados.rados.0.trial187.stdout:1910: done (0 left) 2026-02-13T18:14:30.748 INFO:tasks.rados.rados.0.trial187.stdout:1911: write oid 31 current snap is 215 2026-02-13T18:14:30.748 INFO:tasks.rados.rados.0.trial187.stdout:1911: seq_num 637 ranges {706059=790912,1959265=685222} 2026-02-13T18:14:30.758 INFO:tasks.rados.rados.0.trial187.stdout:1911: writing trial18717860-31 from 706059 to 1496971 tid 1 2026-02-13T18:14:30.766 INFO:tasks.rados.rados.0.trial187.stdout:1911: writing trial18717860-31 from 1959265 to 2644487 tid 2 2026-02-13T18:14:30.766 INFO:tasks.rados.rados.0.trial187.stdout:1912: read oid 40 snap -1 2026-02-13T18:14:30.766 INFO:tasks.rados.rados.0.trial187.stdout:1912: expect deleted 2026-02-13T18:14:30.767 INFO:tasks.rados.rados.0.trial187.stdout:1913: read oid 12 snap 178 2026-02-13T18:14:30.767 INFO:tasks.rados.rados.0.trial187.stdout:1913: expect deleted 2026-02-13T18:14:30.767 INFO:tasks.rados.rados.0.trial187.stdout:1914: write oid 6 current snap is 215 2026-02-13T18:14:30.767 INFO:tasks.rados.rados.0.trial187.stdout:1914: seq_num 638 ranges {722866=466161,1617747=428880,2587634=135232} 2026-02-13T18:14:30.774 INFO:tasks.rados.rados.0.trial187.stdout:1914: writing trial18717860-6 from 722866 to 1189027 tid 1 2026-02-13T18:14:30.780 INFO:tasks.rados.rados.0.trial187.stdout:1914: writing trial18717860-6 from 1617747 to 2046627 tid 2 2026-02-13T18:14:30.785 INFO:tasks.rados.rados.0.trial187.stdout:1914: writing trial18717860-6 from 2587634 to 2722866 tid 3 2026-02-13T18:14:30.785 INFO:tasks.rados.rados.0.trial187.stdout:1915: write oid 36 current snap is 215 2026-02-13T18:14:30.785 INFO:tasks.rados.rados.0.trial187.stdout:1915: seq_num 639 ranges {739673=657763,2076229=663444} 2026-02-13T18:14:30.793 INFO:tasks.rados.rados.0.trial187.stdout:1915: writing trial18717860-36 from 739673 to 1397436 tid 1 2026-02-13T18:14:30.800 INFO:tasks.rados.rados.0.trial187.stdout:1915: writing trial18717860-36 from 2076229 to 2739673 tid 2 2026-02-13T18:14:30.800 INFO:tasks.rados.rados.0.trial187.stdout:1916: read oid 32 snap -1 2026-02-13T18:14:30.800 INFO:tasks.rados.rados.0.trial187.stdout:1916: expect (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:14:30.800 INFO:tasks.rados.rados.0.trial187.stdout:1917: copy_from oid 9 from oid 16 current snap is 215 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: finishing write tid 1 to trial18717860-31 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: finishing write tid 2 to trial18717860-31 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: finishing write tid 3 to trial18717860-31 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: finishing write tid 4 to trial18717860-31 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: oid 31 updating version 0 to 432 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: oid 31 updating version 432 to 433 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: oid 31 version 433 is already newer than 431 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 433 (ObjNum 637 snap 215 seq_num 637) dirty exists 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1911: left oid 31 (ObjNum 637 snap 215 seq_num 637) 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1914: finishing write tid 1 to trial18717860-6 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1914: finishing write tid 2 to trial18717860-6 2026-02-13T18:14:30.801 INFO:tasks.rados.rados.0.trial187.stdout:1914: finishing write tid 3 to trial18717860-6 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: finishing write tid 4 to trial18717860-6 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: finishing write tid 5 to trial18717860-6 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: oid 6 updating version 0 to 790 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: oid 6 updating version 790 to 792 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: oid 6 version 792 is already newer than 789 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: oid 6 version 792 is already newer than 791 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 792 (ObjNum 638 snap 215 seq_num 638) dirty exists 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1914: left oid 6 (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1915: finishing write tid 1 to trial18717860-36 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1911: done (6 left) 2026-02-13T18:14:30.802 INFO:tasks.rados.rados.0.trial187.stdout:1912: done (5 left) 2026-02-13T18:14:30.803 INFO:tasks.rados.rados.0.trial187.stdout:1913: done (4 left) 2026-02-13T18:14:30.803 INFO:tasks.rados.rados.0.trial187.stdout:1914: done (3 left) 2026-02-13T18:14:30.803 INFO:tasks.rados.rados.0.trial187.stdout:1918: write (excl) oid 29 current snap is 215 2026-02-13T18:14:30.803 INFO:tasks.rados.rados.0.trial187.stdout:1918: seq_num 640 ranges {756480=733012,2134711=432549} 2026-02-13T18:14:30.804 INFO:tasks.rados.rados.0.trial187.stdout:1918: writing trial18717860-29 from 756480 to 1489492 tid 1 2026-02-13T18:14:30.809 INFO:tasks.rados.rados.0.trial187.stdout:1918: writing trial18717860-29 from 2134711 to 2567260 tid 2 2026-02-13T18:14:30.809 INFO:tasks.rados.rados.0.trial187.stdout:1919: rollback oid 30 current snap is 215 2026-02-13T18:14:30.809 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 214 2026-02-13T18:14:30.809 INFO:tasks.rados.rados.0.trial187.stdout:1916: expect (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:14:30.906 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:30.944 INFO:tasks.rados.rados.0.trial187.stdout:1917: finishing copy_from racing read to trial18717860-9 2026-02-13T18:14:30.944 INFO:tasks.rados.rados.0.trial187.stdout:1915: finishing write tid 2 to trial18717860-36 2026-02-13T18:14:30.944 INFO:tasks.rados.rados.0.trial187.stdout:1916: done (4 left) 2026-02-13T18:14:30.944 INFO:tasks.rados.rados.0.trial187.stdout:1920: snap_remove snap 184 2026-02-13T18:14:31.509 INFO:tasks.rados.rados.0.trial187.stdout:1920: done (4 left) 2026-02-13T18:14:31.509 INFO:tasks.rados.rados.0.trial187.stdout:1921: write (excl) oid 5 current snap is 215 2026-02-13T18:14:31.509 INFO:tasks.rados.rados.0.trial187.stdout:1921: seq_num 641 ranges {773287=408261,1793193=576207} 2026-02-13T18:14:31.514 INFO:tasks.rados.rados.0.trial187.stdout:1921: writing trial18717860-5 from 773287 to 1181548 tid 1 2026-02-13T18:14:31.519 INFO:tasks.rados.rados.0.trial187.stdout:1921: writing trial18717860-5 from 1793193 to 2369400 tid 2 2026-02-13T18:14:31.519 INFO:tasks.rados.rados.0.trial187.stdout:1922: snap_remove snap 211 2026-02-13T18:14:33.238 INFO:tasks.rados.rados.0.trial187.stdout:1922: done (5 left) 2026-02-13T18:14:33.238 INFO:tasks.rados.rados.0.trial187.stdout:1923: snap_remove snap 208 2026-02-13T18:14:34.242 INFO:tasks.rados.rados.0.trial187.stdout:1923: done (5 left) 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1924: snap_create 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: finishing write tid 3 to trial18717860-36 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: finishing write tid 4 to trial18717860-36 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: oid 36 updating version 0 to 573 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: oid 36 updating version 573 to 575 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: oid 36 version 575 is already newer than 574 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 575 (ObjNum 639 snap 215 seq_num 639) dirty exists 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: left oid 36 (ObjNum 639 snap 215 seq_num 639) 2026-02-13T18:14:34.243 INFO:tasks.rados.rados.0.trial187.stdout:1917: finishing copy_from to trial18717860-9 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: finishing write tid 1 to trial18717860-29 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1919: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1919: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1919: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 795 (ObjNum 635 snap 214 seq_num 635) dirty exists 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: finishing write tid 2 to trial18717860-29 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: finishing write tid 3 to trial18717860-29 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: finishing write tid 4 to trial18717860-29 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: oid 29 updating version 0 to 879 2026-02-13T18:14:34.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: oid 29 updating version 879 to 880 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1918: oid 29 version 880 is already newer than 878 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 880 (ObjNum 640 snap 215 seq_num 640) dirty exists 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1918: left oid 29 (ObjNum 640 snap 215 seq_num 640) 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: finishing write tid 1 to trial18717860-5 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: finishing write tid 2 to trial18717860-5 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: finishing write tid 3 to trial18717860-5 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: finishing write tid 4 to trial18717860-5 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: oid 5 updating version 0 to 840 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: oid 5 updating version 840 to 841 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: oid 5 updating version 841 to 842 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 842 (ObjNum 641 snap 215 seq_num 641) dirty exists 2026-02-13T18:14:34.245 INFO:tasks.rados.rados.0.trial187.stdout:1921: left oid 5 (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:14:35.243 INFO:tasks.rados.rados.0.trial187.stdout:1915: done (5 left) 2026-02-13T18:14:35.243 INFO:tasks.rados.rados.0.trial187.stdout:1917: done (4 left) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1918: done (3 left) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1919: done (2 left) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1921: done (1 left) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1924: done (0 left) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1925: read oid 18 snap -1 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1925: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1926: read oid 24 snap -1 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1926: expect (ObjNum 631 snap 214 seq_num 631) 2026-02-13T18:14:35.244 INFO:tasks.rados.rados.0.trial187.stdout:1927: snap_create 2026-02-13T18:14:35.247 INFO:tasks.rados.rados.0.trial187.stdout:1925: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:14:35.258 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2442789 2026-02-13T18:14:35.310 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 819015 2026-02-13T18:14:35.333 INFO:tasks.rados.rados.0.trial187.stdout:1926: expect (ObjNum 631 snap 214 seq_num 631) 2026-02-13T18:14:35.333 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:35.418 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:36.255 INFO:tasks.rados.rados.0.trial187.stdout:1925: done (2 left) 2026-02-13T18:14:36.255 INFO:tasks.rados.rados.0.trial187.stdout:1926: done (1 left) 2026-02-13T18:14:36.255 INFO:tasks.rados.rados.0.trial187.stdout:1927: done (0 left) 2026-02-13T18:14:36.256 INFO:tasks.rados.rados.0.trial187.stdout:1928: delete oid 13 current snap is 217 2026-02-13T18:14:36.256 INFO:tasks.rados.rados.0.trial187.stdout:1928: done (0 left) 2026-02-13T18:14:36.256 INFO:tasks.rados.rados.0.trial187.stdout:1929: snap_create 2026-02-13T18:14:36.510 INFO:tasks.rados.rados.0.trial187.stdout:1929: done (0 left) 2026-02-13T18:14:36.510 INFO:tasks.rados.rados.0.trial187.stdout:1930: delete oid 3 current snap is 218 2026-02-13T18:14:36.513 INFO:tasks.rados.rados.0.trial187.stdout:1930: done (0 left) 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:1931: read oid 32 snap -1 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:1931: expect (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:1932: copy_from oid 31 from oid 30 current snap is 218 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:1933: rollback oid 33 current snap is 218 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 33 to 169 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:1934: write oid 10 current snap is 218 2026-02-13T18:14:36.514 INFO:tasks.rados.rados.0.trial187.stdout:1934: seq_num 644 ranges {423708=634008,1852286=439887,2752172=71536} 2026-02-13T18:14:36.520 INFO:tasks.rados.rados.0.trial187.stdout:1934: writing trial18717860-10 from 423708 to 1057716 tid 1 2026-02-13T18:14:36.528 INFO:tasks.rados.rados.0.trial187.stdout:1934: writing trial18717860-10 from 1852286 to 2292173 tid 2 2026-02-13T18:14:36.532 INFO:tasks.rados.rados.0.trial187.stdout:1934: writing trial18717860-10 from 2752172 to 2823708 tid 3 2026-02-13T18:14:36.532 INFO:tasks.rados.rados.0.trial187.stdout:1935: read oid 37 snap -1 2026-02-13T18:14:36.533 INFO:tasks.rados.rados.0.trial187.stdout:1935: expect (ObjNum 590 snap 204 seq_num 590) 2026-02-13T18:14:36.533 INFO:tasks.rados.rados.0.trial187.stdout:1936: read oid 3 snap -1 2026-02-13T18:14:36.533 INFO:tasks.rados.rados.0.trial187.stdout:1936: expect deleted 2026-02-13T18:14:36.533 INFO:tasks.rados.rados.0.trial187.stdout:1937: write (excl) oid 11 current snap is 218 2026-02-13T18:14:36.533 INFO:tasks.rados.rados.0.trial187.stdout:1937: seq_num 645 ranges {440515=709257,1910768=583545} 2026-02-13T18:14:36.540 INFO:tasks.rados.rados.0.trial187.stdout:1937: writing trial18717860-11 from 440515 to 1149772 tid 1 2026-02-13T18:14:36.549 INFO:tasks.rados.rados.0.trial187.stdout:1937: writing trial18717860-11 from 1910768 to 2494313 tid 2 2026-02-13T18:14:36.549 INFO:tasks.rados.rados.0.trial187.stdout:1938: delete oid 50 current snap is 218 2026-02-13T18:14:36.549 INFO:tasks.rados.rados.0.trial187.stdout:1931: expect (ObjNum 552 snap 184 seq_num 552) 2026-02-13T18:14:36.640 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:36.678 INFO:tasks.rados.rados.0.trial187.stdout:1933: finishing rollback tid 0 to trial18717860-33 2026-02-13T18:14:36.678 INFO:tasks.rados.rados.0.trial187.stdout:1933: finishing rollback tid 1 to trial18717860-33 2026-02-13T18:14:36.678 INFO:tasks.rados.rados.0.trial187.stdout:1933: finishing rollback tid 2 to trial18717860-33 2026-02-13T18:14:36.678 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1096 (ObjNum 521 snap 164 seq_num 521) dirty exists 2026-02-13T18:14:36.678 INFO:tasks.rados.rados.0.trial187.stdout:1934: finishing write tid 1 to trial18717860-10 2026-02-13T18:14:36.678 INFO:tasks.rados.rados.0.trial187.stdout:1932: finishing copy_from racing read to trial18717860-31 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1932: finishing copy_from to trial18717860-31 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 795 (ObjNum 635 snap 214 seq_num 635) dirty exists 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: finishing write tid 2 to trial18717860-10 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: finishing write tid 3 to trial18717860-10 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: finishing write tid 4 to trial18717860-10 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: finishing write tid 5 to trial18717860-10 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: oid 10 updating version 0 to 843 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: oid 10 updating version 843 to 845 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: oid 10 updating version 845 to 846 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: oid 10 version 846 is already newer than 844 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 846 (ObjNum 644 snap 218 seq_num 644) dirty exists 2026-02-13T18:14:36.679 INFO:tasks.rados.rados.0.trial187.stdout:1934: left oid 10 (ObjNum 644 snap 218 seq_num 644) 2026-02-13T18:14:36.680 INFO:tasks.rados.rados.0.trial187.stdout:1935: expect (ObjNum 590 snap 204 seq_num 590) 2026-02-13T18:14:36.680 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:36.718 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:36.795 INFO:tasks.rados.rados.0.trial187.stdout:1937: finishing write tid 1 to trial18717860-11 2026-02-13T18:14:36.795 INFO:tasks.rados.rados.0.trial187.stdout:1937: finishing write tid 2 to trial18717860-11 2026-02-13T18:14:36.795 INFO:tasks.rados.rados.0.trial187.stdout:1937: finishing write tid 3 to trial18717860-11 2026-02-13T18:14:36.795 INFO:tasks.rados.rados.0.trial187.stdout:1937: finishing write tid 4 to trial18717860-11 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1937: oid 11 updating version 0 to 920 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1937: oid 11 updating version 920 to 921 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1937: oid 11 version 921 is already newer than 919 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 921 (ObjNum 645 snap 218 seq_num 645) dirty exists 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1937: left oid 11 (ObjNum 645 snap 218 seq_num 645) 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1931: done (7 left) 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1932: done (6 left) 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1933: done (5 left) 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1934: done (4 left) 2026-02-13T18:14:36.796 INFO:tasks.rados.rados.0.trial187.stdout:1935: done (3 left) 2026-02-13T18:14:36.797 INFO:tasks.rados.rados.0.trial187.stdout:1936: done (2 left) 2026-02-13T18:14:36.797 INFO:tasks.rados.rados.0.trial187.stdout:1937: done (1 left) 2026-02-13T18:14:36.797 INFO:tasks.rados.rados.0.trial187.stdout:1938: done (0 left) 2026-02-13T18:14:36.797 INFO:tasks.rados.rados.0.trial187.stdout:1939: write (excl) oid 29 current snap is 218 2026-02-13T18:14:36.797 INFO:tasks.rados.rados.0.trial187.stdout:1939: seq_num 647 ranges {474129=576108,1627732=587214,2718088=156041} 2026-02-13T18:14:36.802 INFO:tasks.rados.rados.0.trial187.stdout:1939: writing trial18717860-29 from 474129 to 1050237 tid 1 2026-02-13T18:14:36.810 INFO:tasks.rados.rados.0.trial187.stdout:1939: writing trial18717860-29 from 1627732 to 2214946 tid 2 2026-02-13T18:14:36.815 INFO:tasks.rados.rados.0.trial187.stdout:1939: writing trial18717860-29 from 2718088 to 2874129 tid 3 2026-02-13T18:14:36.815 INFO:tasks.rados.rados.0.trial187.stdout:1940: read oid 1 snap -1 2026-02-13T18:14:36.815 INFO:tasks.rados.rados.0.trial187.stdout:1940: expect (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:14:36.815 INFO:tasks.rados.rados.0.trial187.stdout:1941: write oid 22 current snap is 218 2026-02-13T18:14:36.815 INFO:tasks.rados.rados.0.trial187.stdout:1941: seq_num 648 ranges {490936=651357,1686214=447225,2861864=29072} 2026-02-13T18:14:36.822 INFO:tasks.rados.rados.0.trial187.stdout:1941: writing trial18717860-22 from 490936 to 1142293 tid 1 2026-02-13T18:14:36.829 INFO:tasks.rados.rados.0.trial187.stdout:1941: writing trial18717860-22 from 1686214 to 2133439 tid 2 2026-02-13T18:14:36.835 INFO:tasks.rados.rados.0.trial187.stdout:1941: writing trial18717860-22 from 2861864 to 2890936 tid 3 2026-02-13T18:14:36.835 INFO:tasks.rados.rados.0.trial187.stdout:1942: read oid 49 snap 216 2026-02-13T18:14:36.835 INFO:tasks.rados.rados.0.trial187.stdout:1942: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:36.835 INFO:tasks.rados.rados.0.trial187.stdout:1943: read oid 25 snap 209 2026-02-13T18:14:36.836 INFO:tasks.rados.rados.0.trial187.stdout:1943: expect deleted 2026-02-13T18:14:36.836 INFO:tasks.rados.rados.0.trial187.stdout:1944: write (excl) oid 40 current snap is 218 2026-02-13T18:14:36.836 INFO:tasks.rados.rados.0.trial187.stdout:1944: seq_num 649 ranges {507743=726606,1744696=590883,2772934=134809} 2026-02-13T18:14:36.842 INFO:tasks.rados.rados.0.trial187.stdout:1944: writing trial18717860-40 from 507743 to 1234349 tid 1 2026-02-13T18:14:36.846 INFO:tasks.rados.rados.0.trial187.stdout:1944: writing trial18717860-40 from 1744696 to 2335579 tid 2 2026-02-13T18:14:36.849 INFO:tasks.rados.rados.0.trial187.stdout:1944: writing trial18717860-40 from 2772934 to 2907743 tid 3 2026-02-13T18:14:36.849 INFO:tasks.rados.rados.0.trial187.stdout:1945: delete oid 13 current snap is 218 2026-02-13T18:14:36.849 INFO:tasks.rados.rados.0.trial187.stdout:1939: finishing write tid 1 to trial18717860-29 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: finishing write tid 2 to trial18717860-29 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: finishing write tid 3 to trial18717860-29 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: finishing write tid 4 to trial18717860-29 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: finishing write tid 5 to trial18717860-29 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: oid 29 updating version 0 to 883 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: oid 29 version 883 is already newer than 881 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: oid 29 version 883 is already newer than 882 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: oid 29 updating version 883 to 884 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 884 (ObjNum 647 snap 218 seq_num 647) dirty exists 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1939: left oid 29 (ObjNum 647 snap 218 seq_num 647) 2026-02-13T18:14:36.850 INFO:tasks.rados.rados.0.trial187.stdout:1940: expect (ObjNum 536 snap 168 seq_num 536) 2026-02-13T18:14:36.851 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:36.898 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 522074 2026-02-13T18:14:36.958 INFO:tasks.rados.rados.0.trial187.stdout:1941: finishing write tid 1 to trial18717860-22 2026-02-13T18:14:36.958 INFO:tasks.rados.rados.0.trial187.stdout:1941: finishing write tid 2 to trial18717860-22 2026-02-13T18:14:36.958 INFO:tasks.rados.rados.0.trial187.stdout:1941: finishing write tid 3 to trial18717860-22 2026-02-13T18:14:36.958 INFO:tasks.rados.rados.0.trial187.stdout:1941: finishing write tid 4 to trial18717860-22 2026-02-13T18:14:36.958 INFO:tasks.rados.rados.0.trial187.stdout:1941: finishing write tid 5 to trial18717860-22 2026-02-13T18:14:36.958 INFO:tasks.rados.rados.0.trial187.stdout:1941: oid 22 updating version 0 to 1098 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:1941: oid 22 updating version 1098 to 1100 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:1941: oid 22 updating version 1100 to 1101 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:1941: oid 22 version 1101 is already newer than 1099 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1101 (ObjNum 648 snap 218 seq_num 648) dirty exists 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:1941: left oid 22 (ObjNum 648 snap 218 seq_num 648) 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:1942: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:14:36.959 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:37.040 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:37.081 INFO:tasks.rados.rados.0.trial187.stdout:1944: finishing write tid 1 to trial18717860-40 2026-02-13T18:14:37.081 INFO:tasks.rados.rados.0.trial187.stdout:1944: finishing write tid 2 to trial18717860-40 2026-02-13T18:14:37.081 INFO:tasks.rados.rados.0.trial187.stdout:1944: finishing write tid 3 to trial18717860-40 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1944: finishing write tid 4 to trial18717860-40 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1939: done (6 left) 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1940: done (5 left) 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1941: done (4 left) 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1942: done (3 left) 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1943: done (2 left) 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1945: done (1 left) 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1946: rollback oid 36 current snap is 218 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 36 to 217 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1944: finishing write tid 5 to trial18717860-40 2026-02-13T18:14:37.082 INFO:tasks.rados.rados.0.trial187.stdout:1944: oid 40 updating version 0 to 845 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:1944: oid 40 version 845 is already newer than 844 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:1944: oid 40 version 845 is already newer than 843 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:1944: oid 40 updating version 845 to 846 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 846 (ObjNum 649 snap 218 seq_num 649) dirty exists 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:1944: left oid 40 (ObjNum 649 snap 218 seq_num 649) 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:1944: done (1 left) 2026-02-13T18:14:37.083 INFO:tasks.rados.rados.0.trial187.stdout:1947: snap_remove snap 215 2026-02-13T18:14:37.513 INFO:tasks.rados.rados.0.trial187.stdout:1947: done (1 left) 2026-02-13T18:14:37.513 INFO:tasks.rados.rados.0.trial187.stdout:1948: rollback oid 26 current snap is 218 2026-02-13T18:14:37.513 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 214 2026-02-13T18:14:37.513 INFO:tasks.rados.rados.0.trial187.stdout:1946: finishing rollback tid 0 to trial18717860-36 2026-02-13T18:14:37.513 INFO:tasks.rados.rados.0.trial187.stdout:1946: finishing rollback tid 1 to trial18717860-36 2026-02-13T18:14:37.514 INFO:tasks.rados.rados.0.trial187.stdout:1946: finishing rollback tid 2 to trial18717860-36 2026-02-13T18:14:37.514 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 591 (ObjNum 639 snap 215 seq_num 639) dirty exists 2026-02-13T18:14:37.514 INFO:tasks.rados.rados.0.trial187.stdout:1946: done (1 left) 2026-02-13T18:14:37.514 INFO:tasks.rados.rados.0.trial187.stdout:1949: write (excl) oid 38 current snap is 218 2026-02-13T18:14:37.514 INFO:tasks.rados.rados.0.trial187.stdout:1949: seq_num 651 ranges {541357=477104,1745307=594552} 2026-02-13T18:14:37.519 INFO:tasks.rados.rados.0.trial187.stdout:1949: writing trial18717860-38 from 541357 to 1018461 tid 1 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1949: writing trial18717860-38 from 1745307 to 2339859 tid 2 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1950: copy_from oid 34 from oid 48 current snap is 218 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1948: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1948: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1948: finishing rollback tid 2 to trial18717860-26 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 986 (ObjNum 633 snap 214 seq_num 633) dirty exists 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1949: finishing write tid 1 to trial18717860-38 2026-02-13T18:14:37.529 INFO:tasks.rados.rados.0.trial187.stdout:1948: done (2 left) 2026-02-13T18:14:37.530 INFO:tasks.rados.rados.0.trial187.stdout:1951: read oid 2 snap -1 2026-02-13T18:14:37.530 INFO:tasks.rados.rados.0.trial187.stdout:1951: expect (ObjNum 619 snap 212 seq_num 619) 2026-02-13T18:14:37.530 INFO:tasks.rados.rados.0.trial187.stdout:1952: write (excl) oid 31 current snap is 218 2026-02-13T18:14:37.530 INFO:tasks.rados.rados.0.trial187.stdout:1952: seq_num 652 ranges {558164=552353,1803789=454563,2855203=102961} 2026-02-13T18:14:37.536 INFO:tasks.rados.rados.0.trial187.stdout:1952: writing trial18717860-31 from 558164 to 1110517 tid 1 2026-02-13T18:14:37.543 INFO:tasks.rados.rados.0.trial187.stdout:1952: writing trial18717860-31 from 1803789 to 2258352 tid 2 2026-02-13T18:14:37.549 INFO:tasks.rados.rados.0.trial187.stdout:1952: writing trial18717860-31 from 2855203 to 2958164 tid 3 2026-02-13T18:14:37.549 INFO:tasks.rados.rados.0.trial187.stdout:1953: read oid 12 snap -1 2026-02-13T18:14:37.549 INFO:tasks.rados.rados.0.trial187.stdout:1953: expect deleted 2026-02-13T18:14:37.549 INFO:tasks.rados.rados.0.trial187.stdout:1954: rollback oid 19 current snap is 218 2026-02-13T18:14:37.549 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 212 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: finishing write tid 2 to trial18717860-38 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: finishing write tid 3 to trial18717860-38 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: finishing write tid 4 to trial18717860-38 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: oid 38 updating version 0 to 855 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: oid 38 updating version 855 to 856 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: oid 38 version 856 is already newer than 854 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 856 (ObjNum 651 snap 218 seq_num 651) dirty exists 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1949: left oid 38 (ObjNum 651 snap 218 seq_num 651) 2026-02-13T18:14:37.550 INFO:tasks.rados.rados.0.trial187.stdout:1951: expect (ObjNum 619 snap 212 seq_num 619) 2026-02-13T18:14:37.630 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:37.663 INFO:tasks.rados.rados.0.trial187.stdout:1950: finishing copy_from racing read to trial18717860-34 2026-02-13T18:14:37.663 INFO:tasks.rados.rados.0.trial187.stdout:1950: finishing copy_from to trial18717860-34 2026-02-13T18:14:37.663 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:14:37.663 INFO:tasks.rados.rados.0.trial187.stdout:1952: finishing write tid 1 to trial18717860-31 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: finishing write tid 2 to trial18717860-31 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: finishing write tid 3 to trial18717860-31 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: finishing write tid 4 to trial18717860-31 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: finishing write tid 5 to trial18717860-31 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: oid 31 updating version 0 to 798 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: oid 31 version 798 is already newer than 796 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: oid 31 version 798 is already newer than 797 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: oid 31 updating version 798 to 799 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 799 (ObjNum 652 snap 218 seq_num 652) dirty exists 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1952: left oid 31 (ObjNum 652 snap 218 seq_num 652) 2026-02-13T18:14:37.664 INFO:tasks.rados.rados.0.trial187.stdout:1954: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1954: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1954: finishing rollback tid 2 to trial18717860-19 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 887 (ObjNum 601 snap 209 seq_num 601) dirty exists 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1949: done (5 left) 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1950: done (4 left) 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1951: done (3 left) 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1952: done (2 left) 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1953: done (1 left) 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1954: done (0 left) 2026-02-13T18:14:37.665 INFO:tasks.rados.rados.0.trial187.stdout:1955: snap_create 2026-02-13T18:14:38.517 INFO:tasks.rados.rados.0.trial187.stdout:1955: done (0 left) 2026-02-13T18:14:38.517 INFO:tasks.rados.rados.0.trial187.stdout:1956: read oid 19 snap -1 2026-02-13T18:14:38.517 INFO:tasks.rados.rados.0.trial187.stdout:1956: expect (ObjNum 601 snap 209 seq_num 601) 2026-02-13T18:14:38.517 INFO:tasks.rados.rados.0.trial187.stdout:1957: snap_remove snap 218 2026-02-13T18:14:39.518 INFO:tasks.rados.rados.0.trial187.stdout:1957: done (1 left) 2026-02-13T18:14:39.518 INFO:tasks.rados.rados.0.trial187.stdout:1958: snap_create 2026-02-13T18:14:39.518 INFO:tasks.rados.rados.0.trial187.stdout:1956: expect (ObjNum 601 snap 209 seq_num 601) 2026-02-13T18:14:39.543 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:39.567 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:40.519 INFO:tasks.rados.rados.0.trial187.stdout:1956: done (1 left) 2026-02-13T18:14:40.520 INFO:tasks.rados.rados.0.trial187.stdout:1958: done (0 left) 2026-02-13T18:14:40.520 INFO:tasks.rados.rados.0.trial187.stdout:1959: write oid 34 current snap is 220 2026-02-13T18:14:40.520 INFO:tasks.rados.rados.0.trial187.stdout:1959: seq_num 653 ranges {574971=627602,1862271=598221} 2026-02-13T18:14:40.527 INFO:tasks.rados.rados.0.trial187.stdout:1959: writing trial18717860-34 from 574971 to 1202573 tid 1 2026-02-13T18:14:40.536 INFO:tasks.rados.rados.0.trial187.stdout:1959: writing trial18717860-34 from 1862271 to 2460492 tid 2 2026-02-13T18:14:40.536 INFO:tasks.rados.rados.0.trial187.stdout:1960: delete oid 42 current snap is 220 2026-02-13T18:14:40.536 INFO:tasks.rados.rados.0.trial187.stdout:1959: finishing write tid 1 to trial18717860-34 2026-02-13T18:14:40.538 INFO:tasks.rados.rados.0.trial187.stdout:1960: done (1 left) 2026-02-13T18:14:40.538 INFO:tasks.rados.rados.0.trial187.stdout:1961: snap_create 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: finishing write tid 2 to trial18717860-34 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: finishing write tid 3 to trial18717860-34 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: finishing write tid 4 to trial18717860-34 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: oid 34 updating version 0 to 984 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: oid 34 updating version 984 to 985 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: oid 34 version 985 is already newer than 983 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 985 (ObjNum 653 snap 220 seq_num 653) dirty exists 2026-02-13T18:14:40.539 INFO:tasks.rados.rados.0.trial187.stdout:1959: left oid 34 (ObjNum 653 snap 220 seq_num 653) 2026-02-13T18:14:41.511 INFO:tasks.rados.rados.0.trial187.stdout:1959: done (1 left) 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1961: done (0 left) 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1962: read oid 26 snap -1 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1962: expect (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1963: read oid 41 snap -1 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1963: expect (ObjNum 594 snap 204 seq_num 594) 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1964: rollback oid 11 current snap is 221 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 220 2026-02-13T18:14:41.512 INFO:tasks.rados.rados.0.trial187.stdout:1965: write (excl) oid 50 current snap is 221 2026-02-13T18:14:41.513 INFO:tasks.rados.rados.0.trial187.stdout:1965: seq_num 655 ranges {608585=494453,1579235=601890,2821119=187466} 2026-02-13T18:14:41.518 INFO:tasks.rados.rados.0.trial187.stdout:1965: writing trial18717860-50 from 608585 to 1103038 tid 1 2026-02-13T18:14:41.525 INFO:tasks.rados.rados.0.trial187.stdout:1965: writing trial18717860-50 from 1579235 to 2181125 tid 2 2026-02-13T18:14:41.531 INFO:tasks.rados.rados.0.trial187.stdout:1965: writing trial18717860-50 from 2821119 to 3008585 tid 3 2026-02-13T18:14:41.531 INFO:tasks.rados.rados.0.trial187.stdout:1966: read oid 9 snap -1 2026-02-13T18:14:41.532 INFO:tasks.rados.rados.0.trial187.stdout:1966: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:14:41.532 INFO:tasks.rados.rados.0.trial187.stdout:1967: snap_remove snap 194 2026-02-13T18:14:42.528 INFO:tasks.rados.rados.0.trial187.stdout:1967: done (5 left) 2026-02-13T18:14:42.528 INFO:tasks.rados.rados.0.trial187.stdout:1968: delete oid 19 current snap is 221 2026-02-13T18:14:42.528 INFO:tasks.rados.rados.0.trial187.stdout:1964: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:14:42.528 INFO:tasks.rados.rados.0.trial187.stdout:1962: expect (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:14:42.611 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:42.645 INFO:tasks.rados.rados.0.trial187.stdout:1964: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:14:42.645 INFO:tasks.rados.rados.0.trial187.stdout:1964: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:14:42.645 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 988 (ObjNum 645 snap 218 seq_num 645) dirty exists 2026-02-13T18:14:42.646 INFO:tasks.rados.rados.0.trial187.stdout:1963: expect (ObjNum 594 snap 204 seq_num 594) 2026-02-13T18:14:42.646 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 321624 2026-02-13T18:14:42.693 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:42.751 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1035790 2026-02-13T18:14:42.790 INFO:tasks.rados.rados.0.trial187.stdout:1965: finishing write tid 1 to trial18717860-50 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1965: finishing write tid 2 to trial18717860-50 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1965: finishing write tid 3 to trial18717860-50 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1962: done (5 left) 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1963: done (4 left) 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1964: done (3 left) 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1968: done (2 left) 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1969: write (excl) oid 32 current snap is 221 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1965: finishing write tid 4 to trial18717860-50 2026-02-13T18:14:42.791 INFO:tasks.rados.rados.0.trial187.stdout:1965: finishing write tid 5 to trial18717860-50 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:1965: oid 50 updating version 0 to 986 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:1965: oid 50 updating version 986 to 988 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:1965: oid 50 version 988 is already newer than 987 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:1965: oid 50 version 988 is already newer than 985 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 988 (ObjNum 655 snap 221 seq_num 655) dirty exists 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:1965: left oid 50 (ObjNum 655 snap 221 seq_num 655) 2026-02-13T18:14:42.792 INFO:tasks.rados.rados.0.trial187.stdout:1966: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:14:42.807 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:42.824 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:42.840 INFO:tasks.rados.rados.0.trial187.stdout:1969: seq_num 657 ranges {642199=644951,1696199=605559,2992318=49881} 2026-02-13T18:14:42.849 INFO:tasks.rados.rados.0.trial187.stdout:1969: writing trial18717860-32 from 642199 to 1287150 tid 1 2026-02-13T18:14:42.856 INFO:tasks.rados.rados.0.trial187.stdout:1969: writing trial18717860-32 from 1696199 to 2301758 tid 2 2026-02-13T18:14:42.862 INFO:tasks.rados.rados.0.trial187.stdout:1969: writing trial18717860-32 from 2992318 to 3042199 tid 3 2026-02-13T18:14:42.862 INFO:tasks.rados.rados.0.trial187.stdout:1965: done (2 left) 2026-02-13T18:14:42.862 INFO:tasks.rados.rados.0.trial187.stdout:1966: done (1 left) 2026-02-13T18:14:42.862 INFO:tasks.rados.rados.0.trial187.stdout:1970: write (excl) oid 36 current snap is 221 2026-02-13T18:14:42.862 INFO:tasks.rados.rados.0.trial187.stdout:1970: seq_num 658 ranges {659006=720200,2154681=749217} 2026-02-13T18:14:42.871 INFO:tasks.rados.rados.0.trial187.stdout:1970: writing trial18717860-36 from 659006 to 1379206 tid 1 2026-02-13T18:14:42.882 INFO:tasks.rados.rados.0.trial187.stdout:1970: writing trial18717860-36 from 2154681 to 2903898 tid 2 2026-02-13T18:14:42.882 INFO:tasks.rados.rados.0.trial187.stdout:1971: read oid 21 snap -1 2026-02-13T18:14:42.882 INFO:tasks.rados.rados.0.trial187.stdout:1971: expect (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:42.882 INFO:tasks.rados.rados.0.trial187.stdout:1972: write (excl) oid 28 current snap is 221 2026-02-13T18:14:42.882 INFO:tasks.rados.rados.0.trial187.stdout:1972: seq_num 659 ranges {675813=795449,2096810=609228} 2026-02-13T18:14:42.891 INFO:tasks.rados.rados.0.trial187.stdout:1972: writing trial18717860-28 from 675813 to 1471262 tid 1 2026-02-13T18:14:42.895 INFO:tasks.rados.rados.0.trial187.stdout:1972: writing trial18717860-28 from 2096810 to 2706038 tid 2 2026-02-13T18:14:42.895 INFO:tasks.rados.rados.0.trial187.stdout:1973: snap_remove snap 201 2026-02-13T18:14:43.533 INFO:tasks.rados.rados.0.trial187.stdout:1973: done (4 left) 2026-02-13T18:14:43.533 INFO:tasks.rados.rados.0.trial187.stdout:1974: write oid 15 current snap is 221 2026-02-13T18:14:43.533 INFO:tasks.rados.rados.0.trial187.stdout:1974: seq_num 660 ranges {692620=470698,1755292=752886} 2026-02-13T18:14:43.537 INFO:tasks.rados.rados.0.trial187.stdout:1974: writing trial18717860-15 from 692620 to 1163318 tid 1 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1974: writing trial18717860-15 from 1755292 to 2508178 tid 2 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1975: delete oid 38 current snap is 221 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1969: finishing write tid 1 to trial18717860-32 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1969: finishing write tid 2 to trial18717860-32 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1969: finishing write tid 3 to trial18717860-32 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1969: finishing write tid 4 to trial18717860-32 2026-02-13T18:14:43.543 INFO:tasks.rados.rados.0.trial187.stdout:1969: finishing write tid 5 to trial18717860-32 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1969: oid 32 updating version 0 to 797 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1969: oid 32 updating version 797 to 798 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1969: oid 32 updating version 798 to 799 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1969: oid 32 version 799 is already newer than 796 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 799 (ObjNum 657 snap 221 seq_num 657) dirty exists 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1969: left oid 32 (ObjNum 657 snap 221 seq_num 657) 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1970: finishing write tid 1 to trial18717860-36 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1970: finishing write tid 2 to trial18717860-36 2026-02-13T18:14:43.544 INFO:tasks.rados.rados.0.trial187.stdout:1971: expect (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:43.576 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:43.616 INFO:tasks.rados.rados.0.trial187.stdout:1970: finishing write tid 3 to trial18717860-36 2026-02-13T18:14:43.616 INFO:tasks.rados.rados.0.trial187.stdout:1970: finishing write tid 4 to trial18717860-36 2026-02-13T18:14:43.616 INFO:tasks.rados.rados.0.trial187.stdout:1970: oid 36 updating version 0 to 599 2026-02-13T18:14:43.616 INFO:tasks.rados.rados.0.trial187.stdout:1970: oid 36 updating version 599 to 600 2026-02-13T18:14:43.616 INFO:tasks.rados.rados.0.trial187.stdout:1970: oid 36 updating version 600 to 601 2026-02-13T18:14:43.616 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 601 (ObjNum 658 snap 221 seq_num 658) dirty exists 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1970: left oid 36 (ObjNum 658 snap 221 seq_num 658) 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: finishing write tid 1 to trial18717860-28 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: finishing write tid 2 to trial18717860-28 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: finishing write tid 3 to trial18717860-28 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: finishing write tid 4 to trial18717860-28 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: oid 28 updating version 0 to 795 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: oid 28 version 795 is already newer than 793 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: oid 28 version 795 is already newer than 794 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 795 (ObjNum 659 snap 221 seq_num 659) dirty exists 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1972: left oid 28 (ObjNum 659 snap 221 seq_num 659) 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1974: finishing write tid 1 to trial18717860-15 2026-02-13T18:14:43.617 INFO:tasks.rados.rados.0.trial187.stdout:1974: finishing write tid 2 to trial18717860-15 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: finishing write tid 3 to trial18717860-15 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: finishing write tid 4 to trial18717860-15 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: oid 15 updating version 0 to 890 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: oid 15 version 890 is already newer than 889 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: oid 15 updating version 890 to 891 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 891 (ObjNum 660 snap 221 seq_num 660) dirty exists 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: left oid 15 (ObjNum 660 snap 221 seq_num 660) 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1969: done (5 left) 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1970: done (4 left) 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1971: done (3 left) 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1972: done (2 left) 2026-02-13T18:14:43.618 INFO:tasks.rados.rados.0.trial187.stdout:1974: done (1 left) 2026-02-13T18:14:43.619 INFO:tasks.rados.rados.0.trial187.stdout:1975: done (0 left) 2026-02-13T18:14:43.619 INFO:tasks.rados.rados.0.trial187.stdout:1976: rollback oid 50 current snap is 221 2026-02-13T18:14:43.619 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 219 2026-02-13T18:14:43.619 INFO:tasks.rados.rados.0.trial187.stdout:1977: write (excl) oid 27 current snap is 221 2026-02-13T18:14:43.619 INFO:tasks.rados.rados.0.trial187.stdout:1977: seq_num 662 ranges {726234=737549,1988609=756555} 2026-02-13T18:14:43.625 INFO:tasks.rados.rados.0.trial187.stdout:1977: writing trial18717860-27 from 726234 to 1463783 tid 1 2026-02-13T18:14:43.634 INFO:tasks.rados.rados.0.trial187.stdout:1977: writing trial18717860-27 from 1988609 to 2745164 tid 2 2026-02-13T18:14:43.634 INFO:tasks.rados.rados.0.trial187.stdout:1978: delete oid 36 current snap is 221 2026-02-13T18:14:43.634 INFO:tasks.rados.rados.0.trial187.stdout:1976: finishing rollback tid 0 to trial18717860-50 2026-02-13T18:14:43.634 INFO:tasks.rados.rados.0.trial187.stdout:1976: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:14:43.635 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 990 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:14:43.635 INFO:tasks.rados.rados.0.trial187.stdout:1977: finishing write tid 1 to trial18717860-27 2026-02-13T18:14:43.635 INFO:tasks.rados.rados.0.trial187.stdout:1976: done (2 left) 2026-02-13T18:14:43.636 INFO:tasks.rados.rados.0.trial187.stdout:1978: done (1 left) 2026-02-13T18:14:43.636 INFO:tasks.rados.rados.0.trial187.stdout:1979: read oid 30 snap -1 2026-02-13T18:14:43.636 INFO:tasks.rados.rados.0.trial187.stdout:1979: expect (ObjNum 635 snap 214 seq_num 635) 2026-02-13T18:14:43.636 INFO:tasks.rados.rados.0.trial187.stdout:1980: delete oid 1 current snap is 221 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: finishing write tid 2 to trial18717860-27 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: finishing write tid 3 to trial18717860-27 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: finishing write tid 4 to trial18717860-27 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: oid 27 updating version 0 to 619 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: oid 27 updating version 619 to 620 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: oid 27 updating version 620 to 621 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 621 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:14:43.637 INFO:tasks.rados.rados.0.trial187.stdout:1977: left oid 27 (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:14:43.638 INFO:tasks.rados.rados.0.trial187.stdout:1977: done (2 left) 2026-02-13T18:14:43.638 INFO:tasks.rados.rados.0.trial187.stdout:1980: done (1 left) 2026-02-13T18:14:43.638 INFO:tasks.rados.rados.0.trial187.stdout:1981: write (excl) oid 50 current snap is 221 2026-02-13T18:14:43.638 INFO:tasks.rados.rados.0.trial187.stdout:1981: seq_num 665 ranges {776655=563296,2047702=620235,3095349=81306} 2026-02-13T18:14:43.646 INFO:tasks.rados.rados.0.trial187.stdout:1981: writing trial18717860-50 from 776655 to 1339951 tid 1 2026-02-13T18:14:43.655 INFO:tasks.rados.rados.0.trial187.stdout:1981: writing trial18717860-50 from 2047702 to 2667937 tid 2 2026-02-13T18:14:43.659 INFO:tasks.rados.rados.0.trial187.stdout:1981: writing trial18717860-50 from 3095349 to 3176655 tid 3 2026-02-13T18:14:43.659 INFO:tasks.rados.rados.0.trial187.stdout:1982: delete oid 45 current snap is 221 2026-02-13T18:14:43.659 INFO:tasks.rados.rados.0.trial187.stdout:1979: expect (ObjNum 635 snap 214 seq_num 635) 2026-02-13T18:14:43.685 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1838479 2026-02-13T18:14:43.718 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1987885 2026-02-13T18:14:43.729 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 535130 2026-02-13T18:14:43.759 INFO:tasks.rados.rados.0.trial187.stdout:1981: finishing write tid 1 to trial18717860-50 2026-02-13T18:14:43.759 INFO:tasks.rados.rados.0.trial187.stdout:1981: finishing write tid 2 to trial18717860-50 2026-02-13T18:14:43.759 INFO:tasks.rados.rados.0.trial187.stdout:1981: finishing write tid 3 to trial18717860-50 2026-02-13T18:14:43.759 INFO:tasks.rados.rados.0.trial187.stdout:1981: finishing write tid 4 to trial18717860-50 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: finishing write tid 5 to trial18717860-50 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: oid 50 updating version 0 to 992 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: oid 50 version 992 is already newer than 991 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: oid 50 updating version 992 to 993 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: oid 50 updating version 993 to 994 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 994 (ObjNum 665 snap 221 seq_num 665) dirty exists 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: left oid 50 (ObjNum 665 snap 221 seq_num 665) 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1979: done (2 left) 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1981: done (1 left) 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1982: done (0 left) 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1983: read oid 35 snap 217 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1983: expect deleted 2026-02-13T18:14:43.760 INFO:tasks.rados.rados.0.trial187.stdout:1984: snap_create 2026-02-13T18:14:44.538 INFO:tasks.rados.rados.0.trial187.stdout:1983: done (1 left) 2026-02-13T18:14:44.538 INFO:tasks.rados.rados.0.trial187.stdout:1984: done (0 left) 2026-02-13T18:14:44.538 INFO:tasks.rados.rados.0.trial187.stdout:1985: snap_remove snap 178 2026-02-13T18:14:45.539 INFO:tasks.rados.rados.0.trial187.stdout:1985: done (0 left) 2026-02-13T18:14:45.539 INFO:tasks.rados.rados.0.trial187.stdout:1986: write oid 13 current snap is 222 2026-02-13T18:14:45.539 INFO:tasks.rados.rados.0.trial187.stdout:1986: seq_num 667 ranges {410269=713794,1648313=507551,2917489=292780} 2026-02-13T18:14:45.546 INFO:tasks.rados.rados.0.trial187.stdout:1986: writing trial18717860-13 from 410269 to 1124063 tid 1 2026-02-13T18:14:45.553 INFO:tasks.rados.rados.0.trial187.stdout:1986: writing trial18717860-13 from 1648313 to 2155864 tid 2 2026-02-13T18:14:45.561 INFO:tasks.rados.rados.0.trial187.stdout:1986: writing trial18717860-13 from 2917489 to 3210269 tid 3 2026-02-13T18:14:45.561 INFO:tasks.rados.rados.0.trial187.stdout:1987: write (excl) oid 30 current snap is 222 2026-02-13T18:14:45.561 INFO:tasks.rados.rados.0.trial187.stdout:1987: seq_num 668 ranges {427076=789043,1706795=767562,2944912=282164} 2026-02-13T18:14:45.569 INFO:tasks.rados.rados.0.trial187.stdout:1987: writing trial18717860-30 from 427076 to 1216119 tid 1 2026-02-13T18:14:45.578 INFO:tasks.rados.rados.0.trial187.stdout:1987: writing trial18717860-30 from 1706795 to 2474357 tid 2 2026-02-13T18:14:45.584 INFO:tasks.rados.rados.0.trial187.stdout:1987: writing trial18717860-30 from 2944912 to 3227076 tid 3 2026-02-13T18:14:45.584 INFO:tasks.rados.rados.0.trial187.stdout:1988: rollback oid 49 current snap is 222 2026-02-13T18:14:45.584 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 205 2026-02-13T18:14:45.584 INFO:tasks.rados.rados.0.trial187.stdout:1986: finishing write tid 1 to trial18717860-13 2026-02-13T18:14:45.584 INFO:tasks.rados.rados.0.trial187.stdout:1986: finishing write tid 2 to trial18717860-13 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: finishing write tid 3 to trial18717860-13 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: finishing write tid 4 to trial18717860-13 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: finishing write tid 5 to trial18717860-13 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: oid 13 updating version 0 to 620 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: oid 13 version 620 is already newer than 618 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: oid 13 version 620 is already newer than 619 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: oid 13 updating version 620 to 621 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 621 (ObjNum 667 snap 222 seq_num 667) dirty exists 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1986: left oid 13 (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:14:45.585 INFO:tasks.rados.rados.0.trial187.stdout:1987: finishing write tid 1 to trial18717860-30 2026-02-13T18:14:45.586 INFO:tasks.rados.rados.0.trial187.stdout:1987: finishing write tid 2 to trial18717860-30 2026-02-13T18:14:45.586 INFO:tasks.rados.rados.0.trial187.stdout:1986: done (2 left) 2026-02-13T18:14:45.586 INFO:tasks.rados.rados.0.trial187.stdout:1989: snap_create 2026-02-13T18:14:45.587 INFO:tasks.rados.rados.0.trial187.stdout:1987: finishing write tid 3 to trial18717860-30 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1987: finishing write tid 4 to trial18717860-30 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1988: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1988: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1987: finishing write tid 5 to trial18717860-30 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1987: oid 30 updating version 0 to 801 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1987: oid 30 version 801 is already newer than 800 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1987: oid 30 updating version 801 to 802 2026-02-13T18:14:45.588 INFO:tasks.rados.rados.0.trial187.stdout:1987: oid 30 updating version 802 to 803 2026-02-13T18:14:45.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 803 (ObjNum 668 snap 222 seq_num 668) dirty exists 2026-02-13T18:14:45.589 INFO:tasks.rados.rados.0.trial187.stdout:1987: left oid 30 (ObjNum 668 snap 222 seq_num 668) 2026-02-13T18:14:45.589 INFO:tasks.rados.rados.0.trial187.stdout:1988: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:14:45.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 991 (ObjNum 563 snap 189 seq_num 563) dirty exists 2026-02-13T18:14:46.512 INFO:tasks.rados.rados.0.trial187.stdout:1987: done (2 left) 2026-02-13T18:14:46.513 INFO:tasks.rados.rados.0.trial187.stdout:1988: done (1 left) 2026-02-13T18:14:46.513 INFO:tasks.rados.rados.0.trial187.stdout:1989: done (0 left) 2026-02-13T18:14:46.513 INFO:tasks.rados.rados.0.trial187.stdout:1990: rollback oid 3 current snap is 223 2026-02-13T18:14:46.513 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 219 2026-02-13T18:14:46.513 INFO:tasks.rados.rados.0.trial187.stdout:1991: snap_create 2026-02-13T18:14:46.514 INFO:tasks.rados.rados.0.trial187.stdout:1990: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:14:46.514 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 983 (ObjNum 49 snap 0 seq_num 2975096272) dirty dne 2026-02-13T18:14:47.513 INFO:tasks.rados.rados.0.trial187.stdout:1990: done (1 left) 2026-02-13T18:14:47.513 INFO:tasks.rados.rados.0.trial187.stdout:1991: done (0 left) 2026-02-13T18:14:47.514 INFO:tasks.rados.rados.0.trial187.stdout:1992: snap_create 2026-02-13T18:14:48.515 INFO:tasks.rados.rados.0.trial187.stdout:1992: done (0 left) 2026-02-13T18:14:48.516 INFO:tasks.rados.rados.0.trial187.stdout:1993: read oid 23 snap -1 2026-02-13T18:14:48.516 INFO:tasks.rados.rados.0.trial187.stdout:1993: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:14:48.516 INFO:tasks.rados.rados.0.trial187.stdout:1994: read oid 30 snap 220 2026-02-13T18:14:48.516 INFO:tasks.rados.rados.0.trial187.stdout:1994: expect (ObjNum 635 snap 214 seq_num 635) 2026-02-13T18:14:48.516 INFO:tasks.rados.rados.0.trial187.stdout:1995: snap_create 2026-02-13T18:14:48.519 INFO:tasks.rados.rados.0.trial187.stdout:1994: expect (ObjNum 635 snap 214 seq_num 635) 2026-02-13T18:14:48.616 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1506490 2026-02-13T18:14:48.635 INFO:tasks.rados.rados.0.trial187.stdout:1993: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:14:48.635 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:48.686 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:49.516 INFO:tasks.rados.rados.0.trial187.stdout:1993: done (2 left) 2026-02-13T18:14:49.516 INFO:tasks.rados.rados.0.trial187.stdout:1994: done (1 left) 2026-02-13T18:14:49.517 INFO:tasks.rados.rados.0.trial187.stdout:1995: done (0 left) 2026-02-13T18:14:49.517 INFO:tasks.rados.rados.0.trial187.stdout:1996: snap_remove snap 214 2026-02-13T18:14:50.518 INFO:tasks.rados.rados.0.trial187.stdout:1996: done (0 left) 2026-02-13T18:14:50.518 INFO:tasks.rados.rados.0.trial187.stdout:1997: read oid 5 snap -1 2026-02-13T18:14:50.518 INFO:tasks.rados.rados.0.trial187.stdout:1997: expect (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:14:50.518 INFO:tasks.rados.rados.0.trial187.stdout:1998: rollback oid 7 current snap is 226 2026-02-13T18:14:50.519 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 212 2026-02-13T18:14:50.519 INFO:tasks.rados.rados.0.trial187.stdout:1999: copy_from oid 2 from oid 4 current snap is 226 2026-02-13T18:14:50.519 INFO:tasks.rados.rados.0.trial187.stdout:2000: copy_from oid 46 from oid 45 current snap is 226 2026-02-13T18:14:50.519 INFO:tasks.rados.rados.0.trial187.stdout:2001: snap_remove snap 224 2026-02-13T18:14:51.513 INFO:tasks.rados.rados.0.trial187.stdout:2001: done (4 left) 2026-02-13T18:14:51.514 INFO:tasks.rados.rados.0.trial187.stdout:2002: snap_create 2026-02-13T18:14:51.514 INFO:tasks.rados.rados.0.trial187.stdout:1998: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:14:51.514 INFO:tasks.rados.rados.0.trial187.stdout:1998: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:14:51.514 INFO:tasks.rados.rados.0.trial187.stdout:1998: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:14:51.514 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 908 (ObjNum 595 snap 205 seq_num 595) dirty exists 2026-02-13T18:14:51.514 INFO:tasks.rados.rados.0.trial187.stdout:1997: expect (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:14:51.560 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1123991 2026-02-13T18:14:51.573 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:51.594 INFO:tasks.rados.rados.0.trial187.stdout:2000: finishing copy_from to trial18717860-46 2026-02-13T18:14:51.594 INFO:tasks.rados.rados.0.trial187.stdout:2000: got expected ENOENT (src dne) 2026-02-13T18:14:51.594 INFO:tasks.rados.rados.0.trial187.stdout:1999: finishing copy_from racing read to trial18717860-2 2026-02-13T18:14:51.594 INFO:tasks.rados.rados.0.trial187.stdout:2000: finishing copy_from racing read to trial18717860-46 2026-02-13T18:14:51.595 INFO:tasks.rados.rados.0.trial187.stdout:1999: finishing copy_from to trial18717860-2 2026-02-13T18:14:51.595 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 430 (ObjNum 593 snap 204 seq_num 593) dirty exists 2026-02-13T18:14:52.515 INFO:tasks.rados.rados.0.trial187.stdout:1997: done (4 left) 2026-02-13T18:14:52.515 INFO:tasks.rados.rados.0.trial187.stdout:1998: done (3 left) 2026-02-13T18:14:52.515 INFO:tasks.rados.rados.0.trial187.stdout:1999: done (2 left) 2026-02-13T18:14:52.515 INFO:tasks.rados.rados.0.trial187.stdout:2000: done (1 left) 2026-02-13T18:14:52.515 INFO:tasks.rados.rados.0.trial187.stdout:2002: done (0 left) 2026-02-13T18:14:52.516 INFO:tasks.rados.rados.0.trial187.stdout:2003: read oid 21 snap -1 2026-02-13T18:14:52.516 INFO:tasks.rados.rados.0.trial187.stdout:2003: expect (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:52.516 INFO:tasks.rados.rados.0.trial187.stdout:2004: delete oid 28 current snap is 227 2026-02-13T18:14:52.519 INFO:tasks.rados.rados.0.trial187.stdout:2004: done (1 left) 2026-02-13T18:14:52.519 INFO:tasks.rados.rados.0.trial187.stdout:2005: snap_create 2026-02-13T18:14:52.519 INFO:tasks.rados.rados.0.trial187.stdout:2003: expect (ObjNum 628 snap 214 seq_num 628) 2026-02-13T18:14:52.539 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1305994 2026-02-13T18:14:52.550 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1894227 2026-02-13T18:14:53.516 INFO:tasks.rados.rados.0.trial187.stdout:2003: done (1 left) 2026-02-13T18:14:53.516 INFO:tasks.rados.rados.0.trial187.stdout:2005: done (0 left) 2026-02-13T18:14:53.516 INFO:tasks.rados.rados.0.trial187.stdout:2006: write (excl) oid 4 current snap is 228 2026-02-13T18:14:53.516 INFO:tasks.rados.rados.0.trial187.stdout:2006: seq_num 670 ranges {460690=655894,1540112=771231,2716111=539778} 2026-02-13T18:14:53.523 INFO:tasks.rados.rados.0.trial187.stdout:2006: writing trial18717860-4 from 460690 to 1116584 tid 1 2026-02-13T18:14:53.531 INFO:tasks.rados.rados.0.trial187.stdout:2006: writing trial18717860-4 from 1540112 to 2311343 tid 2 2026-02-13T18:14:53.538 INFO:tasks.rados.rados.0.trial187.stdout:2006: writing trial18717860-4 from 2716111 to 3255889 tid 3 2026-02-13T18:14:53.538 INFO:tasks.rados.rados.0.trial187.stdout:2007: read oid 39 snap 225 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2007: expect deleted 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2008: copy_from oid 34 from oid 38 current snap is 228 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2006: finishing write tid 1 to trial18717860-4 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2006: finishing write tid 2 to trial18717860-4 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2009: rollback oid 14 current snap is 228 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 222 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2010: write (excl) oid 24 current snap is 228 2026-02-13T18:14:53.539 INFO:tasks.rados.rados.0.trial187.stdout:2010: seq_num 671 ranges {477497=731143,1998594=514889,3143534=133963} 2026-02-13T18:14:53.546 INFO:tasks.rados.rados.0.trial187.stdout:2010: writing trial18717860-24 from 477497 to 1208640 tid 1 2026-02-13T18:14:53.555 INFO:tasks.rados.rados.0.trial187.stdout:2010: writing trial18717860-24 from 1998594 to 2513483 tid 2 2026-02-13T18:14:53.561 INFO:tasks.rados.rados.0.trial187.stdout:2010: writing trial18717860-24 from 3143534 to 3277497 tid 3 2026-02-13T18:14:53.561 INFO:tasks.rados.rados.0.trial187.stdout:2011: copy_from oid 42 from oid 48 current snap is 228 2026-02-13T18:14:53.561 INFO:tasks.rados.rados.0.trial187.stdout:2008: finishing copy_from to trial18717860-34 2026-02-13T18:14:53.561 INFO:tasks.rados.rados.0.trial187.stdout:2008: got expected ENOENT (src dne) 2026-02-13T18:14:53.561 INFO:tasks.rados.rados.0.trial187.stdout:2008: finishing copy_from racing read to trial18717860-34 2026-02-13T18:14:53.561 INFO:tasks.rados.rados.0.trial187.stdout:2006: finishing write tid 3 to trial18717860-4 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: finishing write tid 4 to trial18717860-4 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: finishing write tid 5 to trial18717860-4 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: oid 4 updating version 0 to 801 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: oid 4 updating version 801 to 802 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: oid 4 version 802 is already newer than 800 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: oid 4 updating version 802 to 803 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 803 (ObjNum 670 snap 228 seq_num 670) dirty exists 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2006: left oid 4 (ObjNum 670 snap 228 seq_num 670) 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2009: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2009: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:2009: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:14:53.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 618 (ObjNum 561 snap 189 seq_num 561) dirty exists 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2010: finishing write tid 1 to trial18717860-24 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2010: finishing write tid 2 to trial18717860-24 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2006: done (5 left) 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2007: done (4 left) 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2008: done (3 left) 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2009: done (2 left) 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2012: copy_from oid 44 from oid 28 current snap is 228 2026-02-13T18:14:53.563 INFO:tasks.rados.rados.0.trial187.stdout:2013: delete oid 40 current snap is 228 2026-02-13T18:14:53.564 INFO:tasks.rados.rados.0.trial187.stdout:2010: finishing write tid 3 to trial18717860-24 2026-02-13T18:14:53.564 INFO:tasks.rados.rados.0.trial187.stdout:2010: finishing write tid 4 to trial18717860-24 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: finishing write tid 5 to trial18717860-24 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: oid 24 updating version 0 to 798 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: oid 24 updating version 798 to 800 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: oid 24 version 800 is already newer than 799 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: oid 24 version 800 is already newer than 797 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 800 (ObjNum 671 snap 228 seq_num 671) dirty exists 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: left oid 24 (ObjNum 671 snap 228 seq_num 671) 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2010: done (3 left) 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2013: done (2 left) 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2014: read oid 5 snap -1 2026-02-13T18:14:53.565 INFO:tasks.rados.rados.0.trial187.stdout:2014: expect (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:14:53.566 INFO:tasks.rados.rados.0.trial187.stdout:2015: snap_create 2026-02-13T18:14:53.566 INFO:tasks.rados.rados.0.trial187.stdout:2014: expect (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:14:53.636 INFO:tasks.rados.rados.0.trial187.stdout:2012: finishing copy_from to trial18717860-44 2026-02-13T18:14:53.636 INFO:tasks.rados.rados.0.trial187.stdout:2012: got expected ENOENT (src dne) 2026-02-13T18:14:53.636 INFO:tasks.rados.rados.0.trial187.stdout:2011: finishing copy_from racing read to trial18717860-42 2026-02-13T18:14:53.636 INFO:tasks.rados.rados.0.trial187.stdout:2012: finishing copy_from racing read to trial18717860-44 2026-02-13T18:14:53.636 INFO:tasks.rados.rados.0.trial187.stdout:2011: finishing copy_from to trial18717860-42 2026-02-13T18:14:53.637 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:14:54.521 INFO:tasks.rados.rados.0.trial187.stdout:2011: done (3 left) 2026-02-13T18:14:54.521 INFO:tasks.rados.rados.0.trial187.stdout:2012: done (2 left) 2026-02-13T18:14:54.521 INFO:tasks.rados.rados.0.trial187.stdout:2014: done (1 left) 2026-02-13T18:14:54.521 INFO:tasks.rados.rados.0.trial187.stdout:2015: done (0 left) 2026-02-13T18:14:54.521 INFO:tasks.rados.rados.0.trial187.stdout:2016: copy_from oid 17 from oid 49 current snap is 229 2026-02-13T18:14:54.521 INFO:tasks.rados.rados.0.trial187.stdout:2017: snap_create 2026-02-13T18:14:54.534 INFO:tasks.rados.rados.0.trial187.stdout:2016: finishing copy_from racing read to trial18717860-17 2026-02-13T18:14:54.534 INFO:tasks.rados.rados.0.trial187.stdout:2016: finishing copy_from to trial18717860-17 2026-02-13T18:14:54.534 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 991 (ObjNum 563 snap 189 seq_num 563) dirty exists 2026-02-13T18:14:55.522 INFO:tasks.rados.rados.0.trial187.stdout:2016: done (1 left) 2026-02-13T18:14:55.522 INFO:tasks.rados.rados.0.trial187.stdout:2017: done (0 left) 2026-02-13T18:14:55.522 INFO:tasks.rados.rados.0.trial187.stdout:2018: snap_create 2026-02-13T18:14:56.515 INFO:tasks.rados.rados.0.trial187.stdout:2018: done (0 left) 2026-02-13T18:14:56.515 INFO:tasks.rados.rados.0.trial187.stdout:2019: read oid 47 snap 220 2026-02-13T18:14:56.515 INFO:tasks.rados.rados.0.trial187.stdout:2019: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:14:56.515 INFO:tasks.rados.rados.0.trial187.stdout:2020: rollback oid 18 current snap is 231 2026-02-13T18:14:56.515 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 226 2026-02-13T18:14:56.515 INFO:tasks.rados.rados.0.trial187.stdout:2021: snap_remove snap 217 2026-02-13T18:14:57.516 INFO:tasks.rados.rados.0.trial187.stdout:2021: done (2 left) 2026-02-13T18:14:57.516 INFO:tasks.rados.rados.0.trial187.stdout:2022: snap_create 2026-02-13T18:14:57.516 INFO:tasks.rados.rados.0.trial187.stdout:2019: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:14:57.696 INFO:tasks.rados.rados.0.trial187.stdout:2020: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:14:57.696 INFO:tasks.rados.rados.0.trial187.stdout:2020: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:14:57.696 INFO:tasks.rados.rados.0.trial187.stdout:2020: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:14:57.696 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 631 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:14:58.517 INFO:tasks.rados.rados.0.trial187.stdout:2019: done (2 left) 2026-02-13T18:14:58.517 INFO:tasks.rados.rados.0.trial187.stdout:2020: done (1 left) 2026-02-13T18:14:58.518 INFO:tasks.rados.rados.0.trial187.stdout:2022: done (0 left) 2026-02-13T18:14:58.518 INFO:tasks.rados.rados.0.trial187.stdout:2023: copy_from oid 43 from oid 27 current snap is 232 2026-02-13T18:14:58.518 INFO:tasks.rados.rados.0.trial187.stdout:2024: read oid 48 snap -1 2026-02-13T18:14:58.518 INFO:tasks.rados.rados.0.trial187.stdout:2024: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:14:58.518 INFO:tasks.rados.rados.0.trial187.stdout:2025: snap_remove snap 220 2026-02-13T18:14:59.518 INFO:tasks.rados.rados.0.trial187.stdout:2025: done (2 left) 2026-02-13T18:14:59.518 INFO:tasks.rados.rados.0.trial187.stdout:2026: read oid 18 snap 209 2026-02-13T18:14:59.519 INFO:tasks.rados.rados.0.trial187.stdout:2026: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:14:59.519 INFO:tasks.rados.rados.0.trial187.stdout:2027: rollback oid 47 current snap is 232 2026-02-13T18:14:59.519 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 221 2026-02-13T18:14:59.519 INFO:tasks.rados.rados.0.trial187.stdout:2024: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:14:59.545 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:14:59.562 INFO:tasks.rados.rados.0.trial187.stdout:2023: finishing copy_from racing read to trial18717860-43 2026-02-13T18:14:59.562 INFO:tasks.rados.rados.0.trial187.stdout:2023: finishing copy_from to trial18717860-43 2026-02-13T18:14:59.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 621 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:14:59.563 INFO:tasks.rados.rados.0.trial187.stdout:2027: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:14:59.563 INFO:tasks.rados.rados.0.trial187.stdout:2027: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:14:59.563 INFO:tasks.rados.rados.0.trial187.stdout:2023: done (3 left) 2026-02-13T18:14:59.563 INFO:tasks.rados.rados.0.trial187.stdout:2024: done (2 left) 2026-02-13T18:14:59.563 INFO:tasks.rados.rados.0.trial187.stdout:2028: snap_remove snap 230 2026-02-13T18:15:00.524 INFO:tasks.rados.rados.0.trial187.stdout:2028: done (2 left) 2026-02-13T18:15:00.524 INFO:tasks.rados.rados.0.trial187.stdout:2029: delete oid 50 current snap is 232 2026-02-13T18:15:00.524 INFO:tasks.rados.rados.0.trial187.stdout:2027: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:15:00.524 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:15:00.525 INFO:tasks.rados.rados.0.trial187.stdout:2026: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:15:00.525 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:00.620 INFO:tasks.rados.rados.0.trial187.stdout:2026: done (2 left) 2026-02-13T18:15:00.620 INFO:tasks.rados.rados.0.trial187.stdout:2027: done (1 left) 2026-02-13T18:15:00.620 INFO:tasks.rados.rados.0.trial187.stdout:2029: done (0 left) 2026-02-13T18:15:00.620 INFO:tasks.rados.rados.0.trial187.stdout:2030: rollback oid 20 current snap is 232 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 228 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:2031: read oid 36 snap 216 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:2031: expect (ObjNum 639 snap 215 seq_num 639) 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:2032: read oid 39 snap -1 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:2032: expect deleted 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:2033: write oid 37 current snap is 232 2026-02-13T18:15:00.621 INFO:tasks.rados.rados.0.trial187.stdout:2033: seq_num 674 ranges {527918=556890,1657687=778569,3225803=102115} 2026-02-13T18:15:00.627 INFO:tasks.rados.rados.0.trial187.stdout:2033: writing trial18717860-37 from 527918 to 1084808 tid 1 2026-02-13T18:15:00.637 INFO:tasks.rados.rados.0.trial187.stdout:2033: writing trial18717860-37 from 1657687 to 2436256 tid 2 2026-02-13T18:15:00.643 INFO:tasks.rados.rados.0.trial187.stdout:2033: writing trial18717860-37 from 3225803 to 3327918 tid 3 2026-02-13T18:15:00.643 INFO:tasks.rados.rados.0.trial187.stdout:2034: delete oid 24 current snap is 232 2026-02-13T18:15:00.644 INFO:tasks.rados.rados.0.trial187.stdout:2030: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:15:00.644 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:15:00.644 INFO:tasks.rados.rados.0.trial187.stdout:2031: expect (ObjNum 639 snap 215 seq_num 639) 2026-02-13T18:15:00.729 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2174877 2026-02-13T18:15:00.732 INFO:tasks.rados.rados.0.trial187.stdout:2033: finishing write tid 1 to trial18717860-37 2026-02-13T18:15:00.732 INFO:tasks.rados.rados.0.trial187.stdout:2033: finishing write tid 2 to trial18717860-37 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: finishing write tid 3 to trial18717860-37 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: finishing write tid 4 to trial18717860-37 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: finishing write tid 5 to trial18717860-37 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: oid 37 updating version 0 to 1151 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: oid 37 updating version 1151 to 1153 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: oid 37 updating version 1153 to 1154 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: oid 37 version 1154 is already newer than 1152 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1154 (ObjNum 674 snap 232 seq_num 674) dirty exists 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2033: left oid 37 (ObjNum 674 snap 232 seq_num 674) 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2030: done (4 left) 2026-02-13T18:15:00.733 INFO:tasks.rados.rados.0.trial187.stdout:2031: done (3 left) 2026-02-13T18:15:00.734 INFO:tasks.rados.rados.0.trial187.stdout:2032: done (2 left) 2026-02-13T18:15:00.734 INFO:tasks.rados.rados.0.trial187.stdout:2033: done (1 left) 2026-02-13T18:15:00.734 INFO:tasks.rados.rados.0.trial187.stdout:2034: done (0 left) 2026-02-13T18:15:00.734 INFO:tasks.rados.rados.0.trial187.stdout:2035: snap_create 2026-02-13T18:15:01.527 INFO:tasks.rados.rados.0.trial187.stdout:2035: done (0 left) 2026-02-13T18:15:01.527 INFO:tasks.rados.rados.0.trial187.stdout:2036: read oid 16 snap -1 2026-02-13T18:15:01.527 INFO:tasks.rados.rados.0.trial187.stdout:2036: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:15:01.527 INFO:tasks.rados.rados.0.trial187.stdout:2037: read oid 45 snap -1 2026-02-13T18:15:01.527 INFO:tasks.rados.rados.0.trial187.stdout:2037: expect deleted 2026-02-13T18:15:01.528 INFO:tasks.rados.rados.0.trial187.stdout:2038: write oid 38 current snap is 233 2026-02-13T18:15:01.528 INFO:tasks.rados.rados.0.trial187.stdout:2038: seq_num 676 ranges {561532=707388,2058298=782238} 2026-02-13T18:15:01.535 INFO:tasks.rados.rados.0.trial187.stdout:2038: writing trial18717860-38 from 561532 to 1268920 tid 1 2026-02-13T18:15:01.546 INFO:tasks.rados.rados.0.trial187.stdout:2038: writing trial18717860-38 from 2058298 to 2840536 tid 2 2026-02-13T18:15:01.546 INFO:tasks.rados.rados.0.trial187.stdout:2039: snap_remove snap 210 2026-02-13T18:15:02.530 INFO:tasks.rados.rados.0.trial187.stdout:2039: done (3 left) 2026-02-13T18:15:02.530 INFO:tasks.rados.rados.0.trial187.stdout:2040: snap_create 2026-02-13T18:15:02.530 INFO:tasks.rados.rados.0.trial187.stdout:2036: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:15:02.531 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:02.557 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:02.582 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:02.599 INFO:tasks.rados.rados.0.trial187.stdout:2038: finishing write tid 1 to trial18717860-38 2026-02-13T18:15:02.599 INFO:tasks.rados.rados.0.trial187.stdout:2038: finishing write tid 2 to trial18717860-38 2026-02-13T18:15:02.599 INFO:tasks.rados.rados.0.trial187.stdout:2038: finishing write tid 3 to trial18717860-38 2026-02-13T18:15:02.599 INFO:tasks.rados.rados.0.trial187.stdout:2038: finishing write tid 4 to trial18717860-38 2026-02-13T18:15:02.599 INFO:tasks.rados.rados.0.trial187.stdout:2038: oid 38 updating version 0 to 860 2026-02-13T18:15:02.599 INFO:tasks.rados.rados.0.trial187.stdout:2038: oid 38 version 860 is already newer than 858 2026-02-13T18:15:02.600 INFO:tasks.rados.rados.0.trial187.stdout:2038: oid 38 version 860 is already newer than 859 2026-02-13T18:15:02.600 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 860 (ObjNum 676 snap 233 seq_num 676) dirty exists 2026-02-13T18:15:02.600 INFO:tasks.rados.rados.0.trial187.stdout:2038: left oid 38 (ObjNum 676 snap 233 seq_num 676) 2026-02-13T18:15:03.532 INFO:tasks.rados.rados.0.trial187.stdout:2036: done (3 left) 2026-02-13T18:15:03.532 INFO:tasks.rados.rados.0.trial187.stdout:2037: done (2 left) 2026-02-13T18:15:03.533 INFO:tasks.rados.rados.0.trial187.stdout:2038: done (1 left) 2026-02-13T18:15:03.533 INFO:tasks.rados.rados.0.trial187.stdout:2040: done (0 left) 2026-02-13T18:15:03.533 INFO:tasks.rados.rados.0.trial187.stdout:2041: read oid 1 snap 222 2026-02-13T18:15:03.533 INFO:tasks.rados.rados.0.trial187.stdout:2041: expect deleted 2026-02-13T18:15:03.533 INFO:tasks.rados.rados.0.trial187.stdout:2042: copy_from oid 25 from oid 26 current snap is 234 2026-02-13T18:15:03.533 INFO:tasks.rados.rados.0.trial187.stdout:2043: read oid 44 snap -1 2026-02-13T18:15:03.534 INFO:tasks.rados.rados.0.trial187.stdout:2043: expect (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:15:03.534 INFO:tasks.rados.rados.0.trial187.stdout:2044: write oid 39 current snap is 234 2026-02-13T18:15:03.534 INFO:tasks.rados.rados.0.trial187.stdout:2044: seq_num 677 ranges {578339=498990,1833133=525896,2791719=586620} 2026-02-13T18:15:03.538 INFO:tasks.rados.rados.0.trial187.stdout:2044: writing trial18717860-39 from 578339 to 1077329 tid 1 2026-02-13T18:15:03.547 INFO:tasks.rados.rados.0.trial187.stdout:2044: writing trial18717860-39 from 1833133 to 2359029 tid 2 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:2044: writing trial18717860-39 from 2791719 to 3378339 tid 3 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:2045: snap_create 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:2044: finishing write tid 1 to trial18717860-39 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:2042: finishing copy_from racing read to trial18717860-25 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:2042: finishing copy_from to trial18717860-25 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 986 (ObjNum 633 snap 214 seq_num 633) dirty exists 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:2043: expect (ObjNum 547 snap 176 seq_num 547) 2026-02-13T18:15:03.555 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:03.613 INFO:tasks.rados.rados.0.trial187.stdout:2044: finishing write tid 2 to trial18717860-39 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: finishing write tid 3 to trial18717860-39 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: finishing write tid 4 to trial18717860-39 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: finishing write tid 5 to trial18717860-39 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: oid 39 updating version 0 to 1008 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: oid 39 updating version 1008 to 1011 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: oid 39 version 1011 is already newer than 1009 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: oid 39 version 1011 is already newer than 1010 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1011 (ObjNum 677 snap 234 seq_num 677) dirty exists 2026-02-13T18:15:03.614 INFO:tasks.rados.rados.0.trial187.stdout:2044: left oid 39 (ObjNum 677 snap 234 seq_num 677) 2026-02-13T18:15:04.548 INFO:tasks.rados.rados.0.trial187.stdout:2041: done (4 left) 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2042: done (3 left) 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2043: done (2 left) 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2044: done (1 left) 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2045: done (0 left) 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2046: read oid 25 snap -1 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2046: expect (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:15:04.549 INFO:tasks.rados.rados.0.trial187.stdout:2047: snap_create 2026-02-13T18:15:04.553 INFO:tasks.rados.rados.0.trial187.stdout:2046: expect (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:15:04.554 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:04.587 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:04.638 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2069841 2026-02-13T18:15:05.555 INFO:tasks.rados.rados.0.trial187.stdout:2046: done (1 left) 2026-02-13T18:15:05.555 INFO:tasks.rados.rados.0.trial187.stdout:2047: done (0 left) 2026-02-13T18:15:05.555 INFO:tasks.rados.rados.0.trial187.stdout:2048: snap_create 2026-02-13T18:15:06.517 INFO:tasks.rados.rados.0.trial187.stdout:2048: done (0 left) 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:2049: copy_from oid 11 from oid 5 current snap is 237 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:2050: rollback oid 29 current snap is 237 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 234 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:2051: read oid 42 snap -1 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:2051: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:2052: read oid 7 snap 219 2026-02-13T18:15:06.518 INFO:tasks.rados.rados.0.trial187.stdout:2052: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:15:06.519 INFO:tasks.rados.rados.0.trial187.stdout:2053: rollback oid 28 current snap is 237 2026-02-13T18:15:06.519 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 28 to 226 2026-02-13T18:15:06.519 INFO:tasks.rados.rados.0.trial187.stdout:2054: copy_from oid 48 from oid 16 current snap is 237 2026-02-13T18:15:06.519 INFO:tasks.rados.rados.0.trial187.stdout:2055: read oid 38 snap -1 2026-02-13T18:15:06.519 INFO:tasks.rados.rados.0.trial187.stdout:2055: expect (ObjNum 676 snap 233 seq_num 676) 2026-02-13T18:15:06.519 INFO:tasks.rados.rados.0.trial187.stdout:2056: delete oid 24 current snap is 237 2026-02-13T18:15:06.520 INFO:tasks.rados.rados.0.trial187.stdout:2050: finishing rollback tid 0 to trial18717860-29 2026-02-13T18:15:06.522 INFO:tasks.rados.rados.0.trial187.stdout:2053: finishing rollback tid 1 to trial18717860-28 2026-02-13T18:15:06.522 INFO:tasks.rados.rados.0.trial187.stdout:2053: finishing rollback tid 2 to trial18717860-28 2026-02-13T18:15:06.523 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 803 (ObjNum 659 snap 221 seq_num 659) dirty exists 2026-02-13T18:15:06.523 INFO:tasks.rados.rados.0.trial187.stdout:2053: done (7 left) 2026-02-13T18:15:06.523 INFO:tasks.rados.rados.0.trial187.stdout:2056: done (6 left) 2026-02-13T18:15:06.523 INFO:tasks.rados.rados.0.trial187.stdout:2057: snap_remove snap 225 2026-02-13T18:15:07.518 INFO:tasks.rados.rados.0.trial187.stdout:2057: done (6 left) 2026-02-13T18:15:07.519 INFO:tasks.rados.rados.0.trial187.stdout:2058: write (excl) oid 44 current snap is 237 2026-02-13T18:15:07.519 INFO:tasks.rados.rados.0.trial187.stdout:2058: seq_num 679 ranges {611953=649488,1950097=529565,3246565=165388} 2026-02-13T18:15:07.527 INFO:tasks.rados.rados.0.trial187.stdout:2058: writing trial18717860-44 from 611953 to 1261441 tid 1 2026-02-13T18:15:07.535 INFO:tasks.rados.rados.0.trial187.stdout:2058: writing trial18717860-44 from 1950097 to 2479662 tid 2 2026-02-13T18:15:07.541 INFO:tasks.rados.rados.0.trial187.stdout:2058: writing trial18717860-44 from 3246565 to 3411953 tid 3 2026-02-13T18:15:07.541 INFO:tasks.rados.rados.0.trial187.stdout:2059: snap_remove snap 223 2026-02-13T18:15:08.520 INFO:tasks.rados.rados.0.trial187.stdout:2059: done (7 left) 2026-02-13T18:15:08.520 INFO:tasks.rados.rados.0.trial187.stdout:2060: write (excl) oid 33 current snap is 237 2026-02-13T18:15:08.520 INFO:tasks.rados.rados.0.trial187.stdout:2060: seq_num 680 ranges {628760=724737,1892226=673223,3157635=271125} 2026-02-13T18:15:08.529 INFO:tasks.rados.rados.0.trial187.stdout:2060: writing trial18717860-33 from 628760 to 1353497 tid 1 2026-02-13T18:15:08.537 INFO:tasks.rados.rados.0.trial187.stdout:2060: writing trial18717860-33 from 1892226 to 2565449 tid 2 2026-02-13T18:15:08.543 INFO:tasks.rados.rados.0.trial187.stdout:2060: writing trial18717860-33 from 3157635 to 3428760 tid 3 2026-02-13T18:15:08.543 INFO:tasks.rados.rados.0.trial187.stdout:2061: delete oid 34 current snap is 237 2026-02-13T18:15:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2052: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:15:08.682 INFO:tasks.rados.rados.0.trial187.stdout:2051: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:15:08.725 INFO:tasks.rados.rados.0.trial187.stdout:2050: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:15:08.725 INFO:tasks.rados.rados.0.trial187.stdout:2050: finishing rollback tid 2 to trial18717860-29 2026-02-13T18:15:08.725 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 895 (ObjNum 647 snap 218 seq_num 647) dirty exists 2026-02-13T18:15:08.725 INFO:tasks.rados.rados.0.trial187.stdout:2055: expect (ObjNum 676 snap 233 seq_num 676) 2026-02-13T18:15:08.725 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:08.767 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:08.793 INFO:tasks.rados.rados.0.trial187.stdout:2049: finishing copy_from racing read to trial18717860-11 2026-02-13T18:15:08.793 INFO:tasks.rados.rados.0.trial187.stdout:2049: finishing copy_from to trial18717860-11 2026-02-13T18:15:08.793 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 842 (ObjNum 641 snap 215 seq_num 641) dirty exists 2026-02-13T18:15:08.793 INFO:tasks.rados.rados.0.trial187.stdout:2054: finishing copy_from racing read to trial18717860-48 2026-02-13T18:15:08.793 INFO:tasks.rados.rados.0.trial187.stdout:2054: finishing copy_from to trial18717860-48 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 982 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: finishing write tid 1 to trial18717860-44 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: finishing write tid 2 to trial18717860-44 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: finishing write tid 3 to trial18717860-44 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: finishing write tid 4 to trial18717860-44 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: finishing write tid 5 to trial18717860-44 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: oid 44 updating version 0 to 1175 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: oid 44 updating version 1175 to 1176 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: oid 44 updating version 1176 to 1177 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: oid 44 version 1177 is already newer than 1174 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1177 (ObjNum 679 snap 237 seq_num 679) dirty exists 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2058: left oid 44 (ObjNum 679 snap 237 seq_num 679) 2026-02-13T18:15:08.794 INFO:tasks.rados.rados.0.trial187.stdout:2060: finishing write tid 1 to trial18717860-33 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: finishing write tid 2 to trial18717860-33 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: finishing write tid 3 to trial18717860-33 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: finishing write tid 4 to trial18717860-33 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: finishing write tid 5 to trial18717860-33 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: oid 33 updating version 0 to 1189 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: oid 33 version 1189 is already newer than 1188 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: oid 33 version 1189 is already newer than 1187 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: oid 33 updating version 1189 to 1190 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1190 (ObjNum 680 snap 237 seq_num 680) dirty exists 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2060: left oid 33 (ObjNum 680 snap 237 seq_num 680) 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2049: done (8 left) 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2050: done (7 left) 2026-02-13T18:15:08.795 INFO:tasks.rados.rados.0.trial187.stdout:2051: done (6 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2052: done (5 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2054: done (4 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2055: done (3 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2058: done (2 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2060: done (1 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2061: done (0 left) 2026-02-13T18:15:08.796 INFO:tasks.rados.rados.0.trial187.stdout:2062: snap_remove snap 234 2026-02-13T18:15:09.563 INFO:tasks.rados.rados.0.trial187.stdout:2062: done (0 left) 2026-02-13T18:15:09.563 INFO:tasks.rados.rados.0.trial187.stdout:2063: delete oid 28 current snap is 237 2026-02-13T18:15:09.566 INFO:tasks.rados.rados.0.trial187.stdout:2063: done (0 left) 2026-02-13T18:15:09.566 INFO:tasks.rados.rados.0.trial187.stdout:2064: rollback oid 7 current snap is 237 2026-02-13T18:15:09.567 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 205 2026-02-13T18:15:09.567 INFO:tasks.rados.rados.0.trial187.stdout:2065: copy_from oid 39 from oid 47 current snap is 237 2026-02-13T18:15:09.567 INFO:tasks.rados.rados.0.trial187.stdout:2066: write oid 24 current snap is 237 2026-02-13T18:15:09.567 INFO:tasks.rados.rados.0.trial187.stdout:2066: seq_num 683 ranges {679181=550484,1667672=536903,2839904=435373} 2026-02-13T18:15:09.574 INFO:tasks.rados.rados.0.trial187.stdout:2066: writing trial18717860-24 from 679181 to 1229665 tid 1 2026-02-13T18:15:09.581 INFO:tasks.rados.rados.0.trial187.stdout:2066: writing trial18717860-24 from 1667672 to 2204575 tid 2 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2066: writing trial18717860-24 from 2839904 to 3275277 tid 3 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2067: rollback oid 11 current snap is 237 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 228 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2064: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2064: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2064: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 911 (ObjNum 595 snap 205 seq_num 595) dirty exists 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2066: finishing write tid 1 to trial18717860-24 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2065: finishing copy_from racing read to trial18717860-39 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:2065: finishing copy_from to trial18717860-39 2026-02-13T18:15:09.590 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:15:09.591 INFO:tasks.rados.rados.0.trial187.stdout:2066: finishing write tid 2 to trial18717860-24 2026-02-13T18:15:09.591 INFO:tasks.rados.rados.0.trial187.stdout:2064: done (3 left) 2026-02-13T18:15:09.591 INFO:tasks.rados.rados.0.trial187.stdout:2065: done (2 left) 2026-02-13T18:15:09.591 INFO:tasks.rados.rados.0.trial187.stdout:2068: write (excl) oid 44 current snap is 237 2026-02-13T18:15:09.591 INFO:tasks.rados.rados.0.trial187.stdout:2068: seq_num 684 ranges {695988=625733,2009801=680561,3150974=345014} 2026-02-13T18:15:09.598 INFO:tasks.rados.rados.0.trial187.stdout:2068: writing trial18717860-44 from 695988 to 1321721 tid 1 2026-02-13T18:15:09.607 INFO:tasks.rados.rados.0.trial187.stdout:2068: writing trial18717860-44 from 2009801 to 2690362 tid 2 2026-02-13T18:15:09.614 INFO:tasks.rados.rados.0.trial187.stdout:2068: writing trial18717860-44 from 3150974 to 3495988 tid 3 2026-02-13T18:15:09.614 INFO:tasks.rados.rados.0.trial187.stdout:2069: copy_from oid 41 from oid 30 current snap is 237 2026-02-13T18:15:09.614 INFO:tasks.rados.rados.0.trial187.stdout:2067: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:15:09.614 INFO:tasks.rados.rados.0.trial187.stdout:2067: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:15:09.614 INFO:tasks.rados.rados.0.trial187.stdout:2067: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 995 (ObjNum 645 snap 218 seq_num 645) dirty exists 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: finishing write tid 3 to trial18717860-24 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: finishing write tid 4 to trial18717860-24 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: finishing write tid 5 to trial18717860-24 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: oid 24 updating version 0 to 808 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: oid 24 version 808 is already newer than 807 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: oid 24 version 808 is already newer than 805 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: oid 24 version 808 is already newer than 806 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 808 (ObjNum 683 snap 237 seq_num 683) dirty exists 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2066: left oid 24 (ObjNum 683 snap 237 seq_num 683) 2026-02-13T18:15:09.615 INFO:tasks.rados.rados.0.trial187.stdout:2068: finishing write tid 1 to trial18717860-44 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2066: done (3 left) 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2067: done (2 left) 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2070: read oid 13 snap -1 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2070: expect (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2071: write oid 43 current snap is 237 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2068: finishing write tid 2 to trial18717860-44 2026-02-13T18:15:09.616 INFO:tasks.rados.rados.0.trial187.stdout:2071: seq_num 685 ranges {712795=417335,1784636=540572,2894750=457917} 2026-02-13T18:15:09.618 INFO:tasks.rados.rados.0.trial187.stdout:2071: writing trial18717860-43 from 712795 to 1130130 tid 1 2026-02-13T18:15:09.626 INFO:tasks.rados.rados.0.trial187.stdout:2071: writing trial18717860-43 from 1784636 to 2325208 tid 2 2026-02-13T18:15:09.630 INFO:tasks.rados.rados.0.trial187.stdout:2071: writing trial18717860-43 from 2894750 to 3352667 tid 3 2026-02-13T18:15:09.630 INFO:tasks.rados.rados.0.trial187.stdout:2072: rollback oid 21 current snap is 237 2026-02-13T18:15:09.630 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 212 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: finishing write tid 3 to trial18717860-44 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: finishing write tid 4 to trial18717860-44 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: finishing write tid 5 to trial18717860-44 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: oid 44 updating version 0 to 1197 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: oid 44 updating version 1197 to 1198 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: oid 44 updating version 1198 to 1200 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: oid 44 version 1200 is already newer than 1199 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1200 (ObjNum 684 snap 237 seq_num 684) dirty exists 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2068: left oid 44 (ObjNum 684 snap 237 seq_num 684) 2026-02-13T18:15:09.631 INFO:tasks.rados.rados.0.trial187.stdout:2070: expect (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:15:09.649 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:09.678 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2415658 2026-02-13T18:15:09.687 INFO:tasks.rados.rados.0.trial187.stdout:2071: finishing write tid 1 to trial18717860-43 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: finishing write tid 2 to trial18717860-43 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2072: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2072: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 913 (ObjNum 65 snap 0 seq_num 3012901888) dirty dne 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: finishing write tid 3 to trial18717860-43 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: finishing write tid 4 to trial18717860-43 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: finishing write tid 5 to trial18717860-43 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: oid 43 updating version 0 to 1204 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: oid 43 version 1204 is already newer than 1202 2026-02-13T18:15:09.688 INFO:tasks.rados.rados.0.trial187.stdout:2071: oid 43 updating version 1204 to 1205 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2071: oid 43 version 1205 is already newer than 1203 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1205 (ObjNum 685 snap 237 seq_num 685) dirty exists 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2071: left oid 43 (ObjNum 685 snap 237 seq_num 685) 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2069: finishing copy_from racing read to trial18717860-41 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2069: finishing copy_from to trial18717860-41 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 803 (ObjNum 668 snap 222 seq_num 668) dirty exists 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2068: done (4 left) 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2069: done (3 left) 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2070: done (2 left) 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2071: done (1 left) 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2072: done (0 left) 2026-02-13T18:15:09.689 INFO:tasks.rados.rados.0.trial187.stdout:2073: snap_create 2026-02-13T18:15:10.568 INFO:tasks.rados.rados.0.trial187.stdout:2073: done (0 left) 2026-02-13T18:15:10.568 INFO:tasks.rados.rados.0.trial187.stdout:2074: delete oid 50 current snap is 238 2026-02-13T18:15:10.569 INFO:tasks.rados.rados.0.trial187.stdout:2074: done (0 left) 2026-02-13T18:15:10.569 INFO:tasks.rados.rados.0.trial187.stdout:2075: snap_remove snap 231 2026-02-13T18:15:11.518 INFO:tasks.rados.rados.0.trial187.stdout:2075: done (0 left) 2026-02-13T18:15:11.519 INFO:tasks.rados.rados.0.trial187.stdout:2076: snap_create 2026-02-13T18:15:12.520 INFO:tasks.rados.rados.0.trial187.stdout:2076: done (0 left) 2026-02-13T18:15:12.520 INFO:tasks.rados.rados.0.trial187.stdout:2077: snap_remove snap 235 2026-02-13T18:15:13.521 INFO:tasks.rados.rados.0.trial187.stdout:2077: done (0 left) 2026-02-13T18:15:13.521 INFO:tasks.rados.rados.0.trial187.stdout:2078: write (excl) oid 7 current snap is 239 2026-02-13T18:15:13.521 INFO:tasks.rados.rados.0.trial187.stdout:2078: seq_num 687 ranges {746409=567833,1901600=544241,3065949=480460} 2026-02-13T18:15:13.529 INFO:tasks.rados.rados.0.trial187.stdout:2078: writing trial18717860-7 from 746409 to 1314242 tid 1 2026-02-13T18:15:13.537 INFO:tasks.rados.rados.0.trial187.stdout:2078: writing trial18717860-7 from 1901600 to 2445841 tid 2 2026-02-13T18:15:13.544 INFO:tasks.rados.rados.0.trial187.stdout:2078: writing trial18717860-7 from 3065949 to 3546409 tid 3 2026-02-13T18:15:13.544 INFO:tasks.rados.rados.0.trial187.stdout:2079: snap_remove snap 228 2026-02-13T18:15:14.527 INFO:tasks.rados.rados.0.trial187.stdout:2079: done (1 left) 2026-02-13T18:15:14.527 INFO:tasks.rados.rados.0.trial187.stdout:2080: snap_create 2026-02-13T18:15:14.527 INFO:tasks.rados.rados.0.trial187.stdout:2078: finishing write tid 1 to trial18717860-7 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: finishing write tid 2 to trial18717860-7 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: finishing write tid 3 to trial18717860-7 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: finishing write tid 4 to trial18717860-7 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: finishing write tid 5 to trial18717860-7 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: oid 7 updating version 0 to 917 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: oid 7 version 917 is already newer than 915 2026-02-13T18:15:14.528 INFO:tasks.rados.rados.0.trial187.stdout:2078: oid 7 version 917 is already newer than 914 2026-02-13T18:15:14.529 INFO:tasks.rados.rados.0.trial187.stdout:2078: oid 7 version 917 is already newer than 916 2026-02-13T18:15:14.529 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 917 (ObjNum 687 snap 239 seq_num 687) dirty exists 2026-02-13T18:15:14.529 INFO:tasks.rados.rados.0.trial187.stdout:2078: left oid 7 (ObjNum 687 snap 239 seq_num 687) 2026-02-13T18:15:15.527 INFO:tasks.rados.rados.0.trial187.stdout:2078: done (1 left) 2026-02-13T18:15:15.528 INFO:tasks.rados.rados.0.trial187.stdout:2080: done (0 left) 2026-02-13T18:15:15.528 INFO:tasks.rados.rados.0.trial187.stdout:2081: delete oid 22 current snap is 240 2026-02-13T18:15:15.530 INFO:tasks.rados.rados.0.trial187.stdout:2081: done (0 left) 2026-02-13T18:15:15.530 INFO:tasks.rados.rados.0.trial187.stdout:2082: write oid 24 current snap is 240 2026-02-13T18:15:15.530 INFO:tasks.rados.rados.0.trial187.stdout:2082: seq_num 689 ranges {780023=718331,1902211=547910,3004442=575581} 2026-02-13T18:15:15.540 INFO:tasks.rados.rados.0.trial187.stdout:2082: writing trial18717860-24 from 780023 to 1498354 tid 1 2026-02-13T18:15:15.546 INFO:tasks.rados.rados.0.trial187.stdout:2082: writing trial18717860-24 from 1902211 to 2450121 tid 2 2026-02-13T18:15:15.555 INFO:tasks.rados.rados.0.trial187.stdout:2082: writing trial18717860-24 from 3004442 to 3580023 tid 3 2026-02-13T18:15:15.555 INFO:tasks.rados.rados.0.trial187.stdout:2083: copy_from oid 25 from oid 13 current snap is 240 2026-02-13T18:15:15.555 INFO:tasks.rados.rados.0.trial187.stdout:2082: finishing write tid 1 to trial18717860-24 2026-02-13T18:15:15.555 INFO:tasks.rados.rados.0.trial187.stdout:2082: finishing write tid 2 to trial18717860-24 2026-02-13T18:15:15.556 INFO:tasks.rados.rados.0.trial187.stdout:2084: read oid 19 snap -1 2026-02-13T18:15:15.556 INFO:tasks.rados.rados.0.trial187.stdout:2084: expect deleted 2026-02-13T18:15:15.556 INFO:tasks.rados.rados.0.trial187.stdout:2085: delete oid 50 current snap is 240 2026-02-13T18:15:15.556 INFO:tasks.rados.rados.0.trial187.stdout:2084: done (3 left) 2026-02-13T18:15:15.557 INFO:tasks.rados.rados.0.trial187.stdout:2085: done (2 left) 2026-02-13T18:15:15.557 INFO:tasks.rados.rados.0.trial187.stdout:2086: delete oid 43 current snap is 240 2026-02-13T18:15:15.558 INFO:tasks.rados.rados.0.trial187.stdout:2082: finishing write tid 3 to trial18717860-24 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2082: finishing write tid 4 to trial18717860-24 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2086: done (2 left) 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2087: copy_from oid 4 from oid 11 current snap is 240 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2088: rollback oid 18 current snap is 240 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 219 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2089: read oid 6 snap -1 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2089: expect (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2090: read oid 22 snap -1 2026-02-13T18:15:15.559 INFO:tasks.rados.rados.0.trial187.stdout:2090: expect deleted 2026-02-13T18:15:15.560 INFO:tasks.rados.rados.0.trial187.stdout:2091: snap_remove snap 226 2026-02-13T18:15:16.521 INFO:tasks.rados.rados.0.trial187.stdout:2091: done (6 left) 2026-02-13T18:15:16.521 INFO:tasks.rados.rados.0.trial187.stdout:2092: snap_remove snap 203 2026-02-13T18:15:16.907 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:15:16.907 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:15:16.908 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T18:15:16.908 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T18:15:16.920 INFO:tasks.ceph.mon.a:Started 2026-02-13T18:15:16.920 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T18:15:16.920 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T18:15:16.920 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T18:15:16.920 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T18:15:31.921 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T18:15:31.921 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T18:15:31.922 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T18:15:31.922 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:15:31.922 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient: get_monmap_and_config 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient: build_initial_monmap 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient: monmap: 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:31.976642+0000 2026-02-13T18:15:31.981 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:31.976642+0000 2026-02-13T18:15:31.982 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:31.982 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:31.982 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:31.982 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:31.982 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:31.982 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 1 Processor -- start 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 1 -- start start 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient: init 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient(hunting): picked mon.noname-a con 0x7f3c9c085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient(hunting): picked mon.noname-b con 0x7f3c9c085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient(hunting): picked mon.noname-c con 0x7f3c9c181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:31.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c088400 con 0x7f3c9c085790 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c088120 con 0x7f3c9c181d50 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c08c550 con 0x7f3c9c085b60 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.972+0000 7f3ca21ac640 10 monclient(hunting): authenticate will time out at 1163.031977s 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3c9c085790 0x7f3c9c089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40634/0 (socket says 10.20.193.78:40634) 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9b7fe640 1 -- 10.20.193.78:0/2668774148 learned_addr learned my addr 10.20.193.78:0/2668774148 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9affd640 1 --1- 10.20.193.78:0/2668774148 >> v1:10.20.193.78:6790/0 conn(0x7f3c9c085b60 0x7f3c9c085fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:55390/0 (socket says 10.20.193.78:55390) 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9affd640 1 -- 10.20.193.78:0/2668774148 >> v1:10.20.193.78:6790/0 conn(0x7f3c9c085b60 legacy=0x7f3c9c085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9b7fe640 1 -- 10.20.193.78:0/2668774148 >> v1:10.20.193.78:6789/0 conn(0x7f3c9c085790 legacy=0x7f3c9c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9bfff640 1 -- 10.20.193.78:0/2668774148 >> v1:10.20.193.187:6789/0 conn(0x7f3c9c181d50 legacy=0x7f3c9c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817175954 0 0) 0x7f3c88002c60 con 0x7f3c9c085790 2026-02-13T18:15:31.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): my global_id is 94098 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c80003620 con 0x7f3c9c085790 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431849916 0 0) 0x7f3c9c088120 con 0x7f3c9c181d50 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient(hunting): my global_id is 84202 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c88002c60 con 0x7f3c9c181d50 2026-02-13T18:15:31.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 721451044 0 0) 0x7f3c80003620 con 0x7f3c9c085790 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 >> v1:10.20.193.78:6790/0 conn(0x7f3c9c085b60 legacy=0x7f3c9c085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 >> v1:10.20.193.187:6789/0 conn(0x7f3c9c181d50 legacy=0x7f3c9c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 monclient: found mon.noname-a 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c087540 con 0x7f3c9c085790 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3c880032e0 con 0x7f3c9c085790 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:31.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: dump: 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 5 monclient: authenticate success, global_id 94098 2026-02-13T18:15:31.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c880049a0 con 0x7f3c9c085790 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 1 -- 10.20.193.78:0/2668774148 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3c88004d30 con 0x7f3c9c085790 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3c9a7fc640 10 monclient: dump: 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:31.992 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 4 set_mon_vals no callback set 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 10 monclient: shutdown 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 1 -- 10.20.193.78:0/2668774148 >> v1:10.20.193.78:6789/0 conn(0x7f3c9c085790 legacy=0x7f3c9c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 1 -- 10.20.193.78:0/2668774148 shutdown_connections 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 1 -- 10.20.193.78:0/2668774148 >> 10.20.193.78:0/2668774148 conn(0x7f3c9c091720 msgr2=0x7f3c9c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:31.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 1 -- 10.20.193.78:0/2668774148 shutdown_connections 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 1 -- 10.20.193.78:0/2668774148 wait complete. 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 10 monclient: build_initial_monmap 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.976+0000 7f3ca21ac640 10 monclient: monmap: 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:31.994 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 Processor -- start 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- start start 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: init 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient(hunting): picked mon.noname-a con 0x7f3c9c085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient(hunting): picked mon.noname-b con 0x7f3c9c085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient(hunting): picked mon.noname-c con 0x7f3c9c181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c07d040 con 0x7f3c9c085790 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c07b1f0 con 0x7f3c9c085b60 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c07b580 con 0x7f3c9c181d50 2026-02-13T18:15:31.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:31.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient(hunting): authenticate will time out at 1163.036694s 2026-02-13T18:15:31.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c9b7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3c9c085790 0x7f3c9c07a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40650/0 (socket says 10.20.193.78:40650) 2026-02-13T18:15:31.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c9b7fe640 1 -- 10.20.193.78:0/878883614 learned_addr learned my addr 10.20.193.78:0/878883614 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c9b7fe640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.78:6789/0 conn(0x7f3c9c085790 legacy=0x7f3c9c07a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c9bfff640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.78:6790/0 conn(0x7f3c9c181d50 legacy=0x7f3c9c195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951422443 0 0) 0x7f3c9c087540 con 0x7f3c9c085790 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): my global_id is 94101 2026-02-13T18:15:31.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c003620 con 0x7f3c9c085790 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c9affd640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.187:6789/0 conn(0x7f3c9c085b60 legacy=0x7f3c9c07aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 928207569 0 0) 0x7f3c6c003620 con 0x7f3c9c085790 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c9c087540 con 0x7f3c9c085790 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3c880030c0 con 0x7f3c9c085790 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): dump: 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:32.000 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3277638726 0 0) 0x7f3c9c087540 con 0x7f3c9c085790 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.78:6790/0 conn(0x7f3c9c181d50 legacy=0x7f3c9c195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.187:6789/0 conn(0x7f3c9c085b60 legacy=0x7f3c9c07aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: _finish_hunting 0 2026-02-13T18:15:32.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 monclient: found mon.a 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c07c850 con 0x7f3c9c085790 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: _finish_auth 0 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: _check_auth_tickets 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 5 monclient: authenticate success, global_id 94101 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _renew_subs 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c07d8e0 con 0x7f3c9c085790 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _renew_subs 2026-02-13T18:15:32.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c9c07c0e0 con 0x7f3c9c085790 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c880049a0 con 0x7f3c9c085790 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3c88005500 con 0x7f3c9c085790 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c77fff640 10 monclient: dump: 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:32.003 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3c99ffb640 4 set_mon_vals no callback set 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.980+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9c08f620 con 0x7f3c9c085790 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.984+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3c88011b90 con 0x7f3c9c085790 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.984+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(490..490 src has 1..490) ==== 3991+0+0 (unknown 3552165744 0 0) 0x7f3c8804c830 con 0x7f3c9c085790 2026-02-13T18:15:32.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.984+0000 7f3c9affd640 10 monclient: get_auth_request con 0x7f3c6c03d470 auth_method 0 2026-02-13T18:15:32.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.984+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f3c9c08f620 con 0x7f3c9c085790 2026-02-13T18:15:32.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.984+0000 7f3c77fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:32.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:31.984+0000 7f3c77fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:32.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c9c0008e0 con 0x7f3c9c085790 2026-02-13T18:15:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3c77fff640 1 -- 10.20.193.78:0/878883614 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 273919820) 0x7f3c9c07d040 con 0x7f3c9c085790 2026-02-13T18:15:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3c77fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:32.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3c77fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:32.112 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.187:6812/2668687789 conn(0x7f3c6c03d470 legacy=0x7f3c6c05d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 10 monclient: shutdown 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 >> v1:10.20.193.78:6789/0 conn(0x7f3c9c085790 legacy=0x7f3c9c07a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 shutdown_connections 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 >> 10.20.193.78:0/878883614 conn(0x7f3c9c091720 msgr2=0x7f3c9c08cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:32.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 shutdown_connections 2026-02-13T18:15:32.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:32.104+0000 7f3ca21ac640 1 -- 10.20.193.78:0/878883614 wait complete. 2026-02-13T18:15:35.123 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:35.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient: get_monmap_and_config 2026-02-13T18:15:35.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient: build_initial_monmap 2026-02-13T18:15:35.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient: monmap: 2026-02-13T18:15:35.184 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:35.179740+0000 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:35.179740+0000 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:35.185 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:35.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 1 Processor -- start 2026-02-13T18:15:35.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 1 -- start start 2026-02-13T18:15:35.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient: init 2026-02-13T18:15:35.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient(hunting): picked mon.noname-a con 0x7f49f408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient(hunting): picked mon.noname-b con 0x7f49f408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient(hunting): picked mon.noname-c con 0x7f49f408cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f4089e80 con 0x7f49f408c2f0 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f4088c20 con 0x7f49f408cdd0 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f4089ba0 con 0x7f49f408dc80 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49fb85e640 10 monclient(hunting): authenticate will time out at 1166.235162s 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49f95d3640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f49f408c2f0 0x7f49f408c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40652/0 (socket says 10.20.193.78:40652) 2026-02-13T18:15:35.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49f95d3640 1 -- 10.20.193.78:0/430538766 learned_addr learned my addr 10.20.193.78:0/430538766 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.176+0000 7f49f8dd2640 1 --1- 10.20.193.78:0/430538766 >> v1:10.20.193.78:6790/0 conn(0x7f49f408dc80 0x7f49f4181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:55410/0 (socket says 10.20.193.78:55410) 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49f95d3640 1 -- 10.20.193.78:0/430538766 >> v1:10.20.193.78:6789/0 conn(0x7f49f408c2f0 legacy=0x7f49f408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49f8dd2640 1 -- 10.20.193.78:0/430538766 >> v1:10.20.193.78:6790/0 conn(0x7f49f408dc80 legacy=0x7f49f4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286516416 0 0) 0x7f49f4089e80 con 0x7f49f408c2f0 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient(hunting): my global_id is 94104 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49dc003620 con 0x7f49f408c2f0 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49f9dd4640 1 -- 10.20.193.78:0/430538766 >> v1:10.20.193.187:6789/0 conn(0x7f49f408cdd0 legacy=0x7f49f41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3691776150 0 0) 0x7f49dc003620 con 0x7f49f408c2f0 2026-02-13T18:15:35.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 >> v1:10.20.193.78:6790/0 conn(0x7f49f408dc80 legacy=0x7f49f4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 >> v1:10.20.193.187:6789/0 conn(0x7f49f408cdd0 legacy=0x7f49f41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 monclient: found mon.noname-a 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f408d370 con 0x7f49f408c2f0 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: _finish_auth 0 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f49e4003110 con 0x7f49f408c2f0 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:35.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: dump: 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:35.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 5 monclient: authenticate success, global_id 94104 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49e40033e0 con 0x7f49f408c2f0 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 1 -- 10.20.193.78:0/430538766 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f49e4004b50 con 0x7f49f408c2f0 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49e3fff640 10 monclient: dump: 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.194 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 4 set_mon_vals no callback set 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: shutdown 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- 10.20.193.78:0/430538766 >> v1:10.20.193.78:6789/0 conn(0x7f49f408c2f0 legacy=0x7f49f408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- 10.20.193.78:0/430538766 shutdown_connections 2026-02-13T18:15:35.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- 10.20.193.78:0/430538766 >> 10.20.193.78:0/430538766 conn(0x7f49f4091720 msgr2=0x7f49f4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- 10.20.193.78:0/430538766 shutdown_connections 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- 10.20.193.78:0/430538766 wait complete. 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: build_initial_monmap 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: monmap: 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:35.196 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:35.197 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:35.197 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:35.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 Processor -- start 2026-02-13T18:15:35.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- start start 2026-02-13T18:15:35.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: init 2026-02-13T18:15:35.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:35.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient(hunting): picked mon.noname-a con 0x7f49f408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient(hunting): picked mon.noname-c con 0x7f49f408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient(hunting): picked mon.noname-b con 0x7f49f408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f4080d90 con 0x7f49f408c2f0 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f40822b0 con 0x7f49f408dc80 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f4082590 con 0x7f49f408cdd0 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49fb85e640 10 monclient(hunting): authenticate will time out at 1166.239781s 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49f95d3640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f49f408c2f0 0x7f49f4153170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40666/0 (socket says 10.20.193.78:40666) 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49f8dd2640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f49f408cdd0 0x7f49f4083aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:55420/0 (socket says 10.20.193.78:55420) 2026-02-13T18:15:35.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.180+0000 7f49f95d3640 1 -- 10.20.193.78:0/4219555912 learned_addr learned my addr 10.20.193.78:0/4219555912 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49f8dd2640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.78:6790/0 conn(0x7f49f408cdd0 legacy=0x7f49f4083aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49f95d3640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.78:6789/0 conn(0x7f49f408c2f0 legacy=0x7f49f4153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578572762 0 0) 0x7f49f4080d90 con 0x7f49f408c2f0 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): my global_id is 94107 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c4003620 con 0x7f49f408c2f0 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49f9dd4640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.187:6789/0 conn(0x7f49f408dc80 legacy=0x7f49f4195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1615962256 0 0) 0x7f49c4003620 con 0x7f49f408c2f0 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49f4080d90 con 0x7f49f408c2f0 2026-02-13T18:15:35.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f49e4002b70 con 0x7f49f408c2f0 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): dump: 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:35.204 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201391961 0 0) 0x7f49f40822b0 con 0x7f49f408dc80 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient(hunting): my global_id is 84211 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c4003620 con 0x7f49f408dc80 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 114326479 0 0) 0x7f49f4080d90 con 0x7f49f408c2f0 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.78:6790/0 conn(0x7f49f408cdd0 legacy=0x7f49f4083aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.187:6789/0 conn(0x7f49f408dc80 legacy=0x7f49f4195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 monclient: found mon.a 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f405dd30 con 0x7f49f408c2f0 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: _finish_auth 0 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 5 monclient: authenticate success, global_id 94107 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 monclient: _renew_subs 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f49f4088910 con 0x7f49f408c2f0 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 monclient: _renew_subs 2026-02-13T18:15:35.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f49f40841b0 con 0x7f49f408c2f0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f408f600 con 0x7f49f408c2f0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49e4003380 con 0x7f49f408c2f0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f49e40052e0 con 0x7f49f408c2f0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 10 monclient: dump: 2026-02-13T18:15:35.207 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e37fe640 4 set_mon_vals no callback set 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f49e4011970 con 0x7f49f408c2f0 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(490..490 src has 1..490) ==== 3991+0+0 (unknown 3552165744 0 0) 0x7f49e404c7d0 con 0x7f49f408c2f0 2026-02-13T18:15:35.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.184+0000 7f49f8dd2640 10 monclient: get_auth_request con 0x7f49c403d5b0 auth_method 0 2026-02-13T18:15:35.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.188+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f49e4017730 con 0x7f49f408c2f0 2026-02-13T18:15:35.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.188+0000 7f49e1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:35.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.188+0000 7f49e1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:35.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:35.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:35.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:35.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f49f4090810 con 0x7f49f408c2f0 2026-02-13T18:15:35.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49e1ffb640 1 -- 10.20.193.78:0/4219555912 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 2754989208) 0x7f49e401c9f0 con 0x7f49f408c2f0 2026-02-13T18:15:35.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49e1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:35.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49e1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:35.315 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:35.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.187:6812/2668687789 conn(0x7f49c403d5b0 legacy=0x7f49c405da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 10 monclient: shutdown 2026-02-13T18:15:35.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:35.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 >> v1:10.20.193.78:6789/0 conn(0x7f49f408c2f0 legacy=0x7f49f4153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:35.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 shutdown_connections 2026-02-13T18:15:35.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 >> 10.20.193.78:0/4219555912 conn(0x7f49f4091720 msgr2=0x7f49f4057af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:35.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 shutdown_connections 2026-02-13T18:15:35.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:35.308+0000 7f49fb85e640 1 -- 10.20.193.78:0/4219555912 wait complete. 2026-02-13T18:15:38.325 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:38.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient: get_monmap_and_config 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient: build_initial_monmap 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient: monmap: 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:38.391782+0000 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:38.391782+0000 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:38.397 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:38.398 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:38.398 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:38.398 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:38.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 1 Processor -- start 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 1 -- start start 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient: init 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient(hunting): picked mon.noname-a con 0x7f63a8085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient(hunting): picked mon.noname-b con 0x7f63a8085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient(hunting): picked mon.noname-c con 0x7f63a8181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a8088400 con 0x7f63a8085790 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a8088120 con 0x7f63a8181d50 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a808c550 con 0x7f63a8085b60 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:38.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63af0b3640 10 monclient(hunting): authenticate will time out at 1169.447240s 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63ace28640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f63a8085790 0x7f63a8089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:40682/0 (socket says 10.20.193.78:40682) 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f639ffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f63a8085b60 0x7f63a8085fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:55424/0 (socket says 10.20.193.78:55424) 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.388+0000 7f63ace28640 1 -- 10.20.193.78:0/690538532 learned_addr learned my addr 10.20.193.78:0/690538532 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639ffff640 1 -- 10.20.193.78:0/690538532 >> v1:10.20.193.78:6790/0 conn(0x7f63a8085b60 legacy=0x7f63a8085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63ace28640 1 -- 10.20.193.78:0/690538532 >> v1:10.20.193.78:6789/0 conn(0x7f63a8085790 legacy=0x7f63a8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959776703 0 0) 0x7f6398002c60 con 0x7f63a8085790 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient(hunting): my global_id is 94110 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63ad629640 1 -- 10.20.193.78:0/690538532 >> v1:10.20.193.187:6789/0 conn(0x7f63a8181d50 legacy=0x7f63a81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:38.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6394003620 con 0x7f63a8085790 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1300965486 0 0) 0x7f6394003620 con 0x7f63a8085790 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 >> v1:10.20.193.78:6790/0 conn(0x7f63a8085b60 legacy=0x7f63a8085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 >> v1:10.20.193.187:6789/0 conn(0x7f63a8181d50 legacy=0x7f63a81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 monclient: found mon.noname-a 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a8087540 con 0x7f63a8085790 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: _finish_auth 0 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:38.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 5 monclient: authenticate success, global_id 94110 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f63980032e0 con 0x7f63a8085790 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: dump: 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:38.406 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63980049a0 con 0x7f63a8085790 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 1 -- 10.20.193.78:0/690538532 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6398004d30 con 0x7f63a8085790 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f639f7fe640 10 monclient: dump: 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:38.407 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 4 set_mon_vals no callback set 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: shutdown 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:38.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- 10.20.193.78:0/690538532 >> v1:10.20.193.78:6789/0 conn(0x7f63a8085790 legacy=0x7f63a8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- 10.20.193.78:0/690538532 shutdown_connections 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- 10.20.193.78:0/690538532 >> 10.20.193.78:0/690538532 conn(0x7f63a8091720 msgr2=0x7f63a8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- 10.20.193.78:0/690538532 shutdown_connections 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- 10.20.193.78:0/690538532 wait complete. 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: build_initial_monmap 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: monmap: 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:38.409 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 Processor -- start 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- start start 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: init 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient(hunting): picked mon.noname-c con 0x7f63a8085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient(hunting): picked mon.noname-a con 0x7f63a8085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient(hunting): picked mon.noname-b con 0x7f63a8181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:38.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a8080810 con 0x7f63a8085b60 2026-02-13T18:15:38.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a807daf0 con 0x7f63a8181d50 2026-02-13T18:15:38.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a8080af0 con 0x7f63a8085790 2026-02-13T18:15:38.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:38.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63af0b3640 10 monclient(hunting): authenticate will time out at 1169.451894s 2026-02-13T18:15:38.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63ace28640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f63a8085790 0x7f63a807ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:55434/0 (socket says 10.20.193.78:55434) 2026-02-13T18:15:38.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.392+0000 7f63ace28640 1 -- 10.20.193.78:0/3014835211 learned_addr learned my addr 10.20.193.78:0/3014835211 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f63ace28640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.78:6790/0 conn(0x7f63a8085790 legacy=0x7f63a807ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639ffff640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.78:6789/0 conn(0x7f63a8085b60 legacy=0x7f63a807d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f63ad629640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.187:6789/0 conn(0x7f63a8181d50 legacy=0x7f63a8132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047895808 0 0) 0x7f63a8080810 con 0x7f63a8085b60 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): _negotiate 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): my global_id is 94113 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6378003620 con 0x7f63a8085b60 2026-02-13T18:15:38.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639ffff640 1 --1- 10.20.193.78:0/3014835211 >> v1:10.20.193.78:6789/0 conn(0x7f63a8085b60 0x7f63a807d3e0 :-1 s=OPENED pgs=235 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f6378003620 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 77125553 0 0) 0x7f6378003620 con 0x7f63a8085b60 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63a8080810 con 0x7f63a8085b60 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6390003330 con 0x7f63a8085b60 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): dump: 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:38.414 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:38.415 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:38.415 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:38.415 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:38.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:38.396+0000 7f639d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:39.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 667716599 0 0) 0x7f63a8080810 con 0x7f63a8085b60 2026-02-13T18:15:39.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.78:6790/0 conn(0x7f63a8085790 legacy=0x7f63a807ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:39.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.187:6789/0 conn(0x7f63a8181d50 legacy=0x7f63a8132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: _finish_hunting 0 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 monclient: found mon.a 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a808b1f0 con 0x7f63a8085b60 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: _finish_auth 0 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: _check_auth_tickets 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 5 monclient: authenticate success, global_id 94113 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 monclient: _renew_subs 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:39.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63a807fc80 con 0x7f63a8085b60 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 monclient: _renew_subs 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63a807f550 con 0x7f63a8085b60 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6390004c50 con 0x7f63a8085b60 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6390004fb0 con 0x7f63a8085b60 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639effd640 4 set_mon_vals no callback set 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 10 monclient: dump: 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:39.236 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a80389c0 con 0x7f63a8085b60 2026-02-13T18:15:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.224+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f6390005250 con 0x7f63a8085b60 2026-02-13T18:15:39.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.228+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(491..491 src has 1..491) ==== 3899+0+0 (unknown 3816125164 0 0) 0x7f639004c730 con 0x7f63a8085b60 2026-02-13T18:15:39.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.228+0000 7f63ace28640 10 monclient: get_auth_request con 0x7f637803d400 auth_method 0 2026-02-13T18:15:39.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.228+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f6390017750 con 0x7f63a8085b60 2026-02-13T18:15:39.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.228+0000 7f639d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:39.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.228+0000 7f639d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f63a808f620 con 0x7f63a8085b60 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f639d7fa640 1 -- 10.20.193.78:0/3014835211 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 290537305) 0x7f63a808f620 con 0x7f63a8085b60 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f639d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:39.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f639d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:39.354 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:39.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.187:6812/2668687789 conn(0x7f637803d400 legacy=0x7f637805d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:39.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 10 monclient: shutdown 2026-02-13T18:15:39.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:39.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 >> v1:10.20.193.78:6789/0 conn(0x7f63a8085b60 legacy=0x7f63a807d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:39.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 shutdown_connections 2026-02-13T18:15:39.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 >> 10.20.193.78:0/3014835211 conn(0x7f63a8091720 msgr2=0x7f63a808cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:39.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 shutdown_connections 2026-02-13T18:15:39.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:39.344+0000 7f63af0b3640 1 -- 10.20.193.78:0/3014835211 wait complete. 2026-02-13T18:15:42.364 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:42.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient: get_monmap_and_config 2026-02-13T18:15:42.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient: build_initial_monmap 2026-02-13T18:15:42.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient: monmap: 2026-02-13T18:15:42.428 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:42.423495+0000 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:42.423495+0000 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:42.429 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:42.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 1 Processor -- start 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 1 -- start start 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient: init 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient(hunting): picked mon.noname-b con 0x7f091008cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient(hunting): picked mon.noname-c con 0x7f091008d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient(hunting): picked mon.noname-a con 0x7f091008d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0910085ad0 con 0x7f091008d5d0 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0910085ee0 con 0x7f091008d190 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091008e000 con 0x7f091008cdc0 2026-02-13T18:15:42.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:42.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f09178c5640 10 monclient(hunting): authenticate will time out at 1173.478642s 2026-02-13T18:15:42.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f091563a640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f091008cdc0 0x7f091008c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39146/0 (socket says 10.20.193.78:39146) 2026-02-13T18:15:42.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f091563a640 1 -- 10.20.193.78:0/3075754080 learned_addr learned my addr 10.20.193.78:0/3075754080 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:42.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.420+0000 7f0915e3b640 1 --1- 10.20.193.78:0/3075754080 >> v1:10.20.193.78:6789/0 conn(0x7f091008d5d0 0x7f09101a53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52202/0 (socket says 10.20.193.78:52202) 2026-02-13T18:15:42.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f091563a640 1 -- 10.20.193.78:0/3075754080 >> v1:10.20.193.78:6790/0 conn(0x7f091008cdc0 legacy=0x7f091008c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:42.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f0915e3b640 1 -- 10.20.193.78:0/3075754080 >> v1:10.20.193.78:6789/0 conn(0x7f091008d5d0 legacy=0x7f09101a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:42.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f0914e39640 1 -- 10.20.193.78:0/3075754080 >> v1:10.20.193.187:6789/0 conn(0x7f091008d190 legacy=0x7f0910183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:42.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603540819 0 0) 0x7f0910085ad0 con 0x7f091008d5d0 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient(hunting): my global_id is 94116 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f8003620 con 0x7f091008d5d0 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 509747948 0 0) 0x7f08f8003620 con 0x7f091008d5d0 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 >> v1:10.20.193.78:6790/0 conn(0x7f091008cdc0 legacy=0x7f091008c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 >> v1:10.20.193.187:6789/0 conn(0x7f091008d190 legacy=0x7f0910183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: _finish_hunting 0 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 monclient: found mon.noname-a 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:42.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910086f80 con 0x7f091008d5d0 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: _finish_auth 0 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: _check_auth_tickets 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 5 monclient: authenticate success, global_id 94116 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f090c004620 con 0x7f091008d5d0 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: dump: 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:42.437 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f090c0048f0 con 0x7f091008d5d0 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 1 -- 10.20.193.78:0/3075754080 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f090c005fa0 con 0x7f091008d5d0 2026-02-13T18:15:42.438 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f08fffff640 10 monclient: dump: 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:42.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 4 set_mon_vals no callback set 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: shutdown 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- 10.20.193.78:0/3075754080 >> v1:10.20.193.78:6789/0 conn(0x7f091008d5d0 legacy=0x7f09101a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- 10.20.193.78:0/3075754080 shutdown_connections 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- 10.20.193.78:0/3075754080 >> 10.20.193.78:0/3075754080 conn(0x7f0910091720 msgr2=0x7f0910091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- 10.20.193.78:0/3075754080 shutdown_connections 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- 10.20.193.78:0/3075754080 wait complete. 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: build_initial_monmap 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: monmap: 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:42.440 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 Processor -- start 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- start start 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: init 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:42.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient(hunting): picked mon.noname-b con 0x7f091008cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient(hunting): picked mon.noname-a con 0x7f091008d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient(hunting): picked mon.noname-c con 0x7f091008d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091008b700 con 0x7f091008d190 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0910083120 con 0x7f091008cdc0 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0910081c00 con 0x7f091008d5d0 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f09178c5640 10 monclient(hunting): authenticate will time out at 1173.483369s 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f0914e39640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f091008d190 0x7f0910084930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52204/0 (socket says 10.20.193.78:52204) 2026-02-13T18:15:42.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.424+0000 7f0914e39640 1 -- 10.20.193.78:0/2217520605 learned_addr learned my addr 10.20.193.78:0/2217520605 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:42.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f0914e39640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.78:6789/0 conn(0x7f091008d190 legacy=0x7f0910084930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:42.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f0915e3b640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.78:6790/0 conn(0x7f091008d5d0 legacy=0x7f09101950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:42.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046619703 0 0) 0x7f0904002db0 con 0x7f091008d190 2026-02-13T18:15:42.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): my global_id is 94119 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e0003620 con 0x7f091008d190 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f091563a640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.187:6789/0 conn(0x7f091008cdc0 legacy=0x7f0910152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3615867422 0 0) 0x7f08e0003620 con 0x7f091008d190 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0904002db0 con 0x7f091008d190 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0904003710 con 0x7f091008d190 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:42.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): dump: 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2356823949 0 0) 0x7f0904002db0 con 0x7f091008d190 2026-02-13T18:15:42.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.78:6790/0 conn(0x7f091008d5d0 legacy=0x7f09101950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.187:6789/0 conn(0x7f091008cdc0 legacy=0x7f0910152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: _finish_hunting 0 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 monclient: found mon.a 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09100810a0 con 0x7f091008d190 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: _finish_auth 0 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: _check_auth_tickets 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 5 monclient: authenticate success, global_id 94119 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 monclient: _renew_subs 2026-02-13T18:15:42.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0910082b60 con 0x7f091008d190 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 monclient: _renew_subs 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0910085210 con 0x7f091008d190 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0904003d90 con 0x7f091008d190 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0904004160 con 0x7f091008d190 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08ff7fe640 4 set_mon_vals no callback set 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 10 monclient: dump: 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:42.449 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091008f620 con 0x7f091008d190 2026-02-13T18:15:42.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0904011db0 con 0x7f091008d190 2026-02-13T18:15:42.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(491..491 src has 1..491) ==== 3899+0+0 (unknown 3816125164 0 0) 0x7f090404ca00 con 0x7f091008d190 2026-02-13T18:15:42.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.428+0000 7f091563a640 10 monclient: get_auth_request con 0x7f08e003d400 auth_method 0 2026-02-13T18:15:42.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.432+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f091008f620 con 0x7f091008d190 2026-02-13T18:15:42.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.432+0000 7f08fdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:42.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.432+0000 7f08fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:42.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:42.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:42.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:42.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0910090810 con 0x7f091008d190 2026-02-13T18:15:42.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f08fdffb640 1 -- 10.20.193.78:0/2217520605 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1599 (unknown 254746657 0 1130239886) 0x7f091008b700 con 0x7f091008d190 2026-02-13T18:15:42.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f08fdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:42.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f08fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:42.557 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.187:6812/2668687789 conn(0x7f08e003d400 legacy=0x7f08e005d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 10 monclient: shutdown 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 >> v1:10.20.193.78:6789/0 conn(0x7f091008d190 legacy=0x7f0910084930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 shutdown_connections 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 >> 10.20.193.78:0/2217520605 conn(0x7f0910091720 msgr2=0x7f091005ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:42.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 shutdown_connections 2026-02-13T18:15:42.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:42.548+0000 7f09178c5640 1 -- 10.20.193.78:0/2217520605 wait complete. 2026-02-13T18:15:43.040 INFO:tasks.rados.rados.0.trial187.stdout:2092: done (6 left) 2026-02-13T18:15:43.040 INFO:tasks.rados.rados.0.trial187.stdout:2093: write (excl) oid 46 current snap is 240 2026-02-13T18:15:43.040 INFO:tasks.rados.rados.0.trial187.stdout:2093: seq_num 692 ranges {430444=660431,1677657=695237,2970358=569527} 2026-02-13T18:15:43.047 INFO:tasks.rados.rados.0.trial187.stdout:2093: writing trial18717860-46 from 430444 to 1090875 tid 1 2026-02-13T18:15:43.056 INFO:tasks.rados.rados.0.trial187.stdout:2093: writing trial18717860-46 from 1677657 to 2372894 tid 2 2026-02-13T18:15:43.064 INFO:tasks.rados.rados.0.trial187.stdout:2093: writing trial18717860-46 from 2970358 to 3539885 tid 3 2026-02-13T18:15:43.064 INFO:tasks.rados.rados.0.trial187.stdout:2094: snap_remove snap 238 2026-02-13T18:15:44.046 INFO:tasks.rados.rados.0.trial187.stdout:2094: done (7 left) 2026-02-13T18:15:44.046 INFO:tasks.rados.rados.0.trial187.stdout:2095: copy_from oid 48 from oid 26 current snap is 240 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2082: finishing write tid 5 to trial18717860-24 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2082: oid 24 updating version 0 to 812 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2082: oid 24 version 812 is already newer than 811 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2082: oid 24 version 812 is already newer than 810 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2082: oid 24 version 812 is already newer than 809 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 812 (ObjNum 689 snap 240 seq_num 689) dirty exists 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2082: left oid 24 (ObjNum 689 snap 240 seq_num 689) 2026-02-13T18:15:44.047 INFO:tasks.rados.rados.0.trial187.stdout:2089: expect (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:15:44.102 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:44.180 INFO:tasks.rados.rados.0.trial187.stdout:2088: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:15:44.180 INFO:tasks.rados.rados.0.trial187.stdout:2088: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2088: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 661 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2083: finishing copy_from racing read to trial18717860-25 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2083: finishing copy_from to trial18717860-25 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 621 (ObjNum 667 snap 222 seq_num 667) dirty exists 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2087: finishing copy_from racing read to trial18717860-4 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2087: finishing copy_from to trial18717860-4 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 995 (ObjNum 645 snap 218 seq_num 645) dirty exists 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2093: finishing write tid 1 to trial18717860-46 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2093: finishing write tid 2 to trial18717860-46 2026-02-13T18:15:44.181 INFO:tasks.rados.rados.0.trial187.stdout:2093: finishing write tid 3 to trial18717860-46 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2082: done (7 left) 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2083: done (6 left) 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2087: done (5 left) 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2088: done (4 left) 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2089: done (3 left) 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2090: done (2 left) 2026-02-13T18:15:44.182 INFO:tasks.rados.rados.0.trial187.stdout:2096: snap_remove snap 233 2026-02-13T18:15:45.047 INFO:tasks.rados.rados.0.trial187.stdout:2096: done (2 left) 2026-02-13T18:15:45.047 INFO:tasks.rados.rados.0.trial187.stdout:2097: snap_remove snap 239 2026-02-13T18:15:45.568 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:45.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient: get_monmap_and_config 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient: build_initial_monmap 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient: monmap: 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:45.634772+0000 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:45.634772+0000 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:45.640 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:45.641 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:45.641 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:45.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 1 Processor -- start 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 1 -- start start 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient: init 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient(hunting): picked mon.noname-c con 0x7f6c4413f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient(hunting): picked mon.noname-a con 0x7f6c44095410 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient(hunting): picked mon.noname-b con 0x7f6c441851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44140290 con 0x7f6c44095410 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44094750 con 0x7f6c4413f7b0 2026-02-13T18:15:45.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44093c80 con 0x7f6c441851c0 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4b19d640 10 monclient(hunting): authenticate will time out at 1176.689966s 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4999a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6c44095410 0x7f6c44183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52214/0 (socket says 10.20.193.78:52214) 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.632+0000 7f6c4999a640 1 -- 10.20.193.78:0/2099097141 learned_addr learned my addr 10.20.193.78:0/2099097141 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4999a640 1 -- 10.20.193.78:0/2099097141 >> v1:10.20.193.78:6789/0 conn(0x7f6c44095410 legacy=0x7f6c44183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4a99c640 1 -- 10.20.193.78:0/2099097141 >> v1:10.20.193.78:6790/0 conn(0x7f6c441851c0 legacy=0x7f6c441a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4a19b640 1 -- 10.20.193.78:0/2099097141 >> v1:10.20.193.187:6789/0 conn(0x7f6c4413f7b0 legacy=0x7f6c4413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039265524 0 0) 0x7f6c44093c80 con 0x7f6c441851c0 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): _negotiate 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:45.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): my global_id is 4850 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c2c003620 con 0x7f6c441851c0 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370546449 0 0) 0x7f6c44094750 con 0x7f6c4413f7b0 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): _negotiate 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient(hunting): my global_id is 84214 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c44093c80 con 0x7f6c4413f7b0 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1983005746 0 0) 0x7f6c2c003620 con 0x7f6c441851c0 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 >> v1:10.20.193.187:6789/0 conn(0x7f6c4413f7b0 legacy=0x7f6c4413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 >> v1:10.20.193.78:6789/0 conn(0x7f6c44095410 legacy=0x7f6c44183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: _finish_hunting 0 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 monclient: found mon.noname-b 2026-02-13T18:15:45.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c44094190 con 0x7f6c441851c0 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: _finish_auth 0 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: _check_auth_tickets 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 5 monclient: authenticate success, global_id 4850 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c40004670 con 0x7f6c441851c0 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: dump: 2026-02-13T18:15:45.649 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c40004940 con 0x7f6c441851c0 2026-02-13T18:15:45.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 1 -- 10.20.193.78:0/2099097141 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c40004dd0 con 0x7f6c441851c0 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c49199640 10 monclient: dump: 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:45.651 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 4 set_mon_vals no callback set 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: shutdown 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2099097141 >> v1:10.20.193.78:6790/0 conn(0x7f6c441851c0 legacy=0x7f6c441a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2099097141 shutdown_connections 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2099097141 >> 10.20.193.78:0/2099097141 conn(0x7f6c44054400 msgr2=0x7f6c44054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2099097141 shutdown_connections 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2099097141 wait complete. 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: build_initial_monmap 2026-02-13T18:15:45.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: monmap: 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 Processor -- start 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- start start 2026-02-13T18:15:45.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: init 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient(hunting): picked mon.noname-c con 0x7f6c44095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient(hunting): picked mon.noname-a con 0x7f6c4413f7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient(hunting): picked mon.noname-b con 0x7f6c441851c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44111c30 con 0x7f6c4413f7b0 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c44110dc0 con 0x7f6c441851c0 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4410f8d0 con 0x7f6c44095410 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4b19d640 10 monclient(hunting): authenticate will time out at 1176.694690s 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4999a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f6c4413f7b0 0x7f6c4413ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52222/0 (socket says 10.20.193.78:52222) 2026-02-13T18:15:45.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.636+0000 7f6c4999a640 1 -- 10.20.193.78:0/2646386079 learned_addr learned my addr 10.20.193.78:0/2646386079 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:45.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4999a640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.78:6789/0 conn(0x7f6c4413f7b0 legacy=0x7f6c4413ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4a19b640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.78:6790/0 conn(0x7f6c44095410 legacy=0x7f6c4413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924706251 0 0) 0x7f6c4410f8d0 con 0x7f6c44095410 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): my global_id is 4853 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c14003620 con 0x7f6c44095410 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4a99c640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.187:6789/0 conn(0x7f6c441851c0 legacy=0x7f6c441814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1791395280 0 0) 0x7f6c14003620 con 0x7f6c44095410 2026-02-13T18:15:45.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c4410f8d0 con 0x7f6c44095410 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c340033f0 con 0x7f6c44095410 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): dump: 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:45.659 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3433641103 0 0) 0x7f6c4410f8d0 con 0x7f6c44095410 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.187:6789/0 conn(0x7f6c441851c0 legacy=0x7f6c441814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.78:6789/0 conn(0x7f6c4413f7b0 legacy=0x7f6c4413ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: _finish_hunting 0 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 monclient: found mon.c 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c44111390 con 0x7f6c44095410 2026-02-13T18:15:45.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: _finish_auth 0 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: _check_auth_tickets 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 5 monclient: authenticate success, global_id 4853 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 monclient: _renew_subs 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4410f1f0 con 0x7f6c44095410 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 monclient: _renew_subs 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c441106b0 con 0x7f6c44095410 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c340039c0 con 0x7f6c44095410 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f6c34003d20 con 0x7f6c44095410 2026-02-13T18:15:45.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 10 monclient: dump: 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:45.662 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c48998640 4 set_mon_vals no callback set 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f6c34003fc0 con 0x7f6c44095410 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c440008e0 con 0x7f6c44095410 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(494..494 src has 1..494) ==== 3959+0+0 (unknown 3228830255 0 0) 0x7f6c3404c740 con 0x7f6c44095410 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.640+0000 7f6c4999a640 10 monclient: get_auth_request con 0x7f6c1403d3c0 auth_method 0 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.644+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f6c340176c0 con 0x7f6c44095410 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.644+0000 7f6c2affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:45.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.644+0000 7f6c2affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:45.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:45.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:45.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:45.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c44092cd0 con 0x7f6c44095410 2026-02-13T18:15:45.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c2affd640 1 -- 10.20.193.78:0/2646386079 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 2402028853) 0x7f6c34016fa0 con 0x7f6c44095410 2026-02-13T18:15:45.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c2affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:45.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c2affd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:45.768 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":36,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.187:6812/2668687789 conn(0x7f6c1403d3c0 legacy=0x7f6c1405d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 10 monclient: shutdown 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 >> v1:10.20.193.78:6790/0 conn(0x7f6c44095410 legacy=0x7f6c4413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 shutdown_connections 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 >> 10.20.193.78:0/2646386079 conn(0x7f6c44054400 msgr2=0x7f6c441a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 shutdown_connections 2026-02-13T18:15:45.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:45.760+0000 7f6c4b19d640 1 -- 10.20.193.78:0/2646386079 wait complete. 2026-02-13T18:15:46.049 INFO:tasks.rados.rados.0.trial187.stdout:2097: done (2 left) 2026-02-13T18:15:46.049 INFO:tasks.rados.rados.0.trial187.stdout:2098: rollback oid 3 current snap is 240 2026-02-13T18:15:46.049 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 212 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: finishing write tid 4 to trial18717860-46 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: finishing write tid 5 to trial18717860-46 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: oid 46 updating version 0 to 920 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: oid 46 updating version 920 to 921 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: oid 46 version 921 is already newer than 918 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: oid 46 version 921 is already newer than 919 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 921 (ObjNum 692 snap 240 seq_num 692) dirty exists 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2093: left oid 46 (ObjNum 692 snap 240 seq_num 692) 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2095: finishing copy_from racing read to trial18717860-48 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:2095: finishing copy_from to trial18717860-48 2026-02-13T18:15:46.050 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 986 (ObjNum 633 snap 214 seq_num 633) dirty exists 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2093: done (2 left) 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2095: done (1 left) 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2099: read oid 5 snap -1 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2099: expect (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2100: read oid 44 snap -1 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2100: expect (ObjNum 684 snap 237 seq_num 684) 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2101: write (excl) oid 22 current snap is 240 2026-02-13T18:15:46.051 INFO:tasks.rados.rados.0.trial187.stdout:2101: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2026-02-13T18:15:46.056 INFO:tasks.rados.rados.0.trial187.stdout:2101: writing trial18717860-22 from 447251 to 1182931 tid 1 2026-02-13T18:15:46.063 INFO:tasks.rados.rados.0.trial187.stdout:2101: writing trial18717860-22 from 1736139 to 2175034 tid 2 2026-02-13T18:15:46.072 INFO:tasks.rados.rados.0.trial187.stdout:2101: writing trial18717860-22 from 2597781 to 3378580 tid 3 2026-02-13T18:15:46.072 INFO:tasks.rados.rados.0.trial187.stdout:2102: delete oid 31 current snap is 240 2026-02-13T18:15:46.072 INFO:tasks.rados.rados.0.trial187.stdout:2099: expect (ObjNum 641 snap 215 seq_num 641) 2026-02-13T18:15:46.072 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 713738 2026-02-13T18:15:46.117 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1678620 2026-02-13T18:15:46.129 INFO:tasks.rados.rados.0.trial187.stdout:2100: expect (ObjNum 684 snap 237 seq_num 684) 2026-02-13T18:15:46.212 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1737725 2026-02-13T18:15:46.240 INFO:tasks.rados.rados.0.trial187.stdout:2098: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:15:46.240 INFO:tasks.rados.rados.0.trial187.stdout:2098: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:15:46.240 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1033 (ObjNum 582 snap 199 seq_num 582) dirty exists 2026-02-13T18:15:46.240 INFO:tasks.rados.rados.0.trial187.stdout:2101: finishing write tid 1 to trial18717860-22 2026-02-13T18:15:46.240 INFO:tasks.rados.rados.0.trial187.stdout:2101: finishing write tid 2 to trial18717860-22 2026-02-13T18:15:46.240 INFO:tasks.rados.rados.0.trial187.stdout:2098: done (4 left) 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2099: done (3 left) 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2100: done (2 left) 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2102: done (1 left) 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2103: read oid 34 snap -1 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2103: expect deleted 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2104: snap_create 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2101: finishing write tid 3 to trial18717860-22 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2101: finishing write tid 4 to trial18717860-22 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2101: finishing write tid 5 to trial18717860-22 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2101: oid 22 updating version 0 to 1285 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2101: oid 22 version 1285 is already newer than 1282 2026-02-13T18:15:46.241 INFO:tasks.rados.rados.0.trial187.stdout:2101: oid 22 version 1285 is already newer than 1283 2026-02-13T18:15:46.242 INFO:tasks.rados.rados.0.trial187.stdout:2101: oid 22 version 1285 is already newer than 1284 2026-02-13T18:15:46.242 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1285 (ObjNum 693 snap 240 seq_num 693) dirty exists 2026-02-13T18:15:46.242 INFO:tasks.rados.rados.0.trial187.stdout:2101: left oid 22 (ObjNum 693 snap 240 seq_num 693) 2026-02-13T18:15:47.056 INFO:tasks.rados.rados.0.trial187.stdout:2101: done (2 left) 2026-02-13T18:15:47.056 INFO:tasks.rados.rados.0.trial187.stdout:2103: done (1 left) 2026-02-13T18:15:47.056 INFO:tasks.rados.rados.0.trial187.stdout:2104: done (0 left) 2026-02-13T18:15:47.056 INFO:tasks.rados.rados.0.trial187.stdout:2105: read oid 39 snap -1 2026-02-13T18:15:47.056 INFO:tasks.rados.rados.0.trial187.stdout:2105: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:15:47.057 INFO:tasks.rados.rados.0.trial187.stdout:2106: snap_create 2026-02-13T18:15:47.065 INFO:tasks.rados.rados.0.trial187.stdout:2105: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:15:47.084 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1111746 2026-02-13T18:15:47.140 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:48.062 INFO:tasks.rados.rados.0.trial187.stdout:2105: done (1 left) 2026-02-13T18:15:48.062 INFO:tasks.rados.rados.0.trial187.stdout:2106: done (0 left) 2026-02-13T18:15:48.062 INFO:tasks.rados.rados.0.trial187.stdout:2107: read oid 12 snap -1 2026-02-13T18:15:48.062 INFO:tasks.rados.rados.0.trial187.stdout:2107: expect deleted 2026-02-13T18:15:48.062 INFO:tasks.rados.rados.0.trial187.stdout:2108: copy_from oid 21 from oid 11 current snap is 242 2026-02-13T18:15:48.063 INFO:tasks.rados.rados.0.trial187.stdout:2109: read oid 17 snap -1 2026-02-13T18:15:48.063 INFO:tasks.rados.rados.0.trial187.stdout:2109: expect (ObjNum 563 snap 189 seq_num 563) 2026-02-13T18:15:48.063 INFO:tasks.rados.rados.0.trial187.stdout:2110: snap_create 2026-02-13T18:15:48.066 INFO:tasks.rados.rados.0.trial187.stdout:2109: expect (ObjNum 563 snap 189 seq_num 563) 2026-02-13T18:15:48.235 INFO:tasks.rados.rados.0.trial187.stdout:2108: finishing copy_from racing read to trial18717860-21 2026-02-13T18:15:48.235 INFO:tasks.rados.rados.0.trial187.stdout:2108: finishing copy_from to trial18717860-21 2026-02-13T18:15:48.236 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 995 (ObjNum 645 snap 218 seq_num 645) dirty exists 2026-02-13T18:15:48.777 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:48.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient: get_monmap_and_config 2026-02-13T18:15:48.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient: build_initial_monmap 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient: monmap: 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:48.835646+0000 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:48.835646+0000 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:48.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 1 Processor -- start 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 1 -- start start 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient: init 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient(hunting): picked mon.noname-c con 0x7efee413f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient(hunting): picked mon.noname-a con 0x7efee4095410 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient(hunting): picked mon.noname-b con 0x7efee41851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4140290 con 0x7efee4095410 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4094750 con 0x7efee413f7b0 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4093c80 con 0x7efee41851c0 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:48.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee88e2640 10 monclient(hunting): authenticate will time out at 1179.890816s 2026-02-13T18:15:48.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 0x7efee4183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52236/0 (socket says 10.20.193.78:52236) 2026-02-13T18:15:48.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.832+0000 7efee2575640 1 -- 10.20.193.78:0/3760789206 learned_addr learned my addr 10.20.193.78:0/3760789206 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:48.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee2575640 1 -- 10.20.193.78:0/3760789206 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 legacy=0x7efee4183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:48.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee3577640 1 -- 10.20.193.78:0/3760789206 >> v1:10.20.193.78:6790/0 conn(0x7efee41851c0 legacy=0x7efee41a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:48.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842210107 0 0) 0x7efecc002c60 con 0x7efee4095410 2026-02-13T18:15:48.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): _negotiate 2026-02-13T18:15:48.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): my global_id is 94122 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed0003620 con 0x7efee4095410 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266421478 0 0) 0x7efee4093c80 con 0x7efee41851c0 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): _negotiate 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient(hunting): my global_id is 4856 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc002c60 con 0x7efee41851c0 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee2d76640 1 -- 10.20.193.78:0/3760789206 >> v1:10.20.193.187:6789/0 conn(0x7efee413f7b0 legacy=0x7efee413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2845442040 0 0) 0x7efed0003620 con 0x7efee4095410 2026-02-13T18:15:48.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 >> v1:10.20.193.78:6790/0 conn(0x7efee41851c0 legacy=0x7efee41a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 >> v1:10.20.193.187:6789/0 conn(0x7efee413f7b0 legacy=0x7efee413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: _finish_hunting 0 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 monclient: found mon.noname-a 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee4094190 con 0x7efee4095410 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: _finish_auth 0 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: _check_auth_tickets 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 5 monclient: authenticate success, global_id 94122 2026-02-13T18:15:48.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efecc003360 con 0x7efee4095410 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: dump: 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:48.850 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efecc0049a0 con 0x7efee4095410 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 1 -- 10.20.193.78:0/3760789206 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efecc004df0 con 0x7efee4095410 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee1d74640 10 monclient: dump: 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.851 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 4 set_mon_vals no callback set 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: shutdown 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- 10.20.193.78:0/3760789206 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 legacy=0x7efee4183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- 10.20.193.78:0/3760789206 shutdown_connections 2026-02-13T18:15:48.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- 10.20.193.78:0/3760789206 >> 10.20.193.78:0/3760789206 conn(0x7efee4054400 msgr2=0x7efee4054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- 10.20.193.78:0/3760789206 shutdown_connections 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- 10.20.193.78:0/3760789206 wait complete. 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: build_initial_monmap 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: monmap: 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:48.853 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 Processor -- start 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- start start 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: init 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient(hunting): picked mon.noname-a con 0x7efee4095410 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient(hunting): picked mon.noname-c con 0x7efee413f7b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient(hunting): picked mon.noname-b con 0x7efee41851c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4111ac0 con 0x7efee4095410 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4110c50 con 0x7efee41851c0 2026-02-13T18:15:48.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee410f760 con 0x7efee413f7b0 2026-02-13T18:15:48.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:48.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee88e2640 10 monclient(hunting): authenticate will time out at 1179.895307s 2026-02-13T18:15:48.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee2d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 0x7efee413e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52238/0 (socket says 10.20.193.78:52238) 2026-02-13T18:15:48.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.836+0000 7efee2d76640 1 -- 10.20.193.78:0/1672066896 learned_addr learned my addr 10.20.193.78:0/1672066896 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2d76640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 legacy=0x7efee413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2575640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6790/0 conn(0x7efee413f7b0 legacy=0x7efee413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393838621 0 0) 0x7efee4111ac0 con 0x7efee4095410 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): my global_id is 94125 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb0003620 con 0x7efee4095410 2026-02-13T18:15:48.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242543270 0 0) 0x7efee410f760 con 0x7efee413f7b0 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): my global_id is 4859 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee4111ac0 con 0x7efee413f7b0 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2d76640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 legacy=0x7efee413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2d76640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 legacy=0x7efee413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2d76640 1 --1- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 0x7efee413e5d0 :-1 s=OPENED pgs=242 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2d76640 1 --1- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 0x7efee413e5d0 :-1 s=OPENED pgs=242 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6789/0 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee3577640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.187:6789/0 conn(0x7efee41851c0 legacy=0x7efee41814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4229708926 0 0) 0x7efee4111ac0 con 0x7efee413f7b0 2026-02-13T18:15:48.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efee410f760 con 0x7efee413f7b0 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efecc003360 con 0x7efee413f7b0 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): dump: 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:48.861 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264985268 0 0) 0x7efee4110c50 con 0x7efee41851c0 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient(hunting): my global_id is 84223 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee4111ac0 con 0x7efee41851c0 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3413494187 0 0) 0x7efee410f760 con 0x7efee413f7b0 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.187:6789/0 conn(0x7efee41851c0 legacy=0x7efee41814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:48.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6789/0 conn(0x7efee4095410 legacy=0x7efee413e5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 monclient: found mon.c 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee4111220 con 0x7efee413f7b0 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: _finish_auth 0 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 5 monclient: authenticate success, global_id 4859 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 monclient: _renew_subs 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efee410f110 con 0x7efee413f7b0 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 monclient: _renew_subs 2026-02-13T18:15:48.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efee4110490 con 0x7efee413f7b0 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efecc0049a0 con 0x7efee413f7b0 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efecc005390 con 0x7efee413f7b0 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 10 monclient: dump: 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:48.864 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee1573640 4 set_mon_vals no callback set 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee40008e0 con 0x7efee413f7b0 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7efecc011a20 con 0x7efee413f7b0 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(497..497 src has 292..497) ==== 3931+0+0 (unknown 837545725 0 0) 0x7efecc04c890 con 0x7efee413f7b0 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.840+0000 7efee2d76640 10 monclient: get_auth_request con 0x7efeb003d6d0 auth_method 0 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.844+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7efee4140290 con 0x7efee413f7b0 2026-02-13T18:15:48.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.844+0000 7efec37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:48.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.844+0000 7efec37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efee4092cd0 con 0x7efee413f7b0 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efec37fe640 1 -- 10.20.193.78:0/1672066896 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2881014241) 0x7efecc0178f0 con 0x7efee413f7b0 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efec37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efec37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:48.968 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.187:6812/2668687789 conn(0x7efeb003d6d0 legacy=0x7efeb005db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 10 monclient: shutdown 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 >> v1:10.20.193.78:6790/0 conn(0x7efee413f7b0 legacy=0x7efee413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 shutdown_connections 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 >> 10.20.193.78:0/1672066896 conn(0x7efee4054400 msgr2=0x7efee41a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 shutdown_connections 2026-02-13T18:15:48.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:48.960+0000 7efee88e2640 1 -- 10.20.193.78:0/1672066896 wait complete. 2026-02-13T18:15:48.980 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:15:48.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:15:48.980 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:15:49.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.036+0000 7f87219ab640 10 monclient: get_monmap_and_config 2026-02-13T18:15:49.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.036+0000 7f87219ab640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.036+0000 7f87219ab640 10 monclient: monmap: 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:49.041527+0000 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:49.041527+0000 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:49.047 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 Processor -- start 2026-02-13T18:15:49.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- start start 2026-02-13T18:15:49.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient: init 2026-02-13T18:15:49.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:49.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient(hunting): picked mon.noname-b con 0x7f871c084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient(hunting): picked mon.noname-a con 0x7f871c08d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient(hunting): picked mon.noname-c con 0x7f871c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871c08da30 con 0x7f871c08d5f0 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871c089e60 con 0x7f871c1831f0 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871c085410 con 0x7f871c084930 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient(hunting): authenticate will time out at 1180.096922s 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f871affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f871c084930 0x7f871c084d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39214/0 (socket says 10.20.193.78:39214) 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f871affd640 1 -- 10.20.193.78:0/1507813557 learned_addr learned my addr 10.20.193.78:0/1507813557 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f871a7fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f871c08d5f0 0x7f871c181ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52248/0 (socket says 10.20.193.78:52248) 2026-02-13T18:15:49.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f871affd640 1 -- 10.20.193.78:0/1507813557 >> v1:10.20.193.78:6790/0 conn(0x7f871c084930 legacy=0x7f871c084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f871a7fc640 1 -- 10.20.193.78:0/1507813557 >> v1:10.20.193.78:6789/0 conn(0x7f871c08d5f0 legacy=0x7f871c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461427876 0 0) 0x7f8704002c60 con 0x7f871c08d5f0 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): my global_id is 94128 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8708003620 con 0x7f871c08d5f0 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237829168 0 0) 0x7f871c085410 con 0x7f871c084930 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient(hunting): my global_id is 4862 2026-02-13T18:15:49.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8704002c60 con 0x7f871c084930 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f871b7fe640 1 -- 10.20.193.78:0/1507813557 >> v1:10.20.193.187:6789/0 conn(0x7f871c1831f0 legacy=0x7f871c1a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 552189682 0 0) 0x7f8708003620 con 0x7f871c08d5f0 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 >> v1:10.20.193.78:6790/0 conn(0x7f871c084930 legacy=0x7f871c084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 >> v1:10.20.193.187:6789/0 conn(0x7f871c1831f0 legacy=0x7f871c1a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 monclient: found mon.noname-a 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c089b80 con 0x7f871c08d5f0 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f87040032e0 con 0x7f871c08d5f0 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: dump: 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.059 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 5 monclient: authenticate success, global_id 94128 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87040048e0 con 0x7f871c08d5f0 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 1 -- 10.20.193.78:0/1507813557 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8704004c70 con 0x7f871c08d5f0 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f8719ffb640 10 monclient: dump: 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.060 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 4 set_mon_vals no callback set 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 10 monclient: shutdown 2026-02-13T18:15:49.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- 10.20.193.78:0/1507813557 >> v1:10.20.193.78:6789/0 conn(0x7f871c08d5f0 legacy=0x7f871c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- 10.20.193.78:0/1507813557 shutdown_connections 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- 10.20.193.78:0/1507813557 >> 10.20.193.78:0/1507813557 conn(0x7f871c091720 msgr2=0x7f871c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- 10.20.193.78:0/1507813557 shutdown_connections 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.040+0000 7f87219ab640 1 -- 10.20.193.78:0/1507813557 wait complete. 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: monmap: 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:49.062 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 Processor -- start 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 -- start start 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: init 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient(hunting): picked mon.noname-c con 0x7f871c084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient(hunting): picked mon.noname-a con 0x7f871c08d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient(hunting): picked mon.noname-b con 0x7f871c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871c07eaf0 con 0x7f871c08d5f0 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871c0830f0 con 0x7f871c1831f0 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871c088910 con 0x7f871c084930 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient(hunting): authenticate will time out at 1180.100784s 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f871affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f871c084930 0x7f871c131bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39220/0 (socket says 10.20.193.78:39220) 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f871affd640 1 -- 10.20.193.78:0/3702594484 learned_addr learned my addr 10.20.193.78:0/3702594484 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f871a7fc640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c08d5f0 legacy=0x7f871c172c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f871affd640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6790/0 conn(0x7f871c084930 legacy=0x7f871c131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400654007 0 0) 0x7f871c07eaf0 con 0x7f871c08d5f0 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): my global_id is 94131 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86ec003620 con 0x7f871c08d5f0 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790584592 0 0) 0x7f871c088910 con 0x7f871c084930 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): my global_id is 4865 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f871c07eaf0 con 0x7f871c084930 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f871b7fe640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.187:6789/0 conn(0x7f871c1831f0 legacy=0x7f871c1743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 686869590 0 0) 0x7f86ec003620 con 0x7f871c08d5f0 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f871c088910 con 0x7f871c08d5f0 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8704004a90 con 0x7f871c08d5f0 2026-02-13T18:15:49.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): dump: 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2100865017 0 0) 0x7f871c07eaf0 con 0x7f871c084930 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86ec003620 con 0x7f871c084930 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f87100033a0 con 0x7f871c084930 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient(hunting): dump: 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.067 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4026721851 0 0) 0x7f871c088910 con 0x7f871c08d5f0 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6790/0 conn(0x7f871c084930 legacy=0x7f871c131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.187:6789/0 conn(0x7f871c1831f0 legacy=0x7f871c1743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 monclient: found mon.a 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c081ff0 con 0x7f871c08d5f0 2026-02-13T18:15:49.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 5 monclient: authenticate success, global_id 94131 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: _renew_subs 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f871c07c790 con 0x7f871c08d5f0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: _renew_subs 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f871c07d2f0 con 0x7f871c08d5f0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87040048e0 con 0x7f871c08d5f0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8704005400 con 0x7f871c08d5f0 2026-02-13T18:15:49.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f86f3fff640 10 monclient: dump: 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.070 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.044+0000 7f87197fa640 4 set_mon_vals no callback set 2026-02-13T18:15:49.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f87219ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f871c0389c0 con 0x7f871c07bde0 2026-02-13T18:15:49.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f8704011a90 con 0x7f871c08d5f0 2026-02-13T18:15:49.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(497..497 src has 292..497) ==== 3931+0+0 (unknown 837545725 0 0) 0x7f870404c860 con 0x7f871c08d5f0 2026-02-13T18:15:49.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f871b7fe640 10 monclient: get_auth_request con 0x7f86ec03d600 auth_method 0 2026-02-13T18:15:49.072 INFO:tasks.rados.rados.0.trial187.stdout:2107: done (3 left) 2026-02-13T18:15:49.072 INFO:tasks.rados.rados.0.trial187.stdout:2108: done (2 left) 2026-02-13T18:15:49.072 INFO:tasks.rados.rados.0.trial187.stdout:2109: done (1 left) 2026-02-13T18:15:49.072 INFO:tasks.rados.rados.0.trial187.stdout:2110: done (0 left) 2026-02-13T18:15:49.072 INFO:tasks.rados.rados.0.trial187.stdout:2111: snap_remove snap 229 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f871affd640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c07bde0 legacy=0x7f871c05b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249381071 0 0) 0x7f871c0389c0 con 0x7f871c07bde0 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient(hunting): my global_id is 94134 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f871c088910 con 0x7f871c07bde0 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3256843779 0 0) 0x7f871c088910 con 0x7f871c07bde0 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f871c0389c0 con 0x7f871c07bde0 2026-02-13T18:15:49.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8710004f30 con 0x7f871c07bde0 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient: dump: 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.076 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2270193867 0 0) 0x7f871c0389c0 con 0x7f871c07bde0 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f871c08f600 con 0x7f871c07bde0 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8710007280 con 0x7f871c07bde0 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c07bde0 legacy=0x7f871c05b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.048+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c07bde0 legacy=0x7f871c05b3a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.052+0000 7f87219ab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.052+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f871c090810 con 0x7f871c132300 2026-02-13T18:15:49.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f871affd640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c132300 legacy=0x7f871c05bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277180775 0 0) 0x7f871c090810 con 0x7f871c132300 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient(hunting): my global_id is 94137 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f871c0389c0 con 0x7f871c132300 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2050919576 0 0) 0x7f871c0389c0 con 0x7f871c132300 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f871c090810 con 0x7f871c132300 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8710005600 con 0x7f871c132300 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient: dump: 2026-02-13T18:15:49.078 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1819652850 0 0) 0x7f871c090810 con 0x7f871c132300 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f871c0510e0 con 0x7f871c132300 2026-02-13T18:15:49.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4340 (unknown 0 0 525650229) 0x7f8710006a00 con 0x7f871c132300 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c132300 legacy=0x7f871c05bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f86f3fff640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c132300 legacy=0x7f871c05bab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:49.080 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 38, 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 32102, 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:15:49.081 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.082 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.083 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:15:49.084 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.085 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.086 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.087 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:49.088 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.089 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.090 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.091 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:15:49.091 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.091 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.091 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.091 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:15:49.091 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.187:6812/2668687789 conn(0x7f86ec03d600 legacy=0x7f86ec05dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 10 monclient: shutdown 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 >> v1:10.20.193.78:6789/0 conn(0x7f871c08d5f0 legacy=0x7f871c172c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f871b7fe640 1 -- 10.20.193.78:0/3702594484 reap_dead start 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f871b7fe640 1 -- 10.20.193.78:0/3702594484 reap_dead start 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 shutdown_connections 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 >> 10.20.193.78:0/3702594484 conn(0x7f871c091720 msgr2=0x7f871c1a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 shutdown_connections 2026-02-13T18:15:49.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.056+0000 7f87219ab640 1 -- 10.20.193.78:0/3702594484 wait complete. 2026-02-13T18:15:49.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:15:49.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:15:49.093 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:15:49.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.144+0000 7f35c4cab640 10 monclient: get_monmap_and_config 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.144+0000 7f35c4cab640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.144+0000 7f35c4cab640 10 monclient: monmap: 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:49.148882+0000 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:49.148882+0000 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:49.154 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.144+0000 7f35c4cab640 1 Processor -- start 2026-02-13T18:15:49.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.144+0000 7f35c4cab640 1 -- start start 2026-02-13T18:15:49.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.144+0000 7f35c4cab640 10 monclient: init 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient(hunting): picked mon.noname-a con 0x7f35c0084930 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient(hunting): picked mon.noname-b con 0x7f35c008d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient(hunting): picked mon.noname-c con 0x7f35c01831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c008da30 con 0x7f35c0084930 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c0089e60 con 0x7f35c01831f0 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c0085410 con 0x7f35c008d5f0 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient(hunting): authenticate will time out at 1180.204237s 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35be575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f35c0084930 0x7f35c0084d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52274/0 (socket says 10.20.193.78:52274) 2026-02-13T18:15:49.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35be575640 1 -- 10.20.193.78:0/3995279825 learned_addr learned my addr 10.20.193.78:0/3995279825 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35be575640 1 -- 10.20.193.78:0/3995279825 >> v1:10.20.193.78:6789/0 conn(0x7f35c0084930 legacy=0x7f35c0084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bdd74640 1 -- 10.20.193.78:0/3995279825 >> v1:10.20.193.78:6790/0 conn(0x7f35c008d5f0 legacy=0x7f35c0181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bed76640 1 -- 10.20.193.78:0/3995279825 >> v1:10.20.193.187:6789/0 conn(0x7f35c01831f0 legacy=0x7f35c01a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244635905 0 0) 0x7f35b4002c60 con 0x7f35c0084930 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): my global_id is 94140 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac003620 con 0x7f35c0084930 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979426909 0 0) 0x7f35c0085410 con 0x7f35c008d5f0 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): my global_id is 4868 2026-02-13T18:15:49.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b4002c60 con 0x7f35c008d5f0 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134065992 0 0) 0x7f35c0089e60 con 0x7f35c01831f0 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient(hunting): my global_id is 84232 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c0085410 con 0x7f35c01831f0 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1715545368 0 0) 0x7f35ac003620 con 0x7f35c0084930 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 >> v1:10.20.193.78:6790/0 conn(0x7f35c008d5f0 legacy=0x7f35c0181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 >> v1:10.20.193.187:6789/0 conn(0x7f35c01831f0 legacy=0x7f35c01a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 monclient: found mon.noname-a 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c0089b80 con 0x7f35c0084930 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35b40032e0 con 0x7f35c0084930 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: dump: 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 5 monclient: authenticate success, global_id 94140 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:49.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35b40049a0 con 0x7f35c0084930 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 1 -- 10.20.193.78:0/3995279825 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35b4004d30 con 0x7f35c0084930 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35bd573640 10 monclient: dump: 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:49.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 4 set_mon_vals no callback set 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 10 monclient: shutdown 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- 10.20.193.78:0/3995279825 >> v1:10.20.193.78:6789/0 conn(0x7f35c0084930 legacy=0x7f35c0084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- 10.20.193.78:0/3995279825 shutdown_connections 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- 10.20.193.78:0/3995279825 >> 10.20.193.78:0/3995279825 conn(0x7f35c0091720 msgr2=0x7f35c0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- 10.20.193.78:0/3995279825 shutdown_connections 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.148+0000 7f35c4cab640 1 -- 10.20.193.78:0/3995279825 wait complete. 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: monmap: 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:49.164 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 Processor -- start 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 -- start start 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: init 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient(hunting): picked mon.noname-b con 0x7f35c0084930 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient(hunting): picked mon.noname-a con 0x7f35c008d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient(hunting): picked mon.noname-c con 0x7f35c01831f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c007f040 con 0x7f35c008d5f0 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c005ca30 con 0x7f35c0084930 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c0088910 con 0x7f35c01831f0 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient(hunting): authenticate will time out at 1180.208933s 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35bdd74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f35c008d5f0 0x7f35c0172bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52288/0 (socket says 10.20.193.78:52288) 2026-02-13T18:15:49.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35bdd74640 1 -- 10.20.193.78:0/2494570705 learned_addr learned my addr 10.20.193.78:0/2494570705 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35bdd74640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6789/0 conn(0x7f35c008d5f0 legacy=0x7f35c0172bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35bed76640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c01831f0 legacy=0x7f35c01742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35be575640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.187:6789/0 conn(0x7f35c0084930 legacy=0x7f35c0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56914356 0 0) 0x7f35c007f040 con 0x7f35c008d5f0 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): my global_id is 94143 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f358c003620 con 0x7f35c008d5f0 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389072670 0 0) 0x7f35c0088910 con 0x7f35c01831f0 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): my global_id is 4871 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c007f040 con 0x7f35c01831f0 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480762584 0 0) 0x7f35c005ca30 con 0x7f35c0084930 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): my global_id is 84235 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c0088910 con 0x7f35c0084930 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3252059513 0 0) 0x7f358c003620 con 0x7f35c008d5f0 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35c005ca30 con 0x7f35c008d5f0 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35a8003710 con 0x7f35c008d5f0 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): dump: 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.171 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2829312119 0 0) 0x7f35c007f040 con 0x7f35c01831f0 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f358c003620 con 0x7f35c01831f0 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35b0004910 con 0x7f35c01831f0 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): dump: 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.172 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3708588257 0 0) 0x7f35c0088910 con 0x7f35c0084930 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35c007f040 con 0x7f35c0084930 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35b40030c0 con 0x7f35c0084930 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient(hunting): dump: 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3922316619 0 0) 0x7f35c005ca30 con 0x7f35c008d5f0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c01831f0 legacy=0x7f35c01742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.187:6789/0 conn(0x7f35c0084930 legacy=0x7f35c0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 monclient: found mon.a 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c005d6e0 con 0x7f35c008d5f0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 5 monclient: authenticate success, global_id 94143 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: _renew_subs 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35c00830f0 con 0x7f35c008d5f0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: _renew_subs 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.152+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f35c005bd80 con 0x7f35c008d5f0 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35a8003c90 con 0x7f35c008d5f0 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35a8003ff0 con 0x7f35c008d5f0 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: dump: 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35bcd72640 4 set_mon_vals no callback set 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35c4cab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f35c00389c0 con 0x7f35c0132460 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f35a80042c0 con 0x7f35c008d5f0 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(498..498 src has 292..498) ==== 3931+0+0 (unknown 454296637 0 0) 0x7f35a804c720 con 0x7f35c008d5f0 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35bed76640 10 monclient: get_auth_request con 0x7f358c03d9c0 auth_method 0 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35be575640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c0132460 legacy=0x7f35c0058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447824791 0 0) 0x7f35c00389c0 con 0x7f35c0132460 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient(hunting): my global_id is 4874 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c005ca30 con 0x7f35c0132460 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1924750742 0 0) 0x7f35c005ca30 con 0x7f35c0132460 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35c00389c0 con 0x7f35c0132460 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35b4004d40 con 0x7f35c0132460 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: dump: 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 115463473 0 0) 0x7f35c00389c0 con 0x7f35c0132460 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35c007e9e0 con 0x7f35c0132460 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f35b4005060 con 0x7f35c0132460 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c0132460 legacy=0x7f35c0058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.156+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c0132460 legacy=0x7f35c0058010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:49.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.160+0000 7f35c4cab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:15:49.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.160+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f35c008f600 con 0x7f35c004d200 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35be575640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c004d200 legacy=0x7f35c0176a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244767489 0 0) 0x7f35c008f600 con 0x7f35c004d200 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient(hunting): my global_id is 4877 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c00389c0 con 0x7f35c004d200 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 913104874 0 0) 0x7f35c00389c0 con 0x7f35c004d200 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35c008f600 con 0x7f35c004d200 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f35b4005670 con 0x7f35c004d200 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient: dump: 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2532829261 0 0) 0x7f35c008f600 con 0x7f35c004d200 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f35c008d3c0 con 0x7f35c004d200 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 3680749328) 0x7f35b4005910 con 0x7f35c004d200 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:49.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c004d200 legacy=0x7f35c0176a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35a6ffd640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6790/0 conn(0x7f35c004d200 legacy=0x7f35c0176a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 38, 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 630555, 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:15:49.181 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.182 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.183 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:49.184 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:49.185 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:49.186 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.187 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.188 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.189 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.190 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:49.190 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.190 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.190 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.190 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:15:49.190 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.187:6812/2668687789 conn(0x7f358c03d9c0 legacy=0x7f358c05de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 10 monclient: shutdown 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 >> v1:10.20.193.78:6789/0 conn(0x7f35c008d5f0 legacy=0x7f35c0172bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35bed76640 1 -- 10.20.193.78:0/2494570705 reap_dead start 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35bed76640 1 -- 10.20.193.78:0/2494570705 reap_dead start 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 shutdown_connections 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 >> 10.20.193.78:0/2494570705 conn(0x7f35c0091720 msgr2=0x7f35c01a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 shutdown_connections 2026-02-13T18:15:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.164+0000 7f35c4cab640 1 -- 10.20.193.78:0/2494570705 wait complete. 2026-02-13T18:15:49.191 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:15:49.192 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:15:49.192 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient: get_monmap_and_config 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient: monmap: 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:49.255957+0000 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:49.255957+0000 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:49.261 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 1 Processor -- start 2026-02-13T18:15:49.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 1 -- start start 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient: init 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient(hunting): picked mon.noname-c con 0x7feab408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient(hunting): picked mon.noname-a con 0x7feab408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient(hunting): picked mon.noname-b con 0x7feab408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab4089e80 con 0x7feab408dc80 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab4088c20 con 0x7feab408c2f0 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab4089ba0 con 0x7feab408cdd0 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feababdf640 10 monclient(hunting): authenticate will time out at 1180.311292s 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feaabfff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7feab408dc80 0x7feab4181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52298/0 (socket says 10.20.193.78:52298) 2026-02-13T18:15:49.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.252+0000 7feaabfff640 1 -- 10.20.193.78:0/2703780219 learned_addr learned my addr 10.20.193.78:0/2703780219 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaabfff640 1 -- 10.20.193.78:0/2703780219 >> v1:10.20.193.78:6789/0 conn(0x7feab408dc80 legacy=0x7feab4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feab9155640 1 -- 10.20.193.78:0/2703780219 >> v1:10.20.193.78:6790/0 conn(0x7feab408cdd0 legacy=0x7feab41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151734264 0 0) 0x7feab4089e80 con 0x7feab408dc80 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): my global_id is 94146 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feab8954640 1 -- 10.20.193.78:0/2703780219 >> v1:10.20.193.187:6789/0 conn(0x7feab408c2f0 legacy=0x7feab408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaa0003620 con 0x7feab408dc80 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461907526 0 0) 0x7feab4089ba0 con 0x7feab408cdd0 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient(hunting): my global_id is 4880 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab4089e80 con 0x7feab408cdd0 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 472488687 0 0) 0x7feaa0003620 con 0x7feab408dc80 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 >> v1:10.20.193.78:6790/0 conn(0x7feab408cdd0 legacy=0x7feab41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 >> v1:10.20.193.187:6789/0 conn(0x7feab408c2f0 legacy=0x7feab408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 monclient: found mon.noname-a 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab408d370 con 0x7feab408dc80 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fea9c003190 con 0x7feab408dc80 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: dump: 2026-02-13T18:15:49.266 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 5 monclient: authenticate success, global_id 94146 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea9c003420 con 0x7feab408dc80 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 4 set_mon_vals no callback set 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 1 -- 10.20.193.78:0/2703780219 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fea9c004b50 con 0x7feab408dc80 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feaab7fe640 10 monclient: dump: 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: shutdown 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- 10.20.193.78:0/2703780219 >> v1:10.20.193.78:6789/0 conn(0x7feab408dc80 legacy=0x7feab4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- 10.20.193.78:0/2703780219 shutdown_connections 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- 10.20.193.78:0/2703780219 >> 10.20.193.78:0/2703780219 conn(0x7feab4091720 msgr2=0x7feab4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- 10.20.193.78:0/2703780219 shutdown_connections 2026-02-13T18:15:49.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- 10.20.193.78:0/2703780219 wait complete. 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: monmap: 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:49.269 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 Processor -- start 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- start start 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: init 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient(hunting): picked mon.noname-b con 0x7feab408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient(hunting): picked mon.noname-c con 0x7feab408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient(hunting): picked mon.noname-a con 0x7feab408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab4080430 con 0x7feab408dc80 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab4082790 con 0x7feab408c2f0 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab407f7e0 con 0x7feab408cdd0 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feababdf640 10 monclient(hunting): authenticate will time out at 1180.315266s 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feab9155640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7feab408dc80 0x7feab4195e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52306/0 (socket says 10.20.193.78:52306) 2026-02-13T18:15:49.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.256+0000 7feab9155640 1 -- 10.20.193.78:0/2122617006 learned_addr learned my addr 10.20.193.78:0/2122617006 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feab9155640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.78:6789/0 conn(0x7feab408dc80 legacy=0x7feab4195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaabfff640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.78:6790/0 conn(0x7feab408cdd0 legacy=0x7feab407f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588748421 0 0) 0x7feab4080430 con 0x7feab408dc80 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): my global_id is 94149 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea84003620 con 0x7feab408dc80 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306850667 0 0) 0x7feab407f7e0 con 0x7feab408cdd0 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): my global_id is 4883 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab4080430 con 0x7feab408cdd0 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feab8954640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab408c2f0 legacy=0x7feab407e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2678468094 0 0) 0x7fea84003620 con 0x7feab408dc80 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feab407f7e0 con 0x7feab408dc80 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feab0004900 con 0x7feab408dc80 2026-02-13T18:15:49.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): dump: 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652073975 0 0) 0x7feab4082790 con 0x7feab408c2f0 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient(hunting): my global_id is 84241 2026-02-13T18:15:49.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea84003620 con 0x7feab408c2f0 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 896632944 0 0) 0x7feab407f7e0 con 0x7feab408dc80 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.78:6790/0 conn(0x7feab408cdd0 legacy=0x7feab407f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab408c2f0 legacy=0x7feab407e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 monclient: found mon.a 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab40824b0 con 0x7feab408dc80 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 5 monclient: authenticate success, global_id 94149 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 10 monclient: _renew_subs 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feab4083260 con 0x7feab408dc80 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 10 monclient: _renew_subs 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feab4081160 con 0x7feab408dc80 2026-02-13T18:15:49.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feab0004ed0 con 0x7feab408dc80 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feab00052f0 con 0x7feab408dc80 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 10 monclient: dump: 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaaaffd640 4 set_mon_vals no callback set 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7feab0005510 con 0x7feab408dc80 2026-02-13T18:15:49.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feab4084250 con 0x7feab4083e80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(498..498 src has 292..498) ==== 3931+0+0 (unknown 454296637 0 0) 0x7feab004dc90 con 0x7feab408dc80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.260+0000 7feaabfff640 10 monclient: get_auth_request con 0x7fea8403d6a0 auth_method 0 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feab8954640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab4083e80 legacy=0x7feab407a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052911196 0 0) 0x7feab4084250 con 0x7feab4083e80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient(hunting): my global_id is 84244 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab407f7e0 con 0x7feab4083e80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3740724736 0 0) 0x7feab407f7e0 con 0x7feab4083e80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feab4084250 con 0x7feab4083e80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feaa40032a0 con 0x7feab4083e80 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient: dump: 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.278 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3454134557 0 0) 0x7feab4084250 con 0x7feab4083e80 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feab405e5e0 con 0x7feab4083e80 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7feaa40058c0 con 0x7feab4083e80 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab4083e80 legacy=0x7feab407a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.264+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab4083e80 legacy=0x7feab407a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:49.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.268+0000 7feababdf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.268+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feab408f600 con 0x7feab407aae0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.268+0000 7feab8954640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab407aae0 legacy=0x7feab4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243538849 0 0) 0x7feab408f600 con 0x7feab407aae0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient(hunting): my global_id is 84247 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab4084250 con 0x7feab407aae0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3630023165 0 0) 0x7feab4084250 con 0x7feab407aae0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feab408f600 con 0x7feab407aae0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feaa4003ab0 con 0x7feab407aae0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient: dump: 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.281 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1921692420 0 0) 0x7feab408f600 con 0x7feab407aae0 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feab4082080 con 0x7feab407aae0 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 1590363478) 0x7feaa4005b40 con 0x7feab407aae0 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab407aae0 legacy=0x7feab4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feaa97fa640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6789/0 conn(0x7feab407aae0 legacy=0x7feab4198550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 38, 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 177438, 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:15:49.283 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.284 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:15:49.285 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:49.286 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.287 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.288 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.289 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.290 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:15:49.291 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:15:49.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.187:6812/2668687789 conn(0x7fea8403d6a0 legacy=0x7fea8405db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 10 monclient: shutdown 2026-02-13T18:15:49.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 >> v1:10.20.193.78:6789/0 conn(0x7feab408dc80 legacy=0x7feab4195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feab9155640 1 -- 10.20.193.78:0/2122617006 reap_dead start 2026-02-13T18:15:49.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feab9155640 1 -- 10.20.193.78:0/2122617006 reap_dead start 2026-02-13T18:15:49.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 shutdown_connections 2026-02-13T18:15:49.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 >> 10.20.193.78:0/2122617006 conn(0x7feab4091720 msgr2=0x7feab405b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 shutdown_connections 2026-02-13T18:15:49.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.272+0000 7feababdf640 1 -- 10.20.193.78:0/2122617006 wait complete. 2026-02-13T18:15:49.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:15:49.293 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:15:49.293 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient: get_monmap_and_config 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient: monmap: 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:49.350243+0000 2026-02-13T18:15:49.355 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:49.350243+0000 2026-02-13T18:15:49.356 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.356 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.356 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.356 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:49.356 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:49.356 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 1 Processor -- start 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 1 -- start start 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient: init 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient(hunting): picked mon.noname-a con 0x7f12f8085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient(hunting): picked mon.noname-b con 0x7f12f8085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient(hunting): picked mon.noname-c con 0x7f12f8181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f8088400 con 0x7f12f8085790 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f8088120 con 0x7f12f8181d50 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f808c550 con 0x7f12f8085b60 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12fdb8c640 10 monclient(hunting): authenticate will time out at 1180.405598s 2026-02-13T18:15:49.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12f77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f12f8085790 0x7f12f8089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52318/0 (socket says 10.20.193.78:52318) 2026-02-13T18:15:49.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12f77fe640 1 -- 10.20.193.78:0/2536810838 learned_addr learned my addr 10.20.193.78:0/2536810838 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12f77fe640 1 -- 10.20.193.78:0/2536810838 >> v1:10.20.193.78:6789/0 conn(0x7f12f8085790 legacy=0x7f12f8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12f6ffd640 1 -- 10.20.193.78:0/2536810838 >> v1:10.20.193.78:6790/0 conn(0x7f12f8085b60 legacy=0x7f12f8085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12f7fff640 1 -- 10.20.193.78:0/2536810838 >> v1:10.20.193.187:6789/0 conn(0x7f12f8181d50 legacy=0x7f12f81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.348+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109528459 0 0) 0x7f12e4002c60 con 0x7f12f8085790 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): my global_id is 94152 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12dc003620 con 0x7f12f8085790 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942676219 0 0) 0x7f12f808c550 con 0x7f12f8085b60 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): my global_id is 4886 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e4002c60 con 0x7f12f8085b60 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933918173 0 0) 0x7f12f8088120 con 0x7f12f8181d50 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient(hunting): my global_id is 84250 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12f808c550 con 0x7f12f8181d50 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3325130923 0 0) 0x7f12dc003620 con 0x7f12f8085790 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 >> v1:10.20.193.78:6790/0 conn(0x7f12f8085b60 legacy=0x7f12f8085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 >> v1:10.20.193.187:6789/0 conn(0x7f12f8181d50 legacy=0x7f12f81a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 monclient: found mon.noname-a 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f8087540 con 0x7f12f8085790 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f12e40032e0 con 0x7f12f8085790 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: dump: 2026-02-13T18:15:49.361 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 5 monclient: authenticate success, global_id 94152 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12e40049a0 con 0x7f12f8085790 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 1 -- 10.20.193.78:0/2536810838 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f12e4004d30 con 0x7f12f8085790 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f67fc640 10 monclient: dump: 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.362 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 4 set_mon_vals no callback set 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: shutdown 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- 10.20.193.78:0/2536810838 >> v1:10.20.193.78:6789/0 conn(0x7f12f8085790 legacy=0x7f12f8089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- 10.20.193.78:0/2536810838 shutdown_connections 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- 10.20.193.78:0/2536810838 >> 10.20.193.78:0/2536810838 conn(0x7f12f8091720 msgr2=0x7f12f8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- 10.20.193.78:0/2536810838 shutdown_connections 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- 10.20.193.78:0/2536810838 wait complete. 2026-02-13T18:15:49.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: build_initial_monmap 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: monmap: 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:49.364 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 Processor -- start 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- start start 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: init 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient(hunting): picked mon.noname-b con 0x7f12f8085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient(hunting): picked mon.noname-a con 0x7f12f8085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient(hunting): picked mon.noname-c con 0x7f12f8181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f813f600 con 0x7f12f8085b60 2026-02-13T18:15:49.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f813cab0 con 0x7f12f8085790 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f813f8e0 con 0x7f12f8181d50 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12fdb8c640 10 monclient(hunting): authenticate will time out at 1180.410234s 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f6ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f12f8085b60 0x7f12f813c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:52326/0 (socket says 10.20.193.78:52326) 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f7fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f12f8181d50 0x7f12f8175620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39294/0 (socket says 10.20.193.78:39294) 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.352+0000 7f12f6ffd640 1 -- 10.20.193.78:0/608132363 learned_addr learned my addr 10.20.193.78:0/608132363 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12f7fff640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.78:6790/0 conn(0x7f12f8181d50 legacy=0x7f12f8175620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12f6ffd640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.78:6789/0 conn(0x7f12f8085b60 legacy=0x7f12f813c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12f77fe640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.187:6789/0 conn(0x7f12f8085790 legacy=0x7f12f813bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398680794 0 0) 0x7f12f813f8e0 con 0x7f12f8181d50 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): my global_id is 4889 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12c8003620 con 0x7f12f8181d50 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068795643 0 0) 0x7f12f813f600 con 0x7f12f8085b60 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): my global_id is 94155 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12f813f8e0 con 0x7f12f8085b60 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064907614 0 0) 0x7f12f813cab0 con 0x7f12f8085790 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): my global_id is 84253 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12f813f600 con 0x7f12f8085790 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2878017108 0 0) 0x7f12f813f8e0 con 0x7f12f8085b60 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12f813cab0 con 0x7f12f8085b60 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f12e8003450 con 0x7f12f8085b60 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): dump: 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.369 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3377229655 0 0) 0x7f12c8003620 con 0x7f12f8181d50 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12f813f8e0 con 0x7f12f8181d50 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f12ec004910 con 0x7f12f8181d50 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): dump: 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.370 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 735047975 0 0) 0x7f12f813f600 con 0x7f12f8085790 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12c8003620 con 0x7f12f8085790 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f12e4004b50 con 0x7f12f8085790 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient(hunting): dump: 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.371 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1977648446 0 0) 0x7f12f813cab0 con 0x7f12f8085b60 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.78:6790/0 conn(0x7f12f8181d50 legacy=0x7f12f8175620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.187:6789/0 conn(0x7f12f8085790 legacy=0x7f12f813bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 monclient: found mon.a 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f8089bb0 con 0x7f12f8085b60 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: _finish_auth 0 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 5 monclient: authenticate success, global_id 94155 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 monclient: _renew_subs 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12f8088910 con 0x7f12f8085b60 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 monclient: _renew_subs 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f12f8140700 con 0x7f12f8085b60 2026-02-13T18:15:49.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12e8003b40 con 0x7f12f8085b60 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f12e8003f10 con 0x7f12f8085b60 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 10 monclient: dump: 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12f5ffb640 4 set_mon_vals no callback set 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f12e80041e0 con 0x7f12f8085b60 2026-02-13T18:15:49.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f808f620 con 0x7f12f8085b60 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(498..498 src has 292..498) ==== 3931+0+0 (unknown 454296637 0 0) 0x7f12e804c6e0 con 0x7f12f8085b60 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.356+0000 7f12f77fe640 10 monclient: get_auth_request con 0x7f12c803d9c0 auth_method 0 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.360+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f12f808f620 con 0x7f12f8085b60 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.360+0000 7f12d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:49.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.360+0000 7f12d3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:49.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:15:49.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:15:49.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:49.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f12f80510e0 con 0x7f12f8085b60 2026-02-13T18:15:49.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=1,health=11,kv=11,logm=61} crc {auth=620138569,config=1228700967,health=294384058,kv=4087868365,logm=2977404046}) 2026-02-13T18:15:49.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=11,logm=58} crc {auth=2944402683,config=1618278320,health=2038788593,kv=4087868365,logm=3746678157}) 2026-02-13T18:15:49.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=1,health=11,kv=11,logm=61} crc {auth=620138569,config=1228700967,health=294384058,kv=4087868365,logm=2977404046}) 2026-02-13T18:15:49.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=475468099,config=1618278320,health=2038788593,kv=4087868365,logm=1491227556}) 2026-02-13T18:15:49.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12d3fff640 1 -- 10.20.193.78:0/608132363 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f12e80176e0 con 0x7f12f8085b60 2026-02-13T18:15:49.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12d3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:15:49.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12d3fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:49.487 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.487 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2277707632}) 2026-02-13T18:15:49.487 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=551488888}) 2026-02-13T18:15:49.487 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.487 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2277707632}) 2026-02-13T18:15:49.487 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=544864599}) 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.187:6812/2668687789 conn(0x7f12c803d9c0 legacy=0x7f12c805de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 10 monclient: shutdown 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 >> v1:10.20.193.78:6789/0 conn(0x7f12f8085b60 legacy=0x7f12f813c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 shutdown_connections 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 >> 10.20.193.78:0/608132363 conn(0x7f12f8091720 msgr2=0x7f12f805bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:49.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 shutdown_connections 2026-02-13T18:15:49.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:49.476+0000 7f12fdb8c640 1 -- 10.20.193.78:0/608132363 wait complete. 2026-02-13T18:15:49.491 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=521813969}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039174486}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=521813969}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.476+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2735842011}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4023073130}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899625472}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4023073130}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3144368114}) 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.492 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1989178223}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747648611}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1989178223}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3917950254}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4089977308}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270024740}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4089977308}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3469821564}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2807681086}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086599888}) 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.493 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2807681086}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3241069546}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=542251410}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354533656}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.480+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=542251410}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3466926073}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1560400914}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1926519586}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1560400914}) 2026-02-13T18:15:49.494 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3676660729}) 2026-02-13T18:15:49.496 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3692720855}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003132107}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3692720855}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1868865014}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1315010087}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=569632969}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1315010087}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1814695381}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2948174406}) 2026-02-13T18:15:49.497 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977607848}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2948174406}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2567383061}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2574958535}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205814974}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2574958535}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.484+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=165601889}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1829419397}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361598847}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1829419397}) 2026-02-13T18:15:49.498 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2816459082}) 2026-02-13T18:15:49.499 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.499 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3249654479}) 2026-02-13T18:15:49.499 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504468119}) 2026-02-13T18:15:49.499 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.499 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3249654479}) 2026-02-13T18:15:49.499 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=869195344}) 2026-02-13T18:15:49.500 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:15:49.500 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.500 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2781490931}) 2026-02-13T18:15:49.500 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3708394337}) 2026-02-13T18:15:49.500 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.501 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2781490931}) 2026-02-13T18:15:49.501 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.488+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2307210390}) 2026-02-13T18:15:49.737 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.737 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3034132897}) 2026-02-13T18:15:49.737 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2234632755}) 2026-02-13T18:15:49.737 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.737 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3034132897}) 2026-02-13T18:15:49.738 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2591242040}) 2026-02-13T18:15:49.739 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.739 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3128415949}) 2026-02-13T18:15:49.739 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272594880}) 2026-02-13T18:15:49.739 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.739 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3128415949}) 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.727+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2921112418}) 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2606508707}) 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2556777674}) 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2606508707}) 2026-02-13T18:15:49.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3295102716}) 2026-02-13T18:15:49.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=647220035}) 2026-02-13T18:15:49.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899282479}) 2026-02-13T18:15:49.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=647220035}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1542806645}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1139696914}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1020882137}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1139696914}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=93967019}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=22,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=34} crc {logm=474380817,mdsmap=685858242,mgr=869988007,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=4026392687,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=136691628,osd_snap=1435478608}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=30} crc {logm=1374559652,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=349170561,mon_config_key=2659569588,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=136691628,osd_snap=2885632924}) 2026-02-13T18:15:49.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=22,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=34} crc {logm=474380817,mdsmap=685858242,mgr=869988007,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=4026392687,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=136691628,osd_snap=1435478608}) 2026-02-13T18:15:49.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.731+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=29} crc {logm=3982978282,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2924939367,mon_config_key=2284528010,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=136691628,osd_snap=348680905}) 2026-02-13T18:15:49.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=62,osdmap=38} crc {osd_snap=1792709192,osdmap=134280470}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=64,osdmap=36} crc {osd_snap=4183402514,osdmap=1845980249}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=62,osdmap=38} crc {osd_snap=1792709192,osdmap=134280470}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=65,osdmap=35} crc {osd_snap=3220226376,osdmap=1883147134}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2010814116}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3249790762}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2010814116}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1534455669}) 2026-02-13T18:15:49.746 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.747 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=753662434}) 2026-02-13T18:15:49.747 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3078002987}) 2026-02-13T18:15:49.747 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.747 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=753662434}) 2026-02-13T18:15:49.747 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2812897459}) 2026-02-13T18:15:49.748 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.748 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=76} crc {osdmap=1396625664}) 2026-02-13T18:15:49.748 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=79} crc {osdmap=1039280048}) 2026-02-13T18:15:49.748 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:15:49.748 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=76} crc {osdmap=1396625664}) 2026-02-13T18:15:49.748 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:15:49.735+0000 7f9693a3d640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=79} crc {osdmap=2990185352}) 2026-02-13T18:15:50.070 INFO:tasks.rados.rados.0.trial187.stdout:2111: done (0 left) 2026-02-13T18:15:50.070 INFO:tasks.rados.rados.0.trial187.stdout:2112: copy_from oid 28 from oid 47 current snap is 243 2026-02-13T18:15:50.070 INFO:tasks.rados.rados.0.trial187.stdout:2113: read oid 40 snap 242 2026-02-13T18:15:50.070 INFO:tasks.rados.rados.0.trial187.stdout:2113: expect deleted 2026-02-13T18:15:50.070 INFO:tasks.rados.rados.0.trial187.stdout:2114: write oid 8 current snap is 243 2026-02-13T18:15:50.070 INFO:tasks.rados.rados.0.trial187.stdout:2114: seq_num 695 ranges {480865=486178,1453103=442564,2652627=519696} 2026-02-13T18:15:50.076 INFO:tasks.rados.rados.0.trial187.stdout:2114: writing trial18717860-8 from 480865 to 967043 tid 1 2026-02-13T18:15:50.083 INFO:tasks.rados.rados.0.trial187.stdout:2114: writing trial18717860-8 from 1453103 to 1895667 tid 2 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2114: writing trial18717860-8 from 2652627 to 3172323 tid 3 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2115: rollback oid 37 current snap is 243 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 236 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2114: finishing write tid 1 to trial18717860-8 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2112: finishing copy_from racing read to trial18717860-28 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2114: finishing write tid 2 to trial18717860-8 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2112: finishing copy_from to trial18717860-28 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2112: done (3 left) 2026-02-13T18:15:50.092 INFO:tasks.rados.rados.0.trial187.stdout:2113: done (2 left) 2026-02-13T18:15:50.093 INFO:tasks.rados.rados.0.trial187.stdout:2116: write (excl) oid 1 current snap is 243 2026-02-13T18:15:50.093 INFO:tasks.rados.rados.0.trial187.stdout:2116: seq_num 696 ranges {497672=561427,1795232=702575,2963697=730968} 2026-02-13T18:15:50.099 INFO:tasks.rados.rados.0.trial187.stdout:2116: writing trial18717860-1 from 497672 to 1059099 tid 1 2026-02-13T18:15:50.109 INFO:tasks.rados.rados.0.trial187.stdout:2116: writing trial18717860-1 from 1795232 to 2497807 tid 2 2026-02-13T18:15:50.117 INFO:tasks.rados.rados.0.trial187.stdout:2116: writing trial18717860-1 from 2963697 to 3694665 tid 3 2026-02-13T18:15:50.117 INFO:tasks.rados.rados.0.trial187.stdout:2117: read oid 50 snap -1 2026-02-13T18:15:50.117 INFO:tasks.rados.rados.0.trial187.stdout:2117: expect deleted 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2118: rollback oid 33 current snap is 243 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 33 to 196 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: finishing write tid 3 to trial18717860-8 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2119: copy_from oid 17 from oid 47 current snap is 243 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: finishing write tid 4 to trial18717860-8 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: finishing write tid 5 to trial18717860-8 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: oid 8 updating version 0 to 805 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: oid 8 updating version 805 to 807 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: oid 8 version 807 is already newer than 804 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: oid 8 version 807 is already newer than 806 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 807 (ObjNum 695 snap 243 seq_num 695) dirty exists 2026-02-13T18:15:50.118 INFO:tasks.rados.rados.0.trial187.stdout:2114: left oid 8 (ObjNum 695 snap 243 seq_num 695) 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2115: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2115: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2115: finishing rollback tid 2 to trial18717860-37 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1301 (ObjNum 674 snap 232 seq_num 674) dirty exists 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2116: finishing write tid 1 to trial18717860-1 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2116: finishing write tid 2 to trial18717860-1 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2114: done (5 left) 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2115: done (4 left) 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2120: read oid 18 snap -1 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2120: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2121: read oid 23 snap -1 2026-02-13T18:15:50.119 INFO:tasks.rados.rados.0.trial187.stdout:2121: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:15:50.120 INFO:tasks.rados.rados.0.trial187.stdout:2122: delete oid 14 current snap is 243 2026-02-13T18:15:50.120 INFO:tasks.rados.rados.0.trial187.stdout:2118: finishing rollback tid 0 to trial18717860-33 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: finishing write tid 3 to trial18717860-1 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: finishing write tid 4 to trial18717860-1 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: finishing write tid 5 to trial18717860-1 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: oid 1 updating version 0 to 898 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: oid 1 updating version 898 to 899 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: oid 1 version 899 is already newer than 897 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: oid 1 version 899 is already newer than 896 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 899 (ObjNum 696 snap 243 seq_num 696) dirty exists 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2116: left oid 1 (ObjNum 696 snap 243 seq_num 696) 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:2118: finishing rollback tid 1 to trial18717860-33 2026-02-13T18:15:50.121 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1304 (ObjNum 129 snap 0 seq_num 3015285008) dirty dne 2026-02-13T18:15:50.122 INFO:tasks.rados.rados.0.trial187.stdout:2121: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:15:50.143 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3253064 2026-02-13T18:15:50.149 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 753578 2026-02-13T18:15:50.201 INFO:tasks.rados.rados.0.trial187.stdout:2120: expect (ObjNum 585 snap 200 seq_num 585) 2026-02-13T18:15:50.207 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2268449 2026-02-13T18:15:50.227 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2144436 2026-02-13T18:15:50.272 INFO:tasks.rados.rados.0.trial187.stdout:2119: finishing copy_from racing read to trial18717860-17 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2119: finishing copy_from to trial18717860-17 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2116: done (6 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2117: done (5 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2118: done (4 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2119: done (3 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2120: done (2 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2121: done (1 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2122: done (0 left) 2026-02-13T18:15:50.273 INFO:tasks.rados.rados.0.trial187.stdout:2123: read oid 23 snap -1 2026-02-13T18:15:50.274 INFO:tasks.rados.rados.0.trial187.stdout:2123: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:15:50.274 INFO:tasks.rados.rados.0.trial187.stdout:2124: snap_create 2026-02-13T18:15:50.276 INFO:tasks.rados.rados.0.trial187.stdout:2123: expect (ObjNum 555 snap 185 seq_num 555) 2026-02-13T18:15:50.276 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:15:50.322 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 521197 2026-02-13T18:15:50.347 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 633955 2026-02-13T18:15:50.500 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:15:50.501 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient: get_monmap_and_config 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient: monmap: 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:50.555861+0000 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:50.555861+0000 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.561 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.562 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.562 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:50.562 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:50.562 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 1 Processor -- start 2026-02-13T18:15:50.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 1 -- start start 2026-02-13T18:15:50.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient: init 2026-02-13T18:15:50.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient(hunting): picked mon.noname-c con 0x7f961c05e570 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient(hunting): picked mon.noname-b con 0x7f961c08cad0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient(hunting): picked mon.noname-a con 0x7f961c08cf30 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c05e940 con 0x7f961c08cf30 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c08e000 con 0x7f961c05e570 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c084e70 con 0x7f961c08cad0 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9620842640 10 monclient(hunting): authenticate will time out at 1181.611011s 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f961ad76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f961c08cf30 0x7f961c1aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43176/0 (socket says 10.20.193.78:43176) 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f961ad76640 1 -- 10.20.193.78:0/3477519067 learned_addr learned my addr 10.20.193.78:0/3477519067 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.551+0000 7f9619d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f961c08cad0 0x7f961c188930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49632/0 (socket says 10.20.193.78:49632) 2026-02-13T18:15:50.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f961ad76640 1 -- 10.20.193.78:0/3477519067 >> v1:10.20.193.78:6789/0 conn(0x7f961c08cf30 legacy=0x7f961c1aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619d74640 1 -- 10.20.193.78:0/3477519067 >> v1:10.20.193.78:6790/0 conn(0x7f961c08cad0 legacy=0x7f961c188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366827096 0 0) 0x7f961c05e940 con 0x7f961c08cf30 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): my global_id is 94158 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9608003620 con 0x7f961c08cf30 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365445354 0 0) 0x7f961c084e70 con 0x7f961c08cad0 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient(hunting): my global_id is 4892 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c05e940 con 0x7f961c08cad0 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f961a575640 1 -- 10.20.193.78:0/3477519067 >> v1:10.20.193.187:6789/0 conn(0x7f961c05e570 legacy=0x7f961c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1361976002 0 0) 0x7f9608003620 con 0x7f961c08cf30 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 >> v1:10.20.193.78:6790/0 conn(0x7f961c08cad0 legacy=0x7f961c188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 >> v1:10.20.193.187:6789/0 conn(0x7f961c05e570 legacy=0x7f961c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 monclient: found mon.noname-a 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c0845d0 con 0x7f961c08cf30 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f960c004620 con 0x7f961c08cf30 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: dump: 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.571 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 5 monclient: authenticate success, global_id 94158 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f960c0048f0 con 0x7f961c08cf30 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 1 -- 10.20.193.78:0/3477519067 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f960c006060 con 0x7f961c08cf30 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9619573640 10 monclient: dump: 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 4 set_mon_vals no callback set 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: shutdown 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- 10.20.193.78:0/3477519067 >> v1:10.20.193.78:6789/0 conn(0x7f961c08cf30 legacy=0x7f961c1aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- 10.20.193.78:0/3477519067 shutdown_connections 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- 10.20.193.78:0/3477519067 >> 10.20.193.78:0/3477519067 conn(0x7f961c091720 msgr2=0x7f961c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- 10.20.193.78:0/3477519067 shutdown_connections 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- 10.20.193.78:0/3477519067 wait complete. 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: monmap: 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.574 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 Processor -- start 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- start start 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: init 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient(hunting): picked mon.noname-c con 0x7f961c05e570 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient(hunting): picked mon.noname-a con 0x7f961c08cad0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient(hunting): picked mon.noname-b con 0x7f961c08cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c1d8d60 con 0x7f961c08cad0 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c08b440 con 0x7f961c08cf30 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c088910 con 0x7f961c05e570 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f9620842640 10 monclient(hunting): authenticate will time out at 1181.615635s 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f961a575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f961c05e570 0x7f961c1d8650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:49634/0 (socket says 10.20.193.78:49634) 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.555+0000 7f961a575640 1 -- 10.20.193.78:0/1102291746 learned_addr learned my addr 10.20.193.78:0/1102291746 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f961a575640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.78:6790/0 conn(0x7f961c05e570 legacy=0x7f961c1d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9619d74640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.78:6789/0 conn(0x7f961c08cad0 legacy=0x7f961c21f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553684881 0 0) 0x7f961c088910 con 0x7f961c05e570 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): my global_id is 4895 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95e8003620 con 0x7f961c05e570 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162114477 0 0) 0x7f961c1d8d60 con 0x7f961c08cad0 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 10 monclient(hunting): my global_id is 94161 2026-02-13T18:15:50.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c088910 con 0x7f961c08cad0 2026-02-13T18:15:50.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:15:50.578 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.559+0000 7f961ad76640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.187:6789/0 conn(0x7f961c08cf30 legacy=0x7f961c241120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 129197204 0 0) 0x7f961c088910 con 0x7f961c08cad0 2026-02-13T18:15:50.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f961c1d8d60 con 0x7f961c08cad0 2026-02-13T18:15:50.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678764971 0 0) 0x7f961c08b440 con 0x7f961c08cf30 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): my global_id is 84259 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c088910 con 0x7f961c08cf30 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 617636806 0 0) 0x7f95e8003620 con 0x7f961c05e570 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f961c08b440 con 0x7f961c05e570 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9604003420 con 0x7f961c08cad0 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): dump: 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:50.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9610003420 con 0x7f961c05e570 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient(hunting): dump: 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.583 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1534963246 0 0) 0x7f961c1d8d60 con 0x7f961c08cad0 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.78:6790/0 conn(0x7f961c05e570 legacy=0x7f961c1d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.187:6789/0 conn(0x7f961c08cf30 legacy=0x7f961c241120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 monclient: found mon.a 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c05cd10 con 0x7f961c08cad0 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 5 monclient: authenticate success, global_id 94161 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 monclient: _renew_subs 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f961c1bf710 con 0x7f961c08cad0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 monclient: _renew_subs 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f961c1db300 con 0x7f961c08cad0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9604004b90 con 0x7f961c08cad0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9604004f60 con 0x7f961c08cad0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 10 monclient: dump: 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9618d72640 4 set_mon_vals no callback set 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c1c00c0 con 0x7f961c08cad0 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9604005230 con 0x7f961c08cad0 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7f960404c710 con 0x7f961c08cad0 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.563+0000 7f961a575640 10 monclient: get_auth_request con 0x7f95e803d850 auth_method 0 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.567+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f96040176e0 con 0x7f961c08cad0 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.567+0000 7f9602ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.567+0000 7f9602ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f961c08f620 con 0x7f961c08cad0 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9602ffd640 1 -- 10.20.193.78:0/1102291746 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 534686261) 0x7f961c08f620 con 0x7f961c08cad0 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9602ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:50.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9602ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:50.690 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.187:6812/2668687789 conn(0x7f95e803d850 legacy=0x7f95e805dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 10 monclient: shutdown 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 >> v1:10.20.193.78:6789/0 conn(0x7f961c08cad0 legacy=0x7f961c21f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 shutdown_connections 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 >> 10.20.193.78:0/1102291746 conn(0x7f961c091720 msgr2=0x7f961c05dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 shutdown_connections 2026-02-13T18:15:50.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.679+0000 7f9620842640 1 -- 10.20.193.78:0/1102291746 wait complete. 2026-02-13T18:15:50.699 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:15:50.699 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:15:50.699 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:15:50.699 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: get_monmap_and_config 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: monmap: 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:50.761808+0000 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:50.761808+0000 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.767 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.768 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:50.768 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:50.768 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 1 Processor -- start 2026-02-13T18:15:50.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 1 -- start start 2026-02-13T18:15:50.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: init 2026-02-13T18:15:50.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc0084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient(hunting): picked mon.noname-c con 0x7fbcc008d5f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient(hunting): picked mon.noname-a con 0x7fbcc01831f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc008da30 con 0x7fbcc01831f0 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc0089e60 con 0x7fbcc008d5f0 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc0085410 con 0x7fbcc0084930 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient(hunting): authenticate will time out at 1181.817191s 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc630d640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbcc01831f0 0x7fbcc01a35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43194/0 (socket says 10.20.193.78:43194) 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc630d640 1 -- 10.20.193.78:0/2400317494 learned_addr learned my addr 10.20.193.78:0/2400317494 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc630d640 1 -- 10.20.193.78:0/2400317494 >> v1:10.20.193.78:6789/0 conn(0x7fbcc01831f0 legacy=0x7fbcc01a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc5b0c640 1 -- 10.20.193.78:0/2400317494 >> v1:10.20.193.78:6790/0 conn(0x7fbcc0084930 legacy=0x7fbcc0084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842844826 0 0) 0x7fbcbc004170 con 0x7fbcc01831f0 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): my global_id is 94164 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca8003620 con 0x7fbcc01831f0 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc530b640 1 -- 10.20.193.78:0/2400317494 >> v1:10.20.193.187:6789/0 conn(0x7fbcc008d5f0 legacy=0x7fbcc0181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829451608 0 0) 0x7fbcc0085410 con 0x7fbcc0084930 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient(hunting): my global_id is 4898 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcbc004170 con 0x7fbcc0084930 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2236083221 0 0) 0x7fbca8003620 con 0x7fbcc01831f0 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 >> v1:10.20.193.78:6790/0 conn(0x7fbcc0084930 legacy=0x7fbcc0084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 >> v1:10.20.193.187:6789/0 conn(0x7fbcc008d5f0 legacy=0x7fbcc0181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 monclient: found mon.noname-a 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc0089b80 con 0x7fbcc01831f0 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 5 monclient: authenticate success, global_id 94164 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcbc0047f0 con 0x7fbcc01831f0 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: dump: 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.776 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcbc005eb0 con 0x7fbcc01831f0 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 1 -- 10.20.193.78:0/2400317494 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcbc006240 con 0x7fbcc01831f0 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc4b0a640 10 monclient: dump: 2026-02-13T18:15:50.777 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.759+0000 7fbcc7d97640 4 set_mon_vals no callback set 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: shutdown 2026-02-13T18:15:50.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/2400317494 >> v1:10.20.193.78:6789/0 conn(0x7fbcc01831f0 legacy=0x7fbcc01a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/2400317494 shutdown_connections 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/2400317494 >> 10.20.193.78:0/2400317494 conn(0x7fbcc0091720 msgr2=0x7fbcc0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/2400317494 shutdown_connections 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/2400317494 wait complete. 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: monmap: 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:50.779 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 Processor -- start 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- start start 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: init 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient(hunting): picked mon.noname-c con 0x7fbcc0084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient(hunting): picked mon.noname-a con 0x7fbcc008d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc01831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc0088910 con 0x7fbcc008d5f0 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc007cb70 con 0x7fbcc01831f0 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc007eed0 con 0x7fbcc0084930 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient(hunting): authenticate will time out at 1181.821178s 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc530b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbcc008d5f0 0x7fbcc0172e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43200/0 (socket says 10.20.193.78:43200) 2026-02-13T18:15:50.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc530b640 1 -- 10.20.193.78:0/4000351213 learned_addr learned my addr 10.20.193.78:0/4000351213 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc530b640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc008d5f0 legacy=0x7fbcc0172e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc5b0c640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6790/0 conn(0x7fbcc0084930 legacy=0x7fbcc0131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388908194 0 0) 0x7fbcc0088910 con 0x7fbcc008d5f0 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): my global_id is 94167 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc90003620 con 0x7fbcc008d5f0 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 644775421 0 0) 0x7fbcc007eed0 con 0x7fbcc0084930 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): my global_id is 4901 2026-02-13T18:15:50.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc0088910 con 0x7fbcc0084930 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc630d640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.187:6789/0 conn(0x7fbcc01831f0 legacy=0x7fbcc0174520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3427970402 0 0) 0x7fbc90003620 con 0x7fbcc008d5f0 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc007eed0 con 0x7fbcc008d5f0 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcb4003420 con 0x7fbcc008d5f0 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): dump: 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.788 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2659436205 0 0) 0x7fbcc0088910 con 0x7fbcc0084930 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc90003620 con 0x7fbcc0084930 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcb00033f0 con 0x7fbcc0084930 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:50.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient(hunting): dump: 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1526387496 0 0) 0x7fbcc007eed0 con 0x7fbcc008d5f0 2026-02-13T18:15:50.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6790/0 conn(0x7fbcc0084930 legacy=0x7fbcc0131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.187:6789/0 conn(0x7fbcc01831f0 legacy=0x7fbcc0174520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 monclient: found mon.a 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc007e630 con 0x7fbcc008d5f0 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 5 monclient: authenticate success, global_id 94167 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: _renew_subs 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc00823d0 con 0x7fbcc008d5f0 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: _renew_subs 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcc007c150 con 0x7fbcc008d5f0 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcb40039c0 con 0x7fbcc008d5f0 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcb4003d50 con 0x7fbcc008d5f0 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcae7fc640 10 monclient: dump: 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.792 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.763+0000 7fbcaffff640 4 set_mon_vals no callback set 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcc7d97640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcc00389c0 con 0x7fbcc0132300 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fbcb4003fe0 con 0x7fbcc008d5f0 2026-02-13T18:15:50.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7fbcb404c720 con 0x7fbcc008d5f0 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcc630d640 10 monclient: get_auth_request con 0x7fbc9003d650 auth_method 0 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcc5b0c640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc0132300 legacy=0x7fbcc005c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133158016 0 0) 0x7fbcc00389c0 con 0x7fbcc0132300 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient(hunting): my global_id is 94170 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc007eed0 con 0x7fbcc0132300 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3801154800 0 0) 0x7fbcc007eed0 con 0x7fbcc0132300 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc00389c0 con 0x7fbcc0132300 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcb0003b40 con 0x7fbcc0132300 2026-02-13T18:15:50.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient: dump: 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2096015547 0 0) 0x7fbcc00389c0 con 0x7fbcc0132300 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcc0082fc0 con 0x7fbcc0132300 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbcb00058c0 con 0x7fbcc0132300 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc0132300 legacy=0x7fbcc005c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.767+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc0132300 legacy=0x7fbcc005c520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.771+0000 7fbcc7d97640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.771+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcc0090810 con 0x7fbcc004d200 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc5b0c640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc004d200 legacy=0x7fbcc0176c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574504712 0 0) 0x7fbcc0090810 con 0x7fbcc004d200 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient(hunting): my global_id is 94173 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc00389c0 con 0x7fbcc004d200 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2711439987 0 0) 0x7fbcc00389c0 con 0x7fbcc004d200 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc0090810 con 0x7fbcc004d200 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbcb00041f0 con 0x7fbcc004d200 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient: dump: 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.797 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4195720731 0 0) 0x7fbcc0090810 con 0x7fbcc004d200 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcc007c490 con 0x7fbcc004d200 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4340 (unknown 0 0 82285861) 0x7fbcb0004570 con 0x7fbcc004d200 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:15:50.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc004d200 legacy=0x7fbcc0176c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcae7fc640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc004d200 legacy=0x7fbcc0176c50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:15:50.799 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 38, 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 33822, 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:15:50.800 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.801 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:50.802 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:15:50.803 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:50.804 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:50.805 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.806 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:50.807 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:15:50.808 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.809 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:15:50.810 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.187:6812/2668687789 conn(0x7fbc9003d650 legacy=0x7fbc9005db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 10 monclient: shutdown 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 >> v1:10.20.193.78:6789/0 conn(0x7fbcc008d5f0 legacy=0x7fbcc0172e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc630d640 1 -- 10.20.193.78:0/4000351213 reap_dead start 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc630d640 1 -- 10.20.193.78:0/4000351213 reap_dead start 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 shutdown_connections 2026-02-13T18:15:50.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 >> 10.20.193.78:0/4000351213 conn(0x7fbcc0091720 msgr2=0x7fbcc01a35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 shutdown_connections 2026-02-13T18:15:50.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.775+0000 7fbcc7d97640 1 -- 10.20.193.78:0/4000351213 wait complete. 2026-02-13T18:15:50.812 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:15:50.812 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:15:50.812 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:15:50.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.863+0000 7fc70d796640 10 monclient: get_monmap_and_config 2026-02-13T18:15:50.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.863+0000 7fc70d796640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.863+0000 7fc70d796640 10 monclient: monmap: 2026-02-13T18:15:50.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:50.869260+0000 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:50.869260+0000 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:50.875 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 Processor -- start 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- start start 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient: init 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient(hunting): picked mon.noname-a con 0x7fc70813f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient(hunting): picked mon.noname-b con 0x7fc70805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient(hunting): picked mon.noname-c con 0x7fc7081853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc708095530 con 0x7fc70813f8b0 2026-02-13T18:15:50.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc708140390 con 0x7fc7081853c0 2026-02-13T18:15:50.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70805d230 con 0x7fc70805e4b0 2026-02-13T18:15:50.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient(hunting): authenticate will time out at 1181.924688s 2026-02-13T18:15:50.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc706ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc70813f8b0 0x7fc70813fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43240/0 (socket says 10.20.193.78:43240) 2026-02-13T18:15:50.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc706ffd640 1 -- 10.20.193.78:0/2362846711 learned_addr learned my addr 10.20.193.78:0/2362846711 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc706ffd640 1 -- 10.20.193.78:0/2362846711 >> v1:10.20.193.78:6789/0 conn(0x7fc70813f8b0 legacy=0x7fc70813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc7067fc640 1 -- 10.20.193.78:0/2362846711 >> v1:10.20.193.78:6790/0 conn(0x7fc70805e4b0 legacy=0x7fc708183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431109888 0 0) 0x7fc6fc002c60 con 0x7fc70813f8b0 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): my global_id is 94176 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6f4003620 con 0x7fc70813f8b0 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543362605 0 0) 0x7fc70805d230 con 0x7fc70805e4b0 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient(hunting): my global_id is 4904 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6fc002c60 con 0x7fc70805e4b0 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc7077fe640 1 -- 10.20.193.78:0/2362846711 >> v1:10.20.193.187:6789/0 conn(0x7fc7081853c0 legacy=0x7fc7081a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687679512 0 0) 0x7fc6f4003620 con 0x7fc70813f8b0 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 >> v1:10.20.193.78:6790/0 conn(0x7fc70805e4b0 legacy=0x7fc708183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 >> v1:10.20.193.187:6789/0 conn(0x7fc7081853c0 legacy=0x7fc7081a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 monclient: found mon.noname-a 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70805d510 con 0x7fc70813f8b0 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6fc0032e0 con 0x7fc70813f8b0 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: dump: 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.887 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 5 monclient: authenticate success, global_id 94176 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6fc0049a0 con 0x7fc70813f8b0 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 4 set_mon_vals no callback set 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 1 -- 10.20.193.78:0/2362846711 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6fc004db0 con 0x7fc70813f8b0 2026-02-13T18:15:50.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc705ffb640 10 monclient: dump: 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.889 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 10 monclient: shutdown 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- 10.20.193.78:0/2362846711 >> v1:10.20.193.78:6789/0 conn(0x7fc70813f8b0 legacy=0x7fc70813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- 10.20.193.78:0/2362846711 shutdown_connections 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- 10.20.193.78:0/2362846711 >> 10.20.193.78:0/2362846711 conn(0x7fc7080545d0 msgr2=0x7fc7080549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- 10.20.193.78:0/2362846711 shutdown_connections 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.867+0000 7fc70d796640 1 -- 10.20.193.78:0/2362846711 wait complete. 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient: monmap: 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:50.890 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 1 Processor -- start 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 1 -- start start 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient: init 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient(hunting): picked mon.noname-a con 0x7fc70805e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient(hunting): picked mon.noname-b con 0x7fc70813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient(hunting): picked mon.noname-c con 0x7fc7081853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc708111f00 con 0x7fc70805e4b0 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc708111090 con 0x7fc70813f8b0 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70810fba0 con 0x7fc7081853c0 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc70d796640 10 monclient(hunting): authenticate will time out at 1181.929346s 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc706ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc70805e4b0 0x7fc70813ea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43250/0 (socket says 10.20.193.78:43250) 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc706ffd640 1 -- 10.20.193.78:0/2305092431 learned_addr learned my addr 10.20.193.78:0/2305092431 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc706ffd640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6789/0 conn(0x7fc70805e4b0 legacy=0x7fc70813ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc7077fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc7081853c0 legacy=0x7fc708181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078826652 0 0) 0x7fc708111f00 con 0x7fc70805e4b0 2026-02-13T18:15:50.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): my global_id is 94179 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d4003620 con 0x7fc70805e4b0 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333753706 0 0) 0x7fc70810fba0 con 0x7fc7081853c0 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): my global_id is 4907 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc708111f00 con 0x7fc7081853c0 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc7067fc640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.187:6789/0 conn(0x7fc70813f8b0 legacy=0x7fc708180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2904794309 0 0) 0x7fc6d4003620 con 0x7fc70805e4b0 2026-02-13T18:15:50.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc70810fba0 con 0x7fc70805e4b0 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6fc004b50 con 0x7fc70805e4b0 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): dump: 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.894 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 693248538 0 0) 0x7fc70810fba0 con 0x7fc70805e4b0 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc7081853c0 legacy=0x7fc708181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.871+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.187:6789/0 conn(0x7fc70813f8b0 legacy=0x7fc708180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 monclient: found mon.a 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc708111660 con 0x7fc70805e4b0 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 5 monclient: authenticate success, global_id 94179 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 10 monclient: _renew_subs 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc70810f550 con 0x7fc70805e4b0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 10 monclient: _renew_subs 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc70813f3a0 con 0x7fc70805e4b0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6fc0049a0 con 0x7fc70805e4b0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6fc005500 con 0x7fc70805e4b0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: dump: 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc7057fa640 4 set_mon_vals no callback set 2026-02-13T18:15:50.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fc6fc011b90 con 0x7fc70805e4b0 2026-02-13T18:15:50.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7080008e0 con 0x7fc7081107c0 2026-02-13T18:15:50.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7fc6fc04c8b0 con 0x7fc70805e4b0 2026-02-13T18:15:50.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc7077fe640 10 monclient: get_auth_request con 0x7fc6d403d310 auth_method 0 2026-02-13T18:15:50.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc7067fc640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc7081107c0 legacy=0x7fc70808d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188881145 0 0) 0x7fc7080008e0 con 0x7fc7081107c0 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient(hunting): my global_id is 4910 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc70810fba0 con 0x7fc7081107c0 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4063378032 0 0) 0x7fc70810fba0 con 0x7fc7081107c0 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7080008e0 con 0x7fc7081107c0 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6f0003280 con 0x7fc7081107c0 2026-02-13T18:15:50.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: dump: 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2377496757 0 0) 0x7fc7080008e0 con 0x7fc7081107c0 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc708093020 con 0x7fc7081107c0 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc6f00058c0 con 0x7fc7081107c0 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc7081107c0 legacy=0x7fc70808d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.875+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc7081107c0 legacy=0x7fc70808d040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.879+0000 7fc70d796640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.879+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc70812d940 con 0x7fc70812d540 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc7067fc640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc70812d540 legacy=0x7fc708184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252186542 0 0) 0x7fc70812d940 con 0x7fc70812d540 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient(hunting): my global_id is 4913 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7080008e0 con 0x7fc70812d540 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 629674391 0 0) 0x7fc7080008e0 con 0x7fc70812d540 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc70812d940 con 0x7fc70812d540 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc6f0003b20 con 0x7fc70812d540 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient: dump: 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.904 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1024167024 0 0) 0x7fc70812d940 con 0x7fc70812d540 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc708090840 con 0x7fc70812d540 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 2664964233) 0x7fc6f0005b40 con 0x7fc70812d540 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc70812d540 legacy=0x7fc708184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc6e77fe640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6790/0 conn(0x7fc70812d540 legacy=0x7fc708184ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 38, 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 632275, 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:50.906 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:50.907 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:50.908 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:15:50.909 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:50.910 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.911 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.912 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.913 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.914 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:50.915 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:50.916 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:50.916 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:15:50.916 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc6d403d310 legacy=0x7fc6d405d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 10 monclient: shutdown 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 >> v1:10.20.193.78:6789/0 conn(0x7fc70805e4b0 legacy=0x7fc70813ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc7077fe640 1 -- 10.20.193.78:0/2305092431 reap_dead start 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc7077fe640 1 -- 10.20.193.78:0/2305092431 reap_dead start 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 shutdown_connections 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 >> 10.20.193.78:0/2305092431 conn(0x7fc7080545d0 msgr2=0x7fc708096580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 shutdown_connections 2026-02-13T18:15:50.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.883+0000 7fc70d796640 1 -- 10.20.193.78:0/2305092431 wait complete. 2026-02-13T18:15:50.917 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:15:50.917 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:15:50.918 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient: get_monmap_and_config 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient: monmap: 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:50.975933+0000 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:50.975933+0000 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:50.981 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 1 Processor -- start 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 1 -- start start 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient: init 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient(hunting): picked mon.noname-b con 0x7f90c408cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient(hunting): picked mon.noname-a con 0x7f90c408d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient(hunting): picked mon.noname-c con 0x7f90c408d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c4085ad0 con 0x7f90c408d190 2026-02-13T18:15:50.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c4085ee0 con 0x7f90c408d5d0 2026-02-13T18:15:50.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c408e000 con 0x7f90c408cdc0 2026-02-13T18:15:50.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c8d93640 10 monclient(hunting): authenticate will time out at 1182.031091s 2026-02-13T18:15:50.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c1d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f90c408d190 0x7f90c4183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43266/0 (socket says 10.20.193.78:43266) 2026-02-13T18:15:50.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.971+0000 7f90c1d74640 1 -- 10.20.193.78:0/2054324195 learned_addr learned my addr 10.20.193.78:0/2054324195 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c2575640 1 -- 10.20.193.78:0/2054324195 >> v1:10.20.193.78:6790/0 conn(0x7f90c408cdc0 legacy=0x7f90c408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1d74640 1 -- 10.20.193.78:0/2054324195 >> v1:10.20.193.78:6789/0 conn(0x7f90c408d190 legacy=0x7f90c4183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146347039 0 0) 0x7f90c408e000 con 0x7f90c408cdc0 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): my global_id is 4916 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b0003620 con 0x7f90c408cdc0 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881936905 0 0) 0x7f90c4085ad0 con 0x7f90c408d190 2026-02-13T18:15:50.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient(hunting): my global_id is 94182 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c408e000 con 0x7f90c408d190 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c2d76640 1 -- 10.20.193.78:0/2054324195 >> v1:10.20.193.187:6789/0 conn(0x7f90c408d5d0 legacy=0x7f90c41a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1977060833 0 0) 0x7f90c408e000 con 0x7f90c408d190 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 >> v1:10.20.193.78:6790/0 conn(0x7f90c408cdc0 legacy=0x7f90c408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 >> v1:10.20.193.187:6789/0 conn(0x7f90c408d5d0 legacy=0x7f90c41a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: _finish_hunting 0 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 monclient: found mon.noname-a 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:50.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c4086f80 con 0x7f90c408d190 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: _finish_auth 0 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: _check_auth_tickets 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90ac003040 con 0x7f90c408d190 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: dump: 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.989 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 5 monclient: authenticate success, global_id 94182 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90ac003310 con 0x7f90c408d190 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 1 -- 10.20.193.78:0/2054324195 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90ac0049a0 con 0x7f90c408d190 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1573640 10 monclient: dump: 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:50.990 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 4 set_mon_vals no callback set 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: shutdown 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- 10.20.193.78:0/2054324195 >> v1:10.20.193.78:6789/0 conn(0x7f90c408d190 legacy=0x7f90c4183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- 10.20.193.78:0/2054324195 shutdown_connections 2026-02-13T18:15:50.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- 10.20.193.78:0/2054324195 >> 10.20.193.78:0/2054324195 conn(0x7f90c4091720 msgr2=0x7f90c4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- 10.20.193.78:0/2054324195 shutdown_connections 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- 10.20.193.78:0/2054324195 wait complete. 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: build_initial_monmap 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: monmap: 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:50.992 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 Processor -- start 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- start start 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: init 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient(hunting): picked mon.noname-b con 0x7f90c408cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient(hunting): picked mon.noname-a con 0x7f90c408d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient(hunting): picked mon.noname-c con 0x7f90c408d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c40810e0 con 0x7f90c408d190 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c4083160 con 0x7f90c408cdc0 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c4083440 con 0x7f90c408d5d0 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:50.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c8d93640 10 monclient(hunting): authenticate will time out at 1182.035066s 2026-02-13T18:15:50.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f90c408d190 0x7f90c41940d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43270/0 (socket says 10.20.193.78:43270) 2026-02-13T18:15:50.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.975+0000 7f90c1d74640 1 -- 10.20.193.78:0/4271798743 learned_addr learned my addr 10.20.193.78:0/4271798743 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c1d74640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.78:6789/0 conn(0x7f90c408d190 legacy=0x7f90c41940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c2d76640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.78:6790/0 conn(0x7f90c408d5d0 legacy=0x7f90c41957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874312249 0 0) 0x7f90c40810e0 con 0x7f90c408d190 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c2575640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c408cdc0 legacy=0x7f90c4084970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:50.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): my global_id is 94185 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9090003620 con 0x7f90c408d190 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166217864 0 0) 0x7f90c4083440 con 0x7f90c408d5d0 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): my global_id is 4919 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c40810e0 con 0x7f90c408d5d0 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503064405 0 0) 0x7f90c4083160 con 0x7f90c408cdc0 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): my global_id is 84277 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c4083440 con 0x7f90c408cdc0 2026-02-13T18:15:51.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3261752894 0 0) 0x7f9090003620 con 0x7f90c408d190 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90c4083160 con 0x7f90c408d190 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90ac0048e0 con 0x7f90c408d190 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): dump: 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2303737552 0 0) 0x7f90c40810e0 con 0x7f90c408d5d0 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9090003620 con 0x7f90c408d5d0 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90b4004860 con 0x7f90c408d5d0 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient(hunting): dump: 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.002 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 972052950 0 0) 0x7f90c4083160 con 0x7f90c408d190 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.78:6790/0 conn(0x7f90c408d5d0 legacy=0x7f90c41957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c408cdc0 legacy=0x7f90c4084970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: _finish_hunting 0 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 monclient: found mon.a 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c4081c40 con 0x7f90c408d190 2026-02-13T18:15:51.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: _finish_auth 0 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: _check_auth_tickets 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 5 monclient: authenticate success, global_id 94185 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 10 monclient: _renew_subs 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f90c4085080 con 0x7f90c408d190 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 10 monclient: _renew_subs 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f90c4152f20 con 0x7f90c408d190 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90ac0032b0 con 0x7f90c408d190 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90ac005130 con 0x7f90c408d190 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:51.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c0d72640 4 set_mon_vals no callback set 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 10 monclient: dump: 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:51.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f90c408f620 con 0x7f90c407b550 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f90ac0117c0 con 0x7f90c408d190 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7f90ac04c5f0 con 0x7f90c408d190 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.979+0000 7f90c2d76640 10 monclient: get_auth_request con 0x7f909003d830 auth_method 0 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90c2575640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c407b550 legacy=0x7f90c404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499868836 0 0) 0x7f90c4083440 con 0x7f90c407b550 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient(hunting): my global_id is 84280 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c4083160 con 0x7f90c407b550 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2777738322 0 0) 0x7f90c4083160 con 0x7f90c407b550 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90c4083440 con 0x7f90c407b550 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90b8002f90 con 0x7f90c407b550 2026-02-13T18:15:51.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient: dump: 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2229504091 0 0) 0x7f90c4083440 con 0x7f90c407b550 2026-02-13T18:15:51.007 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90c4088910 con 0x7f90c407b550 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f90b80058c0 con 0x7f90c407b550 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c407b550 legacy=0x7f90c404d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.983+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c407b550 legacy=0x7f90c404d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90c8d93640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f90c408b770 con 0x7f90c407b920 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90c2575640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c407b920 legacy=0x7f90c4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731584384 0 0) 0x7f90c408b770 con 0x7f90c407b920 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90aaffd640 10 monclient(hunting): my global_id is 84283 2026-02-13T18:15:51.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.987+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90c4083440 con 0x7f90c407b920 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2515827739 0 0) 0x7f90c4083440 con 0x7f90c407b920 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90c408b770 con 0x7f90c407b920 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f90b8003bb0 con 0x7f90c407b920 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 10 monclient: dump: 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.009 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1160244242 0 0) 0x7f90c408b770 con 0x7f90c407b920 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f90c4090810 con 0x7f90c407b920 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 3566993571) 0x7f90b8005b10 con 0x7f90c407b920 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c407b920 legacy=0x7f90c4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90aaffd640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6789/0 conn(0x7f90c407b920 legacy=0x7f90c4197f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:15:51.010 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 38, 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 179158, 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 3, 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:15:51.011 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:15:51.012 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.013 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:15:51.014 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:15:51.015 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:15:51.016 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:51.017 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:15:51.018 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:15:51.019 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:15:51.020 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.187:6812/2668687789 conn(0x7f909003d830 legacy=0x7f909005dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 10 monclient: shutdown 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 >> v1:10.20.193.78:6789/0 conn(0x7f90c408d190 legacy=0x7f90c41940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c2d76640 1 -- 10.20.193.78:0/4271798743 reap_dead start 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c2d76640 1 -- 10.20.193.78:0/4271798743 reap_dead start 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 shutdown_connections 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 >> 10.20.193.78:0/4271798743 conn(0x7f90c4091720 msgr2=0x7f90c405ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 shutdown_connections 2026-02-13T18:15:51.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:50.991+0000 7f90c8d93640 1 -- 10.20.193.78:0/4271798743 wait complete. 2026-02-13T18:15:51.022 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:15:51.022 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-13T18:15:51.022 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:15:51.022 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-13T18:15:51.022 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-13T18:15:51.022 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T18:15:51.022 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:15:51.039 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T18:15:51.039 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:15:51.039 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:51.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient: get_monmap_and_config 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient: build_initial_monmap 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient: monmap: 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:51.135830+0000 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:51.135830+0000 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:51.141 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:51.142 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 1 Processor -- start 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 1 -- start start 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient: init 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient(hunting): picked mon.noname-b con 0x7fc79c084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient(hunting): picked mon.noname-a con 0x7fc79c08d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:51.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient(hunting): picked mon.noname-c con 0x7fc79c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c08da30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c089e60 con 0x7fc79c1831f0 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a157b640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fc79c084930 legacy=0x7fc79c084d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c085410 con 0x7fc79c084930 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a3806640 10 monclient(hunting): authenticate will time out at 1182.191352s 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a0d7a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc79c08d5f0 0x7fc79c181ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43312/0 (socket says 10.20.193.78:43312) 2026-02-13T18:15:51.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.131+0000 7fc7a0d7a640 1 -- 10.20.193.78:0/1223916763 learned_addr learned my addr 10.20.193.78:0/1223916763 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a0d7a640 1 -- 10.20.193.78:0/1223916763 >> v1:10.20.193.78:6789/0 conn(0x7fc79c08d5f0 legacy=0x7fc79c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802744633 0 0) 0x7fc790002c60 con 0x7fc79c08d5f0 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient(hunting): my global_id is 94188 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a1d7c640 1 -- 10.20.193.78:0/1223916763 >> v1:10.20.193.187:6789/0 conn(0x7fc79c1831f0 legacy=0x7fc79c1a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc784003620 con 0x7fc79c08d5f0 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3349815108 0 0) 0x7fc784003620 con 0x7fc79c08d5f0 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 >> v1:10.20.193.78:6790/0 conn(0x7fc79c084930 legacy=0x7fc79c084d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 >> v1:10.20.193.187:6789/0 conn(0x7fc79c1831f0 legacy=0x7fc79c1a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 monclient: found mon.noname-a 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c089b80 con 0x7fc79c08d5f0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: _finish_auth 0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 5 monclient: authenticate success, global_id 94188 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7900032e0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: dump: 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7900049a0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 1 -- 10.20.193.78:0/1223916763 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc790004d30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc78bfff640 10 monclient: dump: 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 4 set_mon_vals no callback set 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: shutdown 2026-02-13T18:15:51.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- 10.20.193.78:0/1223916763 >> v1:10.20.193.78:6789/0 conn(0x7fc79c08d5f0 legacy=0x7fc79c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- 10.20.193.78:0/1223916763 shutdown_connections 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- 10.20.193.78:0/1223916763 >> 10.20.193.78:0/1223916763 conn(0x7fc79c091720 msgr2=0x7fc79c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- 10.20.193.78:0/1223916763 shutdown_connections 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- 10.20.193.78:0/1223916763 wait complete. 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: build_initial_monmap 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: monmap: 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 Processor -- start 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- start start 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: init 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient(hunting): picked mon.noname-c con 0x7fc79c084930 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient(hunting): picked mon.noname-a con 0x7fc79c08d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a157b640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fc79c084930 legacy=0x7fc79c131bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient(hunting): picked mon.noname-b con 0x7fc79c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c07cd30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c082fe0 con 0x7fc79c1831f0 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79c07fac0 con 0x7fc79c084930 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a3806640 10 monclient(hunting): authenticate will time out at 1182.195847s 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a0d7a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc79c08d5f0 0x7fc79c132300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43326/0 (socket says 10.20.193.78:43326) 2026-02-13T18:15:51.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.135+0000 7fc7a0d7a640 1 -- 10.20.193.78:0/643647972 learned_addr learned my addr 10.20.193.78:0/643647972 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a0d7a640 1 -- 10.20.193.78:0/643647972 >> v1:10.20.193.78:6789/0 conn(0x7fc79c08d5f0 legacy=0x7fc79c132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838324250 0 0) 0x7fc79c07cd30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): my global_id is 94191 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc76c003620 con 0x7fc79c08d5f0 2026-02-13T18:15:51.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1759023578 0 0) 0x7fc76c003620 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc79c07cd30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc790002b30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): dump: 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a1d7c640 1 -- 10.20.193.78:0/643647972 >> v1:10.20.193.187:6789/0 conn(0x7fc79c1831f0 legacy=0x7fc79c173f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4261428615 0 0) 0x7fc79c07cd30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 >> v1:10.20.193.78:6790/0 conn(0x7fc79c084930 legacy=0x7fc79c131bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 >> v1:10.20.193.187:6789/0 conn(0x7fc79c1831f0 legacy=0x7fc79c173f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 monclient: found mon.a 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c07f090 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: _finish_auth 0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 5 monclient: authenticate success, global_id 94191 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 monclient: _renew_subs 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c07d890 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 monclient: _renew_subs 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc79c07c4e0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7900049a0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7900050a0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:51.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 10 monclient: dump: 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc78b7fe640 4 set_mon_vals no callback set 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fc790011730 con 0x7fc79c08d5f0 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79c0389c0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7fc79004c7c0 con 0x7fc79c08d5f0 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.139+0000 7fc7a157b640 10 monclient: get_auth_request con 0x7fc76c03d390 auth_method 0 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.143+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fc79c08da30 con 0x7fc79c08d5f0 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.143+0000 7fc789ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:51.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.143+0000 7fc789ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:51.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:51.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:51.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:51.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc79c08f600 con 0x7fc79c08d5f0 2026-02-13T18:15:51.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc789ffb640 1 -- 10.20.193.78:0/643647972 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1945930617) 0x7fc790017730 con 0x7fc79c08d5f0 2026-02-13T18:15:51.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc789ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:51.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc789ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:51.278 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc76c03d390 legacy=0x7fc76c05d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 10 monclient: shutdown 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 >> v1:10.20.193.78:6789/0 conn(0x7fc79c08d5f0 legacy=0x7fc79c132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 shutdown_connections 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 >> 10.20.193.78:0/643647972 conn(0x7fc79c091720 msgr2=0x7fc79c05daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 shutdown_connections 2026-02-13T18:15:51.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:51.267+0000 7fc7a3806640 1 -- 10.20.193.78:0/643647972 wait complete. 2026-02-13T18:15:54.289 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:54.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient: get_monmap_and_config 2026-02-13T18:15:54.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient: build_initial_monmap 2026-02-13T18:15:54.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient: monmap: 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:54.347342+0000 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:54.347342+0000 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:54.353 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 1 Processor -- start 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 1 -- start start 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient: init 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient(hunting): picked mon.noname-b con 0x7f50f813f7b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient(hunting): picked mon.noname-a con 0x7f50f8095410 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:54.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient(hunting): picked mon.noname-c con 0x7f50f81851c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f8140290 con 0x7f50f8095410 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f8094750 con 0x7f50f81851c0 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f8093c80 con 0x7f50f813f7b0 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50fd638640 10 monclient(hunting): authenticate will time out at 1185.402535s 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50f7fff640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f50f813f7b0 legacy=0x7f50f813fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50f77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f50f8095410 0x7f50f8183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43338/0 (socket says 10.20.193.78:43338) 2026-02-13T18:15:54.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.343+0000 7f50f77fe640 1 -- 10.20.193.78:0/1396379354 learned_addr learned my addr 10.20.193.78:0/1396379354 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:54.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f77fe640 1 -- 10.20.193.78:0/1396379354 >> v1:10.20.193.78:6789/0 conn(0x7f50f8095410 legacy=0x7f50f8183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:54.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588913617 0 0) 0x7f50e8002c60 con 0x7f50f8095410 2026-02-13T18:15:54.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:15:54.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:54.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:54.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient(hunting): my global_id is 94194 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fce37640 1 -- 10.20.193.78:0/1396379354 >> v1:10.20.193.187:6789/0 conn(0x7f50f81851c0 legacy=0x7f50f81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50dc003620 con 0x7f50f8095410 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2354634463 0 0) 0x7f50dc003620 con 0x7f50f8095410 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 >> v1:10.20.193.78:6790/0 conn(0x7f50f813f7b0 legacy=0x7f50f813fb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 >> v1:10.20.193.187:6789/0 conn(0x7f50f81851c0 legacy=0x7f50f81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 monclient: found mon.noname-a 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f8094190 con 0x7f50f8095410 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:15:54.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f50e80032e0 con 0x7f50f8095410 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 5 monclient: authenticate success, global_id 94194 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: dump: 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:54.364 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50e80049a0 con 0x7f50f8095410 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 1 -- 10.20.193.78:0/1396379354 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f50e8004d30 con 0x7f50f8095410 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f6ffd640 10 monclient: dump: 2026-02-13T18:15:54.365 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: get_monmap_and_config success 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 4 set_mon_vals no callback set 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: shutdown 2026-02-13T18:15:54.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- 10.20.193.78:0/1396379354 >> v1:10.20.193.78:6789/0 conn(0x7f50f8095410 legacy=0x7f50f8183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- 10.20.193.78:0/1396379354 shutdown_connections 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- 10.20.193.78:0/1396379354 >> 10.20.193.78:0/1396379354 conn(0x7f50f8054400 msgr2=0x7f50f8054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- 10.20.193.78:0/1396379354 shutdown_connections 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- 10.20.193.78:0/1396379354 wait complete. 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: build_initial_monmap 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: monmap: 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:15:54.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 Processor -- start 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- start start 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: init 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient(hunting): picked mon.noname-b con 0x7f50f8095410 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:54.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient(hunting): picked mon.noname-a con 0x7f50f813f7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient(hunting): picked mon.noname-c con 0x7f50f81851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f8111cc0 con 0x7f50f813f7b0 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f8110e50 con 0x7f50f8095410 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f810f960 con 0x7f50f81851c0 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fd638640 10 monclient(hunting): authenticate will time out at 1185.407128s 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50fce37640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f50f81851c0 legacy=0x7f50f8181bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f50f813f7b0 0x7f50f8180490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43352/0 (socket says 10.20.193.78:43352) 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.347+0000 7f50f77fe640 1 -- 10.20.193.78:0/230184163 learned_addr learned my addr 10.20.193.78:0/230184163 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f77fe640 1 -- 10.20.193.78:0/230184163 >> v1:10.20.193.78:6789/0 conn(0x7f50f813f7b0 legacy=0x7f50f8180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70091059 0 0) 0x7f50f8111cc0 con 0x7f50f813f7b0 2026-02-13T18:15:54.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): my global_id is 94197 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c8003620 con 0x7f50f813f7b0 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f7fff640 1 -- 10.20.193.78:0/230184163 >> v1:10.20.193.187:6789/0 conn(0x7f50f8095410 legacy=0x7f50f813e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 133607520 0 0) 0x7f50c8003620 con 0x7f50f813f7b0 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50f8111cc0 con 0x7f50f813f7b0 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f50e8002b30 con 0x7f50f813f7b0 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): dump: 2026-02-13T18:15:54.370 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266343134 0 0) 0x7f50f8110e50 con 0x7f50f8095410 2026-02-13T18:15:54.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient(hunting): my global_id is 84295 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c8003620 con 0x7f50f8095410 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3096827389 0 0) 0x7f50f8111cc0 con 0x7f50f813f7b0 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 >> v1:10.20.193.78:6790/0 conn(0x7f50f81851c0 legacy=0x7f50f8181bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 >> v1:10.20.193.187:6789/0 conn(0x7f50f8095410 legacy=0x7f50f813e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 monclient: found mon.a 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:54.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f8111420 con 0x7f50f813f7b0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: _finish_auth 0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 5 monclient: authenticate success, global_id 94197 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 monclient: _renew_subs 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50f810f280 con 0x7f50f813f7b0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 monclient: _renew_subs 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50f8110690 con 0x7f50f813f7b0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50e80049a0 con 0x7f50f813f7b0 2026-02-13T18:15:54.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f50e80050a0 con 0x7f50f813f7b0 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 10 monclient: dump: 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:15:54.374 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f67fc640 4 set_mon_vals no callback set 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f80008e0 con 0x7f50f813f7b0 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f50e8011730 con 0x7f50f813f7b0 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7f50e804c7a0 con 0x7f50f813f7b0 2026-02-13T18:15:54.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.351+0000 7f50f7fff640 10 monclient: get_auth_request con 0x7f50c803d4d0 auth_method 0 2026-02-13T18:15:54.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.355+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f50f8140290 con 0x7f50f813f7b0 2026-02-13T18:15:54.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.355+0000 7f50f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:15:54.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.355+0000 7f50f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:15:54.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50fd638640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:15:54.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50fd638640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:54.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50fd638640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:15:54.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f50f8092cd0 con 0x7f50f813f7b0 2026-02-13T18:15:54.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50f4ff9640 1 -- 10.20.193.78:0/230184163 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2864339444) 0x7f50e8017770 con 0x7f50f813f7b0 2026-02-13T18:15:54.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50f4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:15:54.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.471+0000 7f50f4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:15:54.483 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:15:54.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 >> v1:10.20.193.187:6812/2668687789 conn(0x7f50c803d4d0 legacy=0x7f50c805d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:54.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 10 monclient: shutdown 2026-02-13T18:15:54.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:15:54.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 >> v1:10.20.193.78:6789/0 conn(0x7f50f813f7b0 legacy=0x7f50f8180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:15:54.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 shutdown_connections 2026-02-13T18:15:54.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 >> 10.20.193.78:0/230184163 conn(0x7f50f8054400 msgr2=0x7f50f8089630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:15:54.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 shutdown_connections 2026-02-13T18:15:54.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:54.475+0000 7f50fd638640 1 -- 10.20.193.78:0/230184163 wait complete. 2026-02-13T18:15:57.496 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:15:57.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient: get_monmap_and_config 2026-02-13T18:15:57.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient: build_initial_monmap 2026-02-13T18:15:57.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient: monmap: 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:15:57.555092+0000 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:15:57.555092+0000 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:15:57.561 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:15:57.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 1 Processor -- start 2026-02-13T18:15:57.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 1 -- start start 2026-02-13T18:15:57.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient: init 2026-02-13T18:15:57.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient: _reopen_session rank -1 2026-02-13T18:15:57.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient(hunting): picked mon.noname-a con 0x7f3e2808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient(hunting): picked mon.noname-b con 0x7f3e2808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient(hunting): picked mon.noname-c con 0x7f3e2808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28089e80 con 0x7f3e2808c2f0 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28088c20 con 0x7f3e2808cdd0 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28089ba0 con 0x7f3e2808dc80 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient(hunting): _renew_subs 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e304f4640 10 monclient(hunting): authenticate will time out at 1188.610300s 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e2da68640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e28181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e2e269640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3e2808c2f0 0x7f3e2808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43376/0 (socket says 10.20.193.78:43376) 2026-02-13T18:15:57.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.551+0000 7f3e2e269640 1 -- 10.20.193.78:0/3866324217 learned_addr learned my addr 10.20.193.78:0/3866324217 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:15:57.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.555+0000 7f3e2e269640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6789/0 conn(0x7f3e2808c2f0 legacy=0x7f3e2808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:57.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.555+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e281a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:15:57.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:57.755+0000 7f3e2da68640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e28181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:58.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:58.159+0000 7f3e2da68640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e28181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:15:58.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:15:58.963+0000 7f3e2da68640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e28181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:00.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): tick 2026-02-13T18:16:00.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:16:00.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 monclient(hunting): continuing hunt 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e28181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e281a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6789/0 conn(0x7f3e2808c2f0 legacy=0x7f3e2808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f3e080038c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f3e2808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f3e2808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2808d370 con 0x7f3e080038c0 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28089ba0 con 0x7f3e2808cdd0 2026-02-13T18:16:00.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0806a600 con 0x7f3e2808dc80 2026-02-13T18:16:00.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e0ffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:00.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:00.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e2e269640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6789/0 conn(0x7f3e080038c0 legacy=0x7f3e08023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:00.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.555+0000 7f3e2da68640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e080454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:00.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:00.759+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:01.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:01.163+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:01.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:01.967+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): tick 2026-02-13T18:16:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 monclient(hunting): continuing hunt 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e080454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6789/0 conn(0x7f3e080038c0 legacy=0x7f3e08023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f3e2808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f3e0806a920 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f3e2808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0806b960 con 0x7f3e0806a920 2026-02-13T18:16:03.563 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0806a600 con 0x7f3e2808cdd0 2026-02-13T18:16:03.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e08004ce0 con 0x7f3e2808dc80 2026-02-13T18:16:03.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e0ffff640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:03.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.551+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:03.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.555+0000 7f3e2da68640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6789/0 conn(0x7f3e0806a920 legacy=0x7f3e0806ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:03.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.555+0000 7f3e2e269640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e08045470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:03.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:03.755+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:04.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:04.159+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:04.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:04.963+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915784678 0 0) 0x7f3e0806b960 con 0x7f3e0806a920 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient(hunting): my global_id is 94200 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e10003620 con 0x7f3e0806a920 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3841869041 0 0) 0x7f3e10003620 con 0x7f3e0806a920 2026-02-13T18:16:05.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6790/0 conn(0x7f3e2808dc80 legacy=0x7f3e08066d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e08045470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: _finish_hunting 0 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 monclient: found mon.noname-a 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e08005ec0 con 0x7f3e0806a920 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: _finish_auth 0 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: _check_auth_tickets 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 5 monclient: authenticate success, global_id 94200 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e1c0045a0 con 0x7f3e0806a920 2026-02-13T18:16:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: dump: 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.120 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e1c0048e0 con 0x7f3e0806a920 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: handle_config config(0 keys) 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 1 -- 10.20.193.78:0/3866324217 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e1c004c70 con 0x7f3e0806a920 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2d267640 10 monclient: dump: 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.121 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: get_monmap_and_config success 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 4 set_mon_vals no callback set 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: shutdown 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- 10.20.193.78:0/3866324217 >> v1:10.20.193.78:6789/0 conn(0x7f3e0806a920 legacy=0x7f3e0806ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- 10.20.193.78:0/3866324217 shutdown_connections 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- 10.20.193.78:0/3866324217 >> 10.20.193.78:0/3866324217 conn(0x7f3e28091720 msgr2=0x7f3e28091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- 10.20.193.78:0/3866324217 shutdown_connections 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- 10.20.193.78:0/3866324217 wait complete. 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: build_initial_monmap 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: monmap: 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:16:05.123 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:16:05.124 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:16:05.124 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:16:05.124 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 Processor -- start 2026-02-13T18:16:05.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- start start 2026-02-13T18:16:05.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: init 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: _reopen_session rank -1 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient(hunting): picked mon.noname-c con 0x7f3e0806a920 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient(hunting): picked mon.noname-a con 0x7f3e2808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient(hunting): picked mon.noname-b con 0x7f3e2808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2e269640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f3e0806a920 legacy=0x7f3e280857c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28057d60 con 0x7f3e2808cdd0 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e280822f0 con 0x7f3e2808dc80 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e280865e0 con 0x7f3e0806a920 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e304f4640 10 monclient(hunting): authenticate will time out at 1196.167868s 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2da68640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3e2808cdd0 0x7f3e28085ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:44422/0 (socket says 10.20.193.78:44422) 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.107+0000 7f3e2da68640 1 -- 10.20.193.78:0/1369346000 learned_addr learned my addr 10.20.193.78:0/1369346000 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e2da68640 1 -- 10.20.193.78:0/1369346000 >> v1:10.20.193.78:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e28085ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e2ea6a640 1 -- 10.20.193.78:0/1369346000 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808dc80 legacy=0x7f3e2823ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677037894 0 0) 0x7f3e280822f0 con 0x7f3e2808dc80 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): my global_id is 84298 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df8003620 con 0x7f3e2808dc80 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018094939 0 0) 0x7f3e08005ec0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 10 monclient(hunting): my global_id is 94203 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.111+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e280822f0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 414608411 0 0) 0x7f3e280822f0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e08005ec0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e1c004530 con 0x7f3e2808cdd0 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): dump: 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.130 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2479636331 0 0) 0x7f3df8003620 con 0x7f3e2808dc80 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e280822f0 con 0x7f3e2808dc80 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e240048a0 con 0x7f3e2808dc80 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient(hunting): dump: 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1289908460 0 0) 0x7f3e08005ec0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 >> v1:10.20.193.78:6790/0 conn(0x7f3e0806a920 legacy=0x7f3e280857c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 >> v1:10.20.193.187:6789/0 conn(0x7f3e2808dc80 legacy=0x7f3e2823ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: _finish_hunting 0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 monclient: found mon.a 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e280825d0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: _finish_auth 0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: _check_auth_tickets 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 5 monclient: authenticate success, global_id 94203 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 monclient: _renew_subs 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e280810b0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 monclient: _renew_subs 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e280840b0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2808f600 con 0x7f3e2808cdd0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e1c0048d0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3e1c0052b0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: dump: 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3e1c011940 con 0x7f3e2808cdd0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e2ca66640 4 set_mon_vals no callback set 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(499..499 src has 292..499) ==== 3975+0+0 (unknown 3461671805 0 0) 0x7f3e1c04c820 con 0x7f3e2808cdd0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e2e269640 10 monclient: get_auth_request con 0x7f3df803d610 auth_method 0 2026-02-13T18:16:05.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f3e28057d60 con 0x7f3e2808cdd0 2026-02-13T18:16:05.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.115+0000 7f3e0effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:16:05.177 INFO:tasks.rados.rados.0.trial187.stdout:2123: done (1 left) 2026-02-13T18:16:05.177 INFO:tasks.rados.rados.0.trial187.stdout:2124: done (0 left) 2026-02-13T18:16:05.177 INFO:tasks.rados.rados.0.trial187.stdout:2125: write oid 39 current snap is 244 2026-02-13T18:16:05.177 INFO:tasks.rados.rados.0.trial187.stdout:2125: seq_num 698 ranges {531286=711925,1912196=706244,3018543=712743} 2026-02-13T18:16:05.185 INFO:tasks.rados.rados.0.trial187.stdout:2125: writing trial18717860-39 from 531286 to 1243211 tid 1 2026-02-13T18:16:05.195 INFO:tasks.rados.rados.0.trial187.stdout:2125: writing trial18717860-39 from 1912196 to 2618440 tid 2 2026-02-13T18:16:05.203 INFO:tasks.rados.rados.0.trial187.stdout:2125: writing trial18717860-39 from 3018543 to 3731286 tid 3 2026-02-13T18:16:05.203 INFO:tasks.rados.rados.0.trial187.stdout:2126: snap_remove snap 237 2026-02-13T18:16:05.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e304f4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:16:05.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e304f4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:16:05.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e304f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3e28090810 con 0x7f3e2808cdd0 2026-02-13T18:16:05.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e0effd640 1 -- 10.20.193.78:0/1369346000 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 3320535008) 0x7f3e1c0178b0 con 0x7f3e2808cdd0 2026-02-13T18:16:05.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:16:05.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.239+0000 7f3e0effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:16:05.252 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:16:05.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 >> v1:10.20.193.187:6812/2668687789 conn(0x7f3df803d610 legacy=0x7f3df805dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 10 monclient: shutdown 2026-02-13T18:16:05.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:16:05.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 >> v1:10.20.193.78:6789/0 conn(0x7f3e2808cdd0 legacy=0x7f3e28085ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 shutdown_connections 2026-02-13T18:16:05.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 >> 10.20.193.78:0/1369346000 conn(0x7f3e28091720 msgr2=0x7f3e2808aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:16:05.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 shutdown_connections 2026-02-13T18:16:05.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.243+0000 7f3e304f4640 1 -- 10.20.193.78:0/1369346000 wait complete. 2026-02-13T18:16:05.263 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:16:05.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T18:16:05.264 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:16:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient: get_monmap_and_config 2026-02-13T18:16:05.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient: build_initial_monmap 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient: monmap: 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:16:05.328738+0000 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:16:05.328738+0000 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:16:05.336 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 1 Processor -- start 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 1 -- start start 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient: init 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient: _reopen_session rank -1 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient(hunting): picked mon.noname-b con 0x7f3a1008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient(hunting): picked mon.noname-c con 0x7f3a1008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient(hunting): picked mon.noname-a con 0x7f3a1008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a10089e80 con 0x7f3a1008cdd0 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a10088c20 con 0x7f3a1008dc80 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a10089ba0 con 0x7f3a1008c2f0 2026-02-13T18:16:05.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a1768c640 10 monclient(hunting): authenticate will time out at 1196.383869s 2026-02-13T18:16:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a15401640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f3a1008c2f0 legacy=0x7f3a1008c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.323+0000 7f3a15c02640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3a1008cdd0 0x7f3a101a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:44434/0 (socket says 10.20.193.78:44434) 2026-02-13T18:16:05.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a15c02640 1 -- 10.20.193.78:0/3732387618 learned_addr learned my addr 10.20.193.78:0/3732387618 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:16:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a15c02640 1 -- 10.20.193.78:0/3732387618 >> v1:10.20.193.78:6789/0 conn(0x7f3a1008cdd0 legacy=0x7f3a101a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a14c00640 1 -- 10.20.193.78:0/3732387618 >> v1:10.20.193.187:6789/0 conn(0x7f3a1008dc80 legacy=0x7f3a10181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217213659 0 0) 0x7f3a10089e80 con 0x7f3a1008cdd0 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): my global_id is 94206 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39f8003620 con 0x7f3a1008cdd0 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671017058 0 0) 0x7f3a10088c20 con 0x7f3a1008dc80 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient(hunting): my global_id is 84301 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a10089e80 con 0x7f3a1008dc80 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2955665735 0 0) 0x7f39f8003620 con 0x7f3a1008cdd0 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 >> v1:10.20.193.78:6790/0 conn(0x7f3a1008c2f0 legacy=0x7f3a1008c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 >> v1:10.20.193.187:6789/0 conn(0x7f3a1008dc80 legacy=0x7f3a10181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: _finish_hunting 0 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 monclient: found mon.noname-a 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1008d370 con 0x7f3a1008cdd0 2026-02-13T18:16:05.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: _finish_auth 0 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: _check_auth_tickets 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a0c004620 con 0x7f3a1008cdd0 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: dump: 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 5 monclient: authenticate success, global_id 94206 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a0c004870 con 0x7f3a1008cdd0 2026-02-13T18:16:05.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 10 monclient: get_monmap_and_config success 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 4 set_mon_vals no callback set 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 1 -- 10.20.193.78:0/3732387618 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a0c006060 con 0x7f3a1008cdd0 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f39fffff640 10 monclient: dump: 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 10 monclient: shutdown 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 1 -- 10.20.193.78:0/3732387618 >> v1:10.20.193.78:6789/0 conn(0x7f3a1008cdd0 legacy=0x7f3a101a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 1 -- 10.20.193.78:0/3732387618 shutdown_connections 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 1 -- 10.20.193.78:0/3732387618 >> 10.20.193.78:0/3732387618 conn(0x7f3a10091720 msgr2=0x7f3a10091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 1 -- 10.20.193.78:0/3732387618 shutdown_connections 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 1 -- 10.20.193.78:0/3732387618 wait complete. 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 10 monclient: build_initial_monmap 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.327+0000 7f3a1768c640 10 monclient: monmap: 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 Processor -- start 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 -- start start 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: init 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: _reopen_session rank -1 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:16:05.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient(hunting): picked mon.noname-a con 0x7f3a1008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient(hunting): picked mon.noname-c con 0x7f3a1008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient(hunting): picked mon.noname-b con 0x7f3a1008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a10082260 con 0x7f3a1008c2f0 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a14c00640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f3a1008cdd0 legacy=0x7f3a101942a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1005dcf0 con 0x7f3a1008dc80 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a100859d0 con 0x7f3a1008cdd0 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient(hunting): authenticate will time out at 1196.388601s 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a15401640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3a1008c2f0 0x7f3a10083790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:44444/0 (socket says 10.20.193.78:44444) 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a15401640 1 -- 10.20.193.78:0/1277634766 learned_addr learned my addr 10.20.193.78:0/1277634766 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:16:05.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a15401640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a1008c2f0 legacy=0x7f3a10083790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321727135 0 0) 0x7f3a10082260 con 0x7f3a1008c2f0 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): my global_id is 94209 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e0003620 con 0x7f3a1008c2f0 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a15c02640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.187:6789/0 conn(0x7f3a1008dc80 legacy=0x7f3a101959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2273423121 0 0) 0x7f39e0003620 con 0x7f3a1008c2f0 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a10082260 con 0x7f3a1008c2f0 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a000045c0 con 0x7f3a1008c2f0 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): dump: 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645318690 0 0) 0x7f3a1005dcf0 con 0x7f3a1008dc80 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient(hunting): my global_id is 84304 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e0003620 con 0x7f3a1008dc80 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3314018304 0 0) 0x7f3a10082260 con 0x7f3a1008c2f0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6790/0 conn(0x7f3a1008cdd0 legacy=0x7f3a101942a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.187:6789/0 conn(0x7f3a1008dc80 legacy=0x7f3a101959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: _finish_hunting 0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 monclient: found mon.a 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1007ff00 con 0x7f3a1008c2f0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: _finish_auth 0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: _check_auth_tickets 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 5 monclient: authenticate success, global_id 94209 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: _renew_subs 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a10081f80 con 0x7f3a1008c2f0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: _renew_subs 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a10084070 con 0x7f3a1008c2f0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a00004890 con 0x7f3a1008c2f0 2026-02-13T18:16:05.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a00004bf0 con 0x7f3a1008c2f0 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39fdffb640 10 monclient: dump: 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f39ff7fe640 4 set_mon_vals no callback set 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.331+0000 7f3a1768c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3a00004ec0 con 0x7f3a1008c2f0 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3a1008f620 con 0x7f3a10152f40 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(500..500 src has 292..500) ==== 3947+0+0 (unknown 2022314444 0 0) 0x7f3a0004c7f0 con 0x7f3a1008c2f0 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f3a15c02640 10 monclient: get_auth_request con 0x7f39e003d4d0 auth_method 0 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f3a14c00640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a10152f40 legacy=0x7f3a1007a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763939987 0 0) 0x7f3a10089e80 con 0x7f3a10152f40 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient(hunting): my global_id is 94212 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a10082260 con 0x7f3a10152f40 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 516255048 0 0) 0x7f3a10082260 con 0x7f3a10152f40 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a10089e80 con 0x7f3a10152f40 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a040032b0 con 0x7f3a10152f40 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient: dump: 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.352 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 369968234 0 0) 0x7f3a10089e80 con 0x7f3a10152f40 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a10090810 con 0x7f3a10152f40 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3a040058c0 con 0x7f3a10152f40 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a10152f40 legacy=0x7f3a1007a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.335+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a10152f40 legacy=0x7f3a1007a3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.339+0000 7f3a1768c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.339+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3a100510e0 con 0x7f3a1007aae0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a14c00640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a1007aae0 legacy=0x7f3a101980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775936952 0 0) 0x7f3a100510e0 con 0x7f3a1007aae0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient(hunting): my global_id is 94215 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a10089e80 con 0x7f3a1007aae0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3170729711 0 0) 0x7f3a10089e80 con 0x7f3a1007aae0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a100510e0 con 0x7f3a1007aae0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3a04003ae0 con 0x7f3a1007aae0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient: dump: 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 123258362 0 0) 0x7f3a100510e0 con 0x7f3a1007aae0 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a10153310 con 0x7f3a1007aae0 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4496 (unknown 0 0 2562890510) 0x7f3a04005b40 con 0x7f3a1007aae0 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a1007aae0 legacy=0x7f3a101980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f39fdffb640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a1007aae0 legacy=0x7f3a101980f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 40, 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 48390, 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: 1 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:16:05.356 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:16:05.357 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:16:05.358 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.359 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:16:05.360 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:16:05.361 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:16:05.362 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:16:05.363 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:16:05.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.187:6812/2668687789 conn(0x7f39e003d4d0 legacy=0x7f39e005d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 10 monclient: shutdown 2026-02-13T18:16:05.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:16:05.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 >> v1:10.20.193.78:6789/0 conn(0x7f3a1008c2f0 legacy=0x7f3a10083790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a15c02640 1 -- 10.20.193.78:0/1277634766 reap_dead start 2026-02-13T18:16:05.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 shutdown_connections 2026-02-13T18:16:05.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 >> 10.20.193.78:0/1277634766 conn(0x7f3a10091720 msgr2=0x7f3a1008a380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:16:05.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 shutdown_connections 2026-02-13T18:16:05.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.343+0000 7f3a1768c640 1 -- 10.20.193.78:0/1277634766 wait complete. 2026-02-13T18:16:05.365 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:16:05.365 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:16:05.365 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:16:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.423+0000 7f57e4382640 10 monclient: get_monmap_and_config 2026-02-13T18:16:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.423+0000 7f57e4382640 10 monclient: build_initial_monmap 2026-02-13T18:16:05.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.423+0000 7f57e4382640 10 monclient: monmap: 2026-02-13T18:16:05.434 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:16:05.429225+0000 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:16:05.429225+0000 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:16:05.435 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 Processor -- start 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- start start 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient: init 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient: _reopen_session rank -1 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient(hunting): picked mon.noname-c con 0x7f57dc08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient(hunting): picked mon.noname-b con 0x7f57dc08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient(hunting): picked mon.noname-a con 0x7f57dc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc089e80 con 0x7f57dc08cdd0 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc088c20 con 0x7f57dc08c2f0 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e18f6640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f57dc08dc80 legacy=0x7f57dc181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:05.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc089ba0 con 0x7f57dc08dc80 2026-02-13T18:16:05.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:05.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient(hunting): authenticate will time out at 1196.484590s 2026-02-13T18:16:05.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e28f8640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f57dc08cdd0 0x7f57dc1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:44476/0 (socket says 10.20.193.78:44476) 2026-02-13T18:16:05.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e28f8640 1 -- 10.20.193.78:0/897514605 learned_addr learned my addr 10.20.193.78:0/897514605 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:16:05.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e28f8640 1 -- 10.20.193.78:0/897514605 >> v1:10.20.193.78:6789/0 conn(0x7f57dc08cdd0 legacy=0x7f57dc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e20f7640 1 -- 10.20.193.78:0/897514605 >> v1:10.20.193.187:6789/0 conn(0x7f57dc08c2f0 legacy=0x7f57dc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566859481 0 0) 0x7f57dc089e80 con 0x7f57dc08cdd0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient(hunting): my global_id is 94218 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57c4003620 con 0x7f57dc08cdd0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2139525207 0 0) 0x7f57c4003620 con 0x7f57dc08cdd0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 >> v1:10.20.193.78:6790/0 conn(0x7f57dc08dc80 legacy=0x7f57dc181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 >> v1:10.20.193.187:6789/0 conn(0x7f57dc08c2f0 legacy=0x7f57dc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: _finish_hunting 0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 monclient: found mon.noname-a 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc08d370 con 0x7f57dc08cdd0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: _finish_auth 0 2026-02-13T18:16:05.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: _check_auth_tickets 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57d8004620 con 0x7f57dc08cdd0 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 5 monclient: authenticate success, global_id 94218 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: dump: 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57d80048f0 con 0x7f57dc08cdd0 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: handle_config config(0 keys) 2026-02-13T18:16:05.440 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 1 -- 10.20.193.78:0/897514605 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57d8006060 con 0x7f57dc08cdd0 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e10f5640 10 monclient: dump: 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient: get_monmap_and_config success 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 4 set_mon_vals no callback set 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 10 monclient: shutdown 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- 10.20.193.78:0/897514605 >> v1:10.20.193.78:6789/0 conn(0x7f57dc08cdd0 legacy=0x7f57dc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- 10.20.193.78:0/897514605 shutdown_connections 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- 10.20.193.78:0/897514605 >> 10.20.193.78:0/897514605 conn(0x7f57dc091720 msgr2=0x7f57dc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:16:05.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- 10.20.193.78:0/897514605 shutdown_connections 2026-02-13T18:16:05.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.427+0000 7f57e4382640 1 -- 10.20.193.78:0/897514605 wait complete. 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: build_initial_monmap 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: monmap: 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 Processor -- start 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 -- start start 2026-02-13T18:16:05.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: init 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: _reopen_session rank -1 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient(hunting): picked mon.noname-a con 0x7f57dc08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient(hunting): picked mon.noname-b con 0x7f57dc08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient(hunting): picked mon.noname-c con 0x7f57dc08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc081e90 con 0x7f57dc08c2f0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc082170 con 0x7f57dc08cdd0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc0871f0 con 0x7f57dc08dc80 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient(hunting): _renew_subs 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient(hunting): authenticate will time out at 1196.488825s 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e28f8640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f57dc08dc80 legacy=0x7f57dc195850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e20f7640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f57dc08c2f0 0x7f57dc1534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:44478/0 (socket says 10.20.193.78:44478) 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e20f7640 1 -- 10.20.193.78:0/3286010024 learned_addr learned my addr 10.20.193.78:0/3286010024 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e20f7640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.78:6789/0 conn(0x7f57dc08c2f0 legacy=0x7f57dc1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395280943 0 0) 0x7f57dc081e90 con 0x7f57dc08c2f0 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e18f6640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc08cdd0 legacy=0x7f57dc194130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): my global_id is 94221 2026-02-13T18:16:05.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57ac003620 con 0x7f57dc08c2f0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4103252680 0 0) 0x7f57ac003620 con 0x7f57dc08c2f0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57dc081e90 con 0x7f57dc08c2f0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57cc003400 con 0x7f57dc08c2f0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): dump: 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217435374 0 0) 0x7f57dc082170 con 0x7f57dc08cdd0 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient(hunting): my global_id is 84310 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57ac003620 con 0x7f57dc08cdd0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4180610209 0 0) 0x7f57dc081e90 con 0x7f57dc08c2f0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.78:6790/0 conn(0x7f57dc08dc80 legacy=0x7f57dc195850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc08cdd0 legacy=0x7f57dc194130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 monclient: found mon.a 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc080b00 con 0x7f57dc08c2f0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient: _finish_auth 0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 5 monclient: authenticate success, global_id 94221 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: _renew_subs 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc082b70 con 0x7f57dc08c2f0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: _renew_subs 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f57dc0867d0 con 0x7f57dc08c2f0 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e20f7640 1 --1- 10.20.193.78:0/3286010024 >> v1:10.20.193.78:6789/0 conn(0x7f57dc08c2f0 0x7f57dc1534f0 :-1 s=OPENED pgs=295 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f57cc003a30 config(0 keys) 2026-02-13T18:16:05.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57cc003a30 con 0x7f57dc08c2f0 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.431+0000 7f57e08f4640 4 set_mon_vals no callback set 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57e4382640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f57dc08f600 con 0x7f57dc059b20 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57cc003d90 con 0x7f57dc08c2f0 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: dump: 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f57cc004020 con 0x7f57dc08c2f0 2026-02-13T18:16:05.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57e28f8640 10 monclient: get_auth_request con 0x7f57ac03d3d0 auth_method 0 2026-02-13T18:16:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57e18f6640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc059b20 legacy=0x7f57dc04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352422008 0 0) 0x7f57dc08f600 con 0x7f57dc059b20 2026-02-13T18:16:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient(hunting): my global_id is 84313 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57dc081e90 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2053863041 0 0) 0x7f57dc081e90 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57dc08f600 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57d0004360 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: dump: 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 385562107 0 0) 0x7f57dc08f600 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57dc057630 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f57d0006720 con 0x7f57dc059b20 2026-02-13T18:16:05.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:16:05.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:16:05.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc059b20 legacy=0x7f57dc04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.435+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc059b20 legacy=0x7f57dc04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:16:05.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.439+0000 7f57e4382640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:16:05.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.439+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f57dc0389c0 con 0x7f57dc059ef0 2026-02-13T18:16:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e18f6640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc059ef0 legacy=0x7f57dc197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:16:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997080375 0 0) 0x7f57dc0389c0 con 0x7f57dc059ef0 2026-02-13T18:16:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:16:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:16:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:16:05.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient(hunting): my global_id is 84316 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57dc08f600 con 0x7f57dc059ef0 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1676753774 0 0) 0x7f57dc08f600 con 0x7f57dc059ef0 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57dc0389c0 con 0x7f57dc059ef0 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57d0004bb0 con 0x7f57dc059ef0 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient: dump: 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3968877433 0 0) 0x7f57dc0389c0 con 0x7f57dc059ef0 2026-02-13T18:16:05.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f57dc0818d0 con 0x7f57dc059ef0 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4666 (unknown 0 0 1838355588) 0x7f57d00068d0 con 0x7f57dc059ef0 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc059ef0 legacy=0x7f57dc197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6789/0 conn(0x7f57dc059ef0 legacy=0x7f57dc197f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:16:05.455 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 40, 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 193610, 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: 1 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:16:05.456 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.457 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:16:05.458 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:16:05.459 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:16:05.460 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:16:05.461 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.462 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:16:05.463 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.187:6812/2668687789 conn(0x7f57ac03d3d0 legacy=0x7f57ac05d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 10 monclient: shutdown 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 >> v1:10.20.193.78:6789/0 conn(0x7f57dc08c2f0 legacy=0x7f57dc1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e28f8640 1 -- 10.20.193.78:0/3286010024 reap_dead start 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e28f8640 1 -- 10.20.193.78:0/3286010024 reap_dead start 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57c2ffd640 1 -- 10.20.193.78:0/3286010024 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(500..500 src has 292..500) ==== 3947+0+0 (unknown 2022314444 0 0) 0x7f57cc04c850 con 0x7f57dc08c2f0 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 shutdown_connections 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 >> 10.20.193.78:0/3286010024 conn(0x7f57dc091720 msgr2=0x7f57dc05c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 shutdown_connections 2026-02-13T18:16:05.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:16:05.443+0000 7f57e4382640 1 -- 10.20.193.78:0/3286010024 wait complete. 2026-02-13T18:16:05.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:16:05.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2126: done (1 left) 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2127: snap_create 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: finishing write tid 1 to trial18717860-39 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: finishing write tid 2 to trial18717860-39 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: finishing write tid 3 to trial18717860-39 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: finishing write tid 4 to trial18717860-39 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: finishing write tid 5 to trial18717860-39 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: oid 39 updating version 0 to 1040 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: oid 39 version 1040 is already newer than 1037 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: oid 39 version 1040 is already newer than 1039 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:2125: oid 39 version 1040 is already newer than 1038 2026-02-13T18:16:06.183 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1040 (ObjNum 698 snap 244 seq_num 698) dirty exists 2026-02-13T18:16:06.184 INFO:tasks.rados.rados.0.trial187.stdout:2125: left oid 39 (ObjNum 698 snap 244 seq_num 698) 2026-02-13T18:16:07.257 INFO:tasks.rados.rados.0.trial187.stdout:2125: done (1 left) 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:2127: done (0 left) 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:2128: rollback oid 44 current snap is 245 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 232 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:2129: read oid 17 snap -1 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:2129: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:2130: copy_from oid 38 from oid 39 current snap is 245 2026-02-13T18:16:07.258 INFO:tasks.rados.rados.0.trial187.stdout:2131: snap_remove snap 227 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:2131: done (3 left) 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:2132: delete oid 8 current snap is 245 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:2128: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:2128: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:2128: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1318 (ObjNum 547 snap 176 seq_num 547) dirty exists 2026-02-13T18:16:08.188 INFO:tasks.rados.rados.0.trial187.stdout:2129: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:16:08.371 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3675500 2026-02-13T18:16:08.376 INFO:tasks.rados.rados.0.trial187.stdout:2130: finishing copy_from racing read to trial18717860-38 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2130: finishing copy_from to trial18717860-38 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1040 (ObjNum 698 snap 244 seq_num 698) dirty exists 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2128: done (3 left) 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2129: done (2 left) 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2130: done (1 left) 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2132: done (0 left) 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2133: rollback oid 12 current snap is 245 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 242 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2134: write (excl) oid 21 current snap is 245 2026-02-13T18:16:08.377 INFO:tasks.rados.rados.0.trial187.stdout:2134: seq_num 700 ranges {564900=578776,1629160=709913,3073389=492409} 2026-02-13T18:16:08.384 INFO:tasks.rados.rados.0.trial187.stdout:2134: writing trial18717860-21 from 564900 to 1143676 tid 1 2026-02-13T18:16:08.392 INFO:tasks.rados.rados.0.trial187.stdout:2134: writing trial18717860-21 from 1629160 to 2339073 tid 2 2026-02-13T18:16:08.401 INFO:tasks.rados.rados.0.trial187.stdout:2134: writing trial18717860-21 from 3073389 to 3565798 tid 3 2026-02-13T18:16:08.401 INFO:tasks.rados.rados.0.trial187.stdout:2135: snap_create 2026-02-13T18:16:08.401 INFO:tasks.rados.rados.0.trial187.stdout:2133: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:16:08.401 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 842 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:16:08.401 INFO:tasks.rados.rados.0.trial187.stdout:2134: finishing write tid 1 to trial18717860-21 2026-02-13T18:16:08.401 INFO:tasks.rados.rados.0.trial187.stdout:2134: finishing write tid 2 to trial18717860-21 2026-02-13T18:16:08.403 INFO:tasks.rados.rados.0.trial187.stdout:2134: finishing write tid 3 to trial18717860-21 2026-02-13T18:16:08.403 INFO:tasks.rados.rados.0.trial187.stdout:2134: finishing write tid 4 to trial18717860-21 2026-02-13T18:16:08.403 INFO:tasks.rados.rados.0.trial187.stdout:2134: finishing write tid 5 to trial18717860-21 2026-02-13T18:16:08.403 INFO:tasks.rados.rados.0.trial187.stdout:2134: oid 21 updating version 0 to 998 2026-02-13T18:16:08.403 INFO:tasks.rados.rados.0.trial187.stdout:2134: oid 21 updating version 998 to 999 2026-02-13T18:16:08.403 INFO:tasks.rados.rados.0.trial187.stdout:2134: oid 21 version 999 is already newer than 996 2026-02-13T18:16:08.404 INFO:tasks.rados.rados.0.trial187.stdout:2134: oid 21 version 999 is already newer than 997 2026-02-13T18:16:08.404 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 999 (ObjNum 700 snap 245 seq_num 700) dirty exists 2026-02-13T18:16:08.404 INFO:tasks.rados.rados.0.trial187.stdout:2134: left oid 21 (ObjNum 700 snap 245 seq_num 700) 2026-02-13T18:16:09.191 INFO:tasks.rados.rados.0.trial187.stdout:2133: done (2 left) 2026-02-13T18:16:09.191 INFO:tasks.rados.rados.0.trial187.stdout:2134: done (1 left) 2026-02-13T18:16:09.191 INFO:tasks.rados.rados.0.trial187.stdout:2135: done (0 left) 2026-02-13T18:16:09.191 INFO:tasks.rados.rados.0.trial187.stdout:2136: delete oid 33 current snap is 246 2026-02-13T18:16:09.194 INFO:tasks.rados.rados.0.trial187.stdout:2136: done (0 left) 2026-02-13T18:16:09.194 INFO:tasks.rados.rados.0.trial187.stdout:2137: delete oid 34 current snap is 246 2026-02-13T18:16:09.196 INFO:tasks.rados.rados.0.trial187.stdout:2137: done (0 left) 2026-02-13T18:16:09.196 INFO:tasks.rados.rados.0.trial187.stdout:2138: read oid 13 snap -1 2026-02-13T18:16:09.196 INFO:tasks.rados.rados.0.trial187.stdout:2138: expect (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:16:09.196 INFO:tasks.rados.rados.0.trial187.stdout:2139: write oid 2 current snap is 246 2026-02-13T18:16:09.196 INFO:tasks.rados.rados.0.trial187.stdout:2139: seq_num 703 ranges {615321=404523,1804606=457240,2755658=726225} 2026-02-13T18:16:09.202 INFO:tasks.rados.rados.0.trial187.stdout:2139: writing trial18717860-2 from 615321 to 1019844 tid 1 2026-02-13T18:16:09.211 INFO:tasks.rados.rados.0.trial187.stdout:2139: writing trial18717860-2 from 1804606 to 2261846 tid 2 2026-02-13T18:16:09.220 INFO:tasks.rados.rados.0.trial187.stdout:2139: writing trial18717860-2 from 2755658 to 3481883 tid 3 2026-02-13T18:16:09.220 INFO:tasks.rados.rados.0.trial187.stdout:2140: read oid 33 snap 209 2026-02-13T18:16:09.220 INFO:tasks.rados.rados.0.trial187.stdout:2140: expect (ObjNum 586 snap 204 seq_num 586) 2026-02-13T18:16:09.220 INFO:tasks.rados.rados.0.trial187.stdout:2141: read oid 27 snap -1 2026-02-13T18:16:09.220 INFO:tasks.rados.rados.0.trial187.stdout:2141: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:16:09.220 INFO:tasks.rados.rados.0.trial187.stdout:2142: snap_remove snap 243 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2142: done (4 left) 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2143: read oid 26 snap -1 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2143: expect (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2144: read oid 28 snap -1 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2144: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2145: copy_from oid 44 from oid 19 current snap is 246 2026-02-13T18:16:10.197 INFO:tasks.rados.rados.0.trial187.stdout:2138: expect (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:16:10.198 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:10.221 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1414380 2026-02-13T18:16:10.262 INFO:tasks.rados.rados.0.trial187.stdout:2139: finishing write tid 1 to trial18717860-2 2026-02-13T18:16:10.262 INFO:tasks.rados.rados.0.trial187.stdout:2139: finishing write tid 2 to trial18717860-2 2026-02-13T18:16:10.262 INFO:tasks.rados.rados.0.trial187.stdout:2139: finishing write tid 3 to trial18717860-2 2026-02-13T18:16:10.262 INFO:tasks.rados.rados.0.trial187.stdout:2138: done (6 left) 2026-02-13T18:16:10.262 INFO:tasks.rados.rados.0.trial187.stdout:2146: snap_remove snap 245 2026-02-13T18:16:11.197 INFO:tasks.rados.rados.0.trial187.stdout:2146: done (6 left) 2026-02-13T18:16:11.197 INFO:tasks.rados.rados.0.trial187.stdout:2147: snap_remove snap 242 2026-02-13T18:16:11.866 INFO:tasks.rados.rados.0.trial187.stdout:2147: done (6 left) 2026-02-13T18:16:11.866 INFO:tasks.rados.rados.0.trial187.stdout:2148: write (excl) oid 32 current snap is 246 2026-02-13T18:16:11.866 INFO:tasks.rados.rados.0.trial187.stdout:2148: seq_num 704 ranges {632128=479772,1746735=600898,3066728=653850} 2026-02-13T18:16:11.873 INFO:tasks.rados.rados.0.trial187.stdout:2148: writing trial18717860-32 from 632128 to 1111900 tid 1 2026-02-13T18:16:11.881 INFO:tasks.rados.rados.0.trial187.stdout:2148: writing trial18717860-32 from 1746735 to 2347633 tid 2 2026-02-13T18:16:11.891 INFO:tasks.rados.rados.0.trial187.stdout:2148: writing trial18717860-32 from 3066728 to 3720578 tid 3 2026-02-13T18:16:11.891 INFO:tasks.rados.rados.0.trial187.stdout:2149: snap_create 2026-02-13T18:16:11.891 INFO:tasks.rados.rados.0.trial187.stdout:2139: finishing write tid 4 to trial18717860-2 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2139: finishing write tid 5 to trial18717860-2 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2139: oid 2 updating version 0 to 684 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2139: oid 2 version 684 is already newer than 683 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2139: oid 2 updating version 684 to 686 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2139: oid 2 version 686 is already newer than 685 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 686 (ObjNum 703 snap 246 seq_num 703) dirty exists 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2139: left oid 2 (ObjNum 703 snap 246 seq_num 703) 2026-02-13T18:16:11.892 INFO:tasks.rados.rados.0.trial187.stdout:2140: expect (ObjNum 586 snap 204 seq_num 586) 2026-02-13T18:16:11.956 INFO:tasks.rados.rados.0.trial187.stdout:2141: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:16:11.972 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:12.009 INFO:tasks.rados.rados.0.trial187.stdout:2145: finishing copy_from to trial18717860-44 2026-02-13T18:16:12.009 INFO:tasks.rados.rados.0.trial187.stdout:2145: got expected ENOENT (src dne) 2026-02-13T18:16:12.009 INFO:tasks.rados.rados.0.trial187.stdout:2145: finishing copy_from racing read to trial18717860-44 2026-02-13T18:16:12.010 INFO:tasks.rados.rados.0.trial187.stdout:2143: expect (ObjNum 633 snap 214 seq_num 633) 2026-02-13T18:16:12.010 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:12.077 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1501781 2026-02-13T18:16:12.097 INFO:tasks.rados.rados.0.trial187.stdout:2144: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:16:12.145 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: finishing write tid 1 to trial18717860-32 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: finishing write tid 2 to trial18717860-32 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: finishing write tid 3 to trial18717860-32 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: finishing write tid 4 to trial18717860-32 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: finishing write tid 5 to trial18717860-32 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: oid 32 updating version 0 to 809 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: oid 32 updating version 809 to 812 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: oid 32 version 812 is already newer than 811 2026-02-13T18:16:12.263 INFO:tasks.rados.rados.0.trial187.stdout:2148: oid 32 version 812 is already newer than 810 2026-02-13T18:16:12.264 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 812 (ObjNum 704 snap 246 seq_num 704) dirty exists 2026-02-13T18:16:12.264 INFO:tasks.rados.rados.0.trial187.stdout:2148: left oid 32 (ObjNum 704 snap 246 seq_num 704) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2139: done (7 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2140: done (6 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2141: done (5 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2143: done (4 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2144: done (3 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2145: done (2 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2148: done (1 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2149: done (0 left) 2026-02-13T18:16:12.867 INFO:tasks.rados.rados.0.trial187.stdout:2150: delete oid 48 current snap is 247 2026-02-13T18:16:12.880 INFO:tasks.rados.rados.0.trial187.stdout:2150: done (0 left) 2026-02-13T18:16:12.880 INFO:tasks.rados.rados.0.trial187.stdout:2151: write (excl) oid 9 current snap is 247 2026-02-13T18:16:12.880 INFO:tasks.rados.rados.0.trial187.stdout:2151: seq_num 706 ranges {665742=630270,1863699=604567,3121574=676394} 2026-02-13T18:16:12.889 INFO:tasks.rados.rados.0.trial187.stdout:2151: writing trial18717860-9 from 665742 to 1296012 tid 1 2026-02-13T18:16:12.897 INFO:tasks.rados.rados.0.trial187.stdout:2151: writing trial18717860-9 from 1863699 to 2468266 tid 2 2026-02-13T18:16:12.906 INFO:tasks.rados.rados.0.trial187.stdout:2151: writing trial18717860-9 from 3121574 to 3797968 tid 3 2026-02-13T18:16:12.906 INFO:tasks.rados.rados.0.trial187.stdout:2152: snap_create 2026-02-13T18:16:12.906 INFO:tasks.rados.rados.0.trial187.stdout:2151: finishing write tid 1 to trial18717860-9 2026-02-13T18:16:12.907 INFO:tasks.rados.rados.0.trial187.stdout:2151: finishing write tid 2 to trial18717860-9 2026-02-13T18:16:12.909 INFO:tasks.rados.rados.0.trial187.stdout:2151: finishing write tid 3 to trial18717860-9 2026-02-13T18:16:12.909 INFO:tasks.rados.rados.0.trial187.stdout:2151: finishing write tid 4 to trial18717860-9 2026-02-13T18:16:12.909 INFO:tasks.rados.rados.0.trial187.stdout:2151: finishing write tid 5 to trial18717860-9 2026-02-13T18:16:12.910 INFO:tasks.rados.rados.0.trial187.stdout:2151: oid 9 updating version 0 to 1057 2026-02-13T18:16:12.910 INFO:tasks.rados.rados.0.trial187.stdout:2151: oid 9 version 1057 is already newer than 1055 2026-02-13T18:16:12.910 INFO:tasks.rados.rados.0.trial187.stdout:2151: oid 9 version 1057 is already newer than 1056 2026-02-13T18:16:12.910 INFO:tasks.rados.rados.0.trial187.stdout:2151: oid 9 version 1057 is already newer than 1054 2026-02-13T18:16:12.910 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1057 (ObjNum 706 snap 247 seq_num 706) dirty exists 2026-02-13T18:16:12.910 INFO:tasks.rados.rados.0.trial187.stdout:2151: left oid 9 (ObjNum 706 snap 247 seq_num 706) 2026-02-13T18:16:13.868 INFO:tasks.rados.rados.0.trial187.stdout:2151: done (1 left) 2026-02-13T18:16:13.868 INFO:tasks.rados.rados.0.trial187.stdout:2152: done (0 left) 2026-02-13T18:16:13.868 INFO:tasks.rados.rados.0.trial187.stdout:2153: delete oid 35 current snap is 248 2026-02-13T18:16:13.872 INFO:tasks.rados.rados.0.trial187.stdout:2153: done (0 left) 2026-02-13T18:16:13.872 INFO:tasks.rados.rados.0.trial187.stdout:2154: copy_from oid 16 from oid 2 current snap is 248 2026-02-13T18:16:13.872 INFO:tasks.rados.rados.0.trial187.stdout:2155: snap_create 2026-02-13T18:16:13.891 INFO:tasks.rados.rados.0.trial187.stdout:2154: finishing copy_from racing read to trial18717860-16 2026-02-13T18:16:13.893 INFO:tasks.rados.rados.0.trial187.stdout:2154: finishing copy_from to trial18717860-16 2026-02-13T18:16:13.893 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 686 (ObjNum 703 snap 246 seq_num 703) dirty exists 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2154: done (1 left) 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2155: done (0 left) 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2156: read oid 22 snap -1 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2156: expect (ObjNum 693 snap 240 seq_num 693) 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2157: read oid 20 snap -1 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2157: expect deleted 2026-02-13T18:16:14.872 INFO:tasks.rados.rados.0.trial187.stdout:2158: delete oid 16 current snap is 249 2026-02-13T18:16:14.875 INFO:tasks.rados.rados.0.trial187.stdout:2157: done (2 left) 2026-02-13T18:16:14.875 INFO:tasks.rados.rados.0.trial187.stdout:2158: done (1 left) 2026-02-13T18:16:14.876 INFO:tasks.rados.rados.0.trial187.stdout:2159: snap_create 2026-02-13T18:16:14.881 INFO:tasks.rados.rados.0.trial187.stdout:2156: expect (ObjNum 693 snap 240 seq_num 693) 2026-02-13T18:16:14.881 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:14.954 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1520003 2026-02-13T18:16:15.875 INFO:tasks.rados.rados.0.trial187.stdout:2156: done (1 left) 2026-02-13T18:16:15.875 INFO:tasks.rados.rados.0.trial187.stdout:2159: done (0 left) 2026-02-13T18:16:15.875 INFO:tasks.rados.rados.0.trial187.stdout:2160: write oid 42 current snap is 250 2026-02-13T18:16:15.875 INFO:tasks.rados.rados.0.trial187.stdout:2160: seq_num 709 ranges {716163=572370,2039145=468247,3203843=626563} 2026-02-13T18:16:15.883 INFO:tasks.rados.rados.0.trial187.stdout:2160: writing trial18717860-42 from 716163 to 1288533 tid 1 2026-02-13T18:16:15.890 INFO:tasks.rados.rados.0.trial187.stdout:2160: writing trial18717860-42 from 2039145 to 2507392 tid 2 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2160: writing trial18717860-42 from 3203843 to 3830406 tid 3 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2161: read oid 36 snap -1 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2161: expect deleted 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2162: read oid 12 snap -1 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2162: expect deleted 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2163: write (excl) oid 29 current snap is 250 2026-02-13T18:16:15.896 INFO:tasks.rados.rados.0.trial187.stdout:2163: seq_num 710 ranges {732970=647619,2097627=611905,3231266=437835} 2026-02-13T18:16:15.904 INFO:tasks.rados.rados.0.trial187.stdout:2163: writing trial18717860-29 from 732970 to 1380589 tid 1 2026-02-13T18:16:15.913 INFO:tasks.rados.rados.0.trial187.stdout:2163: writing trial18717860-29 from 2097627 to 2709532 tid 2 2026-02-13T18:16:15.918 INFO:tasks.rados.rados.0.trial187.stdout:2163: writing trial18717860-29 from 3231266 to 3669101 tid 3 2026-02-13T18:16:15.918 INFO:tasks.rados.rados.0.trial187.stdout:2164: write oid 43 current snap is 250 2026-02-13T18:16:15.918 INFO:tasks.rados.rados.0.trial187.stdout:2164: seq_num 711 ranges {749777=722868,2156109=471916,3258689=649107} 2026-02-13T18:16:15.923 INFO:tasks.rados.rados.0.trial187.stdout:2164: writing trial18717860-43 from 749777 to 1472645 tid 1 2026-02-13T18:16:15.928 INFO:tasks.rados.rados.0.trial187.stdout:2164: writing trial18717860-43 from 2156109 to 2628025 tid 2 2026-02-13T18:16:15.933 INFO:tasks.rados.rados.0.trial187.stdout:2164: writing trial18717860-43 from 3258689 to 3907796 tid 3 2026-02-13T18:16:15.933 INFO:tasks.rados.rados.0.trial187.stdout:2165: snap_remove snap 222 2026-02-13T18:16:16.868 INFO:tasks.rados.rados.0.trial187.stdout:2165: done (5 left) 2026-02-13T18:16:16.868 INFO:tasks.rados.rados.0.trial187.stdout:2166: copy_from oid 31 from oid 27 current snap is 250 2026-02-13T18:16:16.868 INFO:tasks.rados.rados.0.trial187.stdout:2160: finishing write tid 1 to trial18717860-42 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: finishing write tid 2 to trial18717860-42 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: finishing write tid 3 to trial18717860-42 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: finishing write tid 4 to trial18717860-42 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: finishing write tid 5 to trial18717860-42 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: oid 42 updating version 0 to 998 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: oid 42 version 998 is already newer than 997 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: oid 42 updating version 998 to 999 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: oid 42 version 999 is already newer than 996 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 999 (ObjNum 709 snap 250 seq_num 709) dirty exists 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2160: left oid 42 (ObjNum 709 snap 250 seq_num 709) 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2163: finishing write tid 1 to trial18717860-29 2026-02-13T18:16:16.869 INFO:tasks.rados.rados.0.trial187.stdout:2163: finishing write tid 2 to trial18717860-29 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: finishing write tid 3 to trial18717860-29 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: finishing write tid 4 to trial18717860-29 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: finishing write tid 5 to trial18717860-29 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: oid 29 updating version 0 to 902 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: oid 29 version 902 is already newer than 901 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: oid 29 updating version 902 to 903 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: oid 29 version 903 is already newer than 900 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 903 (ObjNum 710 snap 250 seq_num 710) dirty exists 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2163: left oid 29 (ObjNum 710 snap 250 seq_num 710) 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2164: finishing write tid 1 to trial18717860-43 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2164: finishing write tid 2 to trial18717860-43 2026-02-13T18:16:16.870 INFO:tasks.rados.rados.0.trial187.stdout:2160: done (5 left) 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2161: done (4 left) 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2162: done (3 left) 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2163: done (2 left) 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2167: copy_from oid 36 from oid 47 current snap is 250 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: finishing write tid 3 to trial18717860-43 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: finishing write tid 4 to trial18717860-43 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: finishing write tid 5 to trial18717860-43 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: oid 43 updating version 0 to 1345 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: oid 43 version 1345 is already newer than 1343 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: oid 43 version 1345 is already newer than 1342 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: oid 43 version 1345 is already newer than 1344 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1345 (ObjNum 711 snap 250 seq_num 711) dirty exists 2026-02-13T18:16:16.871 INFO:tasks.rados.rados.0.trial187.stdout:2164: left oid 43 (ObjNum 711 snap 250 seq_num 711) 2026-02-13T18:16:16.872 INFO:tasks.rados.rados.0.trial187.stdout:2164: done (2 left) 2026-02-13T18:16:16.872 INFO:tasks.rados.rados.0.trial187.stdout:2168: rollback oid 5 current snap is 250 2026-02-13T18:16:16.872 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 196 2026-02-13T18:16:16.872 INFO:tasks.rados.rados.0.trial187.stdout:2169: snap_remove snap 241 2026-02-13T18:16:17.870 INFO:tasks.rados.rados.0.trial187.stdout:2169: done (3 left) 2026-02-13T18:16:17.870 INFO:tasks.rados.rados.0.trial187.stdout:2170: write oid 24 current snap is 250 2026-02-13T18:16:17.870 INFO:tasks.rados.rados.0.trial187.stdout:2170: seq_num 712 ranges {766584=798117,2098238=615574,3169759=460379} 2026-02-13T18:16:17.876 INFO:tasks.rados.rados.0.trial187.stdout:2170: writing trial18717860-24 from 766584 to 1564701 tid 1 2026-02-13T18:16:17.880 INFO:tasks.rados.rados.0.trial187.stdout:2170: writing trial18717860-24 from 2098238 to 2713812 tid 2 2026-02-13T18:16:17.884 INFO:tasks.rados.rados.0.trial187.stdout:2170: writing trial18717860-24 from 3169759 to 3630138 tid 3 2026-02-13T18:16:17.884 INFO:tasks.rados.rados.0.trial187.stdout:2171: snap_create 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2168: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2168: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2168: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 850 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2166: finishing copy_from racing read to trial18717860-31 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2166: finishing copy_from to trial18717860-31 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 621 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2167: finishing copy_from racing read to trial18717860-36 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2167: finishing copy_from to trial18717860-36 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2170: finishing write tid 1 to trial18717860-24 2026-02-13T18:16:17.885 INFO:tasks.rados.rados.0.trial187.stdout:2170: finishing write tid 2 to trial18717860-24 2026-02-13T18:16:17.886 INFO:tasks.rados.rados.0.trial187.stdout:2170: finishing write tid 3 to trial18717860-24 2026-02-13T18:16:17.886 INFO:tasks.rados.rados.0.trial187.stdout:2170: finishing write tid 4 to trial18717860-24 2026-02-13T18:16:17.886 INFO:tasks.rados.rados.0.trial187.stdout:2170: finishing write tid 5 to trial18717860-24 2026-02-13T18:16:17.887 INFO:tasks.rados.rados.0.trial187.stdout:2170: oid 24 updating version 0 to 986 2026-02-13T18:16:17.887 INFO:tasks.rados.rados.0.trial187.stdout:2170: oid 24 updating version 986 to 987 2026-02-13T18:16:17.887 INFO:tasks.rados.rados.0.trial187.stdout:2170: oid 24 updating version 987 to 988 2026-02-13T18:16:17.887 INFO:tasks.rados.rados.0.trial187.stdout:2170: oid 24 updating version 988 to 989 2026-02-13T18:16:17.887 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 989 (ObjNum 712 snap 250 seq_num 712) dirty exists 2026-02-13T18:16:17.887 INFO:tasks.rados.rados.0.trial187.stdout:2170: left oid 24 (ObjNum 712 snap 250 seq_num 712) 2026-02-13T18:16:18.877 INFO:tasks.rados.rados.0.trial187.stdout:2166: done (4 left) 2026-02-13T18:16:18.877 INFO:tasks.rados.rados.0.trial187.stdout:2167: done (3 left) 2026-02-13T18:16:18.877 INFO:tasks.rados.rados.0.trial187.stdout:2168: done (2 left) 2026-02-13T18:16:18.877 INFO:tasks.rados.rados.0.trial187.stdout:2170: done (1 left) 2026-02-13T18:16:18.877 INFO:tasks.rados.rados.0.trial187.stdout:2171: done (0 left) 2026-02-13T18:16:18.877 INFO:tasks.rados.rados.0.trial187.stdout:2172: snap_create 2026-02-13T18:16:19.880 INFO:tasks.rados.rados.0.trial187.stdout:2172: done (0 left) 2026-02-13T18:16:19.880 INFO:tasks.rados.rados.0.trial187.stdout:2173: snap_remove snap 250 2026-02-13T18:16:20.881 INFO:tasks.rados.rados.0.trial187.stdout:2173: done (0 left) 2026-02-13T18:16:20.881 INFO:tasks.rados.rados.0.trial187.stdout:2174: delete oid 38 current snap is 252 2026-02-13T18:16:20.885 INFO:tasks.rados.rados.0.trial187.stdout:2174: done (0 left) 2026-02-13T18:16:20.885 INFO:tasks.rados.rados.0.trial187.stdout:2175: snap_create 2026-02-13T18:16:21.867 INFO:tasks.rados.rados.0.trial187.stdout:2175: done (0 left) 2026-02-13T18:16:21.868 INFO:tasks.rados.rados.0.trial187.stdout:2176: copy_from oid 22 from oid 39 current snap is 253 2026-02-13T18:16:21.868 INFO:tasks.rados.rados.0.trial187.stdout:2177: delete oid 49 current snap is 253 2026-02-13T18:16:21.871 INFO:tasks.rados.rados.0.trial187.stdout:2177: done (1 left) 2026-02-13T18:16:21.871 INFO:tasks.rados.rados.0.trial187.stdout:2178: write oid 41 current snap is 253 2026-02-13T18:16:21.871 INFO:tasks.rados.rados.0.trial187.stdout:2178: seq_num 715 ranges {417005=740217,1590037=426968} 2026-02-13T18:16:21.878 INFO:tasks.rados.rados.0.trial187.stdout:2178: writing trial18717860-41 from 417005 to 1157222 tid 1 2026-02-13T18:16:21.884 INFO:tasks.rados.rados.0.trial187.stdout:2178: writing trial18717860-41 from 1590037 to 2017005 tid 2 2026-02-13T18:16:21.884 INFO:tasks.rados.rados.0.trial187.stdout:2179: write (excl) oid 26 current snap is 253 2026-02-13T18:16:21.885 INFO:tasks.rados.rados.0.trial187.stdout:2179: seq_num 716 ranges {433812=415466,1648519=385293} 2026-02-13T18:16:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2179: writing trial18717860-26 from 433812 to 849278 tid 1 2026-02-13T18:16:21.898 INFO:tasks.rados.rados.0.trial187.stdout:2179: writing trial18717860-26 from 1648519 to 2033812 tid 2 2026-02-13T18:16:21.898 INFO:tasks.rados.rados.0.trial187.stdout:2180: copy_from oid 29 from oid 42 current snap is 253 2026-02-13T18:16:21.898 INFO:tasks.rados.rados.0.trial187.stdout:2178: finishing write tid 1 to trial18717860-41 2026-02-13T18:16:21.898 INFO:tasks.rados.rados.0.trial187.stdout:2176: finishing copy_from racing read to trial18717860-22 2026-02-13T18:16:21.898 INFO:tasks.rados.rados.0.trial187.stdout:2176: finishing copy_from to trial18717860-22 2026-02-13T18:16:21.898 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1040 (ObjNum 698 snap 244 seq_num 698) dirty exists 2026-02-13T18:16:21.899 INFO:tasks.rados.rados.0.trial187.stdout:2178: finishing write tid 2 to trial18717860-41 2026-02-13T18:16:21.899 INFO:tasks.rados.rados.0.trial187.stdout:2178: finishing write tid 3 to trial18717860-41 2026-02-13T18:16:21.899 INFO:tasks.rados.rados.0.trial187.stdout:2176: done (3 left) 2026-02-13T18:16:21.899 INFO:tasks.rados.rados.0.trial187.stdout:2181: write oid 12 current snap is 253 2026-02-13T18:16:21.899 INFO:tasks.rados.rados.0.trial187.stdout:2181: seq_num 717 ranges {450619=490715,1590648=459971} 2026-02-13T18:16:21.904 INFO:tasks.rados.rados.0.trial187.stdout:2181: writing trial18717860-12 from 450619 to 941334 tid 1 2026-02-13T18:16:21.912 INFO:tasks.rados.rados.0.trial187.stdout:2181: writing trial18717860-12 from 1590648 to 2050619 tid 2 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2182: copy_from oid 31 from oid 45 current snap is 253 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2178: finishing write tid 4 to trial18717860-41 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2178: oid 41 updating version 0 to 1000 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2178: oid 41 updating version 1000 to 1002 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2178: oid 41 version 1002 is already newer than 1001 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1002 (ObjNum 715 snap 253 seq_num 715) dirty exists 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2178: left oid 41 (ObjNum 715 snap 253 seq_num 715) 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2179: finishing write tid 1 to trial18717860-26 2026-02-13T18:16:21.913 INFO:tasks.rados.rados.0.trial187.stdout:2179: finishing write tid 2 to trial18717860-26 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: finishing write tid 3 to trial18717860-26 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: finishing write tid 4 to trial18717860-26 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: oid 26 updating version 0 to 1069 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: oid 26 updating version 1069 to 1070 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: oid 26 updating version 1070 to 1071 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 1071 (ObjNum 716 snap 253 seq_num 716) dirty exists 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: left oid 26 (ObjNum 716 snap 253 seq_num 716) 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2181: finishing write tid 1 to trial18717860-12 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2178: done (4 left) 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2179: done (3 left) 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2183: read oid 5 snap -1 2026-02-13T18:16:21.914 INFO:tasks.rados.rados.0.trial187.stdout:2183: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:21.915 INFO:tasks.rados.rados.0.trial187.stdout:2184: snap_remove snap 252 2026-02-13T18:16:22.889 INFO:tasks.rados.rados.0.trial187.stdout:2184: done (4 left) 2026-02-13T18:16:22.889 INFO:tasks.rados.rados.0.trial187.stdout:2185: snap_remove snap 248 2026-02-13T18:16:23.893 INFO:tasks.rados.rados.0.trial187.stdout:2185: done (4 left) 2026-02-13T18:16:23.893 INFO:tasks.rados.rados.0.trial187.stdout:2186: snap_create 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2180: finishing copy_from racing read to trial18717860-29 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: finishing write tid 2 to trial18717860-12 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: finishing write tid 3 to trial18717860-12 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: finishing write tid 4 to trial18717860-12 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: oid 12 updating version 0 to 849 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: oid 12 version 849 is already newer than 847 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: oid 12 version 849 is already newer than 848 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 849 (ObjNum 717 snap 253 seq_num 717) dirty exists 2026-02-13T18:16:23.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: left oid 12 (ObjNum 717 snap 253 seq_num 717) 2026-02-13T18:16:23.895 INFO:tasks.rados.rados.0.trial187.stdout:2182: finishing copy_from to trial18717860-31 2026-02-13T18:16:23.895 INFO:tasks.rados.rados.0.trial187.stdout:2182: got expected ENOENT (src dne) 2026-02-13T18:16:23.895 INFO:tasks.rados.rados.0.trial187.stdout:2182: finishing copy_from racing read to trial18717860-31 2026-02-13T18:16:23.895 INFO:tasks.rados.rados.0.trial187.stdout:2183: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:23.938 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2094598 2026-02-13T18:16:23.940 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 304963 2026-02-13T18:16:23.971 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:24.005 INFO:tasks.rados.rados.0.trial187.stdout:2180: finishing copy_from to trial18717860-29 2026-02-13T18:16:24.005 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 999 (ObjNum 709 snap 250 seq_num 709) dirty exists 2026-02-13T18:16:24.894 INFO:tasks.rados.rados.0.trial187.stdout:2180: done (4 left) 2026-02-13T18:16:24.894 INFO:tasks.rados.rados.0.trial187.stdout:2181: done (3 left) 2026-02-13T18:16:24.894 INFO:tasks.rados.rados.0.trial187.stdout:2182: done (2 left) 2026-02-13T18:16:24.894 INFO:tasks.rados.rados.0.trial187.stdout:2183: done (1 left) 2026-02-13T18:16:24.894 INFO:tasks.rados.rados.0.trial187.stdout:2186: done (0 left) 2026-02-13T18:16:24.894 INFO:tasks.rados.rados.0.trial187.stdout:2187: snap_create 2026-02-13T18:16:25.895 INFO:tasks.rados.rados.0.trial187.stdout:2187: done (0 left) 2026-02-13T18:16:25.895 INFO:tasks.rados.rados.0.trial187.stdout:2188: rollback oid 32 current snap is 255 2026-02-13T18:16:25.895 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 205 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:2189: rollback oid 16 current snap is 255 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 246 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:2190: read oid 43 snap 169 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:2190: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:2191: rollback oid 9 current snap is 255 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 221 2026-02-13T18:16:25.896 INFO:tasks.rados.rados.0.trial187.stdout:2192: snap_remove snap 236 2026-02-13T18:16:26.868 INFO:tasks.rados.rados.0.trial187.stdout:2192: done (4 left) 2026-02-13T18:16:26.869 INFO:tasks.rados.rados.0.trial187.stdout:2193: read oid 6 snap -1 2026-02-13T18:16:26.869 INFO:tasks.rados.rados.0.trial187.stdout:2193: expect (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:16:26.869 INFO:tasks.rados.rados.0.trial187.stdout:2194: snap_remove snap 253 2026-02-13T18:16:27.869 INFO:tasks.rados.rados.0.trial187.stdout:2194: done (5 left) 2026-02-13T18:16:27.870 INFO:tasks.rados.rados.0.trial187.stdout:2195: delete oid 50 current snap is 255 2026-02-13T18:16:27.870 INFO:tasks.rados.rados.0.trial187.stdout:2189: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:16:27.870 INFO:tasks.rados.rados.0.trial187.stdout:2189: finishing rollback tid 2 to trial18717860-16 2026-02-13T18:16:27.870 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 988 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:16:27.870 INFO:tasks.rados.rados.0.trial187.stdout:2188: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:16:27.870 INFO:tasks.rados.rados.0.trial187.stdout:2190: expect (ObjNum 537 snap 168 seq_num 537) 2026-02-13T18:16:27.973 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1130229 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2188: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2191: finishing rollback tid 0 to trial18717860-9 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2191: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2191: finishing rollback tid 2 to trial18717860-9 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1079 (ObjNum 494 snap 147 seq_num 494) dirty exists 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2188: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 815 (ObjNum 552 snap 184 seq_num 552) dirty exists 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2188: done (5 left) 2026-02-13T18:16:28.006 INFO:tasks.rados.rados.0.trial187.stdout:2189: done (4 left) 2026-02-13T18:16:28.007 INFO:tasks.rados.rados.0.trial187.stdout:2190: done (3 left) 2026-02-13T18:16:28.007 INFO:tasks.rados.rados.0.trial187.stdout:2191: done (2 left) 2026-02-13T18:16:28.007 INFO:tasks.rados.rados.0.trial187.stdout:2195: done (1 left) 2026-02-13T18:16:28.007 INFO:tasks.rados.rados.0.trial187.stdout:2196: write (excl) oid 2 current snap is 255 2026-02-13T18:16:28.007 INFO:tasks.rados.rados.0.trial187.stdout:2196: seq_num 719 ranges {484233=641213,1707612=376621} 2026-02-13T18:16:28.013 INFO:tasks.rados.rados.0.trial187.stdout:2196: writing trial18717860-2 from 484233 to 1125446 tid 1 2026-02-13T18:16:28.020 INFO:tasks.rados.rados.0.trial187.stdout:2196: writing trial18717860-2 from 1707612 to 2084233 tid 2 2026-02-13T18:16:28.020 INFO:tasks.rados.rados.0.trial187.stdout:2197: rollback oid 10 current snap is 255 2026-02-13T18:16:28.020 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 10 to 246 2026-02-13T18:16:28.020 INFO:tasks.rados.rados.0.trial187.stdout:2193: expect (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:16:28.024 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 939428 2026-02-13T18:16:28.091 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:28.131 INFO:tasks.rados.rados.0.trial187.stdout:2196: finishing write tid 1 to trial18717860-2 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: finishing write tid 2 to trial18717860-2 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: finishing write tid 3 to trial18717860-2 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2193: done (2 left) 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2198: delete oid 37 current snap is 255 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: finishing write tid 4 to trial18717860-2 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: oid 2 updating version 0 to 704 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: oid 2 updating version 704 to 705 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: oid 2 updating version 705 to 706 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 706 (ObjNum 719 snap 255 seq_num 719) dirty exists 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2196: left oid 2 (ObjNum 719 snap 255 seq_num 719) 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2197: finishing rollback tid 0 to trial18717860-10 2026-02-13T18:16:28.132 INFO:tasks.rados.rados.0.trial187.stdout:2197: finishing rollback tid 1 to trial18717860-10 2026-02-13T18:16:28.133 INFO:tasks.rados.rados.0.trial187.stdout:2197: finishing rollback tid 2 to trial18717860-10 2026-02-13T18:16:28.133 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 852 (ObjNum 644 snap 218 seq_num 644) dirty exists 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:2196: done (2 left) 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:2197: done (1 left) 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:2198: done (0 left) 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:2199: read oid 6 snap -1 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:2199: expect (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:2200: rollback oid 41 current snap is 255 2026-02-13T18:16:28.134 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 244 2026-02-13T18:16:28.135 INFO:tasks.rados.rados.0.trial187.stdout:2201: delete oid 9 current snap is 255 2026-02-13T18:16:28.135 INFO:tasks.rados.rados.0.trial187.stdout:2201: done (2 left) 2026-02-13T18:16:28.135 INFO:tasks.rados.rados.0.trial187.stdout:2202: snap_create 2026-02-13T18:16:28.137 INFO:tasks.rados.rados.0.trial187.stdout:2199: expect (ObjNum 638 snap 215 seq_num 638) 2026-02-13T18:16:28.233 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:28.273 INFO:tasks.rados.rados.0.trial187.stdout:2200: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:16:28.273 INFO:tasks.rados.rados.0.trial187.stdout:2200: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:16:28.273 INFO:tasks.rados.rados.0.trial187.stdout:2200: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:16:28.273 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1005 (ObjNum 668 snap 222 seq_num 668) dirty exists 2026-02-13T18:16:28.990 INFO:tasks.rados.rados.0.trial187.stdout:2199: done (2 left) 2026-02-13T18:16:28.990 INFO:tasks.rados.rados.0.trial187.stdout:2200: done (1 left) 2026-02-13T18:16:28.990 INFO:tasks.rados.rados.0.trial187.stdout:2202: done (0 left) 2026-02-13T18:16:28.991 INFO:tasks.rados.rados.0.trial187.stdout:2203: write oid 18 current snap is 256 2026-02-13T18:16:28.991 INFO:tasks.rados.rados.0.trial187.stdout:2203: seq_num 722 ranges {534654=466960,1766705=367949} 2026-02-13T18:16:28.996 INFO:tasks.rados.rados.0.trial187.stdout:2203: writing trial18717860-18 from 534654 to 1001614 tid 1 2026-02-13T18:16:29.004 INFO:tasks.rados.rados.0.trial187.stdout:2203: writing trial18717860-18 from 1766705 to 2134654 tid 2 2026-02-13T18:16:29.005 INFO:tasks.rados.rados.0.trial187.stdout:2204: rollback oid 7 current snap is 256 2026-02-13T18:16:29.005 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 247 2026-02-13T18:16:29.005 INFO:tasks.rados.rados.0.trial187.stdout:2203: finishing write tid 1 to trial18717860-18 2026-02-13T18:16:29.005 INFO:tasks.rados.rados.0.trial187.stdout:2205: write oid 20 current snap is 256 2026-02-13T18:16:29.005 INFO:tasks.rados.rados.0.trial187.stdout:2205: seq_num 723 ranges {551461=658562,1941540=209921} 2026-02-13T18:16:29.012 INFO:tasks.rados.rados.0.trial187.stdout:2205: writing trial18717860-20 from 551461 to 1210023 tid 1 2026-02-13T18:16:29.019 INFO:tasks.rados.rados.0.trial187.stdout:2205: writing trial18717860-20 from 1941540 to 2151461 tid 2 2026-02-13T18:16:29.019 INFO:tasks.rados.rados.0.trial187.stdout:2206: write (excl) oid 29 current snap is 256 2026-02-13T18:16:29.019 INFO:tasks.rados.rados.0.trial187.stdout:2206: seq_num 724 ranges {568268=733811,2000022=168246} 2026-02-13T18:16:29.027 INFO:tasks.rados.rados.0.trial187.stdout:2206: writing trial18717860-29 from 568268 to 1302079 tid 1 2026-02-13T18:16:29.033 INFO:tasks.rados.rados.0.trial187.stdout:2206: writing trial18717860-29 from 2000022 to 2168268 tid 2 2026-02-13T18:16:29.034 INFO:tasks.rados.rados.0.trial187.stdout:2207: write oid 36 current snap is 256 2026-02-13T18:16:29.034 INFO:tasks.rados.rados.0.trial187.stdout:2207: seq_num 725 ranges {585075=409060,1542151=642924} 2026-02-13T18:16:29.038 INFO:tasks.rados.rados.0.trial187.stdout:2207: writing trial18717860-36 from 585075 to 994135 tid 1 2026-02-13T18:16:29.043 INFO:tasks.rados.rados.0.trial187.stdout:2207: writing trial18717860-36 from 1542151 to 2185075 tid 2 2026-02-13T18:16:29.043 INFO:tasks.rados.rados.0.trial187.stdout:2208: write (excl) oid 11 current snap is 256 2026-02-13T18:16:29.043 INFO:tasks.rados.rados.0.trial187.stdout:2208: seq_num 726 ranges {601882=484309,1600633=524904} 2026-02-13T18:16:29.047 INFO:tasks.rados.rados.0.trial187.stdout:2208: writing trial18717860-11 from 601882 to 1086191 tid 1 2026-02-13T18:16:29.051 INFO:tasks.rados.rados.0.trial187.stdout:2208: writing trial18717860-11 from 1600633 to 2125537 tid 2 2026-02-13T18:16:29.051 INFO:tasks.rados.rados.0.trial187.stdout:2209: rollback oid 37 current snap is 256 2026-02-13T18:16:29.051 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 216 2026-02-13T18:16:29.051 INFO:tasks.rados.rados.0.trial187.stdout:2203: finishing write tid 2 to trial18717860-18 2026-02-13T18:16:29.051 INFO:tasks.rados.rados.0.trial187.stdout:2210: write (excl) oid 10 current snap is 256 2026-02-13T18:16:29.051 INFO:tasks.rados.rados.0.trial187.stdout:2210: seq_num 727 ranges {618689=559558,1659115=559574} 2026-02-13T18:16:29.055 INFO:tasks.rados.rados.0.trial187.stdout:2210: writing trial18717860-10 from 618689 to 1178247 tid 1 2026-02-13T18:16:29.060 INFO:tasks.rados.rados.0.trial187.stdout:2210: writing trial18717860-10 from 1659115 to 2218689 tid 2 2026-02-13T18:16:29.060 INFO:tasks.rados.rados.0.trial187.stdout:2211: read oid 13 snap -1 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2211: expect (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2212: read oid 45 snap -1 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2212: expect deleted 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2213: rollback oid 21 current snap is 256 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 254 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2203: finishing write tid 3 to trial18717860-18 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2203: finishing write tid 4 to trial18717860-18 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2203: oid 18 updating version 0 to 709 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2203: oid 18 updating version 709 to 710 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2203: oid 18 version 710 is already newer than 708 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 710 (ObjNum 722 snap 256 seq_num 722) dirty exists 2026-02-13T18:16:29.061 INFO:tasks.rados.rados.0.trial187.stdout:2203: left oid 18 (ObjNum 722 snap 256 seq_num 722) 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2204: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2204: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2204: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1002 (ObjNum 687 snap 239 seq_num 687) dirty exists 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2205: finishing write tid 1 to trial18717860-20 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2203: done (10 left) 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2204: done (9 left) 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2214: copy_from oid 6 from oid 5 current snap is 256 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2205: finishing write tid 2 to trial18717860-20 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2205: finishing write tid 3 to trial18717860-20 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2205: finishing write tid 4 to trial18717860-20 2026-02-13T18:16:29.062 INFO:tasks.rados.rados.0.trial187.stdout:2205: oid 20 updating version 0 to 989 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2205: oid 20 updating version 989 to 990 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2205: oid 20 updating version 990 to 991 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 991 (ObjNum 723 snap 256 seq_num 723) dirty exists 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2205: left oid 20 (ObjNum 723 snap 256 seq_num 723) 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: finishing write tid 1 to trial18717860-29 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: finishing write tid 2 to trial18717860-29 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: finishing write tid 3 to trial18717860-29 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: finishing write tid 4 to trial18717860-29 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: oid 29 updating version 0 to 1000 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: oid 29 updating version 1000 to 1001 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: oid 29 updating version 1001 to 1002 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1002 (ObjNum 724 snap 256 seq_num 724) dirty exists 2026-02-13T18:16:29.063 INFO:tasks.rados.rados.0.trial187.stdout:2206: left oid 29 (ObjNum 724 snap 256 seq_num 724) 2026-02-13T18:16:29.064 INFO:tasks.rados.rados.0.trial187.stdout:2205: done (9 left) 2026-02-13T18:16:29.064 INFO:tasks.rados.rados.0.trial187.stdout:2206: done (8 left) 2026-02-13T18:16:29.064 INFO:tasks.rados.rados.0.trial187.stdout:2215: read oid 38 snap -1 2026-02-13T18:16:29.064 INFO:tasks.rados.rados.0.trial187.stdout:2215: expect deleted 2026-02-13T18:16:29.064 INFO:tasks.rados.rados.0.trial187.stdout:2216: write oid 9 current snap is 256 2026-02-13T18:16:29.064 INFO:tasks.rados.rados.0.trial187.stdout:2216: seq_num 728 ranges {635496=634807,1717597=517899} 2026-02-13T18:16:29.065 INFO:tasks.rados.rados.0.trial187.stdout:2216: writing trial18717860-9 from 635496 to 1270303 tid 1 2026-02-13T18:16:29.069 INFO:tasks.rados.rados.0.trial187.stdout:2216: writing trial18717860-9 from 1717597 to 2235496 tid 2 2026-02-13T18:16:29.069 INFO:tasks.rados.rados.0.trial187.stdout:2217: write (excl) oid 28 current snap is 256 2026-02-13T18:16:29.069 INFO:tasks.rados.rados.0.trial187.stdout:2217: seq_num 729 ranges {652303=710056,2059726=192577} 2026-02-13T18:16:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2217: writing trial18717860-28 from 652303 to 1362359 tid 1 2026-02-13T18:16:29.077 INFO:tasks.rados.rados.0.trial187.stdout:2217: writing trial18717860-28 from 2059726 to 2252303 tid 2 2026-02-13T18:16:29.077 INFO:tasks.rados.rados.0.trial187.stdout:2218: snap_remove snap 219 2026-02-13T18:16:30.045 INFO:tasks.rados.rados.0.trial187.stdout:2218: done (11 left) 2026-02-13T18:16:30.045 INFO:tasks.rados.rados.0.trial187.stdout:2219: write (excl) oid 30 current snap is 256 2026-02-13T18:16:30.045 INFO:tasks.rados.rados.0.trial187.stdout:2219: seq_num 730 ranges {669110=501658,1834561=434549} 2026-02-13T18:16:30.050 INFO:tasks.rados.rados.0.trial187.stdout:2219: writing trial18717860-30 from 669110 to 1170768 tid 1 2026-02-13T18:16:30.054 INFO:tasks.rados.rados.0.trial187.stdout:2219: writing trial18717860-30 from 1834561 to 2269110 tid 2 2026-02-13T18:16:30.055 INFO:tasks.rados.rados.0.trial187.stdout:2220: write (excl) oid 25 current snap is 256 2026-02-13T18:16:30.055 INFO:tasks.rados.rados.0.trial187.stdout:2220: seq_num 731 ranges {685917=576907,1893043=392874} 2026-02-13T18:16:30.059 INFO:tasks.rados.rados.0.trial187.stdout:2220: writing trial18717860-25 from 685917 to 1262824 tid 1 2026-02-13T18:16:30.063 INFO:tasks.rados.rados.0.trial187.stdout:2220: writing trial18717860-25 from 1893043 to 2285917 tid 2 2026-02-13T18:16:30.063 INFO:tasks.rados.rados.0.trial187.stdout:2221: rollback oid 35 current snap is 256 2026-02-13T18:16:30.063 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 35 to 169 2026-02-13T18:16:30.064 INFO:tasks.rados.rados.0.trial187.stdout:2207: finishing write tid 1 to trial18717860-36 2026-02-13T18:16:30.064 INFO:tasks.rados.rados.0.trial187.stdout:2207: finishing write tid 2 to trial18717860-36 2026-02-13T18:16:30.064 INFO:tasks.rados.rados.0.trial187.stdout:2222: write (excl) oid 43 current snap is 256 2026-02-13T18:16:30.064 INFO:tasks.rados.rados.0.trial187.stdout:2222: seq_num 732 ranges {702724=652156,1951525=351199} 2026-02-13T18:16:30.068 INFO:tasks.rados.rados.0.trial187.stdout:2222: writing trial18717860-43 from 702724 to 1354880 tid 1 2026-02-13T18:16:30.072 INFO:tasks.rados.rados.0.trial187.stdout:2222: writing trial18717860-43 from 1951525 to 2302724 tid 2 2026-02-13T18:16:30.072 INFO:tasks.rados.rados.0.trial187.stdout:2223: snap_remove snap 244 2026-02-13T18:16:31.047 INFO:tasks.rados.rados.0.trial187.stdout:2223: done (15 left) 2026-02-13T18:16:31.047 INFO:tasks.rados.rados.0.trial187.stdout:2224: read oid 4 snap -1 2026-02-13T18:16:31.047 INFO:tasks.rados.rados.0.trial187.stdout:2224: expect (ObjNum 645 snap 218 seq_num 645) 2026-02-13T18:16:31.047 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 16 2026-02-13T18:16:31.047 INFO:tasks.rados.rados.0.trial187.stdout:2207: finishing write tid 3 to trial18717860-36 2026-02-13T18:16:31.047 INFO:tasks.rados.rados.0.trial187.stdout:2207: finishing write tid 4 to trial18717860-36 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2207: oid 36 updating version 0 to 988 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2207: oid 36 version 988 is already newer than 987 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2207: oid 36 version 988 is already newer than 986 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 988 (ObjNum 725 snap 256 seq_num 725) dirty exists 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2207: left oid 36 (ObjNum 725 snap 256 seq_num 725) 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2208: finishing write tid 1 to trial18717860-11 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2207: done (15 left) 2026-02-13T18:16:31.048 INFO:tasks.rados.rados.0.trial187.stdout:2225: snap_remove snap 251 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:2225: done (15 left) 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:2226: rollback oid 50 current snap is 256 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 209 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:2209: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:2209: finishing rollback tid 2 to trial18717860-37 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1387 (ObjNum 590 snap 204 seq_num 590) dirty exists 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:2208: finishing write tid 2 to trial18717860-11 2026-02-13T18:16:31.871 INFO:tasks.rados.rados.0.trial187.stdout:2208: finishing write tid 3 to trial18717860-11 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2208: finishing write tid 4 to trial18717860-11 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2208: oid 11 updating version 0 to 998 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2208: oid 11 updating version 998 to 999 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2208: oid 11 version 999 is already newer than 997 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 999 (ObjNum 726 snap 256 seq_num 726) dirty exists 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2208: left oid 11 (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2210: finishing write tid 1 to trial18717860-10 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2210: finishing write tid 2 to trial18717860-10 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2208: done (15 left) 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2209: done (14 left) 2026-02-13T18:16:31.872 INFO:tasks.rados.rados.0.trial187.stdout:2212: done (13 left) 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2215: done (12 left) 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2227: snap_create 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2210: finishing write tid 3 to trial18717860-10 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2210: finishing write tid 4 to trial18717860-10 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2210: oid 10 updating version 0 to 854 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2210: oid 10 version 854 is already newer than 853 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2210: oid 10 updating version 854 to 855 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 855 (ObjNum 727 snap 256 seq_num 727) dirty exists 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2210: left oid 10 (ObjNum 727 snap 256 seq_num 727) 2026-02-13T18:16:31.873 INFO:tasks.rados.rados.0.trial187.stdout:2211: expect (ObjNum 667 snap 222 seq_num 667) 2026-02-13T18:16:31.936 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:31.960 INFO:tasks.rados.rados.0.trial187.stdout:2213: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:16:31.960 INFO:tasks.rados.rados.0.trial187.stdout:2213: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:16:31.960 INFO:tasks.rados.rados.0.trial187.stdout:2213: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1005 (ObjNum 700 snap 245 seq_num 700) dirty exists 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2214: finishing copy_from racing read to trial18717860-6 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: finishing write tid 1 to trial18717860-9 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2214: finishing copy_from to trial18717860-6 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 850 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: finishing write tid 2 to trial18717860-9 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: finishing write tid 3 to trial18717860-9 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: finishing write tid 4 to trial18717860-9 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: oid 9 updating version 0 to 1093 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: oid 9 version 1093 is already newer than 1091 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:2216: oid 9 version 1093 is already newer than 1092 2026-02-13T18:16:31.961 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1093 (ObjNum 728 snap 256 seq_num 728) dirty exists 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2216: left oid 9 (ObjNum 728 snap 256 seq_num 728) 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: finishing write tid 1 to trial18717860-28 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: finishing write tid 2 to trial18717860-28 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: finishing write tid 3 to trial18717860-28 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: finishing write tid 4 to trial18717860-28 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: oid 28 updating version 0 to 991 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: oid 28 version 991 is already newer than 990 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: oid 28 updating version 991 to 992 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 992 (ObjNum 729 snap 256 seq_num 729) dirty exists 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2217: left oid 28 (ObjNum 729 snap 256 seq_num 729) 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2219: finishing write tid 1 to trial18717860-30 2026-02-13T18:16:31.962 INFO:tasks.rados.rados.0.trial187.stdout:2219: finishing write tid 2 to trial18717860-30 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2219: finishing write tid 3 to trial18717860-30 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2219: finishing write tid 4 to trial18717860-30 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2219: oid 30 updating version 0 to 818 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2219: oid 30 version 818 is already newer than 817 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2219: oid 30 version 818 is already newer than 816 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 818 (ObjNum 730 snap 256 seq_num 730) dirty exists 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2219: left oid 30 (ObjNum 730 snap 256 seq_num 730) 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2220: finishing write tid 1 to trial18717860-25 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2221: finishing rollback tid 1 to trial18717860-35 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 853 (ObjNum 129 snap 0 seq_num 3013081528) dirty dne 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2220: finishing write tid 2 to trial18717860-25 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2220: finishing write tid 3 to trial18717860-25 2026-02-13T18:16:31.963 INFO:tasks.rados.rados.0.trial187.stdout:2220: finishing write tid 4 to trial18717860-25 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2220: oid 25 updating version 0 to 989 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2220: oid 25 version 989 is already newer than 987 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2220: oid 25 version 989 is already newer than 988 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 989 (ObjNum 731 snap 256 seq_num 731) dirty exists 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2220: left oid 25 (ObjNum 731 snap 256 seq_num 731) 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: finishing write tid 1 to trial18717860-43 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: finishing write tid 2 to trial18717860-43 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: finishing write tid 3 to trial18717860-43 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: finishing write tid 4 to trial18717860-43 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: oid 43 updating version 0 to 1401 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: oid 43 updating version 1401 to 1403 2026-02-13T18:16:31.964 INFO:tasks.rados.rados.0.trial187.stdout:2222: oid 43 version 1403 is already newer than 1402 2026-02-13T18:16:31.965 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1403 (ObjNum 732 snap 256 seq_num 732) dirty exists 2026-02-13T18:16:31.965 INFO:tasks.rados.rados.0.trial187.stdout:2222: left oid 43 (ObjNum 732 snap 256 seq_num 732) 2026-02-13T18:16:31.965 INFO:tasks.rados.rados.0.trial187.stdout:2224: expect (ObjNum 645 snap 218 seq_num 645) 2026-02-13T18:16:32.002 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1283028 2026-02-13T18:16:32.042 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2439395 2026-02-13T18:16:32.048 INFO:tasks.rados.rados.0.trial187.stdout:2226: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:16:32.048 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 995 (ObjNum 65 snap 0 seq_num 4016853568) dirty dne 2026-02-13T18:16:32.870 INFO:tasks.rados.rados.0.trial187.stdout:2210: done (12 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2211: done (11 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2213: done (10 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2214: done (9 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2216: done (8 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2217: done (7 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2219: done (6 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2220: done (5 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2221: done (4 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2222: done (3 left) 2026-02-13T18:16:32.871 INFO:tasks.rados.rados.0.trial187.stdout:2224: done (2 left) 2026-02-13T18:16:32.872 INFO:tasks.rados.rados.0.trial187.stdout:2226: done (1 left) 2026-02-13T18:16:32.872 INFO:tasks.rados.rados.0.trial187.stdout:2227: done (0 left) 2026-02-13T18:16:32.872 INFO:tasks.rados.rados.0.trial187.stdout:2228: snap_remove snap 216 2026-02-13T18:16:33.872 INFO:tasks.rados.rados.0.trial187.stdout:2228: done (0 left) 2026-02-13T18:16:33.872 INFO:tasks.rados.rados.0.trial187.stdout:2229: write (excl) oid 23 current snap is 257 2026-02-13T18:16:33.872 INFO:tasks.rados.rados.0.trial187.stdout:2229: seq_num 733 ranges {719531=727405,1893654=425877} 2026-02-13T18:16:33.881 INFO:tasks.rados.rados.0.trial187.stdout:2229: writing trial18717860-23 from 719531 to 1446936 tid 1 2026-02-13T18:16:33.887 INFO:tasks.rados.rados.0.trial187.stdout:2229: writing trial18717860-23 from 1893654 to 2319531 tid 2 2026-02-13T18:16:33.887 INFO:tasks.rados.rados.0.trial187.stdout:2230: delete oid 32 current snap is 257 2026-02-13T18:16:33.887 INFO:tasks.rados.rados.0.trial187.stdout:2229: finishing write tid 1 to trial18717860-23 2026-02-13T18:16:33.889 INFO:tasks.rados.rados.0.trial187.stdout:2230: done (1 left) 2026-02-13T18:16:33.889 INFO:tasks.rados.rados.0.trial187.stdout:2231: write oid 28 current snap is 257 2026-02-13T18:16:33.889 INFO:tasks.rados.rados.0.trial187.stdout:2231: seq_num 735 ranges {753145=477903,2010618=342527} 2026-02-13T18:16:33.897 INFO:tasks.rados.rados.0.trial187.stdout:2231: writing trial18717860-28 from 753145 to 1231048 tid 1 2026-02-13T18:16:33.905 INFO:tasks.rados.rados.0.trial187.stdout:2231: writing trial18717860-28 from 2010618 to 2353145 tid 2 2026-02-13T18:16:33.905 INFO:tasks.rados.rados.0.trial187.stdout:2232: snap_remove snap 240 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2232: done (2 left) 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2233: copy_from oid 11 from oid 35 current snap is 257 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2229: finishing write tid 2 to trial18717860-23 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2229: finishing write tid 3 to trial18717860-23 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2229: finishing write tid 4 to trial18717860-23 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2229: oid 23 updating version 0 to 990 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2229: oid 23 version 990 is already newer than 989 2026-02-13T18:16:34.874 INFO:tasks.rados.rados.0.trial187.stdout:2229: oid 23 updating version 990 to 991 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 991 (ObjNum 733 snap 257 seq_num 733) dirty exists 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2229: left oid 23 (ObjNum 733 snap 257 seq_num 733) 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: finishing write tid 1 to trial18717860-28 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: finishing write tid 2 to trial18717860-28 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: finishing write tid 3 to trial18717860-28 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: finishing write tid 4 to trial18717860-28 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: oid 28 updating version 0 to 994 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: oid 28 updating version 994 to 995 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: oid 28 version 995 is already newer than 993 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 995 (ObjNum 735 snap 257 seq_num 735) dirty exists 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2231: left oid 28 (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:16:34.875 INFO:tasks.rados.rados.0.trial187.stdout:2229: done (2 left) 2026-02-13T18:16:34.876 INFO:tasks.rados.rados.0.trial187.stdout:2231: done (1 left) 2026-02-13T18:16:34.876 INFO:tasks.rados.rados.0.trial187.stdout:2234: delete oid 21 current snap is 257 2026-02-13T18:16:34.877 INFO:tasks.rados.rados.0.trial187.stdout:2233: finishing copy_from to trial18717860-11 2026-02-13T18:16:34.877 INFO:tasks.rados.rados.0.trial187.stdout:2233: got expected ENOENT (src dne) 2026-02-13T18:16:34.877 INFO:tasks.rados.rados.0.trial187.stdout:2233: finishing copy_from racing read to trial18717860-11 2026-02-13T18:16:34.878 INFO:tasks.rados.rados.0.trial187.stdout:2233: done (1 left) 2026-02-13T18:16:34.878 INFO:tasks.rados.rados.0.trial187.stdout:2234: done (0 left) 2026-02-13T18:16:34.879 INFO:tasks.rados.rados.0.trial187.stdout:2235: read oid 23 snap -1 2026-02-13T18:16:34.879 INFO:tasks.rados.rados.0.trial187.stdout:2235: expect (ObjNum 733 snap 257 seq_num 733) 2026-02-13T18:16:34.879 INFO:tasks.rados.rados.0.trial187.stdout:2236: write (excl) oid 15 current snap is 257 2026-02-13T18:16:34.879 INFO:tasks.rados.rados.0.trial187.stdout:2236: seq_num 737 ranges {786759=628401,2011229=375530} 2026-02-13T18:16:34.888 INFO:tasks.rados.rados.0.trial187.stdout:2236: writing trial18717860-15 from 786759 to 1415160 tid 1 2026-02-13T18:16:34.895 INFO:tasks.rados.rados.0.trial187.stdout:2236: writing trial18717860-15 from 2011229 to 2386759 tid 2 2026-02-13T18:16:34.895 INFO:tasks.rados.rados.0.trial187.stdout:2237: write oid 21 current snap is 257 2026-02-13T18:16:34.895 INFO:tasks.rados.rados.0.trial187.stdout:2237: seq_num 738 ranges {403566=420003,1386064=546918} 2026-02-13T18:16:34.900 INFO:tasks.rados.rados.0.trial187.stdout:2237: writing trial18717860-21 from 403566 to 823569 tid 1 2026-02-13T18:16:34.908 INFO:tasks.rados.rados.0.trial187.stdout:2237: writing trial18717860-21 from 1386064 to 1932982 tid 2 2026-02-13T18:16:34.908 INFO:tasks.rados.rados.0.trial187.stdout:2238: read oid 39 snap -1 2026-02-13T18:16:34.908 INFO:tasks.rados.rados.0.trial187.stdout:2238: expect (ObjNum 698 snap 244 seq_num 698) 2026-02-13T18:16:34.908 INFO:tasks.rados.rados.0.trial187.stdout:2239: snap_remove snap 247 2026-02-13T18:16:35.879 INFO:tasks.rados.rados.0.trial187.stdout:2239: done (4 left) 2026-02-13T18:16:35.879 INFO:tasks.rados.rados.0.trial187.stdout:2240: read oid 5 snap -1 2026-02-13T18:16:35.879 INFO:tasks.rados.rados.0.trial187.stdout:2240: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:35.879 INFO:tasks.rados.rados.0.trial187.stdout:2241: read oid 4 snap -1 2026-02-13T18:16:35.880 INFO:tasks.rados.rados.0.trial187.stdout:2241: expect (ObjNum 645 snap 218 seq_num 645) 2026-02-13T18:16:35.880 INFO:tasks.rados.rados.0.trial187.stdout:2242: copy_from oid 44 from oid 17 current snap is 257 2026-02-13T18:16:35.880 INFO:tasks.rados.rados.0.trial187.stdout:2235: expect (ObjNum 733 snap 257 seq_num 733) 2026-02-13T18:16:35.880 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:35.951 INFO:tasks.rados.rados.0.trial187.stdout:2236: finishing write tid 1 to trial18717860-15 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: finishing write tid 2 to trial18717860-15 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: finishing write tid 3 to trial18717860-15 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: finishing write tid 4 to trial18717860-15 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: oid 15 updating version 0 to 1004 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: oid 15 updating version 1004 to 1005 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: oid 15 version 1005 is already newer than 1003 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1005 (ObjNum 737 snap 257 seq_num 737) dirty exists 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2236: left oid 15 (ObjNum 737 snap 257 seq_num 737) 2026-02-13T18:16:35.952 INFO:tasks.rados.rados.0.trial187.stdout:2237: finishing write tid 1 to trial18717860-21 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: finishing write tid 2 to trial18717860-21 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: finishing write tid 3 to trial18717860-21 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2235: done (6 left) 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2236: done (5 left) 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2243: snap_create 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: finishing write tid 4 to trial18717860-21 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: oid 21 updating version 0 to 1008 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: oid 21 version 1008 is already newer than 1007 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: oid 21 updating version 1008 to 1009 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1009 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2237: left oid 21 (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:16:35.953 INFO:tasks.rados.rados.0.trial187.stdout:2238: expect (ObjNum 698 snap 244 seq_num 698) 2026-02-13T18:16:36.129 INFO:tasks.rados.rados.0.trial187.stdout:2241: expect (ObjNum 645 snap 218 seq_num 645) 2026-02-13T18:16:36.129 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:36.175 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1511498 2026-02-13T18:16:36.225 INFO:tasks.rados.rados.0.trial187.stdout:2240: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:36.234 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1517695 2026-02-13T18:16:36.288 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:36.323 INFO:tasks.rados.rados.0.trial187.stdout:2242: finishing copy_from racing read to trial18717860-44 2026-02-13T18:16:36.323 INFO:tasks.rados.rados.0.trial187.stdout:2242: finishing copy_from to trial18717860-44 2026-02-13T18:16:36.323 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:16:36.870 INFO:tasks.rados.rados.0.trial187.stdout:2237: done (5 left) 2026-02-13T18:16:36.870 INFO:tasks.rados.rados.0.trial187.stdout:2238: done (4 left) 2026-02-13T18:16:36.871 INFO:tasks.rados.rados.0.trial187.stdout:2240: done (3 left) 2026-02-13T18:16:36.871 INFO:tasks.rados.rados.0.trial187.stdout:2241: done (2 left) 2026-02-13T18:16:36.871 INFO:tasks.rados.rados.0.trial187.stdout:2242: done (1 left) 2026-02-13T18:16:36.871 INFO:tasks.rados.rados.0.trial187.stdout:2243: done (0 left) 2026-02-13T18:16:36.871 INFO:tasks.rados.rados.0.trial187.stdout:2244: write (excl) oid 6 current snap is 258 2026-02-13T18:16:36.871 INFO:tasks.rados.rados.0.trial187.stdout:2244: seq_num 739 ranges {420373=495252,1444546=690576} 2026-02-13T18:16:36.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: writing trial18717860-6 from 420373 to 915625 tid 1 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:2244: writing trial18717860-6 from 1444546 to 2135122 tid 2 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:2245: rollback oid 2 current snap is 258 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 212 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:2244: finishing write tid 1 to trial18717860-6 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:2246: read oid 48 snap 205 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:2246: expect (ObjNum 558 snap 187 seq_num 558) 2026-02-13T18:16:36.885 INFO:tasks.rados.rados.0.trial187.stdout:2247: copy_from oid 28 from oid 14 current snap is 258 2026-02-13T18:16:36.886 INFO:tasks.rados.rados.0.trial187.stdout:2248: write oid 35 current snap is 258 2026-02-13T18:16:36.886 INFO:tasks.rados.rados.0.trial187.stdout:2248: seq_num 740 ranges {437180=570501,1503028=550587} 2026-02-13T18:16:36.891 INFO:tasks.rados.rados.0.trial187.stdout:2248: writing trial18717860-35 from 437180 to 1007681 tid 1 2026-02-13T18:16:36.899 INFO:tasks.rados.rados.0.trial187.stdout:2248: writing trial18717860-35 from 1503028 to 2053615 tid 2 2026-02-13T18:16:36.899 INFO:tasks.rados.rados.0.trial187.stdout:2249: snap_remove snap 254 2026-02-13T18:16:37.875 INFO:tasks.rados.rados.0.trial187.stdout:2249: done (5 left) 2026-02-13T18:16:37.875 INFO:tasks.rados.rados.0.trial187.stdout:2250: delete oid 32 current snap is 258 2026-02-13T18:16:37.875 INFO:tasks.rados.rados.0.trial187.stdout:2245: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:16:37.875 INFO:tasks.rados.rados.0.trial187.stdout:2244: finishing write tid 2 to trial18717860-6 2026-02-13T18:16:37.875 INFO:tasks.rados.rados.0.trial187.stdout:2247: finishing copy_from to trial18717860-28 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2247: got expected ENOENT (src dne) 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2247: finishing copy_from racing read to trial18717860-28 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: finishing write tid 3 to trial18717860-6 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: finishing write tid 4 to trial18717860-6 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: oid 6 updating version 0 to 997 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: oid 6 updating version 997 to 998 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: oid 6 version 998 is already newer than 996 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 998 (ObjNum 739 snap 258 seq_num 739) dirty exists 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2244: left oid 6 (ObjNum 739 snap 258 seq_num 739) 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2245: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:16:37.876 INFO:tasks.rados.rados.0.trial187.stdout:2245: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:16:37.877 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 740 (ObjNum 619 snap 212 seq_num 619) dirty exists 2026-02-13T18:16:37.877 INFO:tasks.rados.rados.0.trial187.stdout:2246: expect (ObjNum 558 snap 187 seq_num 558) 2026-02-13T18:16:37.877 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:37.961 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2248: finishing write tid 1 to trial18717860-35 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2248: finishing write tid 2 to trial18717860-35 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2248: finishing write tid 3 to trial18717860-35 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2244: done (5 left) 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2245: done (4 left) 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2246: done (3 left) 2026-02-13T18:16:37.997 INFO:tasks.rados.rados.0.trial187.stdout:2247: done (2 left) 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2250: done (1 left) 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2251: delete oid 17 current snap is 258 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2248: finishing write tid 4 to trial18717860-35 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2248: oid 35 updating version 0 to 1043 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2248: oid 35 version 1043 is already newer than 1042 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2248: oid 35 updating version 1043 to 1044 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1044 (ObjNum 740 snap 258 seq_num 740) dirty exists 2026-02-13T18:16:37.998 INFO:tasks.rados.rados.0.trial187.stdout:2248: left oid 35 (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:16:38.003 INFO:tasks.rados.rados.0.trial187.stdout:2248: done (1 left) 2026-02-13T18:16:38.004 INFO:tasks.rados.rados.0.trial187.stdout:2251: done (0 left) 2026-02-13T18:16:38.004 INFO:tasks.rados.rados.0.trial187.stdout:2252: read oid 42 snap 169 2026-02-13T18:16:38.004 INFO:tasks.rados.rados.0.trial187.stdout:2252: expect (ObjNum 524 snap 164 seq_num 524) 2026-02-13T18:16:38.004 INFO:tasks.rados.rados.0.trial187.stdout:2253: snap_create 2026-02-13T18:16:38.010 INFO:tasks.rados.rados.0.trial187.stdout:2252: expect (ObjNum 524 snap 164 seq_num 524) 2026-02-13T18:16:38.010 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:38.066 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:38.105 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 423651 2026-02-13T18:16:38.993 INFO:tasks.rados.rados.0.trial187.stdout:2252: done (1 left) 2026-02-13T18:16:38.993 INFO:tasks.rados.rados.0.trial187.stdout:2253: done (0 left) 2026-02-13T18:16:38.993 INFO:tasks.rados.rados.0.trial187.stdout:2254: rollback oid 3 current snap is 259 2026-02-13T18:16:38.994 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 209 2026-02-13T18:16:38.994 INFO:tasks.rados.rados.0.trial187.stdout:2255: write oid 7 current snap is 259 2026-02-13T18:16:38.994 INFO:tasks.rados.rados.0.trial187.stdout:2255: seq_num 743 ranges {487601=796248,1962121=525480} 2026-02-13T18:16:39.001 INFO:tasks.rados.rados.0.trial187.stdout:2255: writing trial18717860-7 from 487601 to 1283849 tid 1 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2255: writing trial18717860-7 from 1962121 to 2487601 tid 2 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2256: read oid 38 snap -1 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2256: expect deleted 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2257: copy_from oid 16 from oid 17 current snap is 259 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2254: finishing rollback tid 0 to trial18717860-3 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2254: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:16:39.010 INFO:tasks.rados.rados.0.trial187.stdout:2254: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:16:39.011 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1135 (ObjNum 582 snap 199 seq_num 582) dirty exists 2026-02-13T18:16:39.011 INFO:tasks.rados.rados.0.trial187.stdout:2254: done (3 left) 2026-02-13T18:16:39.011 INFO:tasks.rados.rados.0.trial187.stdout:2258: rollback oid 44 current snap is 259 2026-02-13T18:16:39.011 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 255 2026-02-13T18:16:39.011 INFO:tasks.rados.rados.0.trial187.stdout:2259: snap_remove snap 205 2026-02-13T18:16:39.994 INFO:tasks.rados.rados.0.trial187.stdout:2259: done (4 left) 2026-02-13T18:16:39.994 INFO:tasks.rados.rados.0.trial187.stdout:2260: snap_remove snap 209 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2260: done (4 left) 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2261: delete oid 39 current snap is 259 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2255: finishing write tid 1 to trial18717860-7 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2257: finishing copy_from to trial18717860-16 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2257: got expected ENOENT (src dne) 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2257: finishing copy_from racing read to trial18717860-16 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2255: finishing write tid 2 to trial18717860-7 2026-02-13T18:16:40.996 INFO:tasks.rados.rados.0.trial187.stdout:2255: finishing write tid 3 to trial18717860-7 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2255: finishing write tid 4 to trial18717860-7 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2255: oid 7 updating version 0 to 1010 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2255: oid 7 updating version 1010 to 1011 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2255: oid 7 updating version 1011 to 1012 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1012 (ObjNum 743 snap 259 seq_num 743) dirty exists 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2255: left oid 7 (ObjNum 743 snap 259 seq_num 743) 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2258: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2258: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:2258: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:16:40.997 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1455 (ObjNum 547 snap 176 seq_num 547) dirty exists 2026-02-13T18:16:41.003 INFO:tasks.rados.rados.0.trial187.stdout:2255: done (4 left) 2026-02-13T18:16:41.003 INFO:tasks.rados.rados.0.trial187.stdout:2256: done (3 left) 2026-02-13T18:16:41.003 INFO:tasks.rados.rados.0.trial187.stdout:2257: done (2 left) 2026-02-13T18:16:41.003 INFO:tasks.rados.rados.0.trial187.stdout:2258: done (1 left) 2026-02-13T18:16:41.003 INFO:tasks.rados.rados.0.trial187.stdout:2261: done (0 left) 2026-02-13T18:16:41.003 INFO:tasks.rados.rados.0.trial187.stdout:2262: snap_create 2026-02-13T18:16:41.871 INFO:tasks.rados.rados.0.trial187.stdout:2262: done (0 left) 2026-02-13T18:16:41.871 INFO:tasks.rados.rados.0.trial187.stdout:2263: snap_create 2026-02-13T18:16:42.872 INFO:tasks.rados.rados.0.trial187.stdout:2263: done (0 left) 2026-02-13T18:16:42.872 INFO:tasks.rados.rados.0.trial187.stdout:2264: delete oid 34 current snap is 261 2026-02-13T18:16:42.875 INFO:tasks.rados.rados.0.trial187.stdout:2264: done (0 left) 2026-02-13T18:16:42.875 INFO:tasks.rados.rados.0.trial187.stdout:2265: rollback oid 31 current snap is 261 2026-02-13T18:16:42.875 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 258 2026-02-13T18:16:42.876 INFO:tasks.rados.rados.0.trial187.stdout:2266: copy_from oid 9 from oid 21 current snap is 261 2026-02-13T18:16:42.876 INFO:tasks.rados.rados.0.trial187.stdout:2267: snap_create 2026-02-13T18:16:42.879 INFO:tasks.rados.rados.0.trial187.stdout:2265: finishing rollback tid 0 to trial18717860-31 2026-02-13T18:16:42.879 INFO:tasks.rados.rados.0.trial187.stdout:2265: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:16:42.879 INFO:tasks.rados.rados.0.trial187.stdout:2265: finishing rollback tid 2 to trial18717860-31 2026-02-13T18:16:42.879 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 999 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:16:42.886 INFO:tasks.rados.rados.0.trial187.stdout:2266: finishing copy_from racing read to trial18717860-9 2026-02-13T18:16:42.886 INFO:tasks.rados.rados.0.trial187.stdout:2266: finishing copy_from to trial18717860-9 2026-02-13T18:16:42.886 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1009 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:16:43.878 INFO:tasks.rados.rados.0.trial187.stdout:2265: done (2 left) 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2266: done (1 left) 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2267: done (0 left) 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2268: read oid 5 snap 261 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2268: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2269: read oid 10 snap -1 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2269: expect (ObjNum 727 snap 256 seq_num 727) 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2270: write (excl) oid 27 current snap is 262 2026-02-13T18:16:43.879 INFO:tasks.rados.rados.0.trial187.stdout:2270: seq_num 746 ranges {538022=738348,1737567=561594} 2026-02-13T18:16:43.886 INFO:tasks.rados.rados.0.trial187.stdout:2270: writing trial18717860-27 from 538022 to 1276370 tid 1 2026-02-13T18:16:43.894 INFO:tasks.rados.rados.0.trial187.stdout:2270: writing trial18717860-27 from 1737567 to 2299161 tid 2 2026-02-13T18:16:43.894 INFO:tasks.rados.rados.0.trial187.stdout:2271: delete oid 7 current snap is 262 2026-02-13T18:16:43.894 INFO:tasks.rados.rados.0.trial187.stdout:2268: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:44.014 INFO:tasks.rados.rados.0.trial187.stdout:2269: expect (ObjNum 727 snap 256 seq_num 727) 2026-02-13T18:16:44.088 INFO:tasks.rados.rados.0.trial187.stdout:2270: finishing write tid 1 to trial18717860-27 2026-02-13T18:16:44.088 INFO:tasks.rados.rados.0.trial187.stdout:2270: finishing write tid 2 to trial18717860-27 2026-02-13T18:16:44.088 INFO:tasks.rados.rados.0.trial187.stdout:2270: finishing write tid 3 to trial18717860-27 2026-02-13T18:16:44.088 INFO:tasks.rados.rados.0.trial187.stdout:2270: finishing write tid 4 to trial18717860-27 2026-02-13T18:16:44.088 INFO:tasks.rados.rados.0.trial187.stdout:2270: oid 27 updating version 0 to 990 2026-02-13T18:16:44.088 INFO:tasks.rados.rados.0.trial187.stdout:2270: oid 27 updating version 990 to 991 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2270: oid 27 updating version 991 to 992 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 992 (ObjNum 746 snap 262 seq_num 746) dirty exists 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2270: left oid 27 (ObjNum 746 snap 262 seq_num 746) 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2268: done (3 left) 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2269: done (2 left) 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2270: done (1 left) 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2271: done (0 left) 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2272: write (excl) oid 27 current snap is 262 2026-02-13T18:16:44.089 INFO:tasks.rados.rados.0.trial187.stdout:2272: seq_num 748 ranges {571636=488846,1854531=565263} 2026-02-13T18:16:44.095 INFO:tasks.rados.rados.0.trial187.stdout:2272: writing trial18717860-27 from 571636 to 1060482 tid 1 2026-02-13T18:16:44.104 INFO:tasks.rados.rados.0.trial187.stdout:2272: writing trial18717860-27 from 1854531 to 2419794 tid 2 2026-02-13T18:16:44.104 INFO:tasks.rados.rados.0.trial187.stdout:2273: delete oid 17 current snap is 262 2026-02-13T18:16:44.104 INFO:tasks.rados.rados.0.trial187.stdout:2272: finishing write tid 1 to trial18717860-27 2026-02-13T18:16:44.105 INFO:tasks.rados.rados.0.trial187.stdout:2273: done (1 left) 2026-02-13T18:16:44.105 INFO:tasks.rados.rados.0.trial187.stdout:2274: write (excl) oid 46 current snap is 262 2026-02-13T18:16:44.105 INFO:tasks.rados.rados.0.trial187.stdout:2274: seq_num 750 ranges {605250=639344,1855142=452579} 2026-02-13T18:16:44.113 INFO:tasks.rados.rados.0.trial187.stdout:2274: writing trial18717860-46 from 605250 to 1244594 tid 1 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2274: writing trial18717860-46 from 1855142 to 2307721 tid 2 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2275: read oid 7 snap -1 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2275: expect deleted 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2276: read oid 16 snap -1 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2276: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2277: rollback oid 22 current snap is 262 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 196 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2272: finishing write tid 2 to trial18717860-27 2026-02-13T18:16:44.122 INFO:tasks.rados.rados.0.trial187.stdout:2272: finishing write tid 3 to trial18717860-27 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2272: finishing write tid 4 to trial18717860-27 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2272: oid 27 updating version 0 to 993 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2272: oid 27 updating version 993 to 994 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2272: oid 27 updating version 994 to 995 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 995 (ObjNum 748 snap 262 seq_num 748) dirty exists 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2272: left oid 27 (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2274: finishing write tid 1 to trial18717860-46 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2272: done (4 left) 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2278: read oid 49 snap -1 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2278: expect deleted 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2279: rollback oid 8 current snap is 262 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 249 2026-02-13T18:16:44.123 INFO:tasks.rados.rados.0.trial187.stdout:2280: read oid 23 snap -1 2026-02-13T18:16:44.124 INFO:tasks.rados.rados.0.trial187.stdout:2280: expect (ObjNum 733 snap 257 seq_num 733) 2026-02-13T18:16:44.124 INFO:tasks.rados.rados.0.trial187.stdout:2281: write (excl) oid 14 current snap is 262 2026-02-13T18:16:44.124 INFO:tasks.rados.rados.0.trial187.stdout:2281: seq_num 751 ranges {622057=714593,1913624=708433} 2026-02-13T18:16:44.130 INFO:tasks.rados.rados.0.trial187.stdout:2281: writing trial18717860-14 from 622057 to 1336650 tid 1 2026-02-13T18:16:44.139 INFO:tasks.rados.rados.0.trial187.stdout:2281: writing trial18717860-14 from 1913624 to 2622057 tid 2 2026-02-13T18:16:44.139 INFO:tasks.rados.rados.0.trial187.stdout:2282: write oid 4 current snap is 262 2026-02-13T18:16:44.139 INFO:tasks.rados.rados.0.trial187.stdout:2282: seq_num 752 ranges {638864=789842,1972106=456248} 2026-02-13T18:16:44.145 INFO:tasks.rados.rados.0.trial187.stdout:2282: writing trial18717860-4 from 638864 to 1428706 tid 1 2026-02-13T18:16:44.149 INFO:tasks.rados.rados.0.trial187.stdout:2282: writing trial18717860-4 from 1972106 to 2428354 tid 2 2026-02-13T18:16:44.149 INFO:tasks.rados.rados.0.trial187.stdout:2283: snap_remove snap 258 2026-02-13T18:16:44.991 INFO:tasks.rados.rados.0.trial187.stdout:2283: done (9 left) 2026-02-13T18:16:44.991 INFO:tasks.rados.rados.0.trial187.stdout:2284: copy_from oid 43 from oid 34 current snap is 262 2026-02-13T18:16:44.991 INFO:tasks.rados.rados.0.trial187.stdout:2279: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:16:44.991 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 808 (ObjNum 129 snap 0 seq_num 3013025560) dirty dne 2026-02-13T18:16:44.992 INFO:tasks.rados.rados.0.trial187.stdout:2274: finishing write tid 2 to trial18717860-46 2026-02-13T18:16:44.992 INFO:tasks.rados.rados.0.trial187.stdout:2280: expect (ObjNum 733 snap 257 seq_num 733) 2026-02-13T18:16:45.000 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 829543 2026-02-13T18:16:45.064 INFO:tasks.rados.rados.0.trial187.stdout:2276: expect (ObjNum 494 snap 147 seq_num 494) 2026-02-13T18:16:45.098 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:45.116 INFO:tasks.rados.rados.0.trial187.stdout:2274: finishing write tid 3 to trial18717860-46 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2274: finishing write tid 4 to trial18717860-46 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2274: oid 46 updating version 0 to 1016 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2274: oid 46 version 1016 is already newer than 1015 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2274: oid 46 version 1016 is already newer than 1014 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1016 (ObjNum 750 snap 262 seq_num 750) dirty exists 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2274: left oid 46 (ObjNum 750 snap 262 seq_num 750) 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2277: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2277: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2277: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1483 (ObjNum 567 snap 190 seq_num 567) dirty exists 2026-02-13T18:16:45.117 INFO:tasks.rados.rados.0.trial187.stdout:2281: finishing write tid 1 to trial18717860-14 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: finishing write tid 2 to trial18717860-14 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: finishing write tid 3 to trial18717860-14 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: finishing write tid 4 to trial18717860-14 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: oid 14 updating version 0 to 994 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: oid 14 version 994 is already newer than 992 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: oid 14 version 994 is already newer than 993 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 994 (ObjNum 751 snap 262 seq_num 751) dirty exists 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2281: left oid 14 (ObjNum 751 snap 262 seq_num 751) 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2282: finishing write tid 1 to trial18717860-4 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2282: finishing write tid 2 to trial18717860-4 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2282: finishing write tid 3 to trial18717860-4 2026-02-13T18:16:45.118 INFO:tasks.rados.rados.0.trial187.stdout:2282: finishing write tid 4 to trial18717860-4 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2282: oid 4 updating version 0 to 1002 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2282: oid 4 version 1002 is already newer than 1000 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2282: oid 4 version 1002 is already newer than 1001 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1002 (ObjNum 752 snap 262 seq_num 752) dirty exists 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2282: left oid 4 (ObjNum 752 snap 262 seq_num 752) 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2284: finishing copy_from to trial18717860-43 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2284: got expected ENOENT (src dne) 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2284: finishing copy_from racing read to trial18717860-43 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2274: done (9 left) 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2275: done (8 left) 2026-02-13T18:16:45.119 INFO:tasks.rados.rados.0.trial187.stdout:2276: done (7 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2277: done (6 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2278: done (5 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2279: done (4 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2280: done (3 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2281: done (2 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2282: done (1 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2284: done (0 left) 2026-02-13T18:16:45.120 INFO:tasks.rados.rados.0.trial187.stdout:2285: delete oid 16 current snap is 262 2026-02-13T18:16:45.121 INFO:tasks.rados.rados.0.trial187.stdout:2285: done (0 left) 2026-02-13T18:16:45.121 INFO:tasks.rados.rados.0.trial187.stdout:2286: snap_create 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2286: done (0 left) 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2287: read oid 20 snap -1 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2287: expect (ObjNum 723 snap 256 seq_num 723) 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2288: copy_from oid 25 from oid 50 current snap is 263 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2289: read oid 35 snap -1 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2289: expect (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2290: read oid 8 snap -1 2026-02-13T18:16:45.995 INFO:tasks.rados.rados.0.trial187.stdout:2290: expect deleted 2026-02-13T18:16:45.996 INFO:tasks.rados.rados.0.trial187.stdout:2291: snap_remove snap 169 2026-02-13T18:16:46.873 INFO:tasks.rados.rados.0.trial187.stdout:2291: done (4 left) 2026-02-13T18:16:46.873 INFO:tasks.rados.rados.0.trial187.stdout:2292: delete oid 49 current snap is 263 2026-02-13T18:16:46.873 INFO:tasks.rados.rados.0.trial187.stdout:2288: finishing copy_from to trial18717860-25 2026-02-13T18:16:46.874 INFO:tasks.rados.rados.0.trial187.stdout:2288: got expected ENOENT (src dne) 2026-02-13T18:16:46.874 INFO:tasks.rados.rados.0.trial187.stdout:2288: finishing copy_from racing read to trial18717860-25 2026-02-13T18:16:46.874 INFO:tasks.rados.rados.0.trial187.stdout:2287: expect (ObjNum 723 snap 256 seq_num 723) 2026-02-13T18:16:46.909 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:46.925 INFO:tasks.rados.rados.0.trial187.stdout:2289: expect (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:16:46.944 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 275509 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2287: done (4 left) 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2288: done (3 left) 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2289: done (2 left) 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2290: done (1 left) 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2292: done (0 left) 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2293: read oid 29 snap 255 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2293: expect (ObjNum 709 snap 250 seq_num 709) 2026-02-13T18:16:46.980 INFO:tasks.rados.rados.0.trial187.stdout:2294: rollback oid 18 current snap is 263 2026-02-13T18:16:46.981 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 196 2026-02-13T18:16:46.981 INFO:tasks.rados.rados.0.trial187.stdout:2295: write oid 32 current snap is 263 2026-02-13T18:16:46.981 INFO:tasks.rados.rados.0.trial187.stdout:2295: seq_num 755 ranges {689285=731942,2147552=541733} 2026-02-13T18:16:46.989 INFO:tasks.rados.rados.0.trial187.stdout:2295: writing trial18717860-32 from 689285 to 1421227 tid 1 2026-02-13T18:16:46.998 INFO:tasks.rados.rados.0.trial187.stdout:2295: writing trial18717860-32 from 2147552 to 2689285 tid 2 2026-02-13T18:16:46.998 INFO:tasks.rados.rados.0.trial187.stdout:2296: write oid 41 current snap is 263 2026-02-13T18:16:46.998 INFO:tasks.rados.rados.0.trial187.stdout:2296: seq_num 756 ranges {706092=407191,1806034=463586} 2026-02-13T18:16:47.005 INFO:tasks.rados.rados.0.trial187.stdout:2296: writing trial18717860-41 from 706092 to 1113283 tid 1 2026-02-13T18:16:47.014 INFO:tasks.rados.rados.0.trial187.stdout:2296: writing trial18717860-41 from 1806034 to 2269620 tid 2 2026-02-13T18:16:47.014 INFO:tasks.rados.rados.0.trial187.stdout:2297: read oid 50 snap -1 2026-02-13T18:16:47.014 INFO:tasks.rados.rados.0.trial187.stdout:2297: expect deleted 2026-02-13T18:16:47.014 INFO:tasks.rados.rados.0.trial187.stdout:2298: write oid 3 current snap is 263 2026-02-13T18:16:47.014 INFO:tasks.rados.rados.0.trial187.stdout:2298: seq_num 757 ranges {722899=482440,1748163=723597} 2026-02-13T18:16:47.022 INFO:tasks.rados.rados.0.trial187.stdout:2298: writing trial18717860-3 from 722899 to 1205339 tid 1 2026-02-13T18:16:47.027 INFO:tasks.rados.rados.0.trial187.stdout:2298: writing trial18717860-3 from 1748163 to 2471760 tid 2 2026-02-13T18:16:47.028 INFO:tasks.rados.rados.0.trial187.stdout:2299: write oid 9 current snap is 263 2026-02-13T18:16:47.028 INFO:tasks.rados.rados.0.trial187.stdout:2299: seq_num 758 ranges {739706=557689,1806645=467255} 2026-02-13T18:16:47.032 INFO:tasks.rados.rados.0.trial187.stdout:2299: writing trial18717860-9 from 739706 to 1297395 tid 1 2026-02-13T18:16:47.036 INFO:tasks.rados.rados.0.trial187.stdout:2299: writing trial18717860-9 from 1806645 to 2273900 tid 2 2026-02-13T18:16:47.036 INFO:tasks.rados.rados.0.trial187.stdout:2300: write (excl) oid 16 current snap is 263 2026-02-13T18:16:47.036 INFO:tasks.rados.rados.0.trial187.stdout:2300: seq_num 759 ranges {756513=632938,1865127=727266} 2026-02-13T18:16:47.041 INFO:tasks.rados.rados.0.trial187.stdout:2300: writing trial18717860-16 from 756513 to 1389451 tid 1 2026-02-13T18:16:47.046 INFO:tasks.rados.rados.0.trial187.stdout:2300: writing trial18717860-16 from 1865127 to 2592393 tid 2 2026-02-13T18:16:47.046 INFO:tasks.rados.rados.0.trial187.stdout:2301: write (excl) oid 48 current snap is 263 2026-02-13T18:16:47.046 INFO:tasks.rados.rados.0.trial187.stdout:2301: seq_num 760 ranges {773320=708187,1923609=470924} 2026-02-13T18:16:47.052 INFO:tasks.rados.rados.0.trial187.stdout:2301: writing trial18717860-48 from 773320 to 1481507 tid 1 2026-02-13T18:16:47.055 INFO:tasks.rados.rados.0.trial187.stdout:2301: writing trial18717860-48 from 1923609 to 2394533 tid 2 2026-02-13T18:16:47.055 INFO:tasks.rados.rados.0.trial187.stdout:2302: write (excl) oid 7 current snap is 263 2026-02-13T18:16:47.056 INFO:tasks.rados.rados.0.trial187.stdout:2302: seq_num 761 ranges {790127=499789,1698444=730935} 2026-02-13T18:16:47.060 INFO:tasks.rados.rados.0.trial187.stdout:2302: writing trial18717860-7 from 790127 to 1289916 tid 1 2026-02-13T18:16:47.065 INFO:tasks.rados.rados.0.trial187.stdout:2302: writing trial18717860-7 from 1698444 to 2429379 tid 2 2026-02-13T18:16:47.065 INFO:tasks.rados.rados.0.trial187.stdout:2303: rollback oid 14 current snap is 263 2026-02-13T18:16:47.065 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 249 2026-02-13T18:16:47.065 INFO:tasks.rados.rados.0.trial187.stdout:2293: expect (ObjNum 709 snap 250 seq_num 709) 2026-02-13T18:16:47.180 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3727970 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:2294: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:2294: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 763 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:2295: finishing write tid 1 to trial18717860-32 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:2295: finishing write tid 2 to trial18717860-32 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:2295: finishing write tid 3 to trial18717860-32 2026-02-13T18:16:47.188 INFO:tasks.rados.rados.0.trial187.stdout:2295: finishing write tid 4 to trial18717860-32 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2295: oid 32 updating version 0 to 820 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2295: oid 32 updating version 820 to 822 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2295: oid 32 version 822 is already newer than 821 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 822 (ObjNum 755 snap 263 seq_num 755) dirty exists 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2295: left oid 32 (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2296: finishing write tid 1 to trial18717860-41 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2296: finishing write tid 2 to trial18717860-41 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2296: finishing write tid 3 to trial18717860-41 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2293: done (10 left) 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2294: done (9 left) 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2295: done (8 left) 2026-02-13T18:16:47.189 INFO:tasks.rados.rados.0.trial187.stdout:2297: done (7 left) 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2304: read oid 12 snap -1 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2304: expect (ObjNum 717 snap 253 seq_num 717) 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2305: snap_create 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2296: finishing write tid 4 to trial18717860-41 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2296: oid 41 updating version 0 to 1007 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2296: oid 41 version 1007 is already newer than 1006 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2296: oid 41 updating version 1007 to 1008 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1008 (ObjNum 756 snap 263 seq_num 756) dirty exists 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2296: left oid 41 (ObjNum 756 snap 263 seq_num 756) 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2298: finishing write tid 1 to trial18717860-3 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2298: finishing write tid 2 to trial18717860-3 2026-02-13T18:16:47.190 INFO:tasks.rados.rados.0.trial187.stdout:2298: finishing write tid 3 to trial18717860-3 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2298: finishing write tid 4 to trial18717860-3 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2298: oid 3 updating version 0 to 1168 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2298: oid 3 updating version 1168 to 1170 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2298: oid 3 version 1170 is already newer than 1169 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1170 (ObjNum 757 snap 263 seq_num 757) dirty exists 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2298: left oid 3 (ObjNum 757 snap 263 seq_num 757) 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2299: finishing write tid 1 to trial18717860-9 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2299: finishing write tid 2 to trial18717860-9 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2299: finishing write tid 3 to trial18717860-9 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2299: finishing write tid 4 to trial18717860-9 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2299: oid 9 updating version 0 to 1172 2026-02-13T18:16:47.191 INFO:tasks.rados.rados.0.trial187.stdout:2299: oid 9 updating version 1172 to 1173 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2299: oid 9 updating version 1173 to 1174 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1174 (ObjNum 758 snap 263 seq_num 758) dirty exists 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2299: left oid 9 (ObjNum 758 snap 263 seq_num 758) 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: finishing write tid 1 to trial18717860-16 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: finishing write tid 2 to trial18717860-16 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: finishing write tid 3 to trial18717860-16 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: finishing write tid 4 to trial18717860-16 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: oid 16 updating version 0 to 993 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: oid 16 updating version 993 to 994 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: oid 16 updating version 994 to 995 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 995 (ObjNum 759 snap 263 seq_num 759) dirty exists 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2300: left oid 16 (ObjNum 759 snap 263 seq_num 759) 2026-02-13T18:16:47.192 INFO:tasks.rados.rados.0.trial187.stdout:2301: finishing write tid 1 to trial18717860-48 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: finishing write tid 2 to trial18717860-48 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: finishing write tid 3 to trial18717860-48 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: finishing write tid 4 to trial18717860-48 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: oid 48 updating version 0 to 1497 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: oid 48 version 1497 is already newer than 1496 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: oid 48 updating version 1497 to 1498 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1498 (ObjNum 760 snap 263 seq_num 760) dirty exists 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2301: left oid 48 (ObjNum 760 snap 263 seq_num 760) 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2302: finishing write tid 1 to trial18717860-7 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2303: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:2303: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:16:47.193 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 996 (ObjNum 33 snap 0 seq_num 4014628888) dirty dne 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: finishing write tid 2 to trial18717860-7 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: finishing write tid 3 to trial18717860-7 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: finishing write tid 4 to trial18717860-7 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: oid 7 updating version 0 to 1018 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: oid 7 updating version 1018 to 1019 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: oid 7 version 1019 is already newer than 1017 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1019 (ObjNum 761 snap 263 seq_num 761) dirty exists 2026-02-13T18:16:47.194 INFO:tasks.rados.rados.0.trial187.stdout:2302: left oid 7 (ObjNum 761 snap 263 seq_num 761) 2026-02-13T18:16:47.195 INFO:tasks.rados.rados.0.trial187.stdout:2304: expect (ObjNum 717 snap 253 seq_num 717) 2026-02-13T18:16:47.205 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:47.221 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2296: done (8 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2298: done (7 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2299: done (6 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2300: done (5 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2301: done (4 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2302: done (3 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2303: done (2 left) 2026-02-13T18:16:47.999 INFO:tasks.rados.rados.0.trial187.stdout:2304: done (1 left) 2026-02-13T18:16:48.000 INFO:tasks.rados.rados.0.trial187.stdout:2305: done (0 left) 2026-02-13T18:16:48.000 INFO:tasks.rados.rados.0.trial187.stdout:2306: rollback oid 15 current snap is 264 2026-02-13T18:16:48.000 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 259 2026-02-13T18:16:48.000 INFO:tasks.rados.rados.0.trial187.stdout:2307: write (excl) oid 43 current snap is 264 2026-02-13T18:16:48.000 INFO:tasks.rados.rados.0.trial187.stdout:2307: seq_num 762 ranges {406934=575038,1640573=474593,2642791=164143} 2026-02-13T18:16:48.002 INFO:tasks.rados.rados.0.trial187.stdout:2307: writing trial18717860-43 from 406934 to 981972 tid 1 2026-02-13T18:16:48.007 INFO:tasks.rados.rados.0.trial187.stdout:2307: writing trial18717860-43 from 1640573 to 2115166 tid 2 2026-02-13T18:16:48.010 INFO:tasks.rados.rados.0.trial187.stdout:2307: writing trial18717860-43 from 2642791 to 2806934 tid 3 2026-02-13T18:16:48.010 INFO:tasks.rados.rados.0.trial187.stdout:2308: write (excl) oid 45 current snap is 264 2026-02-13T18:16:48.010 INFO:tasks.rados.rados.0.trial187.stdout:2308: seq_num 763 ranges {423741=650287,1699055=618251} 2026-02-13T18:16:48.013 INFO:tasks.rados.rados.0.trial187.stdout:2308: writing trial18717860-45 from 423741 to 1074028 tid 1 2026-02-13T18:16:48.019 INFO:tasks.rados.rados.0.trial187.stdout:2308: writing trial18717860-45 from 1699055 to 2317306 tid 2 2026-02-13T18:16:48.019 INFO:tasks.rados.rados.0.trial187.stdout:2309: copy_from oid 16 from oid 47 current snap is 264 2026-02-13T18:16:48.019 INFO:tasks.rados.rados.0.trial187.stdout:2306: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:16:48.019 INFO:tasks.rados.rados.0.trial187.stdout:2306: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2306: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1008 (ObjNum 737 snap 257 seq_num 737) dirty exists 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: finishing write tid 1 to trial18717860-43 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: finishing write tid 2 to trial18717860-43 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: finishing write tid 3 to trial18717860-43 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: finishing write tid 4 to trial18717860-43 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: finishing write tid 5 to trial18717860-43 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: oid 43 updating version 0 to 1502 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: oid 43 version 1502 is already newer than 1500 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: oid 43 updating version 1502 to 1503 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:2307: oid 43 version 1503 is already newer than 1501 2026-02-13T18:16:48.020 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1503 (ObjNum 762 snap 264 seq_num 762) dirty exists 2026-02-13T18:16:48.021 INFO:tasks.rados.rados.0.trial187.stdout:2307: left oid 43 (ObjNum 762 snap 264 seq_num 762) 2026-02-13T18:16:48.021 INFO:tasks.rados.rados.0.trial187.stdout:2308: finishing write tid 1 to trial18717860-45 2026-02-13T18:16:48.021 INFO:tasks.rados.rados.0.trial187.stdout:2306: done (3 left) 2026-02-13T18:16:48.021 INFO:tasks.rados.rados.0.trial187.stdout:2307: done (2 left) 2026-02-13T18:16:48.021 INFO:tasks.rados.rados.0.trial187.stdout:2310: snap_remove snap 259 2026-02-13T18:16:49.003 INFO:tasks.rados.rados.0.trial187.stdout:2310: done (2 left) 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2311: delete oid 25 current snap is 264 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: finishing write tid 2 to trial18717860-45 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: finishing write tid 3 to trial18717860-45 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: finishing write tid 4 to trial18717860-45 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: oid 45 updating version 0 to 853 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: oid 45 version 853 is already newer than 852 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: oid 45 version 853 is already newer than 851 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 853 (ObjNum 763 snap 264 seq_num 763) dirty exists 2026-02-13T18:16:49.004 INFO:tasks.rados.rados.0.trial187.stdout:2308: left oid 45 (ObjNum 763 snap 264 seq_num 763) 2026-02-13T18:16:49.005 INFO:tasks.rados.rados.0.trial187.stdout:2309: finishing copy_from racing read to trial18717860-16 2026-02-13T18:16:49.005 INFO:tasks.rados.rados.0.trial187.stdout:2309: finishing copy_from to trial18717860-16 2026-02-13T18:16:49.005 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:16:49.007 INFO:tasks.rados.rados.0.trial187.stdout:2308: done (2 left) 2026-02-13T18:16:49.007 INFO:tasks.rados.rados.0.trial187.stdout:2309: done (1 left) 2026-02-13T18:16:49.007 INFO:tasks.rados.rados.0.trial187.stdout:2311: done (0 left) 2026-02-13T18:16:49.007 INFO:tasks.rados.rados.0.trial187.stdout:2312: delete oid 10 current snap is 264 2026-02-13T18:16:49.008 INFO:tasks.rados.rados.0.trial187.stdout:2312: done (0 left) 2026-02-13T18:16:49.008 INFO:tasks.rados.rados.0.trial187.stdout:2313: delete oid 15 current snap is 264 2026-02-13T18:16:49.010 INFO:tasks.rados.rados.0.trial187.stdout:2313: done (0 left) 2026-02-13T18:16:49.010 INFO:tasks.rados.rados.0.trial187.stdout:2314: write (excl) oid 48 current snap is 264 2026-02-13T18:16:49.010 INFO:tasks.rados.rados.0.trial187.stdout:2314: seq_num 767 ranges {490969=551283,1816630=625589} 2026-02-13T18:16:49.017 INFO:tasks.rados.rados.0.trial187.stdout:2314: writing trial18717860-48 from 490969 to 1042252 tid 1 2026-02-13T18:16:49.026 INFO:tasks.rados.rados.0.trial187.stdout:2314: writing trial18717860-48 from 1816630 to 2442219 tid 2 2026-02-13T18:16:49.026 INFO:tasks.rados.rados.0.trial187.stdout:2315: snap_create 2026-02-13T18:16:49.027 INFO:tasks.rados.rados.0.trial187.stdout:2314: finishing write tid 1 to trial18717860-48 2026-02-13T18:16:49.029 INFO:tasks.rados.rados.0.trial187.stdout:2314: finishing write tid 2 to trial18717860-48 2026-02-13T18:16:49.030 INFO:tasks.rados.rados.0.trial187.stdout:2314: finishing write tid 3 to trial18717860-48 2026-02-13T18:16:49.030 INFO:tasks.rados.rados.0.trial187.stdout:2314: finishing write tid 4 to trial18717860-48 2026-02-13T18:16:49.030 INFO:tasks.rados.rados.0.trial187.stdout:2314: oid 48 updating version 0 to 1511 2026-02-13T18:16:49.030 INFO:tasks.rados.rados.0.trial187.stdout:2314: oid 48 version 1511 is already newer than 1509 2026-02-13T18:16:49.030 INFO:tasks.rados.rados.0.trial187.stdout:2314: oid 48 version 1511 is already newer than 1510 2026-02-13T18:16:49.031 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1511 (ObjNum 767 snap 264 seq_num 767) dirty exists 2026-02-13T18:16:49.031 INFO:tasks.rados.rados.0.trial187.stdout:2314: left oid 48 (ObjNum 767 snap 264 seq_num 767) 2026-02-13T18:16:50.005 INFO:tasks.rados.rados.0.trial187.stdout:2314: done (1 left) 2026-02-13T18:16:50.006 INFO:tasks.rados.rados.0.trial187.stdout:2315: done (0 left) 2026-02-13T18:16:50.006 INFO:tasks.rados.rados.0.trial187.stdout:2316: write oid 30 current snap is 265 2026-02-13T18:16:50.006 INFO:tasks.rados.rados.0.trial187.stdout:2316: seq_num 768 ranges {507776=742885,1991465=485600} 2026-02-13T18:16:50.014 INFO:tasks.rados.rados.0.trial187.stdout:2316: writing trial18717860-30 from 507776 to 1250661 tid 1 2026-02-13T18:16:50.022 INFO:tasks.rados.rados.0.trial187.stdout:2316: writing trial18717860-30 from 1991465 to 2477065 tid 2 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2317: read oid 6 snap -1 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2317: expect (ObjNum 739 snap 258 seq_num 739) 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2318: read oid 11 snap -1 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2318: expect (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2319: read oid 27 snap -1 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2319: expect (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2320: delete oid 1 current snap is 265 2026-02-13T18:16:50.023 INFO:tasks.rados.rados.0.trial187.stdout:2316: finishing write tid 1 to trial18717860-30 2026-02-13T18:16:50.024 INFO:tasks.rados.rados.0.trial187.stdout:2320: done (4 left) 2026-02-13T18:16:50.024 INFO:tasks.rados.rados.0.trial187.stdout:2321: write (excl) oid 31 current snap is 265 2026-02-13T18:16:50.024 INFO:tasks.rados.rados.0.trial187.stdout:2321: seq_num 770 ranges {541390=493383,1592076=489269,2862175=79215} 2026-02-13T18:16:50.031 INFO:tasks.rados.rados.0.trial187.stdout:2321: writing trial18717860-31 from 541390 to 1034773 tid 1 2026-02-13T18:16:50.038 INFO:tasks.rados.rados.0.trial187.stdout:2321: writing trial18717860-31 from 1592076 to 2081345 tid 2 2026-02-13T18:16:50.044 INFO:tasks.rados.rados.0.trial187.stdout:2321: writing trial18717860-31 from 2862175 to 2941390 tid 3 2026-02-13T18:16:50.044 INFO:tasks.rados.rados.0.trial187.stdout:2322: copy_from oid 41 from oid 50 current snap is 265 2026-02-13T18:16:50.044 INFO:tasks.rados.rados.0.trial187.stdout:2317: expect (ObjNum 739 snap 258 seq_num 739) 2026-02-13T18:16:50.120 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:50.150 INFO:tasks.rados.rados.0.trial187.stdout:2319: expect (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:50.261 INFO:tasks.rados.rados.0.trial187.stdout:2316: finishing write tid 2 to trial18717860-30 2026-02-13T18:16:50.261 INFO:tasks.rados.rados.0.trial187.stdout:2316: finishing write tid 3 to trial18717860-30 2026-02-13T18:16:50.261 INFO:tasks.rados.rados.0.trial187.stdout:2318: expect (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:16:50.261 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:50.343 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1593817 2026-02-13T18:16:50.355 INFO:tasks.rados.rados.0.trial187.stdout:2316: finishing write tid 4 to trial18717860-30 2026-02-13T18:16:50.355 INFO:tasks.rados.rados.0.trial187.stdout:2316: oid 30 updating version 0 to 824 2026-02-13T18:16:50.355 INFO:tasks.rados.rados.0.trial187.stdout:2316: oid 30 updating version 824 to 825 2026-02-13T18:16:50.355 INFO:tasks.rados.rados.0.trial187.stdout:2316: oid 30 version 825 is already newer than 823 2026-02-13T18:16:50.355 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 825 (ObjNum 768 snap 265 seq_num 768) dirty exists 2026-02-13T18:16:50.355 INFO:tasks.rados.rados.0.trial187.stdout:2316: left oid 30 (ObjNum 768 snap 265 seq_num 768) 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: finishing write tid 1 to trial18717860-31 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: finishing write tid 2 to trial18717860-31 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2322: finishing copy_from to trial18717860-41 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2322: got expected ENOENT (src dne) 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2322: finishing copy_from racing read to trial18717860-41 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: finishing write tid 3 to trial18717860-31 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: finishing write tid 4 to trial18717860-31 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: finishing write tid 5 to trial18717860-31 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: oid 31 updating version 0 to 1004 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: oid 31 updating version 1004 to 1006 2026-02-13T18:16:50.356 INFO:tasks.rados.rados.0.trial187.stdout:2321: oid 31 version 1006 is already newer than 1003 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2321: oid 31 version 1006 is already newer than 1005 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1006 (ObjNum 770 snap 265 seq_num 770) dirty exists 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2321: left oid 31 (ObjNum 770 snap 265 seq_num 770) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2316: done (5 left) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2317: done (4 left) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2318: done (3 left) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2319: done (2 left) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2321: done (1 left) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2322: done (0 left) 2026-02-13T18:16:50.357 INFO:tasks.rados.rados.0.trial187.stdout:2323: snap_remove snap 260 2026-02-13T18:16:51.009 INFO:tasks.rados.rados.0.trial187.stdout:2323: done (0 left) 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:2324: copy_from oid 2 from oid 18 current snap is 265 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:2325: read oid 27 snap -1 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:2325: expect (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:2326: copy_from oid 45 from oid 41 current snap is 265 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:2327: rollback oid 6 current snap is 265 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 264 2026-02-13T18:16:51.010 INFO:tasks.rados.rados.0.trial187.stdout:2328: delete oid 24 current snap is 265 2026-02-13T18:16:51.012 INFO:tasks.rados.rados.0.trial187.stdout:2324: finishing copy_from to trial18717860-2 2026-02-13T18:16:51.012 INFO:tasks.rados.rados.0.trial187.stdout:2324: got expected ENOENT (src dne) 2026-02-13T18:16:51.013 INFO:tasks.rados.rados.0.trial187.stdout:2324: finishing copy_from racing read to trial18717860-2 2026-02-13T18:16:51.013 INFO:tasks.rados.rados.0.trial187.stdout:2327: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:16:51.014 INFO:tasks.rados.rados.0.trial187.stdout:2327: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:16:51.016 INFO:tasks.rados.rados.0.trial187.stdout:2325: expect (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:51.030 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1809496 2026-02-13T18:16:51.046 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:51.084 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:51.121 INFO:tasks.rados.rados.0.trial187.stdout:2327: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:16:51.121 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1001 (ObjNum 739 snap 258 seq_num 739) dirty exists 2026-02-13T18:16:51.121 INFO:tasks.rados.rados.0.trial187.stdout:2326: finishing copy_from racing read to trial18717860-45 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2326: finishing copy_from to trial18717860-45 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1008 (ObjNum 756 snap 263 seq_num 756) dirty exists 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2324: done (4 left) 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2325: done (3 left) 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2326: done (2 left) 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2327: done (1 left) 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2328: done (0 left) 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2329: write oid 48 current snap is 265 2026-02-13T18:16:51.122 INFO:tasks.rados.rados.0.trial187.stdout:2329: seq_num 772 ranges {575004=643881,1709040=492938,2917021=57983} 2026-02-13T18:16:51.129 INFO:tasks.rados.rados.0.trial187.stdout:2329: writing trial18717860-48 from 575004 to 1218885 tid 1 2026-02-13T18:16:51.136 INFO:tasks.rados.rados.0.trial187.stdout:2329: writing trial18717860-48 from 1709040 to 2201978 tid 2 2026-02-13T18:16:51.142 INFO:tasks.rados.rados.0.trial187.stdout:2329: writing trial18717860-48 from 2917021 to 2975004 tid 3 2026-02-13T18:16:51.142 INFO:tasks.rados.rados.0.trial187.stdout:2330: write oid 42 current snap is 265 2026-02-13T18:16:51.142 INFO:tasks.rados.rados.0.trial187.stdout:2330: seq_num 773 ranges {591811=719130,1767522=636596,2828091=163720} 2026-02-13T18:16:51.151 INFO:tasks.rados.rados.0.trial187.stdout:2330: writing trial18717860-42 from 591811 to 1310941 tid 1 2026-02-13T18:16:51.159 INFO:tasks.rados.rados.0.trial187.stdout:2330: writing trial18717860-42 from 1767522 to 2404118 tid 2 2026-02-13T18:16:51.163 INFO:tasks.rados.rados.0.trial187.stdout:2330: writing trial18717860-42 from 2828091 to 2991811 tid 3 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2331: read oid 5 snap -1 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2331: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2332: read oid 32 snap -1 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2332: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2333: write oid 23 current snap is 265 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2329: finishing write tid 1 to trial18717860-48 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2329: finishing write tid 2 to trial18717860-48 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2329: finishing write tid 3 to trial18717860-48 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2329: finishing write tid 4 to trial18717860-48 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2329: finishing write tid 5 to trial18717860-48 2026-02-13T18:16:51.164 INFO:tasks.rados.rados.0.trial187.stdout:2329: oid 48 updating version 0 to 1520 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2329: oid 48 version 1520 is already newer than 1518 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2329: oid 48 version 1520 is already newer than 1517 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2329: oid 48 version 1520 is already newer than 1519 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1520 (ObjNum 772 snap 265 seq_num 772) dirty exists 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2329: left oid 48 (ObjNum 772 snap 265 seq_num 772) 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2330: finishing write tid 1 to trial18717860-42 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2330: finishing write tid 2 to trial18717860-42 2026-02-13T18:16:51.165 INFO:tasks.rados.rados.0.trial187.stdout:2333: seq_num 774 ranges {608618=794379,2109651=780254} 2026-02-13T18:16:51.173 INFO:tasks.rados.rados.0.trial187.stdout:2333: writing trial18717860-23 from 608618 to 1402997 tid 1 2026-02-13T18:16:51.183 INFO:tasks.rados.rados.0.trial187.stdout:2333: writing trial18717860-23 from 2109651 to 2889905 tid 2 2026-02-13T18:16:51.183 INFO:tasks.rados.rados.0.trial187.stdout:2329: done (4 left) 2026-02-13T18:16:51.183 INFO:tasks.rados.rados.0.trial187.stdout:2334: read oid 43 snap -1 2026-02-13T18:16:51.183 INFO:tasks.rados.rados.0.trial187.stdout:2334: expect (ObjNum 762 snap 264 seq_num 762) 2026-02-13T18:16:51.184 INFO:tasks.rados.rados.0.trial187.stdout:2335: write oid 38 current snap is 265 2026-02-13T18:16:51.184 INFO:tasks.rados.rados.0.trial187.stdout:2335: seq_num 775 ranges {625425=469628,1768133=640265} 2026-02-13T18:16:51.187 INFO:tasks.rados.rados.0.trial187.stdout:2335: writing trial18717860-38 from 625425 to 1095053 tid 1 2026-02-13T18:16:51.193 INFO:tasks.rados.rados.0.trial187.stdout:2335: writing trial18717860-38 from 1768133 to 2408398 tid 2 2026-02-13T18:16:51.193 INFO:tasks.rados.rados.0.trial187.stdout:2336: copy_from oid 49 from oid 50 current snap is 265 2026-02-13T18:16:51.193 INFO:tasks.rados.rados.0.trial187.stdout:2331: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:16:51.193 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:51.294 INFO:tasks.rados.rados.0.trial187.stdout:2332: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:16:51.299 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1347140 2026-02-13T18:16:51.309 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:51.330 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:51.351 INFO:tasks.rados.rados.0.trial187.stdout:2330: finishing write tid 3 to trial18717860-42 2026-02-13T18:16:51.351 INFO:tasks.rados.rados.0.trial187.stdout:2330: finishing write tid 4 to trial18717860-42 2026-02-13T18:16:51.351 INFO:tasks.rados.rados.0.trial187.stdout:2331: done (6 left) 2026-02-13T18:16:51.351 INFO:tasks.rados.rados.0.trial187.stdout:2332: done (5 left) 2026-02-13T18:16:51.351 INFO:tasks.rados.rados.0.trial187.stdout:2337: snap_create 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2330: finishing write tid 5 to trial18717860-42 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2330: oid 42 updating version 0 to 1012 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2330: oid 42 version 1012 is already newer than 1010 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2330: oid 42 version 1012 is already newer than 1011 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2330: oid 42 version 1012 is already newer than 1009 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1012 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2330: left oid 42 (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2333: finishing write tid 1 to trial18717860-23 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2333: finishing write tid 2 to trial18717860-23 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2333: finishing write tid 3 to trial18717860-23 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2333: finishing write tid 4 to trial18717860-23 2026-02-13T18:16:51.352 INFO:tasks.rados.rados.0.trial187.stdout:2333: oid 23 updating version 0 to 998 2026-02-13T18:16:51.353 INFO:tasks.rados.rados.0.trial187.stdout:2333: oid 23 updating version 998 to 999 2026-02-13T18:16:51.353 INFO:tasks.rados.rados.0.trial187.stdout:2333: oid 23 version 999 is already newer than 997 2026-02-13T18:16:51.353 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 999 (ObjNum 774 snap 265 seq_num 774) dirty exists 2026-02-13T18:16:51.353 INFO:tasks.rados.rados.0.trial187.stdout:2333: left oid 23 (ObjNum 774 snap 265 seq_num 774) 2026-02-13T18:16:51.353 INFO:tasks.rados.rados.0.trial187.stdout:2334: expect (ObjNum 762 snap 264 seq_num 762) 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: finishing write tid 1 to trial18717860-38 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2336: finishing copy_from to trial18717860-49 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2336: got expected ENOENT (src dne) 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2336: finishing copy_from racing read to trial18717860-49 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: finishing write tid 2 to trial18717860-38 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: finishing write tid 3 to trial18717860-38 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: finishing write tid 4 to trial18717860-38 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: oid 38 updating version 0 to 1046 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: oid 38 updating version 1046 to 1047 2026-02-13T18:16:51.453 INFO:tasks.rados.rados.0.trial187.stdout:2335: oid 38 version 1047 is already newer than 1045 2026-02-13T18:16:51.454 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1047 (ObjNum 775 snap 265 seq_num 775) dirty exists 2026-02-13T18:16:51.454 INFO:tasks.rados.rados.0.trial187.stdout:2335: left oid 38 (ObjNum 775 snap 265 seq_num 775) 2026-02-13T18:16:51.873 INFO:tasks.rados.rados.0.trial187.stdout:2330: done (5 left) 2026-02-13T18:16:51.873 INFO:tasks.rados.rados.0.trial187.stdout:2333: done (4 left) 2026-02-13T18:16:51.873 INFO:tasks.rados.rados.0.trial187.stdout:2334: done (3 left) 2026-02-13T18:16:51.874 INFO:tasks.rados.rados.0.trial187.stdout:2335: done (2 left) 2026-02-13T18:16:51.874 INFO:tasks.rados.rados.0.trial187.stdout:2336: done (1 left) 2026-02-13T18:16:51.874 INFO:tasks.rados.rados.0.trial187.stdout:2337: done (0 left) 2026-02-13T18:16:51.874 INFO:tasks.rados.rados.0.trial187.stdout:2338: snap_remove snap 263 2026-02-13T18:16:52.874 INFO:tasks.rados.rados.0.trial187.stdout:2338: done (0 left) 2026-02-13T18:16:52.874 INFO:tasks.rados.rados.0.trial187.stdout:2339: write (excl) oid 39 current snap is 266 2026-02-13T18:16:52.874 INFO:tasks.rados.rados.0.trial187.stdout:2339: seq_num 776 ranges {642232=661230,1942968=783923} 2026-02-13T18:16:52.883 INFO:tasks.rados.rados.0.trial187.stdout:2339: writing trial18717860-39 from 642232 to 1303462 tid 1 2026-02-13T18:16:52.891 INFO:tasks.rados.rados.0.trial187.stdout:2339: writing trial18717860-39 from 1942968 to 2726891 tid 2 2026-02-13T18:16:52.891 INFO:tasks.rados.rados.0.trial187.stdout:2340: read oid 27 snap -1 2026-02-13T18:16:52.891 INFO:tasks.rados.rados.0.trial187.stdout:2340: expect (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2341: read oid 21 snap 255 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2341: expect (ObjNum 700 snap 245 seq_num 700) 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2342: read oid 2 snap -1 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2342: expect (ObjNum 619 snap 212 seq_num 619) 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2343: rollback oid 25 current snap is 266 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 264 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2339: finishing write tid 1 to trial18717860-39 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2344: read oid 35 snap -1 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2344: expect (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2345: write (excl) oid 29 current snap is 266 2026-02-13T18:16:52.892 INFO:tasks.rados.rados.0.trial187.stdout:2345: seq_num 777 ranges {659039=736479,2001450=643934} 2026-02-13T18:16:52.900 INFO:tasks.rados.rados.0.trial187.stdout:2345: writing trial18717860-29 from 659039 to 1395518 tid 1 2026-02-13T18:16:52.909 INFO:tasks.rados.rados.0.trial187.stdout:2345: writing trial18717860-29 from 2001450 to 2645384 tid 2 2026-02-13T18:16:52.909 INFO:tasks.rados.rados.0.trial187.stdout:2346: write oid 12 current snap is 266 2026-02-13T18:16:52.909 INFO:tasks.rados.rados.0.trial187.stdout:2346: seq_num 778 ranges {675846=411728,1543579=787592,2848853=226993} 2026-02-13T18:16:52.916 INFO:tasks.rados.rados.0.trial187.stdout:2346: writing trial18717860-12 from 675846 to 1087574 tid 1 2026-02-13T18:16:52.922 INFO:tasks.rados.rados.0.trial187.stdout:2346: writing trial18717860-12 from 1543579 to 2331171 tid 2 2026-02-13T18:16:52.925 INFO:tasks.rados.rados.0.trial187.stdout:2346: writing trial18717860-12 from 2848853 to 3075846 tid 3 2026-02-13T18:16:52.926 INFO:tasks.rados.rados.0.trial187.stdout:2347: delete oid 11 current snap is 266 2026-02-13T18:16:52.926 INFO:tasks.rados.rados.0.trial187.stdout:2340: expect (ObjNum 748 snap 262 seq_num 748) 2026-02-13T18:16:53.018 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2149443 2026-02-13T18:16:53.028 INFO:tasks.rados.rados.0.trial187.stdout:2344: expect (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:16:53.034 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2145478 2026-02-13T18:16:53.039 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:53.076 INFO:tasks.rados.rados.0.trial187.stdout:2339: finishing write tid 2 to trial18717860-39 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2339: finishing write tid 3 to trial18717860-39 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2339: finishing write tid 4 to trial18717860-39 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2339: oid 39 updating version 0 to 1183 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2339: oid 39 updating version 1183 to 1184 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2339: oid 39 updating version 1184 to 1185 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1185 (ObjNum 776 snap 266 seq_num 776) dirty exists 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2339: left oid 39 (ObjNum 776 snap 266 seq_num 776) 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2343: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 996 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:16:53.077 INFO:tasks.rados.rados.0.trial187.stdout:2341: expect (ObjNum 700 snap 245 seq_num 700) 2026-02-13T18:16:53.238 INFO:tasks.rados.rados.0.trial187.stdout:2342: expect (ObjNum 619 snap 212 seq_num 619) 2026-02-13T18:16:53.275 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 783736 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2345: finishing write tid 1 to trial18717860-29 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2345: finishing write tid 2 to trial18717860-29 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2345: finishing write tid 3 to trial18717860-29 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2339: done (8 left) 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2340: done (7 left) 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2341: done (6 left) 2026-02-13T18:16:53.336 INFO:tasks.rados.rados.0.trial187.stdout:2342: done (5 left) 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2343: done (4 left) 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2344: done (3 left) 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2347: done (2 left) 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2348: rollback oid 48 current snap is 266 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 48 to 264 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2345: finishing write tid 4 to trial18717860-29 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2345: oid 29 updating version 0 to 1012 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2345: oid 29 version 1012 is already newer than 1011 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2345: oid 29 updating version 1012 to 1013 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1013 (ObjNum 777 snap 266 seq_num 777) dirty exists 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2345: left oid 29 (ObjNum 777 snap 266 seq_num 777) 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2346: finishing write tid 1 to trial18717860-12 2026-02-13T18:16:53.337 INFO:tasks.rados.rados.0.trial187.stdout:2346: finishing write tid 2 to trial18717860-12 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: finishing write tid 3 to trial18717860-12 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: finishing write tid 4 to trial18717860-12 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: finishing write tid 5 to trial18717860-12 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: oid 12 updating version 0 to 858 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: oid 12 updating version 858 to 860 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: oid 12 version 860 is already newer than 857 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: oid 12 version 860 is already newer than 859 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 860 (ObjNum 778 snap 266 seq_num 778) dirty exists 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: left oid 12 (ObjNum 778 snap 266 seq_num 778) 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2345: done (2 left) 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2346: done (1 left) 2026-02-13T18:16:53.338 INFO:tasks.rados.rados.0.trial187.stdout:2349: write oid 25 current snap is 266 2026-02-13T18:16:53.339 INFO:tasks.rados.rados.0.trial187.stdout:2349: seq_num 780 ranges {709460=562226,2060543=791261} 2026-02-13T18:16:53.343 INFO:tasks.rados.rados.0.trial187.stdout:2349: writing trial18717860-25 from 709460 to 1271686 tid 1 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2349: writing trial18717860-25 from 2060543 to 2851804 tid 2 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2350: read oid 30 snap -1 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2350: expect (ObjNum 768 snap 265 seq_num 768) 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2351: read oid 24 snap 256 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2351: expect (ObjNum 712 snap 250 seq_num 712) 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2352: read oid 36 snap -1 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2352: expect (ObjNum 725 snap 256 seq_num 725) 2026-02-13T18:16:53.355 INFO:tasks.rados.rados.0.trial187.stdout:2353: snap_remove snap 232 2026-02-13T18:16:54.563 INFO:tasks.rados.rados.0.trial187.stdout:2353: done (5 left) 2026-02-13T18:16:54.563 INFO:tasks.rados.rados.0.trial187.stdout:2354: snap_remove snap 196 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2354: done (5 left) 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2355: read oid 50 snap -1 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2355: expect deleted 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2356: snap_create 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2348: finishing rollback tid 0 to trial18717860-48 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2348: finishing rollback tid 1 to trial18717860-48 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2348: finishing rollback tid 2 to trial18717860-48 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1528 (ObjNum 767 snap 264 seq_num 767) dirty exists 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2349: finishing write tid 1 to trial18717860-25 2026-02-13T18:16:55.565 INFO:tasks.rados.rados.0.trial187.stdout:2352: expect (ObjNum 725 snap 256 seq_num 725) 2026-02-13T18:16:55.633 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2148148 2026-02-13T18:16:55.633 INFO:tasks.rados.rados.0.trial187.stdout:2350: expect (ObjNum 768 snap 265 seq_num 768) 2026-02-13T18:16:55.634 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: finishing write tid 2 to trial18717860-25 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: finishing write tid 3 to trial18717860-25 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: finishing write tid 4 to trial18717860-25 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: oid 25 updating version 0 to 999 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: oid 25 version 999 is already newer than 997 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: oid 25 version 999 is already newer than 998 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 999 (ObjNum 780 snap 266 seq_num 780) dirty exists 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2349: left oid 25 (ObjNum 780 snap 266 seq_num 780) 2026-02-13T18:16:55.784 INFO:tasks.rados.rados.0.trial187.stdout:2351: expect (ObjNum 712 snap 250 seq_num 712) 2026-02-13T18:16:56.566 INFO:tasks.rados.rados.0.trial187.stdout:2348: done (6 left) 2026-02-13T18:16:56.566 INFO:tasks.rados.rados.0.trial187.stdout:2349: done (5 left) 2026-02-13T18:16:56.566 INFO:tasks.rados.rados.0.trial187.stdout:2350: done (4 left) 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2351: done (3 left) 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2352: done (2 left) 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2355: done (1 left) 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2356: done (0 left) 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2357: copy_from oid 14 from oid 7 current snap is 267 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2358: write (excl) oid 25 current snap is 267 2026-02-13T18:16:56.567 INFO:tasks.rados.rados.0.trial187.stdout:2358: seq_num 781 ranges {726267=637475,2119025=651272} 2026-02-13T18:16:56.575 INFO:tasks.rados.rados.0.trial187.stdout:2358: writing trial18717860-25 from 726267 to 1363742 tid 1 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2358: writing trial18717860-25 from 2119025 to 2770297 tid 2 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2359: copy_from oid 8 from oid 42 current snap is 267 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2357: finishing copy_from racing read to trial18717860-14 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2358: finishing write tid 1 to trial18717860-25 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2357: finishing copy_from to trial18717860-14 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1019 (ObjNum 761 snap 263 seq_num 761) dirty exists 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2357: done (2 left) 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2360: write oid 4 current snap is 267 2026-02-13T18:16:56.585 INFO:tasks.rados.rados.0.trial187.stdout:2360: seq_num 782 ranges {743074=712724,2061154=794930} 2026-02-13T18:16:56.594 INFO:tasks.rados.rados.0.trial187.stdout:2360: writing trial18717860-4 from 743074 to 1455798 tid 1 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2360: writing trial18717860-4 from 2061154 to 2856084 tid 2 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2361: read oid 46 snap -1 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2361: expect (ObjNum 750 snap 262 seq_num 750) 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2362: copy_from oid 6 from oid 3 current snap is 267 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2358: finishing write tid 2 to trial18717860-25 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2358: finishing write tid 3 to trial18717860-25 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2358: finishing write tid 4 to trial18717860-25 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2358: oid 25 updating version 0 to 1002 2026-02-13T18:16:56.605 INFO:tasks.rados.rados.0.trial187.stdout:2358: oid 25 version 1002 is already newer than 1000 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2358: oid 25 version 1002 is already newer than 1001 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1002 (ObjNum 781 snap 267 seq_num 781) dirty exists 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2358: left oid 25 (ObjNum 781 snap 267 seq_num 781) 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2359: finishing copy_from racing read to trial18717860-8 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2360: finishing write tid 1 to trial18717860-4 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2358: done (4 left) 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2363: rollback oid 30 current snap is 267 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 262 2026-02-13T18:16:56.606 INFO:tasks.rados.rados.0.trial187.stdout:2364: snap_remove snap 256 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2364: done (5 left) 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2365: copy_from oid 16 from oid 37 current snap is 267 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2359: finishing copy_from to trial18717860-8 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 1012 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2363: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2363: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2363: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1015 (ObjNum 730 snap 256 seq_num 730) dirty exists 2026-02-13T18:16:56.875 INFO:tasks.rados.rados.0.trial187.stdout:2360: finishing write tid 2 to trial18717860-4 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2360: finishing write tid 3 to trial18717860-4 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2360: finishing write tid 4 to trial18717860-4 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2360: oid 4 updating version 0 to 1007 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2360: oid 4 updating version 1007 to 1008 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2360: oid 4 updating version 1008 to 1009 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1009 (ObjNum 782 snap 267 seq_num 782) dirty exists 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2360: left oid 4 (ObjNum 782 snap 267 seq_num 782) 2026-02-13T18:16:56.876 INFO:tasks.rados.rados.0.trial187.stdout:2361: expect (ObjNum 750 snap 262 seq_num 750) 2026-02-13T18:16:56.967 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:16:57.004 INFO:tasks.rados.rados.0.trial187.stdout:2362: finishing copy_from racing read to trial18717860-6 2026-02-13T18:16:57.004 INFO:tasks.rados.rados.0.trial187.stdout:2362: finishing copy_from to trial18717860-6 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1170 (ObjNum 757 snap 263 seq_num 757) dirty exists 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2365: finishing copy_from racing read to trial18717860-16 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2359: done (5 left) 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2360: done (4 left) 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2361: done (3 left) 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2362: done (2 left) 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2363: done (1 left) 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2366: snap_create 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:2365: finishing copy_from to trial18717860-16 2026-02-13T18:16:57.005 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1387 (ObjNum 590 snap 204 seq_num 590) dirty exists 2026-02-13T18:16:57.881 INFO:tasks.rados.rados.0.trial187.stdout:2365: done (1 left) 2026-02-13T18:16:57.882 INFO:tasks.rados.rados.0.trial187.stdout:2366: done (0 left) 2026-02-13T18:16:57.882 INFO:tasks.rados.rados.0.trial187.stdout:2367: write oid 50 current snap is 268 2026-02-13T18:16:57.882 INFO:tasks.rados.rados.0.trial187.stdout:2367: seq_num 783 ranges {759881=787973,2119636=654941} 2026-02-13T18:16:57.892 INFO:tasks.rados.rados.0.trial187.stdout:2367: writing trial18717860-50 from 759881 to 1547854 tid 1 2026-02-13T18:16:57.900 INFO:tasks.rados.rados.0.trial187.stdout:2367: writing trial18717860-50 from 2119636 to 2774577 tid 2 2026-02-13T18:16:57.900 INFO:tasks.rados.rados.0.trial187.stdout:2368: write (excl) oid 31 current snap is 268 2026-02-13T18:16:57.901 INFO:tasks.rados.rados.0.trial187.stdout:2368: seq_num 784 ranges {776688=579575,1894471=798599} 2026-02-13T18:16:57.909 INFO:tasks.rados.rados.0.trial187.stdout:2368: writing trial18717860-31 from 776688 to 1356263 tid 1 2026-02-13T18:16:57.919 INFO:tasks.rados.rados.0.trial187.stdout:2368: writing trial18717860-31 from 1894471 to 2693070 tid 2 2026-02-13T18:16:57.919 INFO:tasks.rados.rados.0.trial187.stdout:2369: copy_from oid 12 from oid 36 current snap is 268 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: finishing write tid 1 to trial18717860-50 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: finishing write tid 2 to trial18717860-50 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: finishing write tid 3 to trial18717860-50 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: finishing write tid 4 to trial18717860-50 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: oid 50 updating version 0 to 1014 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: oid 50 version 1014 is already newer than 1013 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: oid 50 updating version 1014 to 1015 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1015 (ObjNum 783 snap 268 seq_num 783) dirty exists 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: left oid 50 (ObjNum 783 snap 268 seq_num 783) 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2368: finishing write tid 1 to trial18717860-31 2026-02-13T18:16:57.920 INFO:tasks.rados.rados.0.trial187.stdout:2367: done (2 left) 2026-02-13T18:16:57.921 INFO:tasks.rados.rados.0.trial187.stdout:2370: delete oid 18 current snap is 268 2026-02-13T18:16:57.922 INFO:tasks.rados.rados.0.trial187.stdout:2368: finishing write tid 2 to trial18717860-31 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:2368: finishing write tid 3 to trial18717860-31 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:2368: finishing write tid 4 to trial18717860-31 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:2368: oid 31 updating version 0 to 1011 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:2368: oid 31 updating version 1011 to 1012 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:2368: oid 31 version 1012 is already newer than 1010 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1012 (ObjNum 784 snap 268 seq_num 784) dirty exists 2026-02-13T18:16:57.923 INFO:tasks.rados.rados.0.trial187.stdout:2368: left oid 31 (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:16:57.924 INFO:tasks.rados.rados.0.trial187.stdout:2368: done (2 left) 2026-02-13T18:16:57.924 INFO:tasks.rados.rados.0.trial187.stdout:2370: done (1 left) 2026-02-13T18:16:57.924 INFO:tasks.rados.rados.0.trial187.stdout:2371: write (excl) oid 38 current snap is 268 2026-02-13T18:16:57.924 INFO:tasks.rados.rados.0.trial187.stdout:2371: seq_num 786 ranges {410302=730073,1895082=402268,2951884=258418} 2026-02-13T18:16:57.931 INFO:tasks.rados.rados.0.trial187.stdout:2371: writing trial18717860-38 from 410302 to 1140375 tid 1 2026-02-13T18:16:57.939 INFO:tasks.rados.rados.0.trial187.stdout:2371: writing trial18717860-38 from 1895082 to 2297350 tid 2 2026-02-13T18:16:57.944 INFO:tasks.rados.rados.0.trial187.stdout:2371: writing trial18717860-38 from 2951884 to 3210302 tid 3 2026-02-13T18:16:57.944 INFO:tasks.rados.rados.0.trial187.stdout:2372: write (excl) oid 34 current snap is 268 2026-02-13T18:16:57.945 INFO:tasks.rados.rados.0.trial187.stdout:2372: seq_num 787 ranges {427109=405322,1553564=545926,2579307=647802} 2026-02-13T18:16:57.947 INFO:tasks.rados.rados.0.trial187.stdout:2372: writing trial18717860-34 from 427109 to 832431 tid 1 2026-02-13T18:16:57.952 INFO:tasks.rados.rados.0.trial187.stdout:2372: writing trial18717860-34 from 1553564 to 2099490 tid 2 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2372: writing trial18717860-34 from 2579307 to 3227109 tid 3 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2373: rollback oid 39 current snap is 268 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 257 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2369: finishing copy_from racing read to trial18717860-12 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2369: finishing copy_from to trial18717860-12 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 988 (ObjNum 725 snap 256 seq_num 725) dirty exists 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2371: finishing write tid 1 to trial18717860-38 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2371: finishing write tid 2 to trial18717860-38 2026-02-13T18:16:57.958 INFO:tasks.rados.rados.0.trial187.stdout:2371: finishing write tid 3 to trial18717860-38 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: finishing write tid 4 to trial18717860-38 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: finishing write tid 5 to trial18717860-38 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: oid 38 updating version 0 to 1050 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: oid 38 version 1050 is already newer than 1048 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: oid 38 updating version 1050 to 1051 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: oid 38 version 1051 is already newer than 1049 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1051 (ObjNum 786 snap 268 seq_num 786) dirty exists 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2371: left oid 38 (ObjNum 786 snap 268 seq_num 786) 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2372: finishing write tid 1 to trial18717860-34 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2372: finishing write tid 2 to trial18717860-34 2026-02-13T18:16:57.959 INFO:tasks.rados.rados.0.trial187.stdout:2369: done (3 left) 2026-02-13T18:16:57.960 INFO:tasks.rados.rados.0.trial187.stdout:2371: done (2 left) 2026-02-13T18:16:57.960 INFO:tasks.rados.rados.0.trial187.stdout:2374: copy_from oid 33 from oid 50 current snap is 268 2026-02-13T18:16:57.960 INFO:tasks.rados.rados.0.trial187.stdout:2375: read oid 18 snap -1 2026-02-13T18:16:57.960 INFO:tasks.rados.rados.0.trial187.stdout:2375: expect deleted 2026-02-13T18:16:57.960 INFO:tasks.rados.rados.0.trial187.stdout:2376: snap_create 2026-02-13T18:16:57.961 INFO:tasks.rados.rados.0.trial187.stdout:2372: finishing write tid 3 to trial18717860-34 2026-02-13T18:16:57.961 INFO:tasks.rados.rados.0.trial187.stdout:2372: finishing write tid 4 to trial18717860-34 2026-02-13T18:16:57.961 INFO:tasks.rados.rados.0.trial187.stdout:2372: finishing write tid 5 to trial18717860-34 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2372: oid 34 updating version 0 to 1002 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2372: oid 34 updating version 1002 to 1004 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2372: oid 34 version 1004 is already newer than 1003 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2372: oid 34 version 1004 is already newer than 1001 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1004 (ObjNum 787 snap 268 seq_num 787) dirty exists 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2372: left oid 34 (ObjNum 787 snap 268 seq_num 787) 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2373: finishing rollback tid 0 to trial18717860-39 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2373: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:2373: finishing rollback tid 2 to trial18717860-39 2026-02-13T18:16:57.962 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1211 (ObjNum 698 snap 244 seq_num 698) dirty exists 2026-02-13T18:16:57.966 INFO:tasks.rados.rados.0.trial187.stdout:2374: finishing copy_from racing read to trial18717860-33 2026-02-13T18:16:57.966 INFO:tasks.rados.rados.0.trial187.stdout:2374: finishing copy_from to trial18717860-33 2026-02-13T18:16:57.966 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1015 (ObjNum 783 snap 268 seq_num 783) dirty exists 2026-02-13T18:16:58.884 INFO:tasks.rados.rados.0.trial187.stdout:2372: done (4 left) 2026-02-13T18:16:58.885 INFO:tasks.rados.rados.0.trial187.stdout:2373: done (3 left) 2026-02-13T18:16:58.885 INFO:tasks.rados.rados.0.trial187.stdout:2374: done (2 left) 2026-02-13T18:16:58.885 INFO:tasks.rados.rados.0.trial187.stdout:2375: done (1 left) 2026-02-13T18:16:58.885 INFO:tasks.rados.rados.0.trial187.stdout:2376: done (0 left) 2026-02-13T18:16:58.885 INFO:tasks.rados.rados.0.trial187.stdout:2377: write (excl) oid 11 current snap is 269 2026-02-13T18:16:58.885 INFO:tasks.rados.rados.0.trial187.stdout:2377: seq_num 788 ranges {443916=480571,1612046=405937,2606730=495052} 2026-02-13T18:16:58.889 INFO:tasks.rados.rados.0.trial187.stdout:2377: writing trial18717860-11 from 443916 to 924487 tid 1 2026-02-13T18:16:58.893 INFO:tasks.rados.rados.0.trial187.stdout:2377: writing trial18717860-11 from 1612046 to 2017983 tid 2 2026-02-13T18:16:58.898 INFO:tasks.rados.rados.0.trial187.stdout:2377: writing trial18717860-11 from 2606730 to 3101782 tid 3 2026-02-13T18:16:58.898 INFO:tasks.rados.rados.0.trial187.stdout:2378: read oid 28 snap -1 2026-02-13T18:16:58.898 INFO:tasks.rados.rados.0.trial187.stdout:2378: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:16:58.898 INFO:tasks.rados.rados.0.trial187.stdout:2379: write (excl) oid 37 current snap is 269 2026-02-13T18:16:58.898 INFO:tasks.rados.rados.0.trial187.stdout:2379: seq_num 789 ranges {460723=555820,1670528=549595,2634153=626570} 2026-02-13T18:16:58.901 INFO:tasks.rados.rados.0.trial187.stdout:2379: writing trial18717860-37 from 460723 to 1016543 tid 1 2026-02-13T18:16:58.906 INFO:tasks.rados.rados.0.trial187.stdout:2379: writing trial18717860-37 from 1670528 to 2220123 tid 2 2026-02-13T18:16:58.911 INFO:tasks.rados.rados.0.trial187.stdout:2379: writing trial18717860-37 from 2634153 to 3260723 tid 3 2026-02-13T18:16:58.911 INFO:tasks.rados.rados.0.trial187.stdout:2380: copy_from oid 14 from oid 25 current snap is 269 2026-02-13T18:16:58.911 INFO:tasks.rados.rados.0.trial187.stdout:2377: finishing write tid 1 to trial18717860-11 2026-02-13T18:16:58.911 INFO:tasks.rados.rados.0.trial187.stdout:2377: finishing write tid 2 to trial18717860-11 2026-02-13T18:16:58.911 INFO:tasks.rados.rados.0.trial187.stdout:2377: finishing write tid 3 to trial18717860-11 2026-02-13T18:16:58.911 INFO:tasks.rados.rados.0.trial187.stdout:2377: finishing write tid 4 to trial18717860-11 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2377: finishing write tid 5 to trial18717860-11 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2377: oid 11 updating version 0 to 1006 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2377: oid 11 updating version 1006 to 1008 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2377: oid 11 version 1008 is already newer than 1007 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2377: oid 11 version 1008 is already newer than 1005 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1008 (ObjNum 788 snap 269 seq_num 788) dirty exists 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2377: left oid 11 (ObjNum 788 snap 269 seq_num 788) 2026-02-13T18:16:58.912 INFO:tasks.rados.rados.0.trial187.stdout:2378: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:16:58.967 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2082683 2026-02-13T18:16:59.058 INFO:tasks.rados.rados.0.trial187.stdout:2379: finishing write tid 1 to trial18717860-37 2026-02-13T18:16:59.058 INFO:tasks.rados.rados.0.trial187.stdout:2379: finishing write tid 2 to trial18717860-37 2026-02-13T18:16:59.058 INFO:tasks.rados.rados.0.trial187.stdout:2379: finishing write tid 3 to trial18717860-37 2026-02-13T18:16:59.058 INFO:tasks.rados.rados.0.trial187.stdout:2379: finishing write tid 4 to trial18717860-37 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2379: finishing write tid 5 to trial18717860-37 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2379: oid 37 updating version 0 to 1560 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2379: oid 37 version 1560 is already newer than 1559 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2379: oid 37 updating version 1560 to 1562 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2379: oid 37 version 1562 is already newer than 1561 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1562 (ObjNum 789 snap 269 seq_num 789) dirty exists 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2379: left oid 37 (ObjNum 789 snap 269 seq_num 789) 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2380: finishing copy_from racing read to trial18717860-14 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2380: finishing copy_from to trial18717860-14 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1002 (ObjNum 781 snap 267 seq_num 781) dirty exists 2026-02-13T18:16:59.059 INFO:tasks.rados.rados.0.trial187.stdout:2377: done (3 left) 2026-02-13T18:16:59.060 INFO:tasks.rados.rados.0.trial187.stdout:2378: done (2 left) 2026-02-13T18:16:59.060 INFO:tasks.rados.rados.0.trial187.stdout:2379: done (1 left) 2026-02-13T18:16:59.060 INFO:tasks.rados.rados.0.trial187.stdout:2380: done (0 left) 2026-02-13T18:16:59.060 INFO:tasks.rados.rados.0.trial187.stdout:2381: copy_from oid 45 from oid 47 current snap is 269 2026-02-13T18:16:59.060 INFO:tasks.rados.rados.0.trial187.stdout:2382: snap_remove snap 249 2026-02-13T18:16:59.888 INFO:tasks.rados.rados.0.trial187.stdout:2382: done (1 left) 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:2383: copy_from oid 26 from oid 21 current snap is 269 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:2381: finishing copy_from racing read to trial18717860-45 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:2381: finishing copy_from to trial18717860-45 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 985 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:2381: done (1 left) 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:2384: write (excl) oid 34 current snap is 269 2026-02-13T18:16:59.889 INFO:tasks.rados.rados.0.trial187.stdout:2384: seq_num 790 ranges {477530=631069,1612657=409606,2545223=517596} 2026-02-13T18:16:59.894 INFO:tasks.rados.rados.0.trial187.stdout:2384: writing trial18717860-34 from 477530 to 1108599 tid 1 2026-02-13T18:16:59.897 INFO:tasks.rados.rados.0.trial187.stdout:2384: writing trial18717860-34 from 1612657 to 2022263 tid 2 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:2384: writing trial18717860-34 from 2545223 to 3062819 tid 3 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:2385: delete oid 18 current snap is 269 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:2384: finishing write tid 1 to trial18717860-34 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:2383: finishing copy_from racing read to trial18717860-26 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:2383: finishing copy_from to trial18717860-26 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 1009 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:16:59.902 INFO:tasks.rados.rados.0.trial187.stdout:2384: finishing write tid 2 to trial18717860-34 2026-02-13T18:16:59.903 INFO:tasks.rados.rados.0.trial187.stdout:2383: done (2 left) 2026-02-13T18:16:59.903 INFO:tasks.rados.rados.0.trial187.stdout:2385: done (1 left) 2026-02-13T18:16:59.903 INFO:tasks.rados.rados.0.trial187.stdout:2386: write oid 16 current snap is 269 2026-02-13T18:16:59.903 INFO:tasks.rados.rados.0.trial187.stdout:2386: seq_num 792 ranges {511144=497920,1445974=413275,2316422=656493} 2026-02-13T18:16:59.906 INFO:tasks.rados.rados.0.trial187.stdout:2386: writing trial18717860-16 from 511144 to 1009064 tid 1 2026-02-13T18:16:59.910 INFO:tasks.rados.rados.0.trial187.stdout:2386: writing trial18717860-16 from 1445974 to 1859249 tid 2 2026-02-13T18:16:59.915 INFO:tasks.rados.rados.0.trial187.stdout:2386: writing trial18717860-16 from 2316422 to 2972915 tid 3 2026-02-13T18:16:59.916 INFO:tasks.rados.rados.0.trial187.stdout:2387: copy_from oid 24 from oid 15 current snap is 269 2026-02-13T18:16:59.916 INFO:tasks.rados.rados.0.trial187.stdout:2384: finishing write tid 3 to trial18717860-34 2026-02-13T18:16:59.916 INFO:tasks.rados.rados.0.trial187.stdout:2388: read oid 47 snap -1 2026-02-13T18:16:59.916 INFO:tasks.rados.rados.0.trial187.stdout:2388: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:16:59.916 INFO:tasks.rados.rados.0.trial187.stdout:2389: read oid 25 snap 262 2026-02-13T18:16:59.916 INFO:tasks.rados.rados.0.trial187.stdout:2389: expect (ObjNum 731 snap 256 seq_num 731) 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2390: delete oid 10 current snap is 269 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2384: finishing write tid 4 to trial18717860-34 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2384: finishing write tid 5 to trial18717860-34 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2384: oid 34 updating version 0 to 1009 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2384: oid 34 updating version 1009 to 1011 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2384: oid 34 updating version 1011 to 1012 2026-02-13T18:16:59.917 INFO:tasks.rados.rados.0.trial187.stdout:2384: oid 34 version 1012 is already newer than 1010 2026-02-13T18:16:59.918 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1012 (ObjNum 790 snap 269 seq_num 790) dirty exists 2026-02-13T18:16:59.918 INFO:tasks.rados.rados.0.trial187.stdout:2384: left oid 34 (ObjNum 790 snap 269 seq_num 790) 2026-02-13T18:16:59.918 INFO:tasks.rados.rados.0.trial187.stdout:2386: finishing write tid 1 to trial18717860-16 2026-02-13T18:16:59.918 INFO:tasks.rados.rados.0.trial187.stdout:2386: finishing write tid 2 to trial18717860-16 2026-02-13T18:16:59.918 INFO:tasks.rados.rados.0.trial187.stdout:2387: finishing copy_from to trial18717860-24 2026-02-13T18:16:59.918 INFO:tasks.rados.rados.0.trial187.stdout:2387: got expected ENOENT (src dne) 2026-02-13T18:16:59.919 INFO:tasks.rados.rados.0.trial187.stdout:2387: finishing copy_from racing read to trial18717860-24 2026-02-13T18:16:59.920 INFO:tasks.rados.rados.0.trial187.stdout:2384: done (5 left) 2026-02-13T18:16:59.920 INFO:tasks.rados.rados.0.trial187.stdout:2387: done (4 left) 2026-02-13T18:16:59.920 INFO:tasks.rados.rados.0.trial187.stdout:2390: done (3 left) 2026-02-13T18:16:59.920 INFO:tasks.rados.rados.0.trial187.stdout:2391: write oid 24 current snap is 269 2026-02-13T18:16:59.920 INFO:tasks.rados.rados.0.trial187.stdout:2391: seq_num 794 ranges {544758=648418,1846585=416944,2771268=573490} 2026-02-13T18:16:59.923 INFO:tasks.rados.rados.0.trial187.stdout:2391: writing trial18717860-24 from 544758 to 1193176 tid 1 2026-02-13T18:16:59.928 INFO:tasks.rados.rados.0.trial187.stdout:2391: writing trial18717860-24 from 1846585 to 2263529 tid 2 2026-02-13T18:16:59.932 INFO:tasks.rados.rados.0.trial187.stdout:2391: writing trial18717860-24 from 2771268 to 3344758 tid 3 2026-02-13T18:16:59.932 INFO:tasks.rados.rados.0.trial187.stdout:2392: write (excl) oid 6 current snap is 269 2026-02-13T18:16:59.932 INFO:tasks.rados.rados.0.trial187.stdout:2392: seq_num 795 ranges {561565=723667,1905067=560602,3082338=279227} 2026-02-13T18:16:59.937 INFO:tasks.rados.rados.0.trial187.stdout:2392: writing trial18717860-6 from 561565 to 1285232 tid 1 2026-02-13T18:16:59.941 INFO:tasks.rados.rados.0.trial187.stdout:2392: writing trial18717860-6 from 1905067 to 2465669 tid 2 2026-02-13T18:16:59.945 INFO:tasks.rados.rados.0.trial187.stdout:2392: writing trial18717860-6 from 3082338 to 3361565 tid 3 2026-02-13T18:16:59.945 INFO:tasks.rados.rados.0.trial187.stdout:2393: read oid 11 snap 257 2026-02-13T18:16:59.945 INFO:tasks.rados.rados.0.trial187.stdout:2393: expect (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:16:59.945 INFO:tasks.rados.rados.0.trial187.stdout:2394: write oid 49 current snap is 269 2026-02-13T18:16:59.945 INFO:tasks.rados.rados.0.trial187.stdout:2394: seq_num 796 ranges {578372=798916,1963549=420613,2826114=417934} 2026-02-13T18:16:59.950 INFO:tasks.rados.rados.0.trial187.stdout:2394: writing trial18717860-49 from 578372 to 1377288 tid 1 2026-02-13T18:16:59.954 INFO:tasks.rados.rados.0.trial187.stdout:2394: writing trial18717860-49 from 1963549 to 2384162 tid 2 2026-02-13T18:16:59.957 INFO:tasks.rados.rados.0.trial187.stdout:2394: writing trial18717860-49 from 2826114 to 3244048 tid 3 2026-02-13T18:16:59.957 INFO:tasks.rados.rados.0.trial187.stdout:2395: write oid 34 current snap is 269 2026-02-13T18:16:59.957 INFO:tasks.rados.rados.0.trial187.stdout:2395: seq_num 797 ranges {595179=474165,1622031=564271,2737184=629206} 2026-02-13T18:16:59.962 INFO:tasks.rados.rados.0.trial187.stdout:2395: writing trial18717860-34 from 595179 to 1069344 tid 1 2026-02-13T18:16:59.966 INFO:tasks.rados.rados.0.trial187.stdout:2395: writing trial18717860-34 from 1622031 to 2186302 tid 2 2026-02-13T18:16:59.971 INFO:tasks.rados.rados.0.trial187.stdout:2395: writing trial18717860-34 from 2737184 to 3366390 tid 3 2026-02-13T18:16:59.972 INFO:tasks.rados.rados.0.trial187.stdout:2396: read oid 42 snap -1 2026-02-13T18:16:59.972 INFO:tasks.rados.rados.0.trial187.stdout:2396: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:16:59.972 INFO:tasks.rados.rados.0.trial187.stdout:2397: delete oid 18 current snap is 269 2026-02-13T18:16:59.972 INFO:tasks.rados.rados.0.trial187.stdout:2389: expect (ObjNum 731 snap 256 seq_num 731) 2026-02-13T18:16:59.972 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:00.028 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2115613 2026-02-13T18:17:00.035 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1124569 2026-02-13T18:17:00.049 INFO:tasks.rados.rados.0.trial187.stdout:2388: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:17:00.171 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:00.232 INFO:tasks.rados.rados.0.trial187.stdout:2386: finishing write tid 3 to trial18717860-16 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: finishing write tid 4 to trial18717860-16 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: finishing write tid 5 to trial18717860-16 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: oid 16 updating version 0 to 1391 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: oid 16 version 1391 is already newer than 1389 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: oid 16 version 1391 is already newer than 1388 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: oid 16 version 1391 is already newer than 1390 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1391 (ObjNum 792 snap 269 seq_num 792) dirty exists 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2386: left oid 16 (ObjNum 792 snap 269 seq_num 792) 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2391: finishing write tid 1 to trial18717860-24 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2391: finishing write tid 2 to trial18717860-24 2026-02-13T18:17:00.233 INFO:tasks.rados.rados.0.trial187.stdout:2391: finishing write tid 3 to trial18717860-24 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: finishing write tid 4 to trial18717860-24 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: finishing write tid 5 to trial18717860-24 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: oid 24 updating version 0 to 1171 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: oid 24 updating version 1171 to 1172 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: oid 24 updating version 1172 to 1174 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: oid 24 version 1174 is already newer than 1173 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1174 (ObjNum 794 snap 269 seq_num 794) dirty exists 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2391: left oid 24 (ObjNum 794 snap 269 seq_num 794) 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2392: finishing write tid 1 to trial18717860-6 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2392: finishing write tid 2 to trial18717860-6 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2392: finishing write tid 3 to trial18717860-6 2026-02-13T18:17:00.234 INFO:tasks.rados.rados.0.trial187.stdout:2392: finishing write tid 4 to trial18717860-6 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:2392: finishing write tid 5 to trial18717860-6 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:2392: oid 6 updating version 0 to 1176 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:2392: oid 6 updating version 1176 to 1177 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:2392: oid 6 updating version 1177 to 1178 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:2392: oid 6 version 1178 is already newer than 1175 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1178 (ObjNum 795 snap 269 seq_num 795) dirty exists 2026-02-13T18:17:00.235 INFO:tasks.rados.rados.0.trial187.stdout:2392: left oid 6 (ObjNum 795 snap 269 seq_num 795) 2026-02-13T18:17:00.236 INFO:tasks.rados.rados.0.trial187.stdout:2393: expect (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:17:00.236 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:00.281 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1571584 2026-02-13T18:17:00.292 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 403589 2026-02-13T18:17:00.324 INFO:tasks.rados.rados.0.trial187.stdout:2394: finishing write tid 1 to trial18717860-49 2026-02-13T18:17:00.324 INFO:tasks.rados.rados.0.trial187.stdout:2394: finishing write tid 2 to trial18717860-49 2026-02-13T18:17:00.324 INFO:tasks.rados.rados.0.trial187.stdout:2394: finishing write tid 3 to trial18717860-49 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2386: done (9 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2388: done (8 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2389: done (7 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2391: done (6 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2392: done (5 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2393: done (4 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2397: done (3 left) 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2398: read oid 10 snap -1 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2398: expect deleted 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2399: write (excl) oid 45 current snap is 269 2026-02-13T18:17:00.325 INFO:tasks.rados.rados.0.trial187.stdout:2399: seq_num 799 ranges {628793=741016,2138995=567940,3192030=236763} 2026-02-13T18:17:00.329 INFO:tasks.rados.rados.0.trial187.stdout:2399: writing trial18717860-45 from 628793 to 1369809 tid 1 2026-02-13T18:17:00.334 INFO:tasks.rados.rados.0.trial187.stdout:2399: writing trial18717860-45 from 2138995 to 2706935 tid 2 2026-02-13T18:17:00.337 INFO:tasks.rados.rados.0.trial187.stdout:2399: writing trial18717860-45 from 3192030 to 3428793 tid 3 2026-02-13T18:17:00.337 INFO:tasks.rados.rados.0.trial187.stdout:2400: write oid 23 current snap is 269 2026-02-13T18:17:00.338 INFO:tasks.rados.rados.0.trial187.stdout:2400: seq_num 800 ranges {645600=416265,1797477=711598,3219453=226147} 2026-02-13T18:17:00.341 INFO:tasks.rados.rados.0.trial187.stdout:2400: writing trial18717860-23 from 645600 to 1061865 tid 1 2026-02-13T18:17:00.347 INFO:tasks.rados.rados.0.trial187.stdout:2400: writing trial18717860-23 from 1797477 to 2509075 tid 2 2026-02-13T18:17:00.352 INFO:tasks.rados.rados.0.trial187.stdout:2400: writing trial18717860-23 from 3219453 to 3445600 tid 3 2026-02-13T18:17:00.352 INFO:tasks.rados.rados.0.trial187.stdout:2401: read oid 35 snap -1 2026-02-13T18:17:00.352 INFO:tasks.rados.rados.0.trial187.stdout:2401: expect (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:17:00.352 INFO:tasks.rados.rados.0.trial187.stdout:2402: snap_create 2026-02-13T18:17:00.352 INFO:tasks.rados.rados.0.trial187.stdout:2394: finishing write tid 4 to trial18717860-49 2026-02-13T18:17:00.352 INFO:tasks.rados.rados.0.trial187.stdout:2394: finishing write tid 5 to trial18717860-49 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2394: oid 49 updating version 0 to 1015 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2394: oid 49 updating version 1015 to 1016 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2394: oid 49 version 1016 is already newer than 1013 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2394: oid 49 version 1016 is already newer than 1014 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1016 (ObjNum 796 snap 269 seq_num 796) dirty exists 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2394: left oid 49 (ObjNum 796 snap 269 seq_num 796) 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2395: finishing write tid 1 to trial18717860-34 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2395: finishing write tid 2 to trial18717860-34 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2395: finishing write tid 3 to trial18717860-34 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2395: finishing write tid 4 to trial18717860-34 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2395: finishing write tid 5 to trial18717860-34 2026-02-13T18:17:00.353 INFO:tasks.rados.rados.0.trial187.stdout:2395: oid 34 updating version 0 to 1017 2026-02-13T18:17:00.354 INFO:tasks.rados.rados.0.trial187.stdout:2395: oid 34 updating version 1017 to 1018 2026-02-13T18:17:00.354 INFO:tasks.rados.rados.0.trial187.stdout:2395: oid 34 updating version 1018 to 1019 2026-02-13T18:17:00.354 INFO:tasks.rados.rados.0.trial187.stdout:2395: oid 34 updating version 1019 to 1020 2026-02-13T18:17:00.354 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1020 (ObjNum 797 snap 269 seq_num 797) dirty exists 2026-02-13T18:17:00.354 INFO:tasks.rados.rados.0.trial187.stdout:2395: left oid 34 (ObjNum 797 snap 269 seq_num 797) 2026-02-13T18:17:00.354 INFO:tasks.rados.rados.0.trial187.stdout:2396: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:00.365 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2225154 2026-02-13T18:17:00.416 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:00.458 INFO:tasks.rados.rados.0.trial187.stdout:2399: finishing write tid 1 to trial18717860-45 2026-02-13T18:17:00.458 INFO:tasks.rados.rados.0.trial187.stdout:2399: finishing write tid 2 to trial18717860-45 2026-02-13T18:17:00.458 INFO:tasks.rados.rados.0.trial187.stdout:2399: finishing write tid 3 to trial18717860-45 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: finishing write tid 4 to trial18717860-45 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: finishing write tid 5 to trial18717860-45 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: oid 45 updating version 0 to 1012 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: oid 45 version 1012 is already newer than 1011 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: oid 45 version 1012 is already newer than 1009 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: oid 45 version 1012 is already newer than 1010 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1012 (ObjNum 799 snap 269 seq_num 799) dirty exists 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2399: left oid 45 (ObjNum 799 snap 269 seq_num 799) 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2400: finishing write tid 1 to trial18717860-23 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2400: finishing write tid 2 to trial18717860-23 2026-02-13T18:17:00.459 INFO:tasks.rados.rados.0.trial187.stdout:2400: finishing write tid 3 to trial18717860-23 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: finishing write tid 4 to trial18717860-23 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: finishing write tid 5 to trial18717860-23 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: oid 23 updating version 0 to 1022 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: oid 23 version 1022 is already newer than 1021 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: oid 23 updating version 1022 to 1023 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: oid 23 version 1023 is already newer than 1020 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1023 (ObjNum 800 snap 269 seq_num 800) dirty exists 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2400: left oid 23 (ObjNum 800 snap 269 seq_num 800) 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:2401: expect (ObjNum 740 snap 258 seq_num 740) 2026-02-13T18:17:00.460 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 147133 2026-02-13T18:17:00.496 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 527680 2026-02-13T18:17:00.891 INFO:tasks.rados.rados.0.trial187.stdout:2394: done (7 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2395: done (6 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2396: done (5 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2398: done (4 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2399: done (3 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2400: done (2 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2401: done (1 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2402: done (0 left) 2026-02-13T18:17:00.892 INFO:tasks.rados.rados.0.trial187.stdout:2403: snap_create 2026-02-13T18:17:01.874 INFO:tasks.rados.rados.0.trial187.stdout:2403: done (0 left) 2026-02-13T18:17:01.875 INFO:tasks.rados.rados.0.trial187.stdout:2404: delete oid 37 current snap is 271 2026-02-13T18:17:01.880 INFO:tasks.rados.rados.0.trial187.stdout:2404: done (0 left) 2026-02-13T18:17:01.880 INFO:tasks.rados.rados.0.trial187.stdout:2405: read oid 38 snap -1 2026-02-13T18:17:01.880 INFO:tasks.rados.rados.0.trial187.stdout:2405: expect (ObjNum 786 snap 268 seq_num 786) 2026-02-13T18:17:01.880 INFO:tasks.rados.rados.0.trial187.stdout:2406: read oid 33 snap -1 2026-02-13T18:17:01.880 INFO:tasks.rados.rados.0.trial187.stdout:2406: expect (ObjNum 783 snap 268 seq_num 783) 2026-02-13T18:17:01.881 INFO:tasks.rados.rados.0.trial187.stdout:2407: read oid 11 snap -1 2026-02-13T18:17:01.881 INFO:tasks.rados.rados.0.trial187.stdout:2407: expect (ObjNum 788 snap 269 seq_num 788) 2026-02-13T18:17:01.881 INFO:tasks.rados.rados.0.trial187.stdout:2408: copy_from oid 20 from oid 28 current snap is 271 2026-02-13T18:17:01.881 INFO:tasks.rados.rados.0.trial187.stdout:2409: copy_from oid 17 from oid 5 current snap is 271 2026-02-13T18:17:01.881 INFO:tasks.rados.rados.0.trial187.stdout:2410: snap_remove snap 267 2026-02-13T18:17:02.878 INFO:tasks.rados.rados.0.trial187.stdout:2410: done (5 left) 2026-02-13T18:17:02.878 INFO:tasks.rados.rados.0.trial187.stdout:2411: snap_remove snap 221 2026-02-13T18:17:03.880 INFO:tasks.rados.rados.0.trial187.stdout:2411: done (5 left) 2026-02-13T18:17:03.880 INFO:tasks.rados.rados.0.trial187.stdout:2412: rollback oid 3 current snap is 271 2026-02-13T18:17:03.880 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 266 2026-02-13T18:17:03.880 INFO:tasks.rados.rados.0.trial187.stdout:2407: expect (ObjNum 788 snap 269 seq_num 788) 2026-02-13T18:17:03.934 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2797653 2026-02-13T18:17:03.955 INFO:tasks.rados.rados.0.trial187.stdout:2406: expect (ObjNum 783 snap 268 seq_num 783) 2026-02-13T18:17:03.958 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1964350 2026-02-13T18:17:03.971 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:04.016 INFO:tasks.rados.rados.0.trial187.stdout:2405: expect (ObjNum 786 snap 268 seq_num 786) 2026-02-13T18:17:04.048 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 567992 2026-02-13T18:17:04.076 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:04.110 INFO:tasks.rados.rados.0.trial187.stdout:2408: finishing copy_from racing read to trial18717860-20 2026-02-13T18:17:04.110 INFO:tasks.rados.rados.0.trial187.stdout:2408: finishing copy_from to trial18717860-20 2026-02-13T18:17:04.110 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 995 (ObjNum 735 snap 257 seq_num 735) dirty exists 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2409: finishing copy_from racing read to trial18717860-17 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2409: finishing copy_from to trial18717860-17 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 850 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2412: finishing rollback tid 0 to trial18717860-3 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2412: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2412: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1232 (ObjNum 757 snap 263 seq_num 757) dirty exists 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2405: done (5 left) 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2406: done (4 left) 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2407: done (3 left) 2026-02-13T18:17:04.111 INFO:tasks.rados.rados.0.trial187.stdout:2408: done (2 left) 2026-02-13T18:17:04.112 INFO:tasks.rados.rados.0.trial187.stdout:2409: done (1 left) 2026-02-13T18:17:04.112 INFO:tasks.rados.rados.0.trial187.stdout:2412: done (0 left) 2026-02-13T18:17:04.112 INFO:tasks.rados.rados.0.trial187.stdout:2413: delete oid 33 current snap is 271 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2413: done (0 left) 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2414: read oid 42 snap -1 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2414: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2415: rollback oid 49 current snap is 271 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 246 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2416: read oid 5 snap -1 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2416: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2417: copy_from oid 39 from oid 9 current snap is 271 2026-02-13T18:17:04.113 INFO:tasks.rados.rados.0.trial187.stdout:2418: delete oid 13 current snap is 271 2026-02-13T18:17:04.114 INFO:tasks.rados.rados.0.trial187.stdout:2416: expect (ObjNum 493 snap 147 seq_num 493) 2026-02-13T18:17:04.114 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:04.209 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 872525 2026-02-13T18:17:04.235 INFO:tasks.rados.rados.0.trial187.stdout:2415: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:2415: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:2416: done (4 left) 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:2418: done (3 left) 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:2419: rollback oid 40 current snap is 271 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 264 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:2415: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1023 (ObjNum 563 snap 189 seq_num 563) dirty exists 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:2414: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:04.236 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:04.287 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1851728 2026-02-13T18:17:04.343 INFO:tasks.rados.rados.0.trial187.stdout:2417: finishing copy_from racing read to trial18717860-39 2026-02-13T18:17:04.343 INFO:tasks.rados.rados.0.trial187.stdout:2417: finishing copy_from to trial18717860-39 2026-02-13T18:17:04.343 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1174 (ObjNum 758 snap 263 seq_num 758) dirty exists 2026-02-13T18:17:04.343 INFO:tasks.rados.rados.0.trial187.stdout:2419: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:17:04.343 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2414: done (3 left) 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2415: done (2 left) 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2417: done (1 left) 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2419: done (0 left) 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2420: read oid 16 snap 264 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2420: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:17:04.344 INFO:tasks.rados.rados.0.trial187.stdout:2421: snap_remove snap 262 2026-02-13T18:17:04.993 INFO:tasks.rados.rados.0.trial187.stdout:2421: done (1 left) 2026-02-13T18:17:04.994 INFO:tasks.rados.rados.0.trial187.stdout:2422: read oid 8 snap -1 2026-02-13T18:17:04.994 INFO:tasks.rados.rados.0.trial187.stdout:2422: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:04.994 INFO:tasks.rados.rados.0.trial187.stdout:2423: rollback oid 43 current snap is 271 2026-02-13T18:17:04.994 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 43 to 261 2026-02-13T18:17:04.994 INFO:tasks.rados.rados.0.trial187.stdout:2420: expect (ObjNum 354 snap 99 seq_num 354) 2026-02-13T18:17:05.055 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:05.140 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2061485 2026-02-13T18:17:05.171 INFO:tasks.rados.rados.0.trial187.stdout:2423: finishing rollback tid 0 to trial18717860-43 2026-02-13T18:17:05.171 INFO:tasks.rados.rados.0.trial187.stdout:2423: finishing rollback tid 1 to trial18717860-43 2026-02-13T18:17:05.171 INFO:tasks.rados.rados.0.trial187.stdout:2423: finishing rollback tid 2 to trial18717860-43 2026-02-13T18:17:05.171 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1590 (ObjNum 732 snap 256 seq_num 732) dirty exists 2026-02-13T18:17:05.172 INFO:tasks.rados.rados.0.trial187.stdout:2422: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:05.172 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:05.212 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:05.258 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1174137 2026-02-13T18:17:05.291 INFO:tasks.rados.rados.0.trial187.stdout:2420: done (2 left) 2026-02-13T18:17:05.291 INFO:tasks.rados.rados.0.trial187.stdout:2422: done (1 left) 2026-02-13T18:17:05.291 INFO:tasks.rados.rados.0.trial187.stdout:2423: done (0 left) 2026-02-13T18:17:05.291 INFO:tasks.rados.rados.0.trial187.stdout:2424: rollback oid 2 current snap is 271 2026-02-13T18:17:05.291 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 268 2026-02-13T18:17:05.291 INFO:tasks.rados.rados.0.trial187.stdout:2425: delete oid 17 current snap is 271 2026-02-13T18:17:05.292 INFO:tasks.rados.rados.0.trial187.stdout:2425: done (1 left) 2026-02-13T18:17:05.292 INFO:tasks.rados.rados.0.trial187.stdout:2426: rollback oid 8 current snap is 271 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 269 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2427: rollback oid 29 current snap is 271 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 261 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2428: read oid 10 snap -1 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2428: expect deleted 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2429: read oid 32 snap -1 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2429: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2430: write (excl) oid 36 current snap is 271 2026-02-13T18:17:05.293 INFO:tasks.rados.rados.0.trial187.stdout:2430: seq_num 805 ranges {729635=792510,1973534=578947,3240215=289420} 2026-02-13T18:17:05.299 INFO:tasks.rados.rados.0.trial187.stdout:2430: writing trial18717860-36 from 729635 to 1522145 tid 1 2026-02-13T18:17:05.303 INFO:tasks.rados.rados.0.trial187.stdout:2430: writing trial18717860-36 from 1973534 to 2552481 tid 2 2026-02-13T18:17:05.307 INFO:tasks.rados.rados.0.trial187.stdout:2430: writing trial18717860-36 from 3240215 to 3529635 tid 3 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2431: snap_create 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2424: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2427: finishing rollback tid 0 to trial18717860-29 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2427: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2424: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2424: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 800 (ObjNum 619 snap 212 seq_num 619) dirty exists 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2427: finishing rollback tid 2 to trial18717860-29 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1016 (ObjNum 724 snap 256 seq_num 724) dirty exists 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2426: finishing rollback tid 0 to trial18717860-8 2026-02-13T18:17:05.308 INFO:tasks.rados.rados.0.trial187.stdout:2426: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:17:05.309 INFO:tasks.rados.rados.0.trial187.stdout:2426: finishing rollback tid 2 to trial18717860-8 2026-02-13T18:17:05.309 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 1018 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:17:05.309 INFO:tasks.rados.rados.0.trial187.stdout:2429: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:05.311 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1047026 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: finishing write tid 1 to trial18717860-36 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: finishing write tid 2 to trial18717860-36 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: finishing write tid 3 to trial18717860-36 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: finishing write tid 4 to trial18717860-36 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: finishing write tid 5 to trial18717860-36 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: oid 36 updating version 0 to 1024 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: oid 36 updating version 1024 to 1025 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: oid 36 updating version 1025 to 1026 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: oid 36 updating version 1026 to 1027 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1027 (ObjNum 805 snap 271 seq_num 805) dirty exists 2026-02-13T18:17:05.364 INFO:tasks.rados.rados.0.trial187.stdout:2430: left oid 36 (ObjNum 805 snap 271 seq_num 805) 2026-02-13T18:17:05.998 INFO:tasks.rados.rados.0.trial187.stdout:2424: done (6 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2426: done (5 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2427: done (4 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2428: done (3 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2429: done (2 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2430: done (1 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2431: done (0 left) 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2432: read oid 29 snap -1 2026-02-13T18:17:05.999 INFO:tasks.rados.rados.0.trial187.stdout:2432: expect (ObjNum 724 snap 256 seq_num 724) 2026-02-13T18:17:06.000 INFO:tasks.rados.rados.0.trial187.stdout:2433: read oid 18 snap -1 2026-02-13T18:17:06.000 INFO:tasks.rados.rados.0.trial187.stdout:2433: expect deleted 2026-02-13T18:17:06.000 INFO:tasks.rados.rados.0.trial187.stdout:2434: snap_create 2026-02-13T18:17:06.002 INFO:tasks.rados.rados.0.trial187.stdout:2432: expect (ObjNum 724 snap 256 seq_num 724) 2026-02-13T18:17:06.876 INFO:tasks.rados.rados.0.trial187.stdout:2432: done (2 left) 2026-02-13T18:17:06.876 INFO:tasks.rados.rados.0.trial187.stdout:2433: done (1 left) 2026-02-13T18:17:06.876 INFO:tasks.rados.rados.0.trial187.stdout:2434: done (0 left) 2026-02-13T18:17:06.876 INFO:tasks.rados.rados.0.trial187.stdout:2435: read oid 17 snap -1 2026-02-13T18:17:06.876 INFO:tasks.rados.rados.0.trial187.stdout:2435: expect deleted 2026-02-13T18:17:06.877 INFO:tasks.rados.rados.0.trial187.stdout:2436: delete oid 3 current snap is 273 2026-02-13T18:17:06.883 INFO:tasks.rados.rados.0.trial187.stdout:2435: done (1 left) 2026-02-13T18:17:06.883 INFO:tasks.rados.rados.0.trial187.stdout:2436: done (0 left) 2026-02-13T18:17:06.883 INFO:tasks.rados.rados.0.trial187.stdout:2437: read oid 6 snap -1 2026-02-13T18:17:06.883 INFO:tasks.rados.rados.0.trial187.stdout:2437: expect (ObjNum 795 snap 269 seq_num 795) 2026-02-13T18:17:06.883 INFO:tasks.rados.rados.0.trial187.stdout:2438: delete oid 37 current snap is 273 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:2438: done (1 left) 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:2439: copy_from oid 21 from oid 38 current snap is 273 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:2440: read oid 11 snap 261 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:2440: expect (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:2441: rollback oid 5 current snap is 273 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 270 2026-02-13T18:17:06.886 INFO:tasks.rados.rados.0.trial187.stdout:2442: snap_create 2026-02-13T18:17:06.888 INFO:tasks.rados.rados.0.trial187.stdout:2441: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:17:06.888 INFO:tasks.rados.rados.0.trial187.stdout:2441: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:17:06.888 INFO:tasks.rados.rados.0.trial187.stdout:2441: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:17:06.888 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1015 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:17:06.890 INFO:tasks.rados.rados.0.trial187.stdout:2437: expect (ObjNum 795 snap 269 seq_num 795) 2026-02-13T18:17:06.991 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 693107 2026-02-13T18:17:07.028 INFO:tasks.rados.rados.0.trial187.stdout:2440: expect (ObjNum 726 snap 256 seq_num 726) 2026-02-13T18:17:07.061 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:07.094 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:07.128 INFO:tasks.rados.rados.0.trial187.stdout:2439: finishing copy_from racing read to trial18717860-21 2026-02-13T18:17:07.128 INFO:tasks.rados.rados.0.trial187.stdout:2439: finishing copy_from to trial18717860-21 2026-02-13T18:17:07.128 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1051 (ObjNum 786 snap 268 seq_num 786) dirty exists 2026-02-13T18:17:07.879 INFO:tasks.rados.rados.0.trial187.stdout:2437: done (4 left) 2026-02-13T18:17:07.879 INFO:tasks.rados.rados.0.trial187.stdout:2439: done (3 left) 2026-02-13T18:17:07.879 INFO:tasks.rados.rados.0.trial187.stdout:2440: done (2 left) 2026-02-13T18:17:07.879 INFO:tasks.rados.rados.0.trial187.stdout:2441: done (1 left) 2026-02-13T18:17:07.880 INFO:tasks.rados.rados.0.trial187.stdout:2442: done (0 left) 2026-02-13T18:17:07.880 INFO:tasks.rados.rados.0.trial187.stdout:2443: write (excl) oid 4 current snap is 274 2026-02-13T18:17:07.880 INFO:tasks.rados.rados.0.trial187.stdout:2443: seq_num 808 ranges {780056=734610,2148980=726274,3322484=257572} 2026-02-13T18:17:07.889 INFO:tasks.rados.rados.0.trial187.stdout:2443: writing trial18717860-4 from 780056 to 1514666 tid 1 2026-02-13T18:17:07.898 INFO:tasks.rados.rados.0.trial187.stdout:2443: writing trial18717860-4 from 2148980 to 2875254 tid 2 2026-02-13T18:17:07.903 INFO:tasks.rados.rados.0.trial187.stdout:2443: writing trial18717860-4 from 3322484 to 3580056 tid 3 2026-02-13T18:17:07.903 INFO:tasks.rados.rados.0.trial187.stdout:2444: read oid 17 snap -1 2026-02-13T18:17:07.904 INFO:tasks.rados.rados.0.trial187.stdout:2444: expect deleted 2026-02-13T18:17:07.904 INFO:tasks.rados.rados.0.trial187.stdout:2445: snap_create 2026-02-13T18:17:07.904 INFO:tasks.rados.rados.0.trial187.stdout:2443: finishing write tid 1 to trial18717860-4 2026-02-13T18:17:07.904 INFO:tasks.rados.rados.0.trial187.stdout:2443: finishing write tid 2 to trial18717860-4 2026-02-13T18:17:07.905 INFO:tasks.rados.rados.0.trial187.stdout:2443: finishing write tid 3 to trial18717860-4 2026-02-13T18:17:07.905 INFO:tasks.rados.rados.0.trial187.stdout:2443: finishing write tid 4 to trial18717860-4 2026-02-13T18:17:07.905 INFO:tasks.rados.rados.0.trial187.stdout:2443: finishing write tid 5 to trial18717860-4 2026-02-13T18:17:07.905 INFO:tasks.rados.rados.0.trial187.stdout:2443: oid 4 updating version 0 to 1014 2026-02-13T18:17:07.906 INFO:tasks.rados.rados.0.trial187.stdout:2443: oid 4 updating version 1014 to 1016 2026-02-13T18:17:07.906 INFO:tasks.rados.rados.0.trial187.stdout:2443: oid 4 version 1016 is already newer than 1015 2026-02-13T18:17:07.906 INFO:tasks.rados.rados.0.trial187.stdout:2443: oid 4 version 1016 is already newer than 1013 2026-02-13T18:17:07.906 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1016 (ObjNum 808 snap 274 seq_num 808) dirty exists 2026-02-13T18:17:07.906 INFO:tasks.rados.rados.0.trial187.stdout:2443: left oid 4 (ObjNum 808 snap 274 seq_num 808) 2026-02-13T18:17:08.882 INFO:tasks.rados.rados.0.trial187.stdout:2443: done (2 left) 2026-02-13T18:17:08.883 INFO:tasks.rados.rados.0.trial187.stdout:2444: done (1 left) 2026-02-13T18:17:08.883 INFO:tasks.rados.rados.0.trial187.stdout:2445: done (0 left) 2026-02-13T18:17:08.883 INFO:tasks.rados.rados.0.trial187.stdout:2446: write (excl) oid 35 current snap is 275 2026-02-13T18:17:08.883 INFO:tasks.rados.rados.0.trial187.stdout:2446: seq_num 809 ranges {796863=409859,1807462=586285,3066260=530603} 2026-02-13T18:17:08.890 INFO:tasks.rados.rados.0.trial187.stdout:2446: writing trial18717860-35 from 796863 to 1206722 tid 1 2026-02-13T18:17:08.898 INFO:tasks.rados.rados.0.trial187.stdout:2446: writing trial18717860-35 from 1807462 to 2393747 tid 2 2026-02-13T18:17:08.907 INFO:tasks.rados.rados.0.trial187.stdout:2446: writing trial18717860-35 from 3066260 to 3596863 tid 3 2026-02-13T18:17:08.907 INFO:tasks.rados.rados.0.trial187.stdout:2447: read oid 45 snap 272 2026-02-13T18:17:08.907 INFO:tasks.rados.rados.0.trial187.stdout:2447: expect (ObjNum 799 snap 269 seq_num 799) 2026-02-13T18:17:08.908 INFO:tasks.rados.rados.0.trial187.stdout:2448: copy_from oid 42 from oid 18 current snap is 275 2026-02-13T18:17:08.908 INFO:tasks.rados.rados.0.trial187.stdout:2446: finishing write tid 1 to trial18717860-35 2026-02-13T18:17:08.908 INFO:tasks.rados.rados.0.trial187.stdout:2446: finishing write tid 2 to trial18717860-35 2026-02-13T18:17:08.908 INFO:tasks.rados.rados.0.trial187.stdout:2449: delete oid 44 current snap is 275 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2449: done (3 left) 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2450: read oid 44 snap -1 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2450: expect deleted 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2451: delete oid 9 current snap is 275 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2448: finishing copy_from to trial18717860-42 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2448: got expected ENOENT (src dne) 2026-02-13T18:17:08.910 INFO:tasks.rados.rados.0.trial187.stdout:2448: finishing copy_from racing read to trial18717860-42 2026-02-13T18:17:08.911 INFO:tasks.rados.rados.0.trial187.stdout:2446: finishing write tid 3 to trial18717860-35 2026-02-13T18:17:08.911 INFO:tasks.rados.rados.0.trial187.stdout:2446: finishing write tid 4 to trial18717860-35 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:2446: finishing write tid 5 to trial18717860-35 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:2446: oid 35 updating version 0 to 1053 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:2446: oid 35 updating version 1053 to 1054 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:2446: oid 35 updating version 1054 to 1055 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:2446: oid 35 version 1055 is already newer than 1052 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1055 (ObjNum 809 snap 275 seq_num 809) dirty exists 2026-02-13T18:17:08.912 INFO:tasks.rados.rados.0.trial187.stdout:2446: left oid 35 (ObjNum 809 snap 275 seq_num 809) 2026-02-13T18:17:08.913 INFO:tasks.rados.rados.0.trial187.stdout:2447: expect (ObjNum 799 snap 269 seq_num 799) 2026-02-13T18:17:08.994 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:09.115 INFO:tasks.rados.rados.0.trial187.stdout:2446: done (4 left) 2026-02-13T18:17:09.115 INFO:tasks.rados.rados.0.trial187.stdout:2447: done (3 left) 2026-02-13T18:17:09.115 INFO:tasks.rados.rados.0.trial187.stdout:2448: done (2 left) 2026-02-13T18:17:09.115 INFO:tasks.rados.rados.0.trial187.stdout:2450: done (1 left) 2026-02-13T18:17:09.116 INFO:tasks.rados.rados.0.trial187.stdout:2451: done (0 left) 2026-02-13T18:17:09.116 INFO:tasks.rados.rados.0.trial187.stdout:2452: delete oid 29 current snap is 275 2026-02-13T18:17:09.117 INFO:tasks.rados.rados.0.trial187.stdout:2452: done (0 left) 2026-02-13T18:17:09.117 INFO:tasks.rados.rados.0.trial187.stdout:2453: snap_remove snap 246 2026-02-13T18:17:09.886 INFO:tasks.rados.rados.0.trial187.stdout:2453: done (0 left) 2026-02-13T18:17:09.887 INFO:tasks.rados.rados.0.trial187.stdout:2454: write oid 39 current snap is 275 2026-02-13T18:17:09.887 INFO:tasks.rados.rados.0.trial187.stdout:2454: seq_num 813 ranges {464091=710855,1925037=477270,2943246=474970} 2026-02-13T18:17:09.894 INFO:tasks.rados.rados.0.trial187.stdout:2454: writing trial18717860-39 from 464091 to 1174946 tid 1 2026-02-13T18:17:09.903 INFO:tasks.rados.rados.0.trial187.stdout:2454: writing trial18717860-39 from 1925037 to 2402307 tid 2 2026-02-13T18:17:09.910 INFO:tasks.rados.rados.0.trial187.stdout:2454: writing trial18717860-39 from 2943246 to 3418216 tid 3 2026-02-13T18:17:09.910 INFO:tasks.rados.rados.0.trial187.stdout:2455: snap_remove snap 261 2026-02-13T18:17:10.888 INFO:tasks.rados.rados.0.trial187.stdout:2455: done (1 left) 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2456: read oid 7 snap -1 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2456: expect (ObjNum 761 snap 263 seq_num 761) 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2457: delete oid 46 current snap is 275 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: finishing write tid 1 to trial18717860-39 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: finishing write tid 2 to trial18717860-39 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: finishing write tid 3 to trial18717860-39 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: finishing write tid 4 to trial18717860-39 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: finishing write tid 5 to trial18717860-39 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: oid 39 updating version 0 to 1266 2026-02-13T18:17:10.889 INFO:tasks.rados.rados.0.trial187.stdout:2454: oid 39 version 1266 is already newer than 1261 2026-02-13T18:17:10.890 INFO:tasks.rados.rados.0.trial187.stdout:2454: oid 39 version 1266 is already newer than 1264 2026-02-13T18:17:10.890 INFO:tasks.rados.rados.0.trial187.stdout:2454: oid 39 version 1266 is already newer than 1265 2026-02-13T18:17:10.890 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1266 (ObjNum 813 snap 275 seq_num 813) dirty exists 2026-02-13T18:17:10.890 INFO:tasks.rados.rados.0.trial187.stdout:2454: left oid 39 (ObjNum 813 snap 275 seq_num 813) 2026-02-13T18:17:10.899 INFO:tasks.rados.rados.0.trial187.stdout:2456: expect (ObjNum 761 snap 263 seq_num 761) 2026-02-13T18:17:10.899 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:10.935 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:10.967 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1712772 2026-02-13T18:17:10.974 INFO:tasks.rados.rados.0.trial187.stdout:2454: done (2 left) 2026-02-13T18:17:10.974 INFO:tasks.rados.rados.0.trial187.stdout:2456: done (1 left) 2026-02-13T18:17:10.974 INFO:tasks.rados.rados.0.trial187.stdout:2457: done (0 left) 2026-02-13T18:17:10.975 INFO:tasks.rados.rados.0.trial187.stdout:2458: snap_remove snap 271 2026-02-13T18:17:11.877 INFO:tasks.rados.rados.0.trial187.stdout:2458: done (0 left) 2026-02-13T18:17:11.877 INFO:tasks.rados.rados.0.trial187.stdout:2459: snap_create 2026-02-13T18:17:12.878 INFO:tasks.rados.rados.0.trial187.stdout:2459: done (0 left) 2026-02-13T18:17:12.878 INFO:tasks.rados.rados.0.trial187.stdout:2460: snap_remove snap 212 2026-02-13T18:17:13.879 INFO:tasks.rados.rados.0.trial187.stdout:2460: done (0 left) 2026-02-13T18:17:13.879 INFO:tasks.rados.rados.0.trial187.stdout:2461: delete oid 13 current snap is 276 2026-02-13T18:17:13.882 INFO:tasks.rados.rados.0.trial187.stdout:2461: done (0 left) 2026-02-13T18:17:13.883 INFO:tasks.rados.rados.0.trial187.stdout:2462: snap_create 2026-02-13T18:17:14.883 INFO:tasks.rados.rados.0.trial187.stdout:2462: done (0 left) 2026-02-13T18:17:14.883 INFO:tasks.rados.rados.0.trial187.stdout:2463: read oid 31 snap -1 2026-02-13T18:17:14.883 INFO:tasks.rados.rados.0.trial187.stdout:2463: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:17:14.883 INFO:tasks.rados.rados.0.trial187.stdout:2464: copy_from oid 29 from oid 45 current snap is 277 2026-02-13T18:17:14.883 INFO:tasks.rados.rados.0.trial187.stdout:2465: write (excl) oid 48 current snap is 277 2026-02-13T18:17:14.884 INFO:tasks.rados.rados.0.trial187.stdout:2465: seq_num 816 ranges {514512=652955,1700483=740950,3025515=688997} 2026-02-13T18:17:14.890 INFO:tasks.rados.rados.0.trial187.stdout:2465: writing trial18717860-48 from 514512 to 1167467 tid 1 2026-02-13T18:17:14.899 INFO:tasks.rados.rados.0.trial187.stdout:2465: writing trial18717860-48 from 1700483 to 2441433 tid 2 2026-02-13T18:17:14.908 INFO:tasks.rados.rados.0.trial187.stdout:2465: writing trial18717860-48 from 3025515 to 3714512 tid 3 2026-02-13T18:17:14.908 INFO:tasks.rados.rados.0.trial187.stdout:2466: snap_remove snap 275 2026-02-13T18:17:15.886 INFO:tasks.rados.rados.0.trial187.stdout:2466: done (3 left) 2026-02-13T18:17:15.887 INFO:tasks.rados.rados.0.trial187.stdout:2467: write (excl) oid 13 current snap is 277 2026-02-13T18:17:15.887 INFO:tasks.rados.rados.0.trial187.stdout:2467: seq_num 817 ranges {531319=728204,1758965=484608,2652938=520058} 2026-02-13T18:17:15.894 INFO:tasks.rados.rados.0.trial187.stdout:2467: writing trial18717860-13 from 531319 to 1259523 tid 1 2026-02-13T18:17:15.901 INFO:tasks.rados.rados.0.trial187.stdout:2467: writing trial18717860-13 from 1758965 to 2243573 tid 2 2026-02-13T18:17:15.908 INFO:tasks.rados.rados.0.trial187.stdout:2467: writing trial18717860-13 from 2652938 to 3172996 tid 3 2026-02-13T18:17:15.908 INFO:tasks.rados.rados.0.trial187.stdout:2468: snap_create 2026-02-13T18:17:15.908 INFO:tasks.rados.rados.0.trial187.stdout:2463: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:17:16.043 INFO:tasks.rados.rados.0.trial187.stdout:2464: finishing copy_from racing read to trial18717860-29 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2464: finishing copy_from to trial18717860-29 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1012 (ObjNum 799 snap 269 seq_num 799) dirty exists 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: finishing write tid 1 to trial18717860-48 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: finishing write tid 2 to trial18717860-48 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: finishing write tid 3 to trial18717860-48 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: finishing write tid 4 to trial18717860-48 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: finishing write tid 5 to trial18717860-48 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: oid 48 updating version 0 to 1630 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: oid 48 updating version 1630 to 1632 2026-02-13T18:17:16.044 INFO:tasks.rados.rados.0.trial187.stdout:2465: oid 48 version 1632 is already newer than 1631 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2465: oid 48 version 1632 is already newer than 1629 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1632 (ObjNum 816 snap 277 seq_num 816) dirty exists 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2465: left oid 48 (ObjNum 816 snap 277 seq_num 816) 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: finishing write tid 1 to trial18717860-13 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: finishing write tid 2 to trial18717860-13 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: finishing write tid 3 to trial18717860-13 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: finishing write tid 4 to trial18717860-13 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: finishing write tid 5 to trial18717860-13 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: oid 13 updating version 0 to 821 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: oid 13 updating version 821 to 822 2026-02-13T18:17:16.045 INFO:tasks.rados.rados.0.trial187.stdout:2467: oid 13 version 822 is already newer than 820 2026-02-13T18:17:16.046 INFO:tasks.rados.rados.0.trial187.stdout:2467: oid 13 updating version 822 to 823 2026-02-13T18:17:16.046 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 823 (ObjNum 817 snap 277 seq_num 817) dirty exists 2026-02-13T18:17:16.046 INFO:tasks.rados.rados.0.trial187.stdout:2467: left oid 13 (ObjNum 817 snap 277 seq_num 817) 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2463: done (4 left) 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2464: done (3 left) 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2465: done (2 left) 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2467: done (1 left) 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2468: done (0 left) 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2469: write oid 13 current snap is 278 2026-02-13T18:17:16.878 INFO:tasks.rados.rados.0.trial187.stdout:2469: seq_num 818 ranges {548126=403453,1417447=744619,2680361=447683,3680450=67676} 2026-02-13T18:17:16.884 INFO:tasks.rados.rados.0.trial187.stdout:2469: writing trial18717860-13 from 548126 to 951579 tid 1 2026-02-13T18:17:16.889 INFO:tasks.rados.rados.0.trial187.stdout:2469: writing trial18717860-13 from 1417447 to 2162066 tid 2 2026-02-13T18:17:16.895 INFO:tasks.rados.rados.0.trial187.stdout:2469: writing trial18717860-13 from 2680361 to 3128044 tid 3 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2469: writing trial18717860-13 from 3680450 to 3748126 tid 4 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2470: read oid 24 snap -1 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2470: expect (ObjNum 794 snap 269 seq_num 794) 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2471: snap_create 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2469: finishing write tid 1 to trial18717860-13 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2469: finishing write tid 2 to trial18717860-13 2026-02-13T18:17:16.899 INFO:tasks.rados.rados.0.trial187.stdout:2469: finishing write tid 3 to trial18717860-13 2026-02-13T18:17:16.900 INFO:tasks.rados.rados.0.trial187.stdout:2469: finishing write tid 4 to trial18717860-13 2026-02-13T18:17:16.900 INFO:tasks.rados.rados.0.trial187.stdout:2469: finishing write tid 5 to trial18717860-13 2026-02-13T18:17:16.900 INFO:tasks.rados.rados.0.trial187.stdout:2469: finishing write tid 6 to trial18717860-13 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:2469: oid 13 updating version 0 to 826 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:2469: oid 13 version 826 is already newer than 825 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:2469: oid 13 updating version 826 to 827 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:2469: oid 13 updating version 827 to 829 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:2469: oid 13 version 829 is already newer than 828 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 829 (ObjNum 818 snap 278 seq_num 818) dirty exists 2026-02-13T18:17:16.901 INFO:tasks.rados.rados.0.trial187.stdout:2469: left oid 13 (ObjNum 818 snap 278 seq_num 818) 2026-02-13T18:17:16.908 INFO:tasks.rados.rados.0.trial187.stdout:2470: expect (ObjNum 794 snap 269 seq_num 794) 2026-02-13T18:17:16.908 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:17.888 INFO:tasks.rados.rados.0.trial187.stdout:2469: done (2 left) 2026-02-13T18:17:17.888 INFO:tasks.rados.rados.0.trial187.stdout:2470: done (1 left) 2026-02-13T18:17:17.888 INFO:tasks.rados.rados.0.trial187.stdout:2471: done (0 left) 2026-02-13T18:17:17.889 INFO:tasks.rados.rados.0.trial187.stdout:2472: delete oid 2 current snap is 279 2026-02-13T18:17:17.892 INFO:tasks.rados.rados.0.trial187.stdout:2472: done (0 left) 2026-02-13T18:17:17.892 INFO:tasks.rados.rados.0.trial187.stdout:2473: read oid 40 snap -1 2026-02-13T18:17:17.892 INFO:tasks.rados.rados.0.trial187.stdout:2473: expect deleted 2026-02-13T18:17:17.892 INFO:tasks.rados.rados.0.trial187.stdout:2474: snap_remove snap 270 2026-02-13T18:17:18.892 INFO:tasks.rados.rados.0.trial187.stdout:2474: done (1 left) 2026-02-13T18:17:18.892 INFO:tasks.rados.rados.0.trial187.stdout:2475: read oid 26 snap -1 2026-02-13T18:17:18.892 INFO:tasks.rados.rados.0.trial187.stdout:2475: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:17:18.892 INFO:tasks.rados.rados.0.trial187.stdout:2476: write (excl) oid 14 current snap is 279 2026-02-13T18:17:18.892 INFO:tasks.rados.rados.0.trial187.stdout:2476: seq_num 820 ranges {581740=553951,1818058=748288,3018854=470227} 2026-02-13T18:17:18.899 INFO:tasks.rados.rados.0.trial187.stdout:2476: writing trial18717860-14 from 581740 to 1135691 tid 1 2026-02-13T18:17:18.909 INFO:tasks.rados.rados.0.trial187.stdout:2476: writing trial18717860-14 from 1818058 to 2566346 tid 2 2026-02-13T18:17:18.915 INFO:tasks.rados.rados.0.trial187.stdout:2476: writing trial18717860-14 from 3018854 to 3489081 tid 3 2026-02-13T18:17:18.915 INFO:tasks.rados.rados.0.trial187.stdout:2477: write oid 50 current snap is 279 2026-02-13T18:17:18.915 INFO:tasks.rados.rados.0.trial187.stdout:2477: seq_num 821 ranges {598547=629200,1876540=491946,3046277=681499} 2026-02-13T18:17:18.923 INFO:tasks.rados.rados.0.trial187.stdout:2477: writing trial18717860-50 from 598547 to 1227747 tid 1 2026-02-13T18:17:18.931 INFO:tasks.rados.rados.0.trial187.stdout:2477: writing trial18717860-50 from 1876540 to 2368486 tid 2 2026-02-13T18:17:18.939 INFO:tasks.rados.rados.0.trial187.stdout:2477: writing trial18717860-50 from 3046277 to 3727776 tid 3 2026-02-13T18:17:18.939 INFO:tasks.rados.rados.0.trial187.stdout:2478: rollback oid 18 current snap is 279 2026-02-13T18:17:18.939 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 255 2026-02-13T18:17:18.939 INFO:tasks.rados.rados.0.trial187.stdout:2475: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:17:18.973 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 996192 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: finishing write tid 1 to trial18717860-14 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: finishing write tid 2 to trial18717860-14 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: finishing write tid 3 to trial18717860-14 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: finishing write tid 4 to trial18717860-14 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: finishing write tid 5 to trial18717860-14 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: oid 14 updating version 0 to 1031 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: oid 14 version 1031 is already newer than 1028 2026-02-13T18:17:19.010 INFO:tasks.rados.rados.0.trial187.stdout:2476: oid 14 version 1031 is already newer than 1030 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2476: oid 14 version 1031 is already newer than 1029 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1031 (ObjNum 820 snap 279 seq_num 820) dirty exists 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2476: left oid 14 (ObjNum 820 snap 279 seq_num 820) 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2477: finishing write tid 1 to trial18717860-50 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2477: finishing write tid 2 to trial18717860-50 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2478: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2478: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 837 (ObjNum 585 snap 200 seq_num 585) dirty exists 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2477: finishing write tid 3 to trial18717860-50 2026-02-13T18:17:19.011 INFO:tasks.rados.rados.0.trial187.stdout:2477: finishing write tid 4 to trial18717860-50 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2477: finishing write tid 5 to trial18717860-50 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2477: oid 50 updating version 0 to 1016 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2477: oid 50 updating version 1016 to 1019 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2477: oid 50 version 1019 is already newer than 1017 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2477: oid 50 version 1019 is already newer than 1018 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1019 (ObjNum 821 snap 279 seq_num 821) dirty exists 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2477: left oid 50 (ObjNum 821 snap 279 seq_num 821) 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2473: done (4 left) 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2475: done (3 left) 2026-02-13T18:17:19.012 INFO:tasks.rados.rados.0.trial187.stdout:2476: done (2 left) 2026-02-13T18:17:19.013 INFO:tasks.rados.rados.0.trial187.stdout:2477: done (1 left) 2026-02-13T18:17:19.013 INFO:tasks.rados.rados.0.trial187.stdout:2478: done (0 left) 2026-02-13T18:17:19.013 INFO:tasks.rados.rados.0.trial187.stdout:2479: write (excl) oid 33 current snap is 279 2026-02-13T18:17:19.013 INFO:tasks.rados.rados.0.trial187.stdout:2479: seq_num 822 ranges {615354=420802,1651375=751957,3190053=492771} 2026-02-13T18:17:19.014 INFO:tasks.rados.rados.0.trial187.stdout:2479: writing trial18717860-33 from 615354 to 1036156 tid 1 2026-02-13T18:17:19.024 INFO:tasks.rados.rados.0.trial187.stdout:2479: writing trial18717860-33 from 1651375 to 2403332 tid 2 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2479: writing trial18717860-33 from 3190053 to 3682824 tid 3 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2480: read oid 24 snap 264 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2480: expect (ObjNum 712 snap 250 seq_num 712) 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2481: read oid 28 snap -1 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2481: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2482: read oid 20 snap -1 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2482: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2483: write oid 15 current snap is 279 2026-02-13T18:17:19.033 INFO:tasks.rados.rados.0.trial187.stdout:2483: seq_num 823 ranges {632161=496051,1593504=495615,2701123=420396,3611645=220516} 2026-02-13T18:17:19.040 INFO:tasks.rados.rados.0.trial187.stdout:2483: writing trial18717860-15 from 632161 to 1128212 tid 1 2026-02-13T18:17:19.047 INFO:tasks.rados.rados.0.trial187.stdout:2483: writing trial18717860-15 from 1593504 to 2089119 tid 2 2026-02-13T18:17:19.051 INFO:tasks.rados.rados.0.trial187.stdout:2483: writing trial18717860-15 from 2701123 to 3121519 tid 3 2026-02-13T18:17:19.054 INFO:tasks.rados.rados.0.trial187.stdout:2483: writing trial18717860-15 from 3611645 to 3832161 tid 4 2026-02-13T18:17:19.054 INFO:tasks.rados.rados.0.trial187.stdout:2484: write oid 47 current snap is 279 2026-02-13T18:17:19.054 INFO:tasks.rados.rados.0.trial187.stdout:2484: seq_num 824 ranges {648968=571300,1651986=639273,2728546=631668} 2026-02-13T18:17:19.058 INFO:tasks.rados.rados.0.trial187.stdout:2484: writing trial18717860-47 from 648968 to 1220268 tid 1 2026-02-13T18:17:19.063 INFO:tasks.rados.rados.0.trial187.stdout:2484: writing trial18717860-47 from 1651986 to 2291259 tid 2 2026-02-13T18:17:19.067 INFO:tasks.rados.rados.0.trial187.stdout:2484: writing trial18717860-47 from 2728546 to 3360214 tid 3 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2485: snap_create 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: finishing write tid 1 to trial18717860-33 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: finishing write tid 2 to trial18717860-33 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: finishing write tid 3 to trial18717860-33 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: finishing write tid 4 to trial18717860-33 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: finishing write tid 5 to trial18717860-33 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: oid 33 updating version 0 to 1648 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: oid 33 version 1648 is already newer than 1646 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: oid 33 version 1648 is already newer than 1647 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:2479: oid 33 version 1648 is already newer than 1645 2026-02-13T18:17:19.068 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1648 (ObjNum 822 snap 279 seq_num 822) dirty exists 2026-02-13T18:17:19.069 INFO:tasks.rados.rados.0.trial187.stdout:2479: left oid 33 (ObjNum 822 snap 279 seq_num 822) 2026-02-13T18:17:19.069 INFO:tasks.rados.rados.0.trial187.stdout:2482: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:17:19.069 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 264606 2026-02-13T18:17:19.131 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:19.226 INFO:tasks.rados.rados.0.trial187.stdout:2483: finishing write tid 1 to trial18717860-15 2026-02-13T18:17:19.226 INFO:tasks.rados.rados.0.trial187.stdout:2480: expect (ObjNum 712 snap 250 seq_num 712) 2026-02-13T18:17:19.249 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2623691 2026-02-13T18:17:19.270 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:19.367 INFO:tasks.rados.rados.0.trial187.stdout:2481: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:17:19.368 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:19.463 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:19.511 INFO:tasks.rados.rados.0.trial187.stdout:2483: finishing write tid 2 to trial18717860-15 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: finishing write tid 3 to trial18717860-15 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: finishing write tid 4 to trial18717860-15 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: finishing write tid 5 to trial18717860-15 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: finishing write tid 6 to trial18717860-15 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: oid 15 updating version 0 to 1019 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: oid 15 version 1019 is already newer than 1018 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: oid 15 updating version 1019 to 1022 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: oid 15 version 1022 is already newer than 1021 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:2483: oid 15 version 1022 is already newer than 1020 2026-02-13T18:17:19.512 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1022 (ObjNum 823 snap 279 seq_num 823) dirty exists 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2483: left oid 15 (ObjNum 823 snap 279 seq_num 823) 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: finishing write tid 1 to trial18717860-47 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: finishing write tid 2 to trial18717860-47 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: finishing write tid 3 to trial18717860-47 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: finishing write tid 4 to trial18717860-47 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: finishing write tid 5 to trial18717860-47 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: oid 47 updating version 0 to 1392 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: oid 47 updating version 1392 to 1394 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: oid 47 updating version 1394 to 1395 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: oid 47 version 1395 is already newer than 1393 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1395 (ObjNum 824 snap 279 seq_num 824) dirty exists 2026-02-13T18:17:19.513 INFO:tasks.rados.rados.0.trial187.stdout:2484: left oid 47 (ObjNum 824 snap 279 seq_num 824) 2026-02-13T18:17:19.897 INFO:tasks.rados.rados.0.trial187.stdout:2479: done (6 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2480: done (5 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2481: done (4 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2482: done (3 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2483: done (2 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2484: done (1 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2485: done (0 left) 2026-02-13T18:17:19.898 INFO:tasks.rados.rados.0.trial187.stdout:2486: delete oid 38 current snap is 280 2026-02-13T18:17:19.900 INFO:tasks.rados.rados.0.trial187.stdout:2486: done (0 left) 2026-02-13T18:17:19.901 INFO:tasks.rados.rados.0.trial187.stdout:2487: rollback oid 50 current snap is 280 2026-02-13T18:17:19.901 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 257 2026-02-13T18:17:19.901 INFO:tasks.rados.rados.0.trial187.stdout:2488: write oid 12 current snap is 280 2026-02-13T18:17:19.901 INFO:tasks.rados.rados.0.trial187.stdout:2488: seq_num 826 ranges {682582=721798,2168950=642942,3583392=299190} 2026-02-13T18:17:19.906 INFO:tasks.rados.rados.0.trial187.stdout:2488: writing trial18717860-12 from 682582 to 1404380 tid 1 2026-02-13T18:17:19.912 INFO:tasks.rados.rados.0.trial187.stdout:2488: writing trial18717860-12 from 2168950 to 2811892 tid 2 2026-02-13T18:17:19.916 INFO:tasks.rados.rados.0.trial187.stdout:2488: writing trial18717860-12 from 3583392 to 3882582 tid 3 2026-02-13T18:17:19.916 INFO:tasks.rados.rados.0.trial187.stdout:2489: read oid 46 snap -1 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:2489: expect deleted 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:2490: delete oid 29 current snap is 280 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:2487: finishing rollback tid 0 to trial18717860-50 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:2487: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1021 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:2488: finishing write tid 1 to trial18717860-12 2026-02-13T18:17:19.917 INFO:tasks.rados.rados.0.trial187.stdout:2488: finishing write tid 2 to trial18717860-12 2026-02-13T18:17:19.918 INFO:tasks.rados.rados.0.trial187.stdout:2488: finishing write tid 3 to trial18717860-12 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: finishing write tid 4 to trial18717860-12 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: finishing write tid 5 to trial18717860-12 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: oid 12 updating version 0 to 991 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: oid 12 updating version 991 to 992 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: oid 12 version 992 is already newer than 990 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: oid 12 version 992 is already newer than 989 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 992 (ObjNum 826 snap 280 seq_num 826) dirty exists 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: left oid 12 (ObjNum 826 snap 280 seq_num 826) 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2487: done (3 left) 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2488: done (2 left) 2026-02-13T18:17:19.919 INFO:tasks.rados.rados.0.trial187.stdout:2489: done (1 left) 2026-02-13T18:17:19.920 INFO:tasks.rados.rados.0.trial187.stdout:2490: done (0 left) 2026-02-13T18:17:19.920 INFO:tasks.rados.rados.0.trial187.stdout:2491: read oid 20 snap -1 2026-02-13T18:17:19.920 INFO:tasks.rados.rados.0.trial187.stdout:2491: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:17:19.920 INFO:tasks.rados.rados.0.trial187.stdout:2492: write oid 34 current snap is 280 2026-02-13T18:17:19.920 INFO:tasks.rados.rados.0.trial187.stdout:2492: seq_num 828 ranges {716196=472296,1769561=646611,3121885=793109} 2026-02-13T18:17:19.926 INFO:tasks.rados.rados.0.trial187.stdout:2492: writing trial18717860-34 from 716196 to 1188492 tid 1 2026-02-13T18:17:19.934 INFO:tasks.rados.rados.0.trial187.stdout:2492: writing trial18717860-34 from 1769561 to 2416172 tid 2 2026-02-13T18:17:19.943 INFO:tasks.rados.rados.0.trial187.stdout:2492: writing trial18717860-34 from 3121885 to 3914994 tid 3 2026-02-13T18:17:19.944 INFO:tasks.rados.rados.0.trial187.stdout:2493: delete oid 45 current snap is 280 2026-02-13T18:17:19.944 INFO:tasks.rados.rados.0.trial187.stdout:2491: expect (ObjNum 735 snap 257 seq_num 735) 2026-02-13T18:17:19.944 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:20.010 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:20.106 INFO:tasks.rados.rados.0.trial187.stdout:2492: finishing write tid 1 to trial18717860-34 2026-02-13T18:17:20.106 INFO:tasks.rados.rados.0.trial187.stdout:2492: finishing write tid 2 to trial18717860-34 2026-02-13T18:17:20.106 INFO:tasks.rados.rados.0.trial187.stdout:2492: finishing write tid 3 to trial18717860-34 2026-02-13T18:17:20.106 INFO:tasks.rados.rados.0.trial187.stdout:2492: finishing write tid 4 to trial18717860-34 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: finishing write tid 5 to trial18717860-34 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: oid 34 updating version 0 to 1025 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: oid 34 version 1025 is already newer than 1024 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: oid 34 updating version 1025 to 1026 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: oid 34 updating version 1026 to 1027 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1027 (ObjNum 828 snap 280 seq_num 828) dirty exists 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: left oid 34 (ObjNum 828 snap 280 seq_num 828) 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2491: done (2 left) 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2492: done (1 left) 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2493: done (0 left) 2026-02-13T18:17:20.107 INFO:tasks.rados.rados.0.trial187.stdout:2494: write (excl) oid 36 current snap is 280 2026-02-13T18:17:20.108 INFO:tasks.rados.rados.0.trial187.stdout:2494: seq_num 830 ranges {749810=739147,2002878=650280,3293084=415653} 2026-02-13T18:17:20.114 INFO:tasks.rados.rados.0.trial187.stdout:2494: writing trial18717860-36 from 749810 to 1488957 tid 1 2026-02-13T18:17:20.122 INFO:tasks.rados.rados.0.trial187.stdout:2494: writing trial18717860-36 from 2002878 to 2653158 tid 2 2026-02-13T18:17:20.130 INFO:tasks.rados.rados.0.trial187.stdout:2494: writing trial18717860-36 from 3293084 to 3708737 tid 3 2026-02-13T18:17:20.130 INFO:tasks.rados.rados.0.trial187.stdout:2495: delete oid 6 current snap is 280 2026-02-13T18:17:20.130 INFO:tasks.rados.rados.0.trial187.stdout:2494: finishing write tid 1 to trial18717860-36 2026-02-13T18:17:20.130 INFO:tasks.rados.rados.0.trial187.stdout:2494: finishing write tid 2 to trial18717860-36 2026-02-13T18:17:20.132 INFO:tasks.rados.rados.0.trial187.stdout:2494: finishing write tid 3 to trial18717860-36 2026-02-13T18:17:20.132 INFO:tasks.rados.rados.0.trial187.stdout:2494: finishing write tid 4 to trial18717860-36 2026-02-13T18:17:20.132 INFO:tasks.rados.rados.0.trial187.stdout:2494: finishing write tid 5 to trial18717860-36 2026-02-13T18:17:20.132 INFO:tasks.rados.rados.0.trial187.stdout:2494: oid 36 updating version 0 to 1032 2026-02-13T18:17:20.132 INFO:tasks.rados.rados.0.trial187.stdout:2494: oid 36 updating version 1032 to 1035 2026-02-13T18:17:20.132 INFO:tasks.rados.rados.0.trial187.stdout:2494: oid 36 version 1035 is already newer than 1034 2026-02-13T18:17:20.133 INFO:tasks.rados.rados.0.trial187.stdout:2494: oid 36 version 1035 is already newer than 1033 2026-02-13T18:17:20.133 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1035 (ObjNum 830 snap 280 seq_num 830) dirty exists 2026-02-13T18:17:20.133 INFO:tasks.rados.rados.0.trial187.stdout:2494: left oid 36 (ObjNum 830 snap 280 seq_num 830) 2026-02-13T18:17:20.133 INFO:tasks.rados.rados.0.trial187.stdout:2494: done (1 left) 2026-02-13T18:17:20.133 INFO:tasks.rados.rados.0.trial187.stdout:2495: done (0 left) 2026-02-13T18:17:20.133 INFO:tasks.rados.rados.0.trial187.stdout:2496: delete oid 45 current snap is 280 2026-02-13T18:17:20.134 INFO:tasks.rados.rados.0.trial187.stdout:2496: done (0 left) 2026-02-13T18:17:20.134 INFO:tasks.rados.rados.0.trial187.stdout:2497: read oid 50 snap 273 2026-02-13T18:17:20.134 INFO:tasks.rados.rados.0.trial187.stdout:2497: expect (ObjNum 783 snap 268 seq_num 783) 2026-02-13T18:17:20.134 INFO:tasks.rados.rados.0.trial187.stdout:2498: write (excl) oid 20 current snap is 280 2026-02-13T18:17:20.134 INFO:tasks.rados.rados.0.trial187.stdout:2498: seq_num 833 ranges {400231=564894,1661971=338260} 2026-02-13T18:17:20.141 INFO:tasks.rados.rados.0.trial187.stdout:2498: writing trial18717860-20 from 400231 to 965125 tid 1 2026-02-13T18:17:20.149 INFO:tasks.rados.rados.0.trial187.stdout:2498: writing trial18717860-20 from 1661971 to 2000231 tid 2 2026-02-13T18:17:20.149 INFO:tasks.rados.rados.0.trial187.stdout:2499: delete oid 38 current snap is 280 2026-02-13T18:17:20.149 INFO:tasks.rados.rados.0.trial187.stdout:2497: expect (ObjNum 783 snap 268 seq_num 783) 2026-02-13T18:17:20.149 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:20.222 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2810256 2026-02-13T18:17:20.228 INFO:tasks.rados.rados.0.trial187.stdout:2498: finishing write tid 1 to trial18717860-20 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: finishing write tid 2 to trial18717860-20 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: finishing write tid 3 to trial18717860-20 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: finishing write tid 4 to trial18717860-20 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: oid 20 updating version 0 to 1397 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: oid 20 version 1397 is already newer than 1396 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: oid 20 updating version 1397 to 1398 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1398 (ObjNum 833 snap 280 seq_num 833) dirty exists 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: left oid 20 (ObjNum 833 snap 280 seq_num 833) 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2497: done (2 left) 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2498: done (1 left) 2026-02-13T18:17:20.229 INFO:tasks.rados.rados.0.trial187.stdout:2499: done (0 left) 2026-02-13T18:17:20.230 INFO:tasks.rados.rados.0.trial187.stdout:2500: write (excl) oid 36 current snap is 280 2026-02-13T18:17:20.230 INFO:tasks.rados.rados.0.trial187.stdout:2500: seq_num 835 ranges {433845=715392,1662582=371263} 2026-02-13T18:17:20.236 INFO:tasks.rados.rados.0.trial187.stdout:2500: writing trial18717860-36 from 433845 to 1149237 tid 1 2026-02-13T18:17:20.243 INFO:tasks.rados.rados.0.trial187.stdout:2500: writing trial18717860-36 from 1662582 to 2033845 tid 2 2026-02-13T18:17:20.243 INFO:tasks.rados.rados.0.trial187.stdout:2501: copy_from oid 34 from oid 41 current snap is 280 2026-02-13T18:17:20.243 INFO:tasks.rados.rados.0.trial187.stdout:2500: finishing write tid 1 to trial18717860-36 2026-02-13T18:17:20.243 INFO:tasks.rados.rados.0.trial187.stdout:2502: delete oid 4 current snap is 280 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: finishing write tid 2 to trial18717860-36 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: finishing write tid 3 to trial18717860-36 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: finishing write tid 4 to trial18717860-36 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: oid 36 updating version 0 to 1038 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: oid 36 version 1038 is already newer than 1037 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: oid 36 version 1038 is already newer than 1036 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1038 (ObjNum 835 snap 280 seq_num 835) dirty exists 2026-02-13T18:17:20.245 INFO:tasks.rados.rados.0.trial187.stdout:2500: left oid 36 (ObjNum 835 snap 280 seq_num 835) 2026-02-13T18:17:20.246 INFO:tasks.rados.rados.0.trial187.stdout:2500: done (2 left) 2026-02-13T18:17:20.246 INFO:tasks.rados.rados.0.trial187.stdout:2502: done (1 left) 2026-02-13T18:17:20.246 INFO:tasks.rados.rados.0.trial187.stdout:2503: copy_from oid 35 from oid 43 current snap is 280 2026-02-13T18:17:20.247 INFO:tasks.rados.rados.0.trial187.stdout:2504: read oid 31 snap -1 2026-02-13T18:17:20.247 INFO:tasks.rados.rados.0.trial187.stdout:2504: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:17:20.247 INFO:tasks.rados.rados.0.trial187.stdout:2505: copy_from oid 21 from oid 5 current snap is 280 2026-02-13T18:17:20.247 INFO:tasks.rados.rados.0.trial187.stdout:2506: read oid 14 snap -1 2026-02-13T18:17:20.247 INFO:tasks.rados.rados.0.trial187.stdout:2506: expect (ObjNum 820 snap 279 seq_num 820) 2026-02-13T18:17:20.247 INFO:tasks.rados.rados.0.trial187.stdout:2507: snap_remove snap 268 2026-02-13T18:17:20.902 INFO:tasks.rados.rados.0.trial187.stdout:2507: done (5 left) 2026-02-13T18:17:20.902 INFO:tasks.rados.rados.0.trial187.stdout:2508: write (excl) oid 10 current snap is 280 2026-02-13T18:17:20.902 INFO:tasks.rados.rados.0.trial187.stdout:2508: seq_num 837 ranges {467459=582243,1495899=404945} 2026-02-13T18:17:20.908 INFO:tasks.rados.rados.0.trial187.stdout:2508: writing trial18717860-10 from 467459 to 1049702 tid 1 2026-02-13T18:17:20.915 INFO:tasks.rados.rados.0.trial187.stdout:2508: writing trial18717860-10 from 1495899 to 1900844 tid 2 2026-02-13T18:17:20.915 INFO:tasks.rados.rados.0.trial187.stdout:2509: read oid 1 snap 255 2026-02-13T18:17:20.915 INFO:tasks.rados.rados.0.trial187.stdout:2509: expect (ObjNum 696 snap 243 seq_num 696) 2026-02-13T18:17:20.915 INFO:tasks.rados.rados.0.trial187.stdout:2510: write oid 23 current snap is 280 2026-02-13T18:17:20.915 INFO:tasks.rados.rados.0.trial187.stdout:2510: seq_num 838 ranges {484266=657492,1554381=529885} 2026-02-13T18:17:20.922 INFO:tasks.rados.rados.0.trial187.stdout:2510: writing trial18717860-23 from 484266 to 1141758 tid 1 2026-02-13T18:17:20.929 INFO:tasks.rados.rados.0.trial187.stdout:2510: writing trial18717860-23 from 1554381 to 2084266 tid 2 2026-02-13T18:17:20.929 INFO:tasks.rados.rados.0.trial187.stdout:2511: rollback oid 20 current snap is 280 2026-02-13T18:17:20.929 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 265 2026-02-13T18:17:20.929 INFO:tasks.rados.rados.0.trial187.stdout:2506: expect (ObjNum 820 snap 279 seq_num 820) 2026-02-13T18:17:21.026 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3269717 2026-02-13T18:17:21.084 INFO:tasks.rados.rados.0.trial187.stdout:2504: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:17:21.105 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2592727 2026-02-13T18:17:21.159 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.203 INFO:tasks.rados.rados.0.trial187.stdout:2501: finishing copy_from racing read to trial18717860-34 2026-02-13T18:17:21.203 INFO:tasks.rados.rados.0.trial187.stdout:2501: finishing copy_from to trial18717860-34 2026-02-13T18:17:21.203 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1008 (ObjNum 756 snap 263 seq_num 756) dirty exists 2026-02-13T18:17:21.203 INFO:tasks.rados.rados.0.trial187.stdout:2503: finishing copy_from racing read to trial18717860-35 2026-02-13T18:17:21.203 INFO:tasks.rados.rados.0.trial187.stdout:2503: finishing copy_from to trial18717860-35 2026-02-13T18:17:21.203 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1590 (ObjNum 732 snap 256 seq_num 732) dirty exists 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2505: finishing copy_from racing read to trial18717860-21 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2505: finishing copy_from to trial18717860-21 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1015 (ObjNum 493 snap 147 seq_num 493) dirty exists 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2501: done (8 left) 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2503: done (7 left) 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2504: done (6 left) 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2505: done (5 left) 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2506: done (4 left) 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2512: rollback oid 40 current snap is 280 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 273 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2508: finishing write tid 1 to trial18717860-10 2026-02-13T18:17:21.204 INFO:tasks.rados.rados.0.trial187.stdout:2508: finishing write tid 2 to trial18717860-10 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2508: finishing write tid 3 to trial18717860-10 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2508: finishing write tid 4 to trial18717860-10 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2508: oid 10 updating version 0 to 994 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2508: oid 10 updating version 994 to 995 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2508: oid 10 version 995 is already newer than 993 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 995 (ObjNum 837 snap 280 seq_num 837) dirty exists 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2508: left oid 10 (ObjNum 837 snap 280 seq_num 837) 2026-02-13T18:17:21.205 INFO:tasks.rados.rados.0.trial187.stdout:2509: expect (ObjNum 696 snap 243 seq_num 696) 2026-02-13T18:17:21.226 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2610966 2026-02-13T18:17:21.237 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.264 INFO:tasks.rados.rados.0.trial187.stdout:2510: finishing write tid 1 to trial18717860-23 2026-02-13T18:17:21.264 INFO:tasks.rados.rados.0.trial187.stdout:2510: finishing write tid 2 to trial18717860-23 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2510: finishing write tid 3 to trial18717860-23 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2510: finishing write tid 4 to trial18717860-23 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2510: oid 23 updating version 0 to 1040 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2510: oid 23 updating version 1040 to 1041 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2510: oid 23 version 1041 is already newer than 1039 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1041 (ObjNum 838 snap 280 seq_num 838) dirty exists 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2510: left oid 23 (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2511: finishing rollback tid 0 to trial18717860-20 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2511: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2511: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1401 (ObjNum 723 snap 256 seq_num 723) dirty exists 2026-02-13T18:17:21.265 INFO:tasks.rados.rados.0.trial187.stdout:2512: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 0 (ObjNum 129 snap 0 seq_num 3012796544) dirty dne 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2508: done (4 left) 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2509: done (3 left) 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2510: done (2 left) 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2511: done (1 left) 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2512: done (0 left) 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2513: copy_from oid 44 from oid 16 current snap is 280 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2514: write (excl) oid 27 current snap is 280 2026-02-13T18:17:21.266 INFO:tasks.rados.rados.0.trial187.stdout:2514: seq_num 839 ranges {501073=732741,1896510=204563} 2026-02-13T18:17:21.273 INFO:tasks.rados.rados.0.trial187.stdout:2514: writing trial18717860-27 from 501073 to 1233814 tid 1 2026-02-13T18:17:21.279 INFO:tasks.rados.rados.0.trial187.stdout:2514: writing trial18717860-27 from 1896510 to 2101073 tid 2 2026-02-13T18:17:21.279 INFO:tasks.rados.rados.0.trial187.stdout:2515: read oid 24 snap -1 2026-02-13T18:17:21.279 INFO:tasks.rados.rados.0.trial187.stdout:2515: expect (ObjNum 794 snap 269 seq_num 794) 2026-02-13T18:17:21.279 INFO:tasks.rados.rados.0.trial187.stdout:2516: copy_from oid 17 from oid 26 current snap is 280 2026-02-13T18:17:21.280 INFO:tasks.rados.rados.0.trial187.stdout:2514: finishing write tid 1 to trial18717860-27 2026-02-13T18:17:21.280 INFO:tasks.rados.rados.0.trial187.stdout:2517: write oid 22 current snap is 280 2026-02-13T18:17:21.280 INFO:tasks.rados.rados.0.trial187.stdout:2517: seq_num 840 ranges {517880=407990,1554992=562888} 2026-02-13T18:17:21.285 INFO:tasks.rados.rados.0.trial187.stdout:2517: writing trial18717860-22 from 517880 to 925870 tid 1 2026-02-13T18:17:21.293 INFO:tasks.rados.rados.0.trial187.stdout:2517: writing trial18717860-22 from 1554992 to 2117880 tid 2 2026-02-13T18:17:21.294 INFO:tasks.rados.rados.0.trial187.stdout:2518: write oid 8 current snap is 280 2026-02-13T18:17:21.294 INFO:tasks.rados.rados.0.trial187.stdout:2518: seq_num 841 ranges {534687=483239,1613474=412283} 2026-02-13T18:17:21.300 INFO:tasks.rados.rados.0.trial187.stdout:2518: writing trial18717860-8 from 534687 to 1017926 tid 1 2026-02-13T18:17:21.308 INFO:tasks.rados.rados.0.trial187.stdout:2518: writing trial18717860-8 from 1613474 to 2025757 tid 2 2026-02-13T18:17:21.308 INFO:tasks.rados.rados.0.trial187.stdout:2519: read oid 41 snap 257 2026-02-13T18:17:21.308 INFO:tasks.rados.rados.0.trial187.stdout:2519: expect (ObjNum 668 snap 222 seq_num 668) 2026-02-13T18:17:21.308 INFO:tasks.rados.rados.0.trial187.stdout:2520: rollback oid 7 current snap is 280 2026-02-13T18:17:21.308 INFO:tasks.rados.rados.0.trial187.stdout:2513: finishing copy_from racing read to trial18717860-44 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2513: finishing copy_from to trial18717860-44 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1391 (ObjNum 792 snap 269 seq_num 792) dirty exists 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2516: finishing copy_from racing read to trial18717860-17 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2516: finishing copy_from to trial18717860-17 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1009 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2514: finishing write tid 2 to trial18717860-27 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2514: finishing write tid 3 to trial18717860-27 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2514: finishing write tid 4 to trial18717860-27 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2514: oid 27 updating version 0 to 1004 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2514: oid 27 updating version 1004 to 1005 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:2514: oid 27 version 1005 is already newer than 1003 2026-02-13T18:17:21.309 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1005 (ObjNum 839 snap 280 seq_num 839) dirty exists 2026-02-13T18:17:21.310 INFO:tasks.rados.rados.0.trial187.stdout:2514: left oid 27 (ObjNum 839 snap 280 seq_num 839) 2026-02-13T18:17:21.310 INFO:tasks.rados.rados.0.trial187.stdout:2515: expect (ObjNum 794 snap 269 seq_num 794) 2026-02-13T18:17:21.310 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.332 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.357 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.383 INFO:tasks.rados.rados.0.trial187.stdout:2517: finishing write tid 1 to trial18717860-22 2026-02-13T18:17:21.383 INFO:tasks.rados.rados.0.trial187.stdout:2517: finishing write tid 2 to trial18717860-22 2026-02-13T18:17:21.383 INFO:tasks.rados.rados.0.trial187.stdout:2517: finishing write tid 3 to trial18717860-22 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2517: finishing write tid 4 to trial18717860-22 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2517: oid 22 updating version 0 to 1662 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2517: oid 22 updating version 1662 to 1663 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2517: oid 22 version 1663 is already newer than 1661 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1663 (ObjNum 840 snap 280 seq_num 840) dirty exists 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2517: left oid 22 (ObjNum 840 snap 280 seq_num 840) 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2518: finishing write tid 1 to trial18717860-8 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2518: finishing write tid 2 to trial18717860-8 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2518: finishing write tid 3 to trial18717860-8 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 266 2026-02-13T18:17:21.384 INFO:tasks.rados.rados.0.trial187.stdout:2518: finishing write tid 4 to trial18717860-8 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:2518: oid 8 updating version 0 to 1020 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:2518: oid 8 updating version 1020 to 1021 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:2518: oid 8 version 1021 is already newer than 1019 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 1021 (ObjNum 841 snap 280 seq_num 841) dirty exists 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:2518: left oid 8 (ObjNum 841 snap 280 seq_num 841) 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:2519: expect (ObjNum 668 snap 222 seq_num 668) 2026-02-13T18:17:21.385 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.453 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1722964 2026-02-13T18:17:21.474 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2520: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2520: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2520: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1055 (ObjNum 761 snap 263 seq_num 761) dirty exists 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2513: done (7 left) 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2514: done (6 left) 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2515: done (5 left) 2026-02-13T18:17:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2516: done (4 left) 2026-02-13T18:17:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2517: done (3 left) 2026-02-13T18:17:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2518: done (2 left) 2026-02-13T18:17:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2519: done (1 left) 2026-02-13T18:17:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2520: done (0 left) 2026-02-13T18:17:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2521: write (excl) oid 14 current snap is 280 2026-02-13T18:17:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2521: seq_num 842 ranges {551494=558488,1671956=479538} 2026-02-13T18:17:21.530 INFO:tasks.rados.rados.0.trial187.stdout:2521: writing trial18717860-14 from 551494 to 1109982 tid 1 2026-02-13T18:17:21.538 INFO:tasks.rados.rados.0.trial187.stdout:2521: writing trial18717860-14 from 1671956 to 2151494 tid 2 2026-02-13T18:17:21.538 INFO:tasks.rados.rados.0.trial187.stdout:2522: write (excl) oid 49 current snap is 280 2026-02-13T18:17:21.538 INFO:tasks.rados.rados.0.trial187.stdout:2521: finishing write tid 1 to trial18717860-14 2026-02-13T18:17:21.538 INFO:tasks.rados.rados.0.trial187.stdout:2522: seq_num 843 ranges {568301=633737,1614085=415952} 2026-02-13T18:17:21.546 INFO:tasks.rados.rados.0.trial187.stdout:2522: writing trial18717860-49 from 568301 to 1202038 tid 1 2026-02-13T18:17:21.552 INFO:tasks.rados.rados.0.trial187.stdout:2522: writing trial18717860-49 from 1614085 to 2030037 tid 2 2026-02-13T18:17:21.552 INFO:tasks.rados.rados.0.trial187.stdout:2523: write oid 13 current snap is 280 2026-02-13T18:17:21.552 INFO:tasks.rados.rados.0.trial187.stdout:2523: seq_num 844 ranges {585108=425339,1788920=396188} 2026-02-13T18:17:21.558 INFO:tasks.rados.rados.0.trial187.stdout:2523: writing trial18717860-13 from 585108 to 1010447 tid 1 2026-02-13T18:17:21.568 INFO:tasks.rados.rados.0.trial187.stdout:2523: writing trial18717860-13 from 1788920 to 2185108 tid 2 2026-02-13T18:17:21.568 INFO:tasks.rados.rados.0.trial187.stdout:2524: read oid 6 snap -1 2026-02-13T18:17:21.568 INFO:tasks.rados.rados.0.trial187.stdout:2524: expect deleted 2026-02-13T18:17:21.568 INFO:tasks.rados.rados.0.trial187.stdout:2525: read oid 43 snap 266 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2525: expect (ObjNum 762 snap 264 seq_num 762) 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2526: write oid 38 current snap is 280 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: finishing write tid 2 to trial18717860-14 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: finishing write tid 3 to trial18717860-14 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: finishing write tid 4 to trial18717860-14 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: oid 14 updating version 0 to 1044 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: oid 14 version 1044 is already newer than 1043 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: oid 14 version 1044 is already newer than 1042 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1044 (ObjNum 842 snap 280 seq_num 842) dirty exists 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2521: left oid 14 (ObjNum 842 snap 280 seq_num 842) 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2522: finishing write tid 1 to trial18717860-49 2026-02-13T18:17:21.569 INFO:tasks.rados.rados.0.trial187.stdout:2522: finishing write tid 2 to trial18717860-49 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2522: finishing write tid 3 to trial18717860-49 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2522: finishing write tid 4 to trial18717860-49 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2522: oid 49 updating version 0 to 1029 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2522: oid 49 updating version 1029 to 1030 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2522: oid 49 version 1030 is already newer than 1028 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1030 (ObjNum 843 snap 280 seq_num 843) dirty exists 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2522: left oid 49 (ObjNum 843 snap 280 seq_num 843) 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2523: finishing write tid 1 to trial18717860-13 2026-02-13T18:17:21.570 INFO:tasks.rados.rados.0.trial187.stdout:2526: seq_num 845 ranges {601915=500588,1847402=354513} 2026-02-13T18:17:21.577 INFO:tasks.rados.rados.0.trial187.stdout:2526: writing trial18717860-38 from 601915 to 1102503 tid 1 2026-02-13T18:17:21.583 INFO:tasks.rados.rados.0.trial187.stdout:2526: writing trial18717860-38 from 1847402 to 2201915 tid 2 2026-02-13T18:17:21.583 INFO:tasks.rados.rados.0.trial187.stdout:2521: done (5 left) 2026-02-13T18:17:21.583 INFO:tasks.rados.rados.0.trial187.stdout:2522: done (4 left) 2026-02-13T18:17:21.583 INFO:tasks.rados.rados.0.trial187.stdout:2527: snap_remove snap 257 2026-02-13T18:17:21.879 INFO:tasks.rados.rados.0.trial187.stdout:2527: done (4 left) 2026-02-13T18:17:21.880 INFO:tasks.rados.rados.0.trial187.stdout:2528: write oid 22 current snap is 280 2026-02-13T18:17:21.880 INFO:tasks.rados.rados.0.trial187.stdout:2528: seq_num 846 ranges {618722=575837,1905884=312838} 2026-02-13T18:17:21.884 INFO:tasks.rados.rados.0.trial187.stdout:2528: writing trial18717860-22 from 618722 to 1194559 tid 1 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2528: writing trial18717860-22 from 1905884 to 2218722 tid 2 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2529: rollback oid 16 current snap is 280 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 264 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2523: finishing write tid 2 to trial18717860-13 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2523: finishing write tid 3 to trial18717860-13 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2523: finishing write tid 4 to trial18717860-13 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2523: oid 13 updating version 0 to 844 2026-02-13T18:17:21.889 INFO:tasks.rados.rados.0.trial187.stdout:2523: oid 13 version 844 is already newer than 843 2026-02-13T18:17:21.890 INFO:tasks.rados.rados.0.trial187.stdout:2523: oid 13 updating version 844 to 845 2026-02-13T18:17:21.890 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 845 (ObjNum 844 snap 280 seq_num 844) dirty exists 2026-02-13T18:17:21.890 INFO:tasks.rados.rados.0.trial187.stdout:2523: left oid 13 (ObjNum 844 snap 280 seq_num 844) 2026-02-13T18:17:21.890 INFO:tasks.rados.rados.0.trial187.stdout:2525: expect (ObjNum 762 snap 264 seq_num 762) 2026-02-13T18:17:21.890 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:21.947 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1320071 2026-02-13T18:17:22.004 INFO:tasks.rados.rados.0.trial187.stdout:2526: finishing write tid 1 to trial18717860-38 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2526: finishing write tid 2 to trial18717860-38 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2526: finishing write tid 3 to trial18717860-38 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2523: done (5 left) 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2524: done (4 left) 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2525: done (3 left) 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2530: read oid 32 snap -1 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2530: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2531: snap_create 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2526: finishing write tid 4 to trial18717860-38 2026-02-13T18:17:22.005 INFO:tasks.rados.rados.0.trial187.stdout:2526: oid 38 updating version 0 to 1593 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2526: oid 38 version 1593 is already newer than 1592 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2526: oid 38 version 1593 is already newer than 1591 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1593 (ObjNum 845 snap 280 seq_num 845) dirty exists 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2526: left oid 38 (ObjNum 845 snap 280 seq_num 845) 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: finishing write tid 1 to trial18717860-22 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: finishing write tid 2 to trial18717860-22 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: finishing write tid 3 to trial18717860-22 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: finishing write tid 4 to trial18717860-22 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: oid 22 updating version 0 to 1674 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: oid 22 version 1674 is already newer than 1672 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:2528: oid 22 version 1674 is already newer than 1673 2026-02-13T18:17:22.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1674 (ObjNum 846 snap 280 seq_num 846) dirty exists 2026-02-13T18:17:22.007 INFO:tasks.rados.rados.0.trial187.stdout:2528: left oid 22 (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:17:22.007 INFO:tasks.rados.rados.0.trial187.stdout:2529: finishing rollback tid 0 to trial18717860-16 2026-02-13T18:17:22.007 INFO:tasks.rados.rados.0.trial187.stdout:2529: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:17:22.007 INFO:tasks.rados.rados.0.trial187.stdout:2529: finishing rollback tid 2 to trial18717860-16 2026-02-13T18:17:22.007 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1404 (ObjNum 354 snap 99 seq_num 354) dirty exists 2026-02-13T18:17:22.007 INFO:tasks.rados.rados.0.trial187.stdout:2530: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2526: done (4 left) 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2528: done (3 left) 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2529: done (2 left) 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2530: done (1 left) 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2531: done (0 left) 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2532: copy_from oid 16 from oid 40 current snap is 281 2026-02-13T18:17:22.906 INFO:tasks.rados.rados.0.trial187.stdout:2533: delete oid 25 current snap is 281 2026-02-13T18:17:22.907 INFO:tasks.rados.rados.0.trial187.stdout:2532: finishing copy_from to trial18717860-16 2026-02-13T18:17:22.907 INFO:tasks.rados.rados.0.trial187.stdout:2532: got expected ENOENT (src dne) 2026-02-13T18:17:22.908 INFO:tasks.rados.rados.0.trial187.stdout:2532: finishing copy_from racing read to trial18717860-16 2026-02-13T18:17:22.909 INFO:tasks.rados.rados.0.trial187.stdout:2532: done (1 left) 2026-02-13T18:17:22.909 INFO:tasks.rados.rados.0.trial187.stdout:2533: done (0 left) 2026-02-13T18:17:22.909 INFO:tasks.rados.rados.0.trial187.stdout:2534: snap_remove snap 272 2026-02-13T18:17:23.911 INFO:tasks.rados.rados.0.trial187.stdout:2534: done (0 left) 2026-02-13T18:17:23.912 INFO:tasks.rados.rados.0.trial187.stdout:2535: read oid 48 snap 266 2026-02-13T18:17:23.912 INFO:tasks.rados.rados.0.trial187.stdout:2535: expect (ObjNum 767 snap 264 seq_num 767) 2026-02-13T18:17:23.912 INFO:tasks.rados.rados.0.trial187.stdout:2536: delete oid 38 current snap is 281 2026-02-13T18:17:23.915 INFO:tasks.rados.rados.0.trial187.stdout:2536: done (1 left) 2026-02-13T18:17:23.915 INFO:tasks.rados.rados.0.trial187.stdout:2537: read oid 1 snap -1 2026-02-13T18:17:23.915 INFO:tasks.rados.rados.0.trial187.stdout:2537: expect deleted 2026-02-13T18:17:23.915 INFO:tasks.rados.rados.0.trial187.stdout:2538: write (excl) oid 41 current snap is 281 2026-02-13T18:17:23.915 INFO:tasks.rados.rados.0.trial187.stdout:2538: seq_num 849 ranges {669143=401584,1564977=426959} 2026-02-13T18:17:23.921 INFO:tasks.rados.rados.0.trial187.stdout:2538: writing trial18717860-41 from 669143 to 1070727 tid 1 2026-02-13T18:17:23.928 INFO:tasks.rados.rados.0.trial187.stdout:2538: writing trial18717860-41 from 1564977 to 1991936 tid 2 2026-02-13T18:17:23.928 INFO:tasks.rados.rados.0.trial187.stdout:2539: snap_remove snap 279 2026-02-13T18:17:24.913 INFO:tasks.rados.rados.0.trial187.stdout:2539: done (3 left) 2026-02-13T18:17:24.913 INFO:tasks.rados.rados.0.trial187.stdout:2540: delete oid 13 current snap is 281 2026-02-13T18:17:24.913 INFO:tasks.rados.rados.0.trial187.stdout:2535: expect (ObjNum 767 snap 264 seq_num 767) 2026-02-13T18:17:24.950 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:25.006 INFO:tasks.rados.rados.0.trial187.stdout:2538: finishing write tid 1 to trial18717860-41 2026-02-13T18:17:25.006 INFO:tasks.rados.rados.0.trial187.stdout:2538: finishing write tid 2 to trial18717860-41 2026-02-13T18:17:25.006 INFO:tasks.rados.rados.0.trial187.stdout:2538: finishing write tid 3 to trial18717860-41 2026-02-13T18:17:25.006 INFO:tasks.rados.rados.0.trial187.stdout:2538: finishing write tid 4 to trial18717860-41 2026-02-13T18:17:25.006 INFO:tasks.rados.rados.0.trial187.stdout:2538: oid 41 updating version 0 to 1022 2026-02-13T18:17:25.006 INFO:tasks.rados.rados.0.trial187.stdout:2538: oid 41 updating version 1022 to 1023 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2538: oid 41 updating version 1023 to 1024 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1024 (ObjNum 849 snap 281 seq_num 849) dirty exists 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2538: left oid 41 (ObjNum 849 snap 281 seq_num 849) 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2535: done (3 left) 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2537: done (2 left) 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2538: done (1 left) 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2540: done (0 left) 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2541: copy_from oid 37 from oid 2 current snap is 281 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2542: write oid 29 current snap is 281 2026-02-13T18:17:25.007 INFO:tasks.rados.rados.0.trial187.stdout:2542: seq_num 851 ranges {702757=552082,1681941=430628} 2026-02-13T18:17:25.014 INFO:tasks.rados.rados.0.trial187.stdout:2542: writing trial18717860-29 from 702757 to 1254839 tid 1 2026-02-13T18:17:25.020 INFO:tasks.rados.rados.0.trial187.stdout:2542: writing trial18717860-29 from 1681941 to 2112569 tid 2 2026-02-13T18:17:25.020 INFO:tasks.rados.rados.0.trial187.stdout:2543: write oid 7 current snap is 281 2026-02-13T18:17:25.020 INFO:tasks.rados.rados.0.trial187.stdout:2543: seq_num 852 ranges {719564=743684,2140423=179141} 2026-02-13T18:17:25.030 INFO:tasks.rados.rados.0.trial187.stdout:2543: writing trial18717860-7 from 719564 to 1463248 tid 1 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:2543: writing trial18717860-7 from 2140423 to 2319564 tid 2 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:2544: rollback oid 31 current snap is 281 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 266 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:2541: finishing copy_from to trial18717860-37 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:2541: got expected ENOENT (src dne) 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:2541: finishing copy_from racing read to trial18717860-37 2026-02-13T18:17:25.036 INFO:tasks.rados.rados.0.trial187.stdout:2541: done (3 left) 2026-02-13T18:17:25.037 INFO:tasks.rados.rados.0.trial187.stdout:2545: write oid 30 current snap is 281 2026-02-13T18:17:25.037 INFO:tasks.rados.rados.0.trial187.stdout:2545: seq_num 853 ranges {736371=418933,1798905=434297} 2026-02-13T18:17:25.043 INFO:tasks.rados.rados.0.trial187.stdout:2545: writing trial18717860-30 from 736371 to 1155304 tid 1 2026-02-13T18:17:25.051 INFO:tasks.rados.rados.0.trial187.stdout:2545: writing trial18717860-30 from 1798905 to 2233202 tid 2 2026-02-13T18:17:25.051 INFO:tasks.rados.rados.0.trial187.stdout:2546: read oid 48 snap -1 2026-02-13T18:17:25.051 INFO:tasks.rados.rados.0.trial187.stdout:2546: expect (ObjNum 816 snap 277 seq_num 816) 2026-02-13T18:17:25.051 INFO:tasks.rados.rados.0.trial187.stdout:2547: write oid 6 current snap is 281 2026-02-13T18:17:25.051 INFO:tasks.rados.rados.0.trial187.stdout:2547: seq_num 854 ranges {753178=494182,1857387=495791} 2026-02-13T18:17:25.056 INFO:tasks.rados.rados.0.trial187.stdout:2547: writing trial18717860-6 from 753178 to 1247360 tid 1 2026-02-13T18:17:25.060 INFO:tasks.rados.rados.0.trial187.stdout:2547: writing trial18717860-6 from 1857387 to 2353178 tid 2 2026-02-13T18:17:25.060 INFO:tasks.rados.rados.0.trial187.stdout:2548: write oid 37 current snap is 281 2026-02-13T18:17:25.060 INFO:tasks.rados.rados.0.trial187.stdout:2548: seq_num 855 ranges {769985=569431,1915869=437966} 2026-02-13T18:17:25.065 INFO:tasks.rados.rados.0.trial187.stdout:2548: writing trial18717860-37 from 769985 to 1339416 tid 1 2026-02-13T18:17:25.069 INFO:tasks.rados.rados.0.trial187.stdout:2548: writing trial18717860-37 from 1915869 to 2353835 tid 2 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2549: snap_create 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: finishing write tid 1 to trial18717860-29 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: finishing write tid 2 to trial18717860-29 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: finishing write tid 3 to trial18717860-29 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: finishing write tid 4 to trial18717860-29 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: oid 29 updating version 0 to 1025 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: oid 29 version 1025 is already newer than 1024 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: oid 29 updating version 1025 to 1026 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1026 (ObjNum 851 snap 281 seq_num 851) dirty exists 2026-02-13T18:17:25.070 INFO:tasks.rados.rados.0.trial187.stdout:2542: left oid 29 (ObjNum 851 snap 281 seq_num 851) 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: finishing write tid 1 to trial18717860-7 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: finishing write tid 2 to trial18717860-7 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: finishing write tid 3 to trial18717860-7 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2544: finishing rollback tid 0 to trial18717860-31 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: finishing write tid 4 to trial18717860-7 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: oid 7 updating version 0 to 1056 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: oid 7 updating version 1056 to 1057 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: oid 7 updating version 1057 to 1058 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1058 (ObjNum 852 snap 281 seq_num 852) dirty exists 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2543: left oid 7 (ObjNum 852 snap 281 seq_num 852) 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2544: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:2544: finishing rollback tid 2 to trial18717860-31 2026-02-13T18:17:25.071 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1020 (ObjNum 770 snap 265 seq_num 770) dirty exists 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: finishing write tid 1 to trial18717860-30 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: finishing write tid 2 to trial18717860-30 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: finishing write tid 3 to trial18717860-30 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: finishing write tid 4 to trial18717860-30 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: oid 30 updating version 0 to 1024 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: oid 30 version 1024 is already newer than 1022 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: oid 30 version 1024 is already newer than 1023 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1024 (ObjNum 853 snap 281 seq_num 853) dirty exists 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2545: left oid 30 (ObjNum 853 snap 281 seq_num 853) 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:2546: expect (ObjNum 816 snap 277 seq_num 816) 2026-02-13T18:17:25.072 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 247740 2026-02-13T18:17:25.133 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:25.228 INFO:tasks.rados.rados.0.trial187.stdout:2547: finishing write tid 1 to trial18717860-6 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: finishing write tid 2 to trial18717860-6 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: finishing write tid 3 to trial18717860-6 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: finishing write tid 4 to trial18717860-6 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: oid 6 updating version 0 to 1180 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: oid 6 updating version 1180 to 1181 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: oid 6 updating version 1181 to 1182 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1182 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2547: left oid 6 (ObjNum 854 snap 281 seq_num 854) 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2548: finishing write tid 1 to trial18717860-37 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2548: finishing write tid 2 to trial18717860-37 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2548: finishing write tid 3 to trial18717860-37 2026-02-13T18:17:25.229 INFO:tasks.rados.rados.0.trial187.stdout:2548: finishing write tid 4 to trial18717860-37 2026-02-13T18:17:25.230 INFO:tasks.rados.rados.0.trial187.stdout:2548: oid 37 updating version 0 to 1684 2026-02-13T18:17:25.230 INFO:tasks.rados.rados.0.trial187.stdout:2548: oid 37 version 1684 is already newer than 1683 2026-02-13T18:17:25.230 INFO:tasks.rados.rados.0.trial187.stdout:2548: oid 37 updating version 1684 to 1685 2026-02-13T18:17:25.230 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1685 (ObjNum 855 snap 281 seq_num 855) dirty exists 2026-02-13T18:17:25.230 INFO:tasks.rados.rados.0.trial187.stdout:2548: left oid 37 (ObjNum 855 snap 281 seq_num 855) 2026-02-13T18:17:25.920 INFO:tasks.rados.rados.0.trial187.stdout:2542: done (7 left) 2026-02-13T18:17:25.920 INFO:tasks.rados.rados.0.trial187.stdout:2543: done (6 left) 2026-02-13T18:17:25.920 INFO:tasks.rados.rados.0.trial187.stdout:2544: done (5 left) 2026-02-13T18:17:25.920 INFO:tasks.rados.rados.0.trial187.stdout:2545: done (4 left) 2026-02-13T18:17:25.920 INFO:tasks.rados.rados.0.trial187.stdout:2546: done (3 left) 2026-02-13T18:17:25.920 INFO:tasks.rados.rados.0.trial187.stdout:2547: done (2 left) 2026-02-13T18:17:25.921 INFO:tasks.rados.rados.0.trial187.stdout:2548: done (1 left) 2026-02-13T18:17:25.921 INFO:tasks.rados.rados.0.trial187.stdout:2549: done (0 left) 2026-02-13T18:17:25.921 INFO:tasks.rados.rados.0.trial187.stdout:2550: read oid 31 snap 276 2026-02-13T18:17:25.921 INFO:tasks.rados.rados.0.trial187.stdout:2550: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:17:25.921 INFO:tasks.rados.rados.0.trial187.stdout:2551: snap_remove snap 273 2026-02-13T18:17:26.880 INFO:tasks.rados.rados.0.trial187.stdout:2551: done (1 left) 2026-02-13T18:17:26.880 INFO:tasks.rados.rados.0.trial187.stdout:2552: delete oid 3 current snap is 282 2026-02-13T18:17:26.880 INFO:tasks.rados.rados.0.trial187.stdout:2550: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:17:26.880 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:26.967 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:27.011 INFO:tasks.rados.rados.0.trial187.stdout:2550: done (1 left) 2026-02-13T18:17:27.011 INFO:tasks.rados.rados.0.trial187.stdout:2552: done (0 left) 2026-02-13T18:17:27.011 INFO:tasks.rados.rados.0.trial187.stdout:2553: delete oid 41 current snap is 282 2026-02-13T18:17:27.014 INFO:tasks.rados.rados.0.trial187.stdout:2553: done (0 left) 2026-02-13T18:17:27.014 INFO:tasks.rados.rados.0.trial187.stdout:2554: write oid 41 current snap is 282 2026-02-13T18:17:27.014 INFO:tasks.rados.rados.0.trial187.stdout:2554: seq_num 858 ranges {420406=795178,1974962=445444} 2026-02-13T18:17:27.022 INFO:tasks.rados.rados.0.trial187.stdout:2554: writing trial18717860-41 from 420406 to 1215584 tid 1 2026-02-13T18:17:27.030 INFO:tasks.rados.rados.0.trial187.stdout:2554: writing trial18717860-41 from 1974962 to 2420406 tid 2 2026-02-13T18:17:27.030 INFO:tasks.rados.rados.0.trial187.stdout:2555: read oid 47 snap -1 2026-02-13T18:17:27.030 INFO:tasks.rados.rados.0.trial187.stdout:2555: expect (ObjNum 824 snap 279 seq_num 824) 2026-02-13T18:17:27.031 INFO:tasks.rados.rados.0.trial187.stdout:2556: read oid 11 snap -1 2026-02-13T18:17:27.031 INFO:tasks.rados.rados.0.trial187.stdout:2556: expect (ObjNum 788 snap 269 seq_num 788) 2026-02-13T18:17:27.031 INFO:tasks.rados.rados.0.trial187.stdout:2557: write (excl) oid 31 current snap is 282 2026-02-13T18:17:27.031 INFO:tasks.rados.rados.0.trial187.stdout:2554: finishing write tid 1 to trial18717860-41 2026-02-13T18:17:27.031 INFO:tasks.rados.rados.0.trial187.stdout:2557: seq_num 859 ranges {437213=470427,1633444=728951} 2026-02-13T18:17:27.036 INFO:tasks.rados.rados.0.trial187.stdout:2557: writing trial18717860-31 from 437213 to 907640 tid 1 2026-02-13T18:17:27.046 INFO:tasks.rados.rados.0.trial187.stdout:2557: writing trial18717860-31 from 1633444 to 2362395 tid 2 2026-02-13T18:17:27.046 INFO:tasks.rados.rados.0.trial187.stdout:2558: snap_remove snap 265 2026-02-13T18:17:27.924 INFO:tasks.rados.rados.0.trial187.stdout:2558: done (4 left) 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2559: rollback oid 27 current snap is 282 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 264 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: finishing write tid 2 to trial18717860-41 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: finishing write tid 3 to trial18717860-41 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: finishing write tid 4 to trial18717860-41 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: oid 41 updating version 0 to 1027 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: oid 41 updating version 1027 to 1028 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: oid 41 version 1028 is already newer than 1026 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1028 (ObjNum 858 snap 282 seq_num 858) dirty exists 2026-02-13T18:17:27.925 INFO:tasks.rados.rados.0.trial187.stdout:2554: left oid 41 (ObjNum 858 snap 282 seq_num 858) 2026-02-13T18:17:27.926 INFO:tasks.rados.rados.0.trial187.stdout:2555: expect (ObjNum 824 snap 279 seq_num 824) 2026-02-13T18:17:27.971 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3440021 2026-02-13T18:17:28.111 INFO:tasks.rados.rados.0.trial187.stdout:2557: finishing write tid 1 to trial18717860-31 2026-02-13T18:17:28.112 INFO:tasks.rados.rados.0.trial187.stdout:2556: expect (ObjNum 788 snap 269 seq_num 788) 2026-02-13T18:17:28.112 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:28.142 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2059536 2026-02-13T18:17:28.155 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1474272 2026-02-13T18:17:28.173 INFO:tasks.rados.rados.0.trial187.stdout:2557: finishing write tid 2 to trial18717860-31 2026-02-13T18:17:28.173 INFO:tasks.rados.rados.0.trial187.stdout:2557: finishing write tid 3 to trial18717860-31 2026-02-13T18:17:28.173 INFO:tasks.rados.rados.0.trial187.stdout:2557: finishing write tid 4 to trial18717860-31 2026-02-13T18:17:28.173 INFO:tasks.rados.rados.0.trial187.stdout:2557: oid 31 updating version 0 to 1022 2026-02-13T18:17:28.173 INFO:tasks.rados.rados.0.trial187.stdout:2557: oid 31 updating version 1022 to 1023 2026-02-13T18:17:28.173 INFO:tasks.rados.rados.0.trial187.stdout:2557: oid 31 version 1023 is already newer than 1021 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1023 (ObjNum 859 snap 282 seq_num 859) dirty exists 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2557: left oid 31 (ObjNum 859 snap 282 seq_num 859) 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2559: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2559: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2554: done (4 left) 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2555: done (3 left) 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2556: done (2 left) 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2557: done (1 left) 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2560: copy_from oid 26 from oid 49 current snap is 282 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2559: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1009 (ObjNum 748 snap 262 seq_num 748) dirty exists 2026-02-13T18:17:28.174 INFO:tasks.rados.rados.0.trial187.stdout:2559: done (1 left) 2026-02-13T18:17:28.175 INFO:tasks.rados.rados.0.trial187.stdout:2561: rollback oid 9 current snap is 282 2026-02-13T18:17:28.175 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 278 2026-02-13T18:17:28.175 INFO:tasks.rados.rados.0.trial187.stdout:2562: rollback oid 27 current snap is 282 2026-02-13T18:17:28.175 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 255 2026-02-13T18:17:28.175 INFO:tasks.rados.rados.0.trial187.stdout:2563: copy_from oid 12 from oid 8 current snap is 282 2026-02-13T18:17:28.175 INFO:tasks.rados.rados.0.trial187.stdout:2564: delete oid 47 current snap is 282 2026-02-13T18:17:28.176 INFO:tasks.rados.rados.0.trial187.stdout:2562: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:17:28.176 INFO:tasks.rados.rados.0.trial187.stdout:2562: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:17:28.176 INFO:tasks.rados.rados.0.trial187.stdout:2562: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:17:28.176 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1012 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:17:28.176 INFO:tasks.rados.rados.0.trial187.stdout:2561: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:17:28.176 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1251 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:17:28.177 INFO:tasks.rados.rados.0.trial187.stdout:2561: done (4 left) 2026-02-13T18:17:28.177 INFO:tasks.rados.rados.0.trial187.stdout:2562: done (3 left) 2026-02-13T18:17:28.177 INFO:tasks.rados.rados.0.trial187.stdout:2564: done (2 left) 2026-02-13T18:17:28.177 INFO:tasks.rados.rados.0.trial187.stdout:2565: copy_from oid 24 from oid 7 current snap is 282 2026-02-13T18:17:28.177 INFO:tasks.rados.rados.0.trial187.stdout:2566: delete oid 44 current snap is 282 2026-02-13T18:17:28.180 INFO:tasks.rados.rados.0.trial187.stdout:2560: finishing copy_from racing read to trial18717860-26 2026-02-13T18:17:28.180 INFO:tasks.rados.rados.0.trial187.stdout:2566: done (3 left) 2026-02-13T18:17:28.180 INFO:tasks.rados.rados.0.trial187.stdout:2567: read oid 17 snap -1 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2567: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2568: read oid 10 snap -1 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2568: expect (ObjNum 837 snap 280 seq_num 837) 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2569: read oid 32 snap -1 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2569: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2570: rollback oid 18 current snap is 282 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 264 2026-02-13T18:17:28.181 INFO:tasks.rados.rados.0.trial187.stdout:2571: snap_remove snap 266 2026-02-13T18:17:28.927 INFO:tasks.rados.rados.0.trial187.stdout:2571: done (7 left) 2026-02-13T18:17:28.927 INFO:tasks.rados.rados.0.trial187.stdout:2572: copy_from oid 14 from oid 42 current snap is 282 2026-02-13T18:17:28.927 INFO:tasks.rados.rados.0.trial187.stdout:2560: finishing copy_from to trial18717860-26 2026-02-13T18:17:28.927 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 1030 (ObjNum 843 snap 280 seq_num 843) dirty exists 2026-02-13T18:17:28.927 INFO:tasks.rados.rados.0.trial187.stdout:2567: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:17:28.945 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:28.975 INFO:tasks.rados.rados.0.trial187.stdout:2569: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:28.995 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:29.032 INFO:tasks.rados.rados.0.trial187.stdout:2563: finishing copy_from racing read to trial18717860-12 2026-02-13T18:17:29.032 INFO:tasks.rados.rados.0.trial187.stdout:2565: finishing copy_from racing read to trial18717860-24 2026-02-13T18:17:29.032 INFO:tasks.rados.rados.0.trial187.stdout:2568: expect (ObjNum 837 snap 280 seq_num 837) 2026-02-13T18:17:29.033 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1457667 2026-02-13T18:17:29.057 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:29.073 INFO:tasks.rados.rados.0.trial187.stdout:2563: finishing copy_from to trial18717860-12 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1021 (ObjNum 841 snap 280 seq_num 841) dirty exists 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2570: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2565: finishing copy_from to trial18717860-24 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1058 (ObjNum 852 snap 281 seq_num 852) dirty exists 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2570: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 866 (ObjNum 129 snap 0 seq_num 3013748000) dirty dne 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2560: done (7 left) 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2563: done (6 left) 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2565: done (5 left) 2026-02-13T18:17:29.074 INFO:tasks.rados.rados.0.trial187.stdout:2567: done (4 left) 2026-02-13T18:17:29.075 INFO:tasks.rados.rados.0.trial187.stdout:2568: done (3 left) 2026-02-13T18:17:29.075 INFO:tasks.rados.rados.0.trial187.stdout:2569: done (2 left) 2026-02-13T18:17:29.075 INFO:tasks.rados.rados.0.trial187.stdout:2570: done (1 left) 2026-02-13T18:17:29.075 INFO:tasks.rados.rados.0.trial187.stdout:2573: write (excl) oid 30 current snap is 282 2026-02-13T18:17:29.075 INFO:tasks.rados.rados.0.trial187.stdout:2573: seq_num 862 ranges {487634=412527,1408890=592631} 2026-02-13T18:17:29.079 INFO:tasks.rados.rados.0.trial187.stdout:2573: writing trial18717860-30 from 487634 to 900161 tid 1 2026-02-13T18:17:29.086 INFO:tasks.rados.rados.0.trial187.stdout:2573: writing trial18717860-30 from 1408890 to 2001521 tid 2 2026-02-13T18:17:29.086 INFO:tasks.rados.rados.0.trial187.stdout:2574: snap_remove snap 255 2026-02-13T18:17:29.936 INFO:tasks.rados.rados.0.trial187.stdout:2574: done (2 left) 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2575: snap_create 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2572: finishing copy_from racing read to trial18717860-14 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2572: finishing copy_from to trial18717860-14 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1012 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: finishing write tid 1 to trial18717860-30 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: finishing write tid 2 to trial18717860-30 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: finishing write tid 3 to trial18717860-30 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: finishing write tid 4 to trial18717860-30 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: oid 30 updating version 0 to 1025 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: oid 30 updating version 1025 to 1026 2026-02-13T18:17:29.937 INFO:tasks.rados.rados.0.trial187.stdout:2573: oid 30 updating version 1026 to 1027 2026-02-13T18:17:29.938 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1027 (ObjNum 862 snap 282 seq_num 862) dirty exists 2026-02-13T18:17:29.938 INFO:tasks.rados.rados.0.trial187.stdout:2573: left oid 30 (ObjNum 862 snap 282 seq_num 862) 2026-02-13T18:17:30.939 INFO:tasks.rados.rados.0.trial187.stdout:2572: done (2 left) 2026-02-13T18:17:30.939 INFO:tasks.rados.rados.0.trial187.stdout:2573: done (1 left) 2026-02-13T18:17:30.940 INFO:tasks.rados.rados.0.trial187.stdout:2575: done (0 left) 2026-02-13T18:17:30.940 INFO:tasks.rados.rados.0.trial187.stdout:2576: write (excl) oid 1 current snap is 283 2026-02-13T18:17:30.940 INFO:tasks.rados.rados.0.trial187.stdout:2576: seq_num 863 ranges {504441=487776,1467372=736289} 2026-02-13T18:17:30.945 INFO:tasks.rados.rados.0.trial187.stdout:2576: writing trial18717860-1 from 504441 to 992217 tid 1 2026-02-13T18:17:30.954 INFO:tasks.rados.rados.0.trial187.stdout:2576: writing trial18717860-1 from 1467372 to 2203661 tid 2 2026-02-13T18:17:30.954 INFO:tasks.rados.rados.0.trial187.stdout:2577: write (excl) oid 46 current snap is 283 2026-02-13T18:17:30.954 INFO:tasks.rados.rados.0.trial187.stdout:2577: seq_num 864 ranges {521248=563025,1809501=596300} 2026-02-13T18:17:30.961 INFO:tasks.rados.rados.0.trial187.stdout:2577: writing trial18717860-46 from 521248 to 1084273 tid 1 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2577: writing trial18717860-46 from 1809501 to 2405801 tid 2 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2578: read oid 6 snap -1 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2578: expect (ObjNum 854 snap 281 seq_num 854) 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2579: copy_from oid 9 from oid 42 current snap is 283 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2576: finishing write tid 1 to trial18717860-1 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2576: finishing write tid 2 to trial18717860-1 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2576: finishing write tid 3 to trial18717860-1 2026-02-13T18:17:30.971 INFO:tasks.rados.rados.0.trial187.stdout:2576: finishing write tid 4 to trial18717860-1 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2576: oid 1 updating version 0 to 1027 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2576: oid 1 updating version 1027 to 1028 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2576: oid 1 updating version 1028 to 1029 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 1029 (ObjNum 863 snap 283 seq_num 863) dirty exists 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2576: left oid 1 (ObjNum 863 snap 283 seq_num 863) 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2577: finishing write tid 1 to trial18717860-46 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2576: done (3 left) 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2580: read oid 47 snap -1 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2580: expect deleted 2026-02-13T18:17:30.972 INFO:tasks.rados.rados.0.trial187.stdout:2581: snap_create 2026-02-13T18:17:30.974 INFO:tasks.rados.rados.0.trial187.stdout:2577: finishing write tid 2 to trial18717860-46 2026-02-13T18:17:30.974 INFO:tasks.rados.rados.0.trial187.stdout:2577: finishing write tid 3 to trial18717860-46 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:2577: finishing write tid 4 to trial18717860-46 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:2577: oid 46 updating version 0 to 1061 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:2577: oid 46 version 1061 is already newer than 1060 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:2577: oid 46 version 1061 is already newer than 1059 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1061 (ObjNum 864 snap 283 seq_num 864) dirty exists 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:2577: left oid 46 (ObjNum 864 snap 283 seq_num 864) 2026-02-13T18:17:30.975 INFO:tasks.rados.rados.0.trial187.stdout:2578: expect (ObjNum 854 snap 281 seq_num 854) 2026-02-13T18:17:31.005 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:31.037 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2147291 2026-02-13T18:17:31.039 INFO:tasks.rados.rados.0.trial187.stdout:2579: finishing copy_from racing read to trial18717860-9 2026-02-13T18:17:31.039 INFO:tasks.rados.rados.0.trial187.stdout:2579: finishing copy_from to trial18717860-9 2026-02-13T18:17:31.039 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1012 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2577: done (4 left) 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2578: done (3 left) 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2579: done (2 left) 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2580: done (1 left) 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2581: done (0 left) 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2582: copy_from oid 6 from oid 40 current snap is 284 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:2583: rollback oid 25 current snap is 284 2026-02-13T18:17:31.882 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 269 2026-02-13T18:17:31.883 INFO:tasks.rados.rados.0.trial187.stdout:2584: snap_remove snap 276 2026-02-13T18:17:33.001 INFO:tasks.rados.rados.0.trial187.stdout:2584: done (2 left) 2026-02-13T18:17:33.001 INFO:tasks.rados.rados.0.trial187.stdout:2585: snap_remove snap 280 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2585: done (2 left) 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2586: snap_create 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2582: finishing copy_from to trial18717860-6 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2582: got expected ENOENT (src dne) 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2583: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2582: finishing copy_from racing read to trial18717860-6 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:2583: finishing rollback tid 2 to trial18717860-25 2026-02-13T18:17:33.957 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1014 (ObjNum 781 snap 267 seq_num 781) dirty exists 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2582: done (2 left) 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2583: done (1 left) 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2586: done (0 left) 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2587: read oid 31 snap 281 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2587: expect (ObjNum 770 snap 265 seq_num 770) 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2588: write (excl) oid 16 current snap is 285 2026-02-13T18:17:34.958 INFO:tasks.rados.rados.0.trial187.stdout:2588: seq_num 865 ranges {538055=638274,1867983=670072} 2026-02-13T18:17:34.965 INFO:tasks.rados.rados.0.trial187.stdout:2588: writing trial18717860-16 from 538055 to 1176329 tid 1 2026-02-13T18:17:34.975 INFO:tasks.rados.rados.0.trial187.stdout:2588: writing trial18717860-16 from 1867983 to 2538055 tid 2 2026-02-13T18:17:34.975 INFO:tasks.rados.rados.0.trial187.stdout:2589: read oid 32 snap -1 2026-02-13T18:17:34.975 INFO:tasks.rados.rados.0.trial187.stdout:2589: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:34.975 INFO:tasks.rados.rados.0.trial187.stdout:2590: copy_from oid 41 from oid 50 current snap is 285 2026-02-13T18:17:34.975 INFO:tasks.rados.rados.0.trial187.stdout:2587: expect (ObjNum 770 snap 265 seq_num 770) 2026-02-13T18:17:35.084 INFO:tasks.rados.rados.0.trial187.stdout:2588: finishing write tid 1 to trial18717860-16 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2590: finishing copy_from to trial18717860-41 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2590: got expected ENOENT (src dne) 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2590: finishing copy_from racing read to trial18717860-41 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: finishing write tid 2 to trial18717860-16 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: finishing write tid 3 to trial18717860-16 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: finishing write tid 4 to trial18717860-16 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: oid 16 updating version 0 to 1406 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: oid 16 updating version 1406 to 1408 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: oid 16 version 1408 is already newer than 1407 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1408 (ObjNum 865 snap 285 seq_num 865) dirty exists 2026-02-13T18:17:35.085 INFO:tasks.rados.rados.0.trial187.stdout:2588: left oid 16 (ObjNum 865 snap 285 seq_num 865) 2026-02-13T18:17:35.086 INFO:tasks.rados.rados.0.trial187.stdout:2589: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:17:35.099 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2587: done (3 left) 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2588: done (2 left) 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2589: done (1 left) 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2590: done (0 left) 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2591: read oid 23 snap -1 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2591: expect (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:17:35.140 INFO:tasks.rados.rados.0.trial187.stdout:2592: snap_create 2026-02-13T18:17:35.143 INFO:tasks.rados.rados.0.trial187.stdout:2591: expect (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:17:35.143 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:35.466 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T18:17:35.466 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T18:17:35.467 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T18:17:35.467 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T18:17:35.469 INFO:tasks.ceph.mon.c:Started 2026-02-13T18:17:35.469 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:17:35.469 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:17:35.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.518+0000 7fbeebfff640 10 monclient: get_monmap_and_config 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.518+0000 7fbeebfff640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.518+0000 7fbeebfff640 10 monclient: monmap: 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:35.525274+0000 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:35.525274+0000 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.532 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.533 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:35.533 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:35.533 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 Processor -- start 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- start start 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: init 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient(hunting): picked mon.noname-b con 0x7fbeec08b0f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient(hunting): picked mon.noname-a con 0x7fbeec086cd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient(hunting): picked mon.noname-c con 0x7fbeec182b50 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec086560 con 0x7fbeec086cd0 2026-02-13T18:17:35.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec086840 con 0x7fbeec182b50 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec08d1f0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient(hunting): authenticate will time out at 1286.580517s 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeea7fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbeec086cd0 0x7fbeec08cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56466/0 (socket says 10.20.193.78:56466) 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeea7fc640 1 -- 10.20.193.78:0/1422228603 learned_addr learned my addr 10.20.193.78:0/1422228603 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeea7fc640 1 -- 10.20.193.78:0/1422228603 >> v1:10.20.193.78:6789/0 conn(0x7fbeec086cd0 legacy=0x7fbeec08cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeeaffd640 1 -- 10.20.193.78:0/1422228603 >> v1:10.20.193.78:6790/0 conn(0x7fbeec08b0f0 legacy=0x7fbeec08c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096248497 0 0) 0x7fbeec086560 con 0x7fbeec086cd0 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient(hunting): my global_id is 94224 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbed8003620 con 0x7fbeec086cd0 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeeb7fe640 1 -- 10.20.193.78:0/1422228603 >> v1:10.20.193.187:6789/0 conn(0x7fbeec182b50 legacy=0x7fbeec1a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1820431336 0 0) 0x7fbed8003620 con 0x7fbeec086cd0 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 >> v1:10.20.193.78:6790/0 conn(0x7fbeec08b0f0 legacy=0x7fbeec08c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 >> v1:10.20.193.187:6789/0 conn(0x7fbeec182b50 legacy=0x7fbeec1a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 monclient: found mon.noname-a 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec08de50 con 0x7fbeec086cd0 2026-02-13T18:17:35.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 5 monclient: authenticate success, global_id 94224 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbed4003110 con 0x7fbeec086cd0 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: dump: 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.541 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbed4003450 con 0x7fbeec086cd0 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 1 -- 10.20.193.78:0/1422228603 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbed4004b50 con 0x7fbeec086cd0 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbee9ffb640 10 monclient: dump: 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.543 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 4 set_mon_vals no callback set 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: shutdown 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- 10.20.193.78:0/1422228603 >> v1:10.20.193.78:6789/0 conn(0x7fbeec086cd0 legacy=0x7fbeec08cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- 10.20.193.78:0/1422228603 shutdown_connections 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- 10.20.193.78:0/1422228603 >> 10.20.193.78:0/1422228603 conn(0x7fbeec0545d0 msgr2=0x7fbeec0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- 10.20.193.78:0/1422228603 shutdown_connections 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 1 -- 10.20.193.78:0/1422228603 wait complete. 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.522+0000 7fbeebfff640 10 monclient: monmap: 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 Processor -- start 2026-02-13T18:17:35.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 -- start start 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: init 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient(hunting): picked mon.noname-b con 0x7fbeec086cd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient(hunting): picked mon.noname-a con 0x7fbeec08b0f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient(hunting): picked mon.noname-c con 0x7fbeec182b50 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec08ab10 con 0x7fbeec08b0f0 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec13b4d0 con 0x7fbeec086cd0 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec13b7b0 con 0x7fbeec182b50 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient(hunting): authenticate will time out at 1286.584394s 2026-02-13T18:17:35.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeea7fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbeec08b0f0 0x7fbeec0893a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56470/0 (socket says 10.20.193.78:56470) 2026-02-13T18:17:35.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeea7fc640 1 -- 10.20.193.78:0/196989772 learned_addr learned my addr 10.20.193.78:0/196989772 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeea7fc640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.78:6789/0 conn(0x7fbeec08b0f0 legacy=0x7fbeec0893a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeeb7fe640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.78:6790/0 conn(0x7fbeec182b50 legacy=0x7fbeec195390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeeaffd640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.187:6789/0 conn(0x7fbeec086cd0 legacy=0x7fbeec088c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987751157 0 0) 0x7fbeec13b4d0 con 0x7fbeec086cd0 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): my global_id is 84322 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb8003620 con 0x7fbeec086cd0 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842822107 0 0) 0x7fbeec08ab10 con 0x7fbeec08b0f0 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): my global_id is 94227 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeec13b4d0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 164500776 0 0) 0x7fbeec13b4d0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbeec08ab10 con 0x7fbeec08b0f0 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbed4004a90 con 0x7fbeec08b0f0 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): dump: 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.553 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1819967524 0 0) 0x7fbeb8003620 con 0x7fbeec086cd0 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbeec13b4d0 con 0x7fbeec086cd0 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbee0003380 con 0x7fbeec086cd0 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient(hunting): dump: 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.554 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 764751133 0 0) 0x7fbeec08ab10 con 0x7fbeec08b0f0 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.78:6790/0 conn(0x7fbeec182b50 legacy=0x7fbeec195390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.187:6789/0 conn(0x7fbeec086cd0 legacy=0x7fbeec088c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 monclient: found mon.a 2026-02-13T18:17:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec13ba90 con 0x7fbeec08b0f0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 5 monclient: authenticate success, global_id 94227 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: _renew_subs 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec141610 con 0x7fbeec08b0f0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: _renew_subs 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbeec089ab0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbed4003350 con 0x7fbeec08b0f0 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbed40052e0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbecb7fe640 10 monclient: dump: 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.557 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.526+0000 7fbee97fa640 4 set_mon_vals no callback set 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fbed4011970 con 0x7fbeec08b0f0 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbeebfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbeebfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbeebfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec089da0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(590..590 src has 292..590) ==== 3963+0+0 (unknown 3841000013 0 0) 0x7fbed404c6f0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbeeaffd640 10 monclient: get_auth_request con 0x7fbeb803d6a0 auth_method 0 2026-02-13T18:17:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fbeec089da0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbecb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.530+0000 7fbecb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:35.629 INFO:tasks.rados.rados.0.trial187.stdout:2591: done (1 left) 2026-02-13T18:17:35.629 INFO:tasks.rados.rados.0.trial187.stdout:2592: done (0 left) 2026-02-13T18:17:35.629 INFO:tasks.rados.rados.0.trial187.stdout:2593: read oid 16 snap -1 2026-02-13T18:17:35.629 INFO:tasks.rados.rados.0.trial187.stdout:2593: expect (ObjNum 865 snap 285 seq_num 865) 2026-02-13T18:17:35.629 INFO:tasks.rados.rados.0.trial187.stdout:2594: snap_create 2026-02-13T18:17:35.633 INFO:tasks.rados.rados.0.trial187.stdout:2593: expect (ObjNum 865 snap 285 seq_num 865) 2026-02-13T18:17:35.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:17:35.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:35.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbeec050ff0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbecb7fe640 1 -- 10.20.193.78:0/196989772 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1003944329) 0x7fbed40176d0 con 0x7fbeec08b0f0 2026-02-13T18:17:35.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbecb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:35.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbecb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:35.667 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.187:6812/2668687789 conn(0x7fbeb803d6a0 legacy=0x7fbeb805db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 10 monclient: shutdown 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 >> v1:10.20.193.78:6789/0 conn(0x7fbeec08b0f0 legacy=0x7fbeec0893a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 shutdown_connections 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 >> 10.20.193.78:0/196989772 conn(0x7fbeec0545d0 msgr2=0x7fbeec18f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 shutdown_connections 2026-02-13T18:17:35.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.654+0000 7fbeebfff640 1 -- 10.20.193.78:0/196989772 wait complete. 2026-02-13T18:17:35.678 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:17:35.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:17:35.678 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:17:35.717 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: get_monmap_and_config 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: monmap: 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:35.733632+0000 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:35.733632+0000 2026-02-13T18:17:35.740 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.741 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.741 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.741 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:35.741 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:35.741 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 1 Processor -- start 2026-02-13T18:17:35.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 1 -- start start 2026-02-13T18:17:35.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: init 2026-02-13T18:17:35.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:17:35.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient(hunting): picked mon.noname-b con 0x7f5b6808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient(hunting): picked mon.noname-c con 0x7f5b6808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient(hunting): picked mon.noname-a con 0x7f5b6808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b68089e80 con 0x7f5b6808cdd0 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b68088c20 con 0x7f5b6808dc80 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b68089ba0 con 0x7f5b6808c2f0 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient(hunting): authenticate will time out at 1286.788765s 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b66575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 0x7f5b6808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45386/0 (socket says 10.20.193.78:45386) 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b66d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5b6808cdd0 0x7f5b681a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56478/0 (socket says 10.20.193.78:56478) 2026-02-13T18:17:35.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b66575640 1 -- 10.20.193.78:0/1318236442 learned_addr learned my addr 10.20.193.78:0/1318236442 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b66d76640 1 -- 10.20.193.78:0/1318236442 >> v1:10.20.193.78:6789/0 conn(0x7f5b6808cdd0 legacy=0x7f5b681a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b66575640 1 -- 10.20.193.78:0/1318236442 >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 legacy=0x7f5b6808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65d74640 1 -- 10.20.193.78:0/1318236442 >> v1:10.20.193.187:6789/0 conn(0x7f5b6808dc80 legacy=0x7f5b68181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136087114 0 0) 0x7f5b68089ba0 con 0x7f5b6808c2f0 2026-02-13T18:17:35.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): my global_id is 104099 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b54003620 con 0x7f5b6808c2f0 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517194407 0 0) 0x7f5b68089e80 con 0x7f5b6808cdd0 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): my global_id is 94230 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b68089ba0 con 0x7f5b6808cdd0 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334656412 0 0) 0x7f5b68088c20 con 0x7f5b6808dc80 2026-02-13T18:17:35.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient(hunting): my global_id is 84325 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b68089e80 con 0x7f5b6808dc80 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3154232140 0 0) 0x7f5b54003620 con 0x7f5b6808c2f0 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 >> v1:10.20.193.187:6789/0 conn(0x7f5b6808dc80 legacy=0x7f5b68181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 >> v1:10.20.193.78:6789/0 conn(0x7f5b6808cdd0 legacy=0x7f5b681a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 monclient: found mon.noname-b 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6808d370 con 0x7f5b6808c2f0 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b5c003040 con 0x7f5b6808c2f0 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: dump: 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.755 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 5 monclient: authenticate success, global_id 104099 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b66575640 1 --1- 10.20.193.78:0/1318236442 >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 0x7f5b6808c6c0 :-1 s=OPENED pgs=462 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f5b5c0049a0 mon_map magic: 0 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b5c003310 con 0x7f5b6808c2f0 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b65573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:35.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 4 set_mon_vals no callback set 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.730+0000 7f5b6cc5b640 10 monclient: shutdown 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/1318236442 >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 legacy=0x7f5b6808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b65573640 1 -- 10.20.193.78:0/1318236442 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b5c0049a0 con 0x7f5b6808c2f0 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b65573640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/1318236442 shutdown_connections 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/1318236442 >> 10.20.193.78:0/1318236442 conn(0x7f5b68091720 msgr2=0x7f5b68091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/1318236442 shutdown_connections 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/1318236442 wait complete. 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: monmap: 2026-02-13T18:17:35.757 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 Processor -- start 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- start start 2026-02-13T18:17:35.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: init 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient(hunting): picked mon.noname-c con 0x7f5b6808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient(hunting): picked mon.noname-b con 0x7f5b6808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient(hunting): picked mon.noname-a con 0x7f5b6808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b681540d0 con 0x7f5b6808dc80 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b68082460 con 0x7f5b6808cdd0 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b68088910 con 0x7f5b6808c2f0 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient(hunting): authenticate will time out at 1286.792868s 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b66575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 0x7f5b68083990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45400/0 (socket says 10.20.193.78:45400) 2026-02-13T18:17:35.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b66575640 1 -- 10.20.193.78:0/2046578333 learned_addr learned my addr 10.20.193.78:0/2046578333 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b66d76640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b6808dc80 legacy=0x7f5b68195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b66575640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 legacy=0x7f5b68083990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b65d74640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.187:6789/0 conn(0x7f5b6808cdd0 legacy=0x7f5b681944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282280737 0 0) 0x7f5b681540d0 con 0x7f5b6808dc80 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): my global_id is 94233 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b34003620 con 0x7f5b6808dc80 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584892542 0 0) 0x7f5b68088910 con 0x7f5b6808c2f0 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): my global_id is 104102 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b681540d0 con 0x7f5b6808c2f0 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606679854 0 0) 0x7f5b68082460 con 0x7f5b6808cdd0 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): my global_id is 84328 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b68088910 con 0x7f5b6808cdd0 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3890119437 0 0) 0x7f5b34003620 con 0x7f5b6808dc80 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b68082460 con 0x7f5b6808dc80 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b58004850 con 0x7f5b6808dc80 2026-02-13T18:17:35.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): dump: 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.762 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2649725632 0 0) 0x7f5b681540d0 con 0x7f5b6808c2f0 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b34003620 con 0x7f5b6808c2f0 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b5c0034c0 con 0x7f5b6808c2f0 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): dump: 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.763 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3296734475 0 0) 0x7f5b68088910 con 0x7f5b6808cdd0 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b681540d0 con 0x7f5b6808cdd0 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b500033d0 con 0x7f5b6808cdd0 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient(hunting): dump: 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2342190695 0 0) 0x7f5b68082460 con 0x7f5b6808dc80 2026-02-13T18:17:35.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6790/0 conn(0x7f5b6808c2f0 legacy=0x7f5b68083990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.187:6789/0 conn(0x7f5b6808cdd0 legacy=0x7f5b681944f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 monclient: found mon.a 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b680870a0 con 0x7f5b6808dc80 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 5 monclient: authenticate success, global_id 94233 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: _renew_subs 2026-02-13T18:17:35.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b68082180 con 0x7f5b6808dc80 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: _renew_subs 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b680840a0 con 0x7f5b6808dc80 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b580060a0 con 0x7f5b6808dc80 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b58006400 con 0x7f5b6808dc80 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b4effd640 10 monclient: dump: 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.767 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.734+0000 7f5b64d72640 4 set_mon_vals no callback set 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b6cc5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5b6808f620 con 0x7f5b68153170 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5b58006650 con 0x7f5b6808dc80 2026-02-13T18:17:35.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(591..591 src has 292..591) ==== 3963+0+0 (unknown 1268574373 0 0) 0x7f5b5804da70 con 0x7f5b6808dc80 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b65d74640 10 monclient: get_auth_request con 0x7f5b3403d9a0 auth_method 0 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b66575640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b68153170 legacy=0x7f5b6805b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584677675 0 0) 0x7f5b34003620 con 0x7f5b68153170 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient(hunting): my global_id is 94236 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b68082460 con 0x7f5b68153170 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 347346575 0 0) 0x7f5b68082460 con 0x7f5b68153170 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b34003620 con 0x7f5b68153170 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b5c004f30 con 0x7f5b68153170 2026-02-13T18:17:35.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient: dump: 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2639685761 0 0) 0x7f5b34003620 con 0x7f5b68153170 2026-02-13T18:17:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b68090810 con 0x7f5b68153170 2026-02-13T18:17:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5b5c005060 con 0x7f5b68153170 2026-02-13T18:17:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b68153170 legacy=0x7f5b6805b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.738+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b68153170 legacy=0x7f5b6805b4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.742+0000 7f5b6cc5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.742+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5b680510e0 con 0x7f5b6804d200 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b66575640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b6804d200 legacy=0x7f5b68198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038653531 0 0) 0x7f5b680510e0 con 0x7f5b6804d200 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient(hunting): my global_id is 94239 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b34003620 con 0x7f5b6804d200 2026-02-13T18:17:35.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1960632226 0 0) 0x7f5b34003620 con 0x7f5b6804d200 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b680510e0 con 0x7f5b6804d200 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5b5c005630 con 0x7f5b6804d200 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient: dump: 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.774 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 687642924 0 0) 0x7f5b680510e0 con 0x7f5b6804d200 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b68153540 con 0x7f5b6804d200 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 1696879604) 0x7f5b5c005980 con 0x7f5b6804d200 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b6804d200 legacy=0x7f5b68198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b4effd640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b6804d200 legacy=0x7f5b68198340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:35.775 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 44, 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 138793, 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.776 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:35.777 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:35.778 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:35.779 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:35.780 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:35.781 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:35.782 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:35.783 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.784 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:35.785 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.786 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:35.787 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.187:6812/2668687789 conn(0x7f5b3403d9a0 legacy=0x7f5b3405de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 10 monclient: shutdown 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 >> v1:10.20.193.78:6789/0 conn(0x7f5b6808dc80 legacy=0x7f5b68195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b66d76640 1 -- 10.20.193.78:0/2046578333 reap_dead start 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 shutdown_connections 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 >> 10.20.193.78:0/2046578333 conn(0x7f5b68091720 msgr2=0x7f5b68058c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 shutdown_connections 2026-02-13T18:17:35.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.746+0000 7f5b6cc5b640 1 -- 10.20.193.78:0/2046578333 wait complete. 2026-02-13T18:17:35.789 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:17:35.789 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:17:35.789 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:17:35.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient: get_monmap_and_config 2026-02-13T18:17:35.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient: monmap: 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:35.851967+0000 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:35.851967+0000 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:35.859 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 1 Processor -- start 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 1 -- start start 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient: init 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient(hunting): picked mon.noname-b con 0x7fa38c08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient(hunting): picked mon.noname-c con 0x7fa38c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient(hunting): picked mon.noname-a con 0x7fa38c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c089e80 con 0x7fa38c08cdd0 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c088c20 con 0x7fa38c08dc80 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c089ba0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa391c52640 10 monclient(hunting): authenticate will time out at 1286.907078s 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa38b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa38c08c2f0 0x7fa38c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45404/0 (socket says 10.20.193.78:45404) 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.846+0000 7fa38b7fe640 1 -- 10.20.193.78:0/1524615205 learned_addr learned my addr 10.20.193.78:0/1524615205 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38b7fe640 1 -- 10.20.193.78:0/1524615205 >> v1:10.20.193.78:6790/0 conn(0x7fa38c08c2f0 legacy=0x7fa38c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38bfff640 1 -- 10.20.193.78:0/1524615205 >> v1:10.20.193.78:6789/0 conn(0x7fa38c08cdd0 legacy=0x7fa38c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38affd640 1 -- 10.20.193.78:0/1524615205 >> v1:10.20.193.187:6789/0 conn(0x7fa38c08dc80 legacy=0x7fa38c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215958755 0 0) 0x7fa38c089ba0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): my global_id is 104105 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa370003620 con 0x7fa38c08c2f0 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588390865 0 0) 0x7fa38c089e80 con 0x7fa38c08cdd0 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient(hunting): my global_id is 94242 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c089ba0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1751248489 0 0) 0x7fa370003620 con 0x7fa38c08c2f0 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 >> v1:10.20.193.187:6789/0 conn(0x7fa38c08dc80 legacy=0x7fa38c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 >> v1:10.20.193.78:6789/0 conn(0x7fa38c08cdd0 legacy=0x7fa38c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 monclient: found mon.noname-b 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c08d370 con 0x7fa38c08c2f0 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa378003110 con 0x7fa38c08c2f0 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: dump: 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.868 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 5 monclient: authenticate success, global_id 104105 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3780033e0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 1 -- 10.20.193.78:0/1524615205 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa378004b50 con 0x7fa38c08c2f0 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38a7fc640 10 monclient: dump: 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.870 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 4 set_mon_vals no callback set 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: shutdown 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- 10.20.193.78:0/1524615205 >> v1:10.20.193.78:6790/0 conn(0x7fa38c08c2f0 legacy=0x7fa38c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- 10.20.193.78:0/1524615205 shutdown_connections 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- 10.20.193.78:0/1524615205 >> 10.20.193.78:0/1524615205 conn(0x7fa38c091720 msgr2=0x7fa38c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- 10.20.193.78:0/1524615205 shutdown_connections 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- 10.20.193.78:0/1524615205 wait complete. 2026-02-13T18:17:35.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: monmap: 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 Processor -- start 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- start start 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: init 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient(hunting): picked mon.noname-a con 0x7fa38c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient(hunting): picked mon.noname-c con 0x7fa38c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient(hunting): picked mon.noname-b con 0x7fa38c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c0821e0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c0824c0 con 0x7fa38c08dc80 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c085cb0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa391c52640 10 monclient(hunting): authenticate will time out at 1286.911778s 2026-02-13T18:17:35.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa38c08cdd0 0x7fa38c0839f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45420/0 (socket says 10.20.193.78:45420) 2026-02-13T18:17:35.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.850+0000 7fa38affd640 1 -- 10.20.193.78:0/1377435556 learned_addr learned my addr 10.20.193.78:0/1377435556 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa38affd640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c08cdd0 legacy=0x7fa38c0839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa38b7fe640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6789/0 conn(0x7fa38c08c2f0 legacy=0x7fa38c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461498933 0 0) 0x7fa38c085cb0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): my global_id is 104108 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35c003620 con 0x7fa38c08cdd0 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819904799 0 0) 0x7fa38c0821e0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): my global_id is 94245 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c085cb0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa38bfff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.187:6789/0 conn(0x7fa38c08dc80 legacy=0x7fa38c1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2661556629 0 0) 0x7fa35c003620 con 0x7fa38c08cdd0 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa38c0821e0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa37c003420 con 0x7fa38c08cdd0 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): dump: 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.881 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732768273 0 0) 0x7fa38c0824c0 con 0x7fa38c08dc80 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): my global_id is 84334 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35c003620 con 0x7fa38c08dc80 2026-02-13T18:17:35.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 108349238 0 0) 0x7fa38c085cb0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa38c0824c0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa3780048e0 con 0x7fa38c08c2f0 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient(hunting): dump: 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.883 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 681545873 0 0) 0x7fa38c0821e0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.187:6789/0 conn(0x7fa38c08dc80 legacy=0x7fa38c1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6789/0 conn(0x7fa38c08c2f0 legacy=0x7fa38c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 monclient: found mon.c 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c05de80 con 0x7fa38c08cdd0 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 5 monclient: authenticate success, global_id 104108 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 10 monclient: _renew_subs 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c081f00 con 0x7fa38c08cdd0 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 10 monclient: _renew_subs 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa38c084100 con 0x7fa38c08cdd0 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa37c0039c0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa37c003d20 con 0x7fa38c08cdd0 2026-02-13T18:17:35.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 10 monclient: dump: 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.886 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa389ffb640 4 set_mon_vals no callback set 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa38c08f5e0 con 0x7fa38c07a3d0 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa37c003fb0 con 0x7fa38c08cdd0 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(591..591 src has 292..591) ==== 3963+0+0 (unknown 1268574373 0 0) 0x7fa37c04c750 con 0x7fa38c08cdd0 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.854+0000 7fa38bfff640 10 monclient: get_auth_request con 0x7fa35c03d880 auth_method 0 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa38b7fe640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c07a3d0 legacy=0x7fa38c07a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3148488096 0 0) 0x7fa38c08f5e0 con 0x7fa38c07a3d0 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient(hunting): my global_id is 104111 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c0821e0 con 0x7fa38c07a3d0 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2223187771 0 0) 0x7fa38c0821e0 con 0x7fa38c07a3d0 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa38c08f5e0 con 0x7fa38c07a3d0 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa378004c70 con 0x7fa38c07a3d0 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient: dump: 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.888 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2309214213 0 0) 0x7fa38c08f5e0 con 0x7fa38c07a3d0 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa38c090810 con 0x7fa38c07a3d0 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa378007a20 con 0x7fa38c07a3d0 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c07a3d0 legacy=0x7fa38c07a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.858+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c07a3d0 legacy=0x7fa38c07a7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.862+0000 7fa391c52640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.862+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa38c080120 con 0x7fa38c07aeb0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.862+0000 7fa38b7fe640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c07aeb0 legacy=0x7fa38c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438258254 0 0) 0x7fa38c080120 con 0x7fa38c07aeb0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient(hunting): my global_id is 104114 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c08f5e0 con 0x7fa38c07aeb0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2678725412 0 0) 0x7fa38c08f5e0 con 0x7fa38c07aeb0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa38c080120 con 0x7fa38c07aeb0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa3780053e0 con 0x7fa38c07aeb0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient: dump: 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2489925707 0 0) 0x7fa38c080120 con 0x7fa38c07aeb0 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa38c0510e0 con 0x7fa38c07aeb0 2026-02-13T18:17:35.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4340 (unknown 0 0 1234141548) 0x7fa3780077b0 con 0x7fa38c07aeb0 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c07aeb0 legacy=0x7fa38c197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa367fff640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c07aeb0 legacy=0x7fa38c197c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:17:35.892 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 44, 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 367, 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:35.893 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:35.894 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:35.895 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:35.896 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.897 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:35.898 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:35.899 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:35.900 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:35.901 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:35.902 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:17:35.902 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:35.902 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:35.902 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:35.902 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:35.902 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa35c03d880 legacy=0x7fa35c05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 10 monclient: shutdown 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 >> v1:10.20.193.78:6790/0 conn(0x7fa38c08cdd0 legacy=0x7fa38c0839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa38bfff640 1 -- 10.20.193.78:0/1377435556 reap_dead start 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa38bfff640 1 -- 10.20.193.78:0/1377435556 reap_dead start 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 shutdown_connections 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 >> 10.20.193.78:0/1377435556 conn(0x7fa38c091720 msgr2=0x7fa38c05b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 shutdown_connections 2026-02-13T18:17:35.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.866+0000 7fa391c52640 1 -- 10.20.193.78:0/1377435556 wait complete. 2026-02-13T18:17:35.904 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:17:35.904 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:17:35.904 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:17:35.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.958+0000 7f57d7ec6640 10 monclient: get_monmap_and_config 2026-02-13T18:17:35.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.958+0000 7f57d7ec6640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.958+0000 7f57d7ec6640 10 monclient: monmap: 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:35.965345+0000 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:35.965345+0000 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:35.972 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 Processor -- start 2026-02-13T18:17:35.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- start start 2026-02-13T18:17:35.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient: init 2026-02-13T18:17:35.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient(hunting): picked mon.noname-c con 0x7f57d008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient(hunting): picked mon.noname-a con 0x7f57d008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient(hunting): picked mon.noname-b con 0x7f57d008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d0089e80 con 0x7f57d008dc80 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d0088c20 con 0x7f57d008c2f0 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d0089ba0 con 0x7f57d008cdd0 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient(hunting): authenticate will time out at 1287.020598s 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d543a640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f57d008dc80 0x7f57d0181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56556/0 (socket says 10.20.193.78:56556) 2026-02-13T18:17:35.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d543a640 1 -- 10.20.193.78:0/1080358756 learned_addr learned my addr 10.20.193.78:0/1080358756 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d543a640 1 -- 10.20.193.78:0/1080358756 >> v1:10.20.193.78:6789/0 conn(0x7f57d008dc80 legacy=0x7f57d0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d643c640 1 -- 10.20.193.78:0/1080358756 >> v1:10.20.193.78:6790/0 conn(0x7f57d008cdd0 legacy=0x7f57d01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d5c3b640 1 -- 10.20.193.78:0/1080358756 >> v1:10.20.193.187:6789/0 conn(0x7f57d008c2f0 legacy=0x7f57d008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425307386 0 0) 0x7f57d0089e80 con 0x7f57d008dc80 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): my global_id is 94248 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b8003620 con 0x7f57d008dc80 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197997432 0 0) 0x7f57d0089ba0 con 0x7f57d008cdd0 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient(hunting): my global_id is 104117 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d0089e80 con 0x7f57d008cdd0 2026-02-13T18:17:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3813597072 0 0) 0x7f57b8003620 con 0x7f57d008dc80 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 >> v1:10.20.193.78:6790/0 conn(0x7f57d008cdd0 legacy=0x7f57d01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 >> v1:10.20.193.187:6789/0 conn(0x7f57d008c2f0 legacy=0x7f57d008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 monclient: found mon.noname-a 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d008d370 con 0x7f57d008dc80 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 5 monclient: authenticate success, global_id 94248 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57c4003110 con 0x7f57d008dc80 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: dump: 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57c40033e0 con 0x7f57d008dc80 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 1 -- 10.20.193.78:0/1080358756 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57c4004b50 con 0x7f57d008dc80 2026-02-13T18:17:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d4c39640 10 monclient: dump: 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 4 set_mon_vals no callback set 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 10 monclient: shutdown 2026-02-13T18:17:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- 10.20.193.78:0/1080358756 >> v1:10.20.193.78:6789/0 conn(0x7f57d008dc80 legacy=0x7f57d0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- 10.20.193.78:0/1080358756 shutdown_connections 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- 10.20.193.78:0/1080358756 >> 10.20.193.78:0/1080358756 conn(0x7f57d0091720 msgr2=0x7f57d0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- 10.20.193.78:0/1080358756 shutdown_connections 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.962+0000 7f57d7ec6640 1 -- 10.20.193.78:0/1080358756 wait complete. 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: build_initial_monmap 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: monmap: 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:35.982 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 Processor -- start 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 -- start start 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: init 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient(hunting): picked mon.noname-a con 0x7f57d008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient(hunting): picked mon.noname-b con 0x7f57d008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient(hunting): picked mon.noname-c con 0x7f57d008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d0088910 con 0x7f57d008c2f0 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d00821f0 con 0x7f57d008cdd0 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d01535e0 con 0x7f57d008dc80 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient(hunting): authenticate will time out at 1287.024871s 2026-02-13T18:17:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d5c3b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f57d008c2f0 0x7f57d0152ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56568/0 (socket says 10.20.193.78:56568) 2026-02-13T18:17:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d5c3b640 1 -- 10.20.193.78:0/2963470221 learned_addr learned my addr 10.20.193.78:0/2963470221 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d643c640 1 --1- 10.20.193.78:0/2963470221 >> v1:10.20.193.78:6790/0 conn(0x7f57d008dc80 0x7f57d0195240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45480/0 (socket says 10.20.193.78:45480) 2026-02-13T18:17:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d5c3b640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.78:6789/0 conn(0x7f57d008c2f0 legacy=0x7f57d0152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d643c640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.78:6790/0 conn(0x7f57d008dc80 legacy=0x7f57d0195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585658974 0 0) 0x7f57d01535e0 con 0x7f57d008dc80 2026-02-13T18:17:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): my global_id is 104120 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a0003620 con 0x7f57d008dc80 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681042382 0 0) 0x7f57c0002d80 con 0x7f57d008c2f0 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): my global_id is 94251 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d01535e0 con 0x7f57d008c2f0 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d543a640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d008cdd0 legacy=0x7f57d0083720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 643893972 0 0) 0x7f57a0003620 con 0x7f57d008dc80 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57c0002d80 con 0x7f57d008dc80 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57cc004c20 con 0x7f57d008dc80 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): dump: 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1968835584 0 0) 0x7f57d01535e0 con 0x7f57d008c2f0 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57a0003620 con 0x7f57d008c2f0 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57c0003510 con 0x7f57d008c2f0 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): dump: 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046726096 0 0) 0x7f57d00821f0 con 0x7f57d008cdd0 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient(hunting): my global_id is 84340 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d01535e0 con 0x7f57d008cdd0 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2683797570 0 0) 0x7f57c0002d80 con 0x7f57d008dc80 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d008cdd0 legacy=0x7f57d0083720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.78:6789/0 conn(0x7f57d008c2f0 legacy=0x7f57d0152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 monclient: found mon.c 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d0087230 con 0x7f57d008dc80 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: _finish_auth 0 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 5 monclient: authenticate success, global_id 104120 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: _renew_subs 2026-02-13T18:17:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f57d0081950 con 0x7f57d008dc80 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: _renew_subs 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f57d0083e30 con 0x7f57d008dc80 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57cc0050f0 con 0x7f57d008dc80 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57cc005490 con 0x7f57d008dc80 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57be7fc640 10 monclient: dump: 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.992 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.966+0000 7f57bffff640 4 set_mon_vals no callback set 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57d7ec6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f57d008f5e0 con 0x7f57d005b260 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f57cc005670 con 0x7f57d008dc80 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(591..591 src has 292..591) ==== 3963+0+0 (unknown 1268574373 0 0) 0x7f57cc04db10 con 0x7f57d008dc80 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57d543a640 10 monclient: get_auth_request con 0x7f57a003d880 auth_method 0 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57d5c3b640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d005b260 legacy=0x7f57d004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3894636844 0 0) 0x7f57d008f5e0 con 0x7f57d005b260 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient(hunting): my global_id is 84343 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57c0002d80 con 0x7f57d005b260 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4189603370 0 0) 0x7f57c0002d80 con 0x7f57d005b260 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57d008f5e0 con 0x7f57d005b260 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57c0003c30 con 0x7f57d005b260 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient: dump: 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.994 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 121893901 0 0) 0x7f57d008f5e0 con 0x7f57d005b260 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57d0090810 con 0x7f57d005b260 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f57c00058c0 con 0x7f57d005b260 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d005b260 legacy=0x7f57d004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.970+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d005b260 legacy=0x7f57d004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.974+0000 7f57d7ec6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:35.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.974+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f57d00510e0 con 0x7f57d005b630 2026-02-13T18:17:35.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d5c3b640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d005b630 legacy=0x7f57d0197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:35.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329806833 0 0) 0x7f57d00510e0 con 0x7f57d005b630 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient(hunting): my global_id is 84346 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d008f5e0 con 0x7f57d005b630 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2466466776 0 0) 0x7f57d008f5e0 con 0x7f57d005b630 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57d00510e0 con 0x7f57d005b630 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f57c00042e0 con 0x7f57d005b630 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient: dump: 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:35.997 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3510994994 0 0) 0x7f57d00510e0 con 0x7f57d005b630 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f57d004d910 con 0x7f57d005b630 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 2476413360) 0x7f57c0005b20 con 0x7f57d005b630 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d005b630 legacy=0x7f57d0197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:35.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57be7fc640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6789/0 conn(0x7f57d005b630 legacy=0x7f57d0197970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 44, 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 284145, 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:35.999 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:36.000 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:36.001 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:36.002 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:36.003 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:36.004 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:36.005 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:36.006 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:36.007 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:36.008 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:36.009 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.187:6812/2668687789 conn(0x7f57a003d880 legacy=0x7f57a005dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 10 monclient: shutdown 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 >> v1:10.20.193.78:6790/0 conn(0x7f57d008dc80 legacy=0x7f57d0195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d643c640 1 -- 10.20.193.78:0/2963470221 reap_dead start 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d643c640 1 -- 10.20.193.78:0/2963470221 reap_dead start 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 shutdown_connections 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 >> 10.20.193.78:0/2963470221 conn(0x7f57d0091720 msgr2=0x7f57d00589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 shutdown_connections 2026-02-13T18:17:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:35.978+0000 7f57d7ec6640 1 -- 10.20.193.78:0/2963470221 wait complete. 2026-02-13T18:17:36.011 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:17:36.011 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:17:36.011 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:17:36.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient: get_monmap_and_config 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient: build_initial_monmap 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient: monmap: 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:36.075276+0000 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:36.075276+0000 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:36.082 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:36.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 1 Processor -- start 2026-02-13T18:17:36.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 1 -- start start 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient: init 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient(hunting): picked mon.noname-b con 0x7f80e008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient(hunting): picked mon.noname-a con 0x7f80e008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient(hunting): picked mon.noname-c con 0x7f80e008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0089e80 con 0x7f80e008dc80 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0088c20 con 0x7f80e008cdd0 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0089ba0 con 0x7f80e008c2f0 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80e66d4640 10 monclient(hunting): authenticate will time out at 1287.130379s 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80dffff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f80e008c2f0 0x7f80e008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45488/0 (socket says 10.20.193.78:45488) 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80dffff640 1 -- 10.20.193.78:0/2201632276 learned_addr learned my addr 10.20.193.78:0/2201632276 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:36.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.070+0000 7f80df7fe640 1 --1- 10.20.193.78:0/2201632276 >> v1:10.20.193.78:6789/0 conn(0x7f80e008dc80 0x7f80e0181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56574/0 (socket says 10.20.193.78:56574) 2026-02-13T18:17:36.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80dffff640 1 -- 10.20.193.78:0/2201632276 >> v1:10.20.193.78:6790/0 conn(0x7f80e008c2f0 legacy=0x7f80e008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:36.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80df7fe640 1 -- 10.20.193.78:0/2201632276 >> v1:10.20.193.78:6789/0 conn(0x7f80e008dc80 legacy=0x7f80e0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:36.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942932079 0 0) 0x7f80e0089ba0 con 0x7f80e008c2f0 2026-02-13T18:17:36.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:36.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:36.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): my global_id is 104123 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80c4003620 con 0x7f80e008c2f0 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503176324 0 0) 0x7f80e0089e80 con 0x7f80e008dc80 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient(hunting): my global_id is 94254 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e0089ba0 con 0x7f80e008dc80 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e4c4a640 1 -- 10.20.193.78:0/2201632276 >> v1:10.20.193.187:6789/0 conn(0x7f80e008cdd0 legacy=0x7f80e01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763693995 0 0) 0x7f80c4003620 con 0x7f80e008c2f0 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 >> v1:10.20.193.187:6789/0 conn(0x7f80e008cdd0 legacy=0x7f80e01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 >> v1:10.20.193.78:6789/0 conn(0x7f80e008dc80 legacy=0x7f80e0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: _finish_hunting 0 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 monclient: found mon.noname-b 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:36.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e008d370 con 0x7f80e008c2f0 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: _finish_auth 0 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: _check_auth_tickets 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 5 monclient: authenticate success, global_id 104123 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f80cc003110 con 0x7f80e008c2f0 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: dump: 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:36.089 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80cc0033e0 con 0x7f80e008c2f0 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 1 -- 10.20.193.78:0/2201632276 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f80cc004b50 con 0x7f80e008c2f0 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80deffd640 10 monclient: dump: 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:36.090 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 4 set_mon_vals no callback set 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: shutdown 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- 10.20.193.78:0/2201632276 >> v1:10.20.193.78:6790/0 conn(0x7f80e008c2f0 legacy=0x7f80e008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- 10.20.193.78:0/2201632276 shutdown_connections 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- 10.20.193.78:0/2201632276 >> 10.20.193.78:0/2201632276 conn(0x7f80e0091720 msgr2=0x7f80e0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- 10.20.193.78:0/2201632276 shutdown_connections 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- 10.20.193.78:0/2201632276 wait complete. 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: build_initial_monmap 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: monmap: 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:36.091 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 Processor -- start 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- start start 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: init 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient(hunting): picked mon.noname-a con 0x7f80e008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient(hunting): picked mon.noname-c con 0x7f80e008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient(hunting): picked mon.noname-b con 0x7f80e008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e00574a0 con 0x7f80e008c2f0 2026-02-13T18:17:36.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e005dc70 con 0x7f80e008dc80 2026-02-13T18:17:36.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0088910 con 0x7f80e008cdd0 2026-02-13T18:17:36.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:36.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80e66d4640 10 monclient(hunting): authenticate will time out at 1287.134972s 2026-02-13T18:17:36.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80dffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f80e008c2f0 0x7f80e0083960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56588/0 (socket says 10.20.193.78:56588) 2026-02-13T18:17:36.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.074+0000 7f80dffff640 1 -- 10.20.193.78:0/3711565540 learned_addr learned my addr 10.20.193.78:0/3711565540 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80df7fe640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6790/0 conn(0x7f80e008cdd0 legacy=0x7f80e0194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dffff640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6789/0 conn(0x7f80e008c2f0 legacy=0x7f80e0083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910420898 0 0) 0x7f80e0088910 con 0x7f80e008cdd0 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _negotiate 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): my global_id is 104126 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80b0003620 con 0x7f80e008cdd0 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887980215 0 0) 0x7f80e00574a0 con 0x7f80e008c2f0 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _negotiate 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): my global_id is 94257 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e0088910 con 0x7f80e008c2f0 2026-02-13T18:17:36.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80df7fe640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6790/0 conn(0x7f80e008cdd0 legacy=0x7f80e0194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80df7fe640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6790/0 conn(0x7f80e008cdd0 legacy=0x7f80e0194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80df7fe640 1 --1- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6790/0 conn(0x7f80e008cdd0 0x7f80e0194460 :-1 s=OPENED pgs=471 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80df7fe640 1 --1- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6790/0 conn(0x7f80e008cdd0 0x7f80e0194460 :-1 s=OPENED pgs=471 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6790/0 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2876275999 0 0) 0x7f80e0088910 con 0x7f80e008c2f0 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80e00574a0 con 0x7f80e008c2f0 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f80cc0048e0 con 0x7f80e008c2f0 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): dump: 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:36.097 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e4c4a640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.187:6789/0 conn(0x7f80e008dc80 legacy=0x7f80e0195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1293815239 0 0) 0x7f80e00574a0 con 0x7f80e008c2f0 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6790/0 conn(0x7f80e008cdd0 legacy=0x7f80e0194460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.187:6789/0 conn(0x7f80e008dc80 legacy=0x7f80e0195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: _finish_hunting 0 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 monclient: found mon.a 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e0087280 con 0x7f80e008c2f0 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: _finish_auth 0 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: _check_auth_tickets 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:36.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 5 monclient: authenticate success, global_id 94257 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 monclient: _renew_subs 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80e0082150 con 0x7f80e008c2f0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 monclient: _renew_subs 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f80e0084070 con 0x7f80e008c2f0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80cc0033c0 con 0x7f80e008c2f0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f80cc004b50 con 0x7f80e008c2f0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 10 monclient: dump: 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:36.099 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80de7fc640 4 set_mon_vals no callback set 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f80cc011810 con 0x7f80e008c2f0 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e008f620 con 0x7f80e008c2f0 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(591..591 src has 292..591) ==== 3963+0+0 (unknown 1268574373 0 0) 0x7f80cc04c6f0 con 0x7f80e008c2f0 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.078+0000 7f80df7fe640 10 monclient: get_auth_request con 0x7f80b003d4f0 auth_method 0 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.082+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f80e008f620 con 0x7f80e008c2f0 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.082+0000 7f80dcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:36.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.082+0000 7f80dcff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:36.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:17:36.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:17:36.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:36.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f80e0090810 con 0x7f80e008c2f0 2026-02-13T18:17:36.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80dcff9640 1 -- 10.20.193.78:0/3711565540 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f80cc017670 con 0x7f80e008c2f0 2026-02-13T18:17:36.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80dcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:17:36.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80dcff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:36.215 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.202+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.215 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.202+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=820042391,config=1618278320,health=3455443743,kv=4087868365,logm=2878728813}) 2026-02-13T18:17:36.216 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.202+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=12,kv=11,logm=57} crc {auth=309776177,config=1618278320,health=2727677313,kv=4087868365,logm=3147166903}) 2026-02-13T18:17:36.216 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.202+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.216 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.202+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=820042391,config=1618278320,health=3455443743,kv=4087868365,logm=2878728813}) 2026-02-13T18:17:36.216 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.202+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=13,kv=11,logm=57} crc {auth=2175872767,config=1618278320,health=3811746669,kv=4087868365,logm=838868534}) 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.187:6812/2668687789 conn(0x7f80b003d4f0 legacy=0x7f80b005d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 10 monclient: shutdown 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 >> v1:10.20.193.78:6789/0 conn(0x7f80e008c2f0 legacy=0x7f80e0083960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 shutdown_connections 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 >> 10.20.193.78:0/3711565540 conn(0x7f80e0091720 msgr2=0x7f80e0058cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 shutdown_connections 2026-02-13T18:17:36.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:36.202+0000 7f80e66d4640 1 -- 10.20.193.78:0/3711565540 wait complete. 2026-02-13T18:17:36.219 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.219 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1191786337}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1275173669}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1191786337}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2551091544}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2426370594}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203802313}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2426370594}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3557920760}) 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.220 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3617700771}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=301901304}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3617700771}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1959992779}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4044230339}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196230777}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4044230339}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1946826849}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1076385091}) 2026-02-13T18:17:36.221 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1647724739}) 2026-02-13T18:17:36.222 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.222 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1076385091}) 2026-02-13T18:17:36.222 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.206+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2413649311}) 2026-02-13T18:17:36.222 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.210+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.223 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.210+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2092401666}) 2026-02-13T18:17:36.223 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.210+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2694944397}) 2026-02-13T18:17:36.223 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.210+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.223 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.210+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2092401666}) 2026-02-13T18:17:36.223 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.210+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=181581488}) 2026-02-13T18:17:36.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:17:36.230 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.230 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2518904464}) 2026-02-13T18:17:36.230 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820011945}) 2026-02-13T18:17:36.230 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.230 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2518904464}) 2026-02-13T18:17:36.230 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=339247612}) 2026-02-13T18:17:36.231 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2537658418}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3948912232}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2537658418}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2400986950}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=436048122}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3172589456}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=436048122}) 2026-02-13T18:17:36.232 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.218+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=431300863}) 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4165942297}) 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933008260}) 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4165942297}) 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2697002088}) 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.234 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2807238735}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435967211}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2807238735}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3135976478}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=378463082}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880706764}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=378463082}) 2026-02-13T18:17:36.235 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3844003991}) 2026-02-13T18:17:36.237 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=747261331}) 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526080596}) 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=747261331}) 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=586996362}) 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2884427845}) 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1314722881}) 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.238 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2884427845}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.222+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2951115172}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=768701825}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3997704467}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=768701825}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3073385931}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1443233219}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=353880608}) 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.239 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1443233219}) 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=746088496}) 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4247539310}) 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2085297240}) 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4247539310}) 2026-02-13T18:17:36.240 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3929374117}) 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=582036208}) 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4162008944}) 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=582036208}) 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2611214437}) 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.243 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1106545088}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2396698004}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1106545088}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=740655602}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2547525985}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265199608}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2547525985}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.226+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3933553863}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1016479146}) 2026-02-13T18:17:36.244 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=787932810}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1016479146}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3716085814}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3525938342}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10031942}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3525938342}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1240826693}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3188593348}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2934611668}) 2026-02-13T18:17:36.245 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3188593348}) 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1100146108}) 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1544543039}) 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82954474}) 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1544543039}) 2026-02-13T18:17:36.246 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=825090293}) 2026-02-13T18:17:36.249 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1} crc {logm=3595461106,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=3202418915,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=55734535,osd_metadata=1252444728,osd_pg_creating=3070495546}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=56,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=3990940116,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=209471756,mon_config_key=2172609631,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3542048198}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1} crc {logm=3595461106,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=3202418915,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=55734535,osd_metadata=1252444728,osd_pg_creating=3070495546}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.230+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=3460260050,mdsmap=685858242,mgr=12400356,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=3528947043,mon_config_key=3718364256,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=2500976215}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=1677948554}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=2709119188}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=1677948554}) 2026-02-13T18:17:36.250 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=353633818}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=3948893440,osdmap=647707678}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=2316270083,osdmap=4139595288}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=3948893440,osdmap=647707678}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=8,osdmap=92} crc {osd_snap=3796920930,osdmap=1042462437}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3560222511}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1291112275}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3560222511}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3851539119}) 2026-02-13T18:17:36.251 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2178712604}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1016689458}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2178712604}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.234+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2910823968}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1515469586}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1093597860}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1515469586}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=455001470}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=60} crc {osdmap=461006044}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=3145315566}) 2026-02-13T18:17:36.252 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:17:36.253 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=60} crc {osdmap=461006044}) 2026-02-13T18:17:36.253 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:17:36.238+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=60} crc {osdmap=1153352997}) 2026-02-13T18:17:36.632 INFO:tasks.rados.rados.0.trial187.stdout:2593: done (1 left) 2026-02-13T18:17:36.632 INFO:tasks.rados.rados.0.trial187.stdout:2594: done (0 left) 2026-02-13T18:17:36.632 INFO:tasks.rados.rados.0.trial187.stdout:2595: write oid 6 current snap is 287 2026-02-13T18:17:36.632 INFO:tasks.rados.rados.0.trial187.stdout:2595: seq_num 866 ranges {554862=713523,1926465=599969} 2026-02-13T18:17:36.641 INFO:tasks.rados.rados.0.trial187.stdout:2595: writing trial18717860-6 from 554862 to 1268385 tid 1 2026-02-13T18:17:36.649 INFO:tasks.rados.rados.0.trial187.stdout:2595: writing trial18717860-6 from 1926465 to 2526434 tid 2 2026-02-13T18:17:36.649 INFO:tasks.rados.rados.0.trial187.stdout:2596: read oid 33 snap -1 2026-02-13T18:17:36.650 INFO:tasks.rados.rados.0.trial187.stdout:2596: expect (ObjNum 822 snap 279 seq_num 822) 2026-02-13T18:17:36.650 INFO:tasks.rados.rados.0.trial187.stdout:2597: read oid 14 snap -1 2026-02-13T18:17:36.650 INFO:tasks.rados.rados.0.trial187.stdout:2597: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:36.650 INFO:tasks.rados.rados.0.trial187.stdout:2598: delete oid 11 current snap is 287 2026-02-13T18:17:36.650 INFO:tasks.rados.rados.0.trial187.stdout:2595: finishing write tid 1 to trial18717860-6 2026-02-13T18:17:36.651 INFO:tasks.rados.rados.0.trial187.stdout:2595: finishing write tid 2 to trial18717860-6 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:2595: finishing write tid 3 to trial18717860-6 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:2595: finishing write tid 4 to trial18717860-6 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:2595: oid 6 updating version 0 to 1185 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:2595: oid 6 version 1185 is already newer than 1183 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:2595: oid 6 version 1185 is already newer than 1184 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1185 (ObjNum 866 snap 287 seq_num 866) dirty exists 2026-02-13T18:17:36.652 INFO:tasks.rados.rados.0.trial187.stdout:2595: left oid 6 (ObjNum 866 snap 287 seq_num 866) 2026-02-13T18:17:36.654 INFO:tasks.rados.rados.0.trial187.stdout:2596: expect (ObjNum 822 snap 279 seq_num 822) 2026-02-13T18:17:36.668 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2071693 2026-02-13T18:17:36.741 INFO:tasks.rados.rados.0.trial187.stdout:2597: expect (ObjNum 773 snap 265 seq_num 773) 2026-02-13T18:17:36.783 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:36.866 INFO:tasks.rados.rados.0.trial187.stdout:2595: done (3 left) 2026-02-13T18:17:36.866 INFO:tasks.rados.rados.0.trial187.stdout:2596: done (2 left) 2026-02-13T18:17:36.866 INFO:tasks.rados.rados.0.trial187.stdout:2597: done (1 left) 2026-02-13T18:17:36.866 INFO:tasks.rados.rados.0.trial187.stdout:2598: done (0 left) 2026-02-13T18:17:36.866 INFO:tasks.rados.rados.0.trial187.stdout:2599: delete oid 20 current snap is 287 2026-02-13T18:17:36.867 INFO:tasks.rados.rados.0.trial187.stdout:2599: done (0 left) 2026-02-13T18:17:36.867 INFO:tasks.rados.rados.0.trial187.stdout:2600: delete oid 10 current snap is 287 2026-02-13T18:17:36.869 INFO:tasks.rados.rados.0.trial187.stdout:2600: done (0 left) 2026-02-13T18:17:36.869 INFO:tasks.rados.rados.0.trial187.stdout:2601: snap_remove snap 264 2026-02-13T18:17:37.227 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:17:37.227 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:17:37.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient: get_monmap_and_config 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient: monmap: 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:37.292055+0000 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:37.292055+0000 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:37.299 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:37.300 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 1 Processor -- start 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 1 -- start start 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient: init 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient(hunting): picked mon.noname-b con 0x7f5604085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient(hunting): picked mon.noname-a con 0x7f5604085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient(hunting): picked mon.noname-c con 0x7f5604181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5604088400 con 0x7f5604085b60 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5604088120 con 0x7f5604181d50 2026-02-13T18:17:37.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560408c550 con 0x7f5604085790 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f560bd2c640 10 monclient(hunting): authenticate will time out at 1288.347413s 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f5609aa1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5604085790 0x7f5604089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45508/0 (socket says 10.20.193.78:45508) 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f5609aa1640 1 -- 10.20.193.78:0/3300360414 learned_addr learned my addr 10.20.193.78:0/3300360414 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.286+0000 7f56092a0640 1 --1- 10.20.193.78:0/3300360414 >> v1:10.20.193.78:6789/0 conn(0x7f5604085b60 0x7f5604085fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56610/0 (socket says 10.20.193.78:56610) 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f56092a0640 1 -- 10.20.193.78:0/3300360414 >> v1:10.20.193.78:6789/0 conn(0x7f5604085b60 legacy=0x7f5604085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5609aa1640 1 -- 10.20.193.78:0/3300360414 >> v1:10.20.193.78:6790/0 conn(0x7f5604085790 legacy=0x7f5604089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895211876 0 0) 0x7f55f8002c60 con 0x7f5604085b60 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): my global_id is 94260 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec0058b0 con 0x7f5604085b60 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564331693 0 0) 0x7f560408c550 con 0x7f5604085790 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient(hunting): my global_id is 104129 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f8002c60 con 0x7f5604085790 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560a2a2640 1 -- 10.20.193.78:0/3300360414 >> v1:10.20.193.187:6789/0 conn(0x7f5604181d50 legacy=0x7f56041a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2247464198 0 0) 0x7f55ec0058b0 con 0x7f5604085b60 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 >> v1:10.20.193.78:6790/0 conn(0x7f5604085790 legacy=0x7f5604089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 >> v1:10.20.193.187:6789/0 conn(0x7f5604181d50 legacy=0x7f56041a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 monclient: found mon.noname-a 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5604087540 con 0x7f5604085b60 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f55f8003360 con 0x7f5604085b60 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:37.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: dump: 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 5 monclient: authenticate success, global_id 94260 2026-02-13T18:17:37.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55f80048e0 con 0x7f5604085b60 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 1 -- 10.20.193.78:0/3300360414 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f55f8004c70 con 0x7f5604085b60 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f5608a9f640 10 monclient: dump: 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.310 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 4 set_mon_vals no callback set 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: shutdown 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- 10.20.193.78:0/3300360414 >> v1:10.20.193.78:6789/0 conn(0x7f5604085b60 legacy=0x7f5604085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- 10.20.193.78:0/3300360414 shutdown_connections 2026-02-13T18:17:37.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- 10.20.193.78:0/3300360414 >> 10.20.193.78:0/3300360414 conn(0x7f5604091720 msgr2=0x7f5604091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- 10.20.193.78:0/3300360414 shutdown_connections 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- 10.20.193.78:0/3300360414 wait complete. 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: monmap: 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:37.312 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 Processor -- start 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- start start 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: init 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient(hunting): picked mon.noname-b con 0x7f5604085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient(hunting): picked mon.noname-a con 0x7f5604085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient(hunting): picked mon.noname-c con 0x7f5604181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560413f580 con 0x7f5604085b60 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5604153e40 con 0x7f5604085790 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560413f860 con 0x7f5604181d50 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560bd2c640 10 monclient(hunting): authenticate will time out at 1288.351911s 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f56092a0640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5604085b60 0x7f5604153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56620/0 (socket says 10.20.193.78:56620) 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f560a2a2640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5604181d50 0x7f56041755d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45510/0 (socket says 10.20.193.78:45510) 2026-02-13T18:17:37.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.290+0000 7f56092a0640 1 -- 10.20.193.78:0/4156155404 learned_addr learned my addr 10.20.193.78:0/4156155404 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560a2a2640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.78:6790/0 conn(0x7f5604181d50 legacy=0x7f56041755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f56092a0640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.78:6789/0 conn(0x7f5604085b60 legacy=0x7f5604153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498532768 0 0) 0x7f560413f860 con 0x7f5604181d50 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): my global_id is 104132 2026-02-13T18:17:37.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d4003620 con 0x7f5604181d50 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284566384 0 0) 0x7f560413f580 con 0x7f5604085b60 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): my global_id is 94263 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560413f860 con 0x7f5604085b60 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f5609aa1640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.187:6789/0 conn(0x7f5604085790 legacy=0x7f5604153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1406243519 0 0) 0x7f55d4003620 con 0x7f5604181d50 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f560413f580 con 0x7f5604181d50 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5600004860 con 0x7f5604181d50 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.319 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): dump: 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:37.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 656994627 0 0) 0x7f560413f860 con 0x7f5604085b60 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55d4003620 con 0x7f5604085b60 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f55f80031b0 con 0x7f5604085b60 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient(hunting): dump: 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.321 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2207882267 0 0) 0x7f560413f580 con 0x7f5604181d50 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.187:6789/0 conn(0x7f5604085790 legacy=0x7f5604153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.78:6789/0 conn(0x7f5604085b60 legacy=0x7f5604153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 monclient: found mon.c 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560405d440 con 0x7f5604181d50 2026-02-13T18:17:37.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 5 monclient: authenticate success, global_id 104132 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 monclient: _renew_subs 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5604088910 con 0x7f5604181d50 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 monclient: _renew_subs 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f560413ffc0 con 0x7f5604181d50 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5600004ed0 con 0x7f5604181d50 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5600005230 con 0x7f5604181d50 2026-02-13T18:17:37.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 10 monclient: dump: 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.324 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f3fff640 4 set_mon_vals no callback set 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56040389c0 con 0x7f5604181d50 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5600005410 con 0x7f5604181d50 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.294+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(592..592 src has 292..592) ==== 3963+0+0 (unknown 3003050417 0 0) 0x7f560004da70 con 0x7f5604181d50 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.298+0000 7f5609aa1640 10 monclient: get_auth_request con 0x7f55d403d6e0 auth_method 0 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.298+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f5600018a50 con 0x7f5604181d50 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.298+0000 7f55f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.298+0000 7f55f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f560413d550 con 0x7f5604181d50 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f55f27fc640 1 -- 10.20.193.78:0/4156155404 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1475664069) 0x7f5600018330 con 0x7f5604181d50 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f55f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:37.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f55f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:37.434 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.187:6812/2668687789 conn(0x7f55d403d6e0 legacy=0x7f55d405db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 10 monclient: shutdown 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 >> v1:10.20.193.78:6790/0 conn(0x7f5604181d50 legacy=0x7f56041755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 shutdown_connections 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 >> 10.20.193.78:0/4156155404 conn(0x7f5604091720 msgr2=0x7f560405cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 shutdown_connections 2026-02-13T18:17:37.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.422+0000 7f560bd2c640 1 -- 10.20.193.78:0/4156155404 wait complete. 2026-02-13T18:17:37.443 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:17:37.444 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:17:37.444 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:17:37.444 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:17:37.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient: get_monmap_and_config 2026-02-13T18:17:37.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient: monmap: 2026-02-13T18:17:37.514 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.514 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:37.507737+0000 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:37.507737+0000 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:37.515 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 1 Processor -- start 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 1 -- start start 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient: init 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient(hunting): picked mon.noname-b con 0x7fca1c08e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient(hunting): picked mon.noname-a con 0x7fca1c08d940 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient(hunting): picked mon.noname-c con 0x7fca1c08eee0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c08bfe0 con 0x7fca1c08d940 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c08d000 con 0x7fca1c08eee0 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c08d1d0 con 0x7fca1c08e400 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca24292640 10 monclient(hunting): authenticate will time out at 1288.562886s 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca22007640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fca1c08e400 0x7fca1c08e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45516/0 (socket says 10.20.193.78:45516) 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.502+0000 7fca22007640 1 -- 10.20.193.78:0/3467194653 learned_addr learned my addr 10.20.193.78:0/3467194653 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca22007640 1 -- 10.20.193.78:0/3467194653 >> v1:10.20.193.78:6790/0 conn(0x7fca1c08e400 legacy=0x7fca1c08e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21806640 1 -- 10.20.193.78:0/3467194653 >> v1:10.20.193.78:6789/0 conn(0x7fca1c08d940 legacy=0x7fca1c181d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501936980 0 0) 0x7fca1c08d1d0 con 0x7fca1c08e400 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): my global_id is 104135 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca04003620 con 0x7fca1c08e400 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca22808640 1 -- 10.20.193.78:0/3467194653 >> v1:10.20.193.187:6789/0 conn(0x7fca1c08eee0 legacy=0x7fca1c1a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002538610 0 0) 0x7fca1c08bfe0 con 0x7fca1c08d940 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient(hunting): my global_id is 94266 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c08d1d0 con 0x7fca1c08d940 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763365890 0 0) 0x7fca04003620 con 0x7fca1c08e400 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 >> v1:10.20.193.187:6789/0 conn(0x7fca1c08eee0 legacy=0x7fca1c1a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 >> v1:10.20.193.78:6789/0 conn(0x7fca1c08d940 legacy=0x7fca1c181d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 monclient: found mon.noname-b 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c08d3a0 con 0x7fca1c08e400 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca0c003110 con 0x7fca1c08e400 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 5 monclient: authenticate success, global_id 104135 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: dump: 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.524 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca0c003450 con 0x7fca1c08e400 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 1 -- 10.20.193.78:0/3467194653 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca0c004b50 con 0x7fca1c08e400 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21005640 10 monclient: dump: 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 4 set_mon_vals no callback set 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: shutdown 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- 10.20.193.78:0/3467194653 >> v1:10.20.193.78:6790/0 conn(0x7fca1c08e400 legacy=0x7fca1c08e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- 10.20.193.78:0/3467194653 shutdown_connections 2026-02-13T18:17:37.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- 10.20.193.78:0/3467194653 >> 10.20.193.78:0/3467194653 conn(0x7fca1c054e30 msgr2=0x7fca1c093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- 10.20.193.78:0/3467194653 shutdown_connections 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- 10.20.193.78:0/3467194653 wait complete. 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: monmap: 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:37.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 Processor -- start 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- start start 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: init 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient(hunting): picked mon.noname-b con 0x7fca1c08d940 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient(hunting): picked mon.noname-a con 0x7fca1c08e400 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient(hunting): picked mon.noname-c con 0x7fca1c08eee0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c13d5c0 con 0x7fca1c08e400 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c08abf0 con 0x7fca1c08d940 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c13f920 con 0x7fca1c08eee0 2026-02-13T18:17:37.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca24292640 10 monclient(hunting): authenticate will time out at 1288.567560s 2026-02-13T18:17:37.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21806640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fca1c08e400 0x7fca1c1924f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56642/0 (socket says 10.20.193.78:56642) 2026-02-13T18:17:37.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.506+0000 7fca21806640 1 -- 10.20.193.78:0/2685971558 learned_addr learned my addr 10.20.193.78:0/2685971558 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca21806640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c08e400 legacy=0x7fca1c1924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca22808640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6790/0 conn(0x7fca1c08eee0 legacy=0x7fca1c193c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082406128 0 0) 0x7fca1c13d5c0 con 0x7fca1c08e400 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): my global_id is 94269 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9ec003620 con 0x7fca1c08e400 2026-02-13T18:17:37.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241313875 0 0) 0x7fca1c13f920 con 0x7fca1c08eee0 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 10 monclient(hunting): my global_id is 104138 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c13d5c0 con 0x7fca1c08eee0 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca22007640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.187:6789/0 conn(0x7fca1c08d940 legacy=0x7fca1c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.510+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3900248161 0 0) 0x7fc9ec003620 con 0x7fca1c08e400 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca1c13f920 con 0x7fca1c08e400 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4045369575 0 0) 0x7fca1c13d5c0 con 0x7fca1c08eee0 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9ec003620 con 0x7fca1c08eee0 2026-02-13T18:17:37.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787646093 0 0) 0x7fca1c08abf0 con 0x7fca1c08d940 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): my global_id is 84364 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c13d5c0 con 0x7fca1c08d940 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca10003370 con 0x7fca1c08e400 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): dump: 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.535 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca18004890 con 0x7fca1c08eee0 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): dump: 2026-02-13T18:17:37.536 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 405421022 0 0) 0x7fc9ec003620 con 0x7fca1c08eee0 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.187:6789/0 conn(0x7fca1c08d940 legacy=0x7fca1c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c08e400 legacy=0x7fca1c1924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 monclient: found mon.c 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c13f080 con 0x7fca1c08eee0 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 5 monclient: authenticate success, global_id 104138 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 10 monclient: _renew_subs 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c13e120 con 0x7fca1c08eee0 2026-02-13T18:17:37.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 10 monclient: _renew_subs 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fca1c141730 con 0x7fca1c08eee0 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca18004ed0 con 0x7fca1c08eee0 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca18005260 con 0x7fca1c08eee0 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: dump: 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.539 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca20804640 4 set_mon_vals no callback set 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fca1c0008e0 con 0x7fca1c151360 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fca18005440 con 0x7fca1c08eee0 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(592..592 src has 292..592) ==== 3963+0+0 (unknown 3003050417 0 0) 0x7fca1804d970 con 0x7fca1c08eee0 2026-02-13T18:17:37.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca21806640 10 monclient: get_auth_request con 0x7fc9ec03d8d0 auth_method 0 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca22007640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c151360 legacy=0x7fca1c05c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474227714 0 0) 0x7fca1c0008e0 con 0x7fca1c151360 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient(hunting): my global_id is 94272 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9ec003620 con 0x7fca1c151360 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3109342151 0 0) 0x7fc9ec003620 con 0x7fca1c151360 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca1c0008e0 con 0x7fca1c151360 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca0c004b50 con 0x7fca1c151360 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 10 monclient: dump: 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3059845026 0 0) 0x7fca1c0008e0 con 0x7fca1c151360 2026-02-13T18:17:37.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.514+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca1c05e470 con 0x7fca1c151360 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fca0c002f80 con 0x7fca1c151360 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca02ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca02ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c151360 legacy=0x7fca1c05c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c151360 legacy=0x7fca1c05c890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca24292640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:37.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.518+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fca1c1a4df0 con 0x7fca1c04d200 2026-02-13T18:17:37.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca22007640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c04d200 legacy=0x7fca1c196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968153276 0 0) 0x7fca1c1a4df0 con 0x7fca1c04d200 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient(hunting): my global_id is 94275 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c0008e0 con 0x7fca1c04d200 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2194752015 0 0) 0x7fca1c0008e0 con 0x7fca1c04d200 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca1c1a4df0 con 0x7fca1c04d200 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fca0c005000 con 0x7fca1c04d200 2026-02-13T18:17:37.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient: dump: 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.546 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1275200661 0 0) 0x7fca1c1a4df0 con 0x7fca1c04d200 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca1c13f4f0 con 0x7fca1c04d200 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 2754479354) 0x7fca0c0063f0 con 0x7fca1c04d200 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c04d200 legacy=0x7fca1c196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca02ffd640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6789/0 conn(0x7fca1c04d200 legacy=0x7fca1c196340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:37.547 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 44, 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 140569, 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:37.548 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.549 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.550 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:37.551 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.552 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.553 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.554 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:37.555 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.556 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.557 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:37.558 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:37.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc9ec03d8d0 legacy=0x7fc9ec05dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 10 monclient: shutdown 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 >> v1:10.20.193.78:6790/0 conn(0x7fca1c08eee0 legacy=0x7fca1c193c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca22808640 1 -- 10.20.193.78:0/2685971558 reap_dead start 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca22808640 1 -- 10.20.193.78:0/2685971558 reap_dead start 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 shutdown_connections 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 >> 10.20.193.78:0/2685971558 conn(0x7fca1c054e30 msgr2=0x7fca1c0891b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 shutdown_connections 2026-02-13T18:17:37.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.522+0000 7fca24292640 1 -- 10.20.193.78:0/2685971558 wait complete. 2026-02-13T18:17:37.560 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:17:37.561 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:17:37.561 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:17:37.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient: get_monmap_and_config 2026-02-13T18:17:37.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient: monmap: 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:37.615912+0000 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:37.615912+0000 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:37.623 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 1 Processor -- start 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 1 -- start start 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient: init 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient(hunting): picked mon.noname-b con 0x7f3d5008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient(hunting): picked mon.noname-c con 0x7f3d5008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient(hunting): picked mon.noname-a con 0x7f3d5008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d50089e80 con 0x7f3d5008cdd0 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d50088c20 con 0x7f3d5008dc80 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d50089ba0 con 0x7f3d5008c2f0 2026-02-13T18:17:37.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d58700640 10 monclient(hunting): authenticate will time out at 1288.671467s 2026-02-13T18:17:37.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d56475640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f3d5008c2f0 0x7f3d5008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45544/0 (socket says 10.20.193.78:45544) 2026-02-13T18:17:37.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.610+0000 7f3d56475640 1 -- 10.20.193.78:0/4174185085 learned_addr learned my addr 10.20.193.78:0/4174185085 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d56475640 1 -- 10.20.193.78:0/4174185085 >> v1:10.20.193.78:6790/0 conn(0x7f3d5008c2f0 legacy=0x7f3d5008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d56c76640 1 -- 10.20.193.78:0/4174185085 >> v1:10.20.193.78:6789/0 conn(0x7f3d5008cdd0 legacy=0x7f3d501a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55c74640 1 -- 10.20.193.78:0/4174185085 >> v1:10.20.193.187:6789/0 conn(0x7f3d5008dc80 legacy=0x7f3d50181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016797519 0 0) 0x7f3d50089ba0 con 0x7f3d5008c2f0 2026-02-13T18:17:37.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): my global_id is 104141 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d38003620 con 0x7f3d5008c2f0 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296837275 0 0) 0x7f3d50089e80 con 0x7f3d5008cdd0 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): my global_id is 94278 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d50089ba0 con 0x7f3d5008cdd0 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053437572 0 0) 0x7f3d50088c20 con 0x7f3d5008dc80 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient(hunting): my global_id is 84367 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d50089e80 con 0x7f3d5008dc80 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2672880468 0 0) 0x7f3d38003620 con 0x7f3d5008c2f0 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 >> v1:10.20.193.187:6789/0 conn(0x7f3d5008dc80 legacy=0x7f3d50181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 >> v1:10.20.193.78:6789/0 conn(0x7f3d5008cdd0 legacy=0x7f3d501a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 monclient: found mon.noname-b 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5008d370 con 0x7f3d5008c2f0 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d40003110 con 0x7f3d5008c2f0 2026-02-13T18:17:37.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: dump: 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 5 monclient: authenticate success, global_id 104141 2026-02-13T18:17:37.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d400033e0 con 0x7f3d5008c2f0 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 1 -- 10.20.193.78:0/4174185085 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d40004b50 con 0x7f3d5008c2f0 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d55473640 10 monclient: dump: 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.633 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 4 set_mon_vals no callback set 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: shutdown 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- 10.20.193.78:0/4174185085 >> v1:10.20.193.78:6790/0 conn(0x7f3d5008c2f0 legacy=0x7f3d5008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- 10.20.193.78:0/4174185085 shutdown_connections 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- 10.20.193.78:0/4174185085 >> 10.20.193.78:0/4174185085 conn(0x7f3d50091720 msgr2=0x7f3d50091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- 10.20.193.78:0/4174185085 shutdown_connections 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- 10.20.193.78:0/4174185085 wait complete. 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: monmap: 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.634 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 Processor -- start 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- start start 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: init 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:17:37.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient(hunting): picked mon.noname-b con 0x7f3d5008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient(hunting): picked mon.noname-a con 0x7f3d5008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 10 monclient(hunting): picked mon.noname-c con 0x7f3d5008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.614+0000 7f3d58700640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d50057930 con 0x7f3d5008cdd0 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d50088910 con 0x7f3d5008c2f0 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5007dd10 con 0x7f3d5008dc80 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 monclient(hunting): authenticate will time out at 1288.676035s 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d55c74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3d5008cdd0 0x7f3d50192080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56668/0 (socket says 10.20.193.78:56668) 2026-02-13T18:17:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d55c74640 1 -- 10.20.193.78:0/1976528615 learned_addr learned my addr 10.20.193.78:0/1976528615 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d55c74640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6789/0 conn(0x7f3d5008cdd0 legacy=0x7f3d50192080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d56c76640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5008dc80 legacy=0x7f3d501937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d56475640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.187:6789/0 conn(0x7f3d5008c2f0 legacy=0x7f3d50151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730824287 0 0) 0x7f3d50089e80 con 0x7f3d5008cdd0 2026-02-13T18:17:37.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): my global_id is 94281 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d20003620 con 0x7f3d5008cdd0 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293798483 0 0) 0x7f3d5007dd10 con 0x7f3d5008dc80 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): my global_id is 104144 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d50089e80 con 0x7f3d5008dc80 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221870109 0 0) 0x7f3d50088910 con 0x7f3d5008c2f0 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): my global_id is 84370 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d5007dd10 con 0x7f3d5008c2f0 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 183196914 0 0) 0x7f3d20003620 con 0x7f3d5008cdd0 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d50088910 con 0x7f3d5008cdd0 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d44003490 con 0x7f3d5008cdd0 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): dump: 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.643 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 451461299 0 0) 0x7f3d50089e80 con 0x7f3d5008dc80 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d20003620 con 0x7f3d5008dc80 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d4c004c20 con 0x7f3d5008dc80 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient(hunting): dump: 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.644 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2970196927 0 0) 0x7f3d50088910 con 0x7f3d5008cdd0 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5008dc80 legacy=0x7f3d501937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.187:6789/0 conn(0x7f3d5008c2f0 legacy=0x7f3d50151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 monclient: found mon.a 2026-02-13T18:17:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d50080a50 con 0x7f3d5008cdd0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 5 monclient: authenticate success, global_id 94281 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 monclient: _renew_subs 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d50080070 con 0x7f3d5008cdd0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 monclient: _renew_subs 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d5007e870 con 0x7f3d5008cdd0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d44003bf0 con 0x7f3d5008cdd0 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d44003f80 con 0x7f3d5008cdd0 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 10 monclient: dump: 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.647 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d54c72640 4 set_mon_vals no callback set 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d5008f620 con 0x7f3d5007d2b0 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3d440041d0 con 0x7f3d5008cdd0 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.618+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(592..592 src has 292..592) ==== 3963+0+0 (unknown 3003050417 0 0) 0x7f3d4404c770 con 0x7f3d5008cdd0 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d56c76640 10 monclient: get_auth_request con 0x7f3d2003d5a0 auth_method 0 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d56475640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5007d2b0 legacy=0x7f3d5005b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183268563 0 0) 0x7f3d5008d370 con 0x7f3d5007d2b0 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient(hunting): my global_id is 104147 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d50088910 con 0x7f3d5007d2b0 2026-02-13T18:17:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 180115248 0 0) 0x7f3d50088910 con 0x7f3d5007d2b0 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d5008d370 con 0x7f3d5007d2b0 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d40004ee0 con 0x7f3d5007d2b0 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient: dump: 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.649 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2043089017 0 0) 0x7f3d5008d370 con 0x7f3d5007d2b0 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d50090810 con 0x7f3d5007d2b0 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3d40007a20 con 0x7f3d5007d2b0 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5007d2b0 legacy=0x7f3d5005b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.622+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5007d2b0 legacy=0x7f3d5005b3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.626+0000 7f3d58700640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.626+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d500510e0 con 0x7f3d5004d200 2026-02-13T18:17:37.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d56475640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5004d200 legacy=0x7f3d50195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106815614 0 0) 0x7f3d500510e0 con 0x7f3d5004d200 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient(hunting): my global_id is 104150 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d5008d370 con 0x7f3d5004d200 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2862168102 0 0) 0x7f3d5008d370 con 0x7f3d5004d200 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d500510e0 con 0x7f3d5004d200 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3d40005430 con 0x7f3d5004d200 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient: dump: 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.651 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1317885536 0 0) 0x7f3d500510e0 con 0x7f3d5004d200 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d5007d680 con 0x7f3d5004d200 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4341 (unknown 0 0 437118417) 0x7f3d400077a0 con 0x7f3d5004d200 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5004d200 legacy=0x7f3d50195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d36ffd640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6790/0 conn(0x7f3d5004d200 legacy=0x7f3d50195ed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 44, 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 2131, 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:17:37.653 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.654 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.655 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:37.656 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.657 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.658 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.659 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.660 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.661 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:37.662 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.187:6812/2668687789 conn(0x7f3d2003d5a0 legacy=0x7f3d2005da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 10 monclient: shutdown 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 >> v1:10.20.193.78:6789/0 conn(0x7f3d5008cdd0 legacy=0x7f3d50192080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d56c76640 1 -- 10.20.193.78:0/1976528615 reap_dead start 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d56c76640 1 -- 10.20.193.78:0/1976528615 reap_dead start 2026-02-13T18:17:37.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 shutdown_connections 2026-02-13T18:17:37.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 >> 10.20.193.78:0/1976528615 conn(0x7f3d50091720 msgr2=0x7f3d50058b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 shutdown_connections 2026-02-13T18:17:37.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.630+0000 7f3d58700640 1 -- 10.20.193.78:0/1976528615 wait complete. 2026-02-13T18:17:37.664 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:17:37.664 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:17:37.664 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:17:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient: get_monmap_and_config 2026-02-13T18:17:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient: monmap: 2026-02-13T18:17:37.735 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.735 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.735 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:37.727356+0000 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:37.727356+0000 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 1 Processor -- start 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 1 -- start start 2026-02-13T18:17:37.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient: init 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient(hunting): picked mon.noname-a con 0x7f319c08cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient(hunting): picked mon.noname-c con 0x7f319c08d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient(hunting): picked mon.noname-b con 0x7f319c08d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c085ad0 con 0x7f319c08cdc0 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c085ee0 con 0x7f319c08d190 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c08e000 con 0x7f319c08d5d0 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a3577640 10 monclient(hunting): authenticate will time out at 1288.782502s 2026-02-13T18:17:37.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a12ec640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f319c08cdc0 0x7f319c08c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56670/0 (socket says 10.20.193.78:56670) 2026-02-13T18:17:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a1aed640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f319c08d5d0 0x7f319c1a53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45596/0 (socket says 10.20.193.78:45596) 2026-02-13T18:17:37.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.722+0000 7f31a12ec640 1 -- 10.20.193.78:0/2453688819 learned_addr learned my addr 10.20.193.78:0/2453688819 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a12ec640 1 -- 10.20.193.78:0/2453688819 >> v1:10.20.193.78:6789/0 conn(0x7f319c08cdc0 legacy=0x7f319c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a1aed640 1 -- 10.20.193.78:0/2453688819 >> v1:10.20.193.78:6790/0 conn(0x7f319c08d5d0 legacy=0x7f319c1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608867065 0 0) 0x7f319c08e000 con 0x7f319c08d5d0 2026-02-13T18:17:37.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient(hunting): my global_id is 104153 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3184003620 con 0x7f319c08d5d0 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a0aeb640 1 -- 10.20.193.78:0/2453688819 >> v1:10.20.193.187:6789/0 conn(0x7f319c08d190 legacy=0x7f319c183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317524514 0 0) 0x7f3184003620 con 0x7f319c08d5d0 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 >> v1:10.20.193.187:6789/0 conn(0x7f319c08d190 legacy=0x7f319c183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 >> v1:10.20.193.78:6789/0 conn(0x7f319c08cdc0 legacy=0x7f319c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 monclient: found mon.noname-b 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c086f80 con 0x7f319c08d5d0 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 5 monclient: authenticate success, global_id 104153 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3198004620 con 0x7f319c08d5d0 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: dump: 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.745 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31980048f0 con 0x7f319c08d5d0 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 1 -- 10.20.193.78:0/2453688819 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3198005fa0 con 0x7f319c08d5d0 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f318bfff640 10 monclient: dump: 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.746 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 4 set_mon_vals no callback set 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: shutdown 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- 10.20.193.78:0/2453688819 >> v1:10.20.193.78:6790/0 conn(0x7f319c08d5d0 legacy=0x7f319c1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- 10.20.193.78:0/2453688819 shutdown_connections 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- 10.20.193.78:0/2453688819 >> 10.20.193.78:0/2453688819 conn(0x7f319c091720 msgr2=0x7f319c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- 10.20.193.78:0/2453688819 shutdown_connections 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- 10.20.193.78:0/2453688819 wait complete. 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: monmap: 2026-02-13T18:17:37.747 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 Processor -- start 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- start start 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: init 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:17:37.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient(hunting): picked mon.noname-a con 0x7f319c08cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient(hunting): picked mon.noname-c con 0x7f319c08d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient(hunting): picked mon.noname-b con 0x7f319c08d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c088910 con 0x7f319c08cdc0 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c08b7b0 con 0x7f319c08d5d0 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c081200 con 0x7f319c08d190 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a3577640 10 monclient(hunting): authenticate will time out at 1288.787166s 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a12ec640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f319c08cdc0 0x7f319c084a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56676/0 (socket says 10.20.193.78:56676) 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.726+0000 7f31a12ec640 1 -- 10.20.193.78:0/719808652 learned_addr learned my addr 10.20.193.78:0/719808652 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a12ec640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.78:6789/0 conn(0x7f319c08cdc0 legacy=0x7f319c084a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a0aeb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.78:6790/0 conn(0x7f319c08d190 legacy=0x7f319c1942d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a1aed640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c08d5d0 legacy=0x7f319c1959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494676081 0 0) 0x7f319c081200 con 0x7f319c08d190 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): my global_id is 104156 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f316c003620 con 0x7f319c08d190 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2717668482 0 0) 0x7f316c003620 con 0x7f319c08d190 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f319c081200 con 0x7f319c08d190 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3190003380 con 0x7f319c08d190 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): dump: 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.750 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3923842040 0 0) 0x7f319c081200 con 0x7f319c08d190 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c08d5d0 legacy=0x7f319c1959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.78:6789/0 conn(0x7f319c08cdc0 legacy=0x7f319c084a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 monclient: found mon.c 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c082cc0 con 0x7f319c08d190 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 5 monclient: authenticate success, global_id 104156 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 10 monclient: _renew_subs 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f319c083560 con 0x7f319c08d190 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 10 monclient: _renew_subs 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f319c081d60 con 0x7f319c08d190 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31900039c0 con 0x7f319c08d190 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3190003d60 con 0x7f319c08d190 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 10 monclient: dump: 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f318b7fe640 4 set_mon_vals no callback set 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f319c153340 con 0x7f319c152f70 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3190004030 con 0x7f319c08d190 2026-02-13T18:17:37.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(592..592 src has 292..592) ==== 3963+0+0 (unknown 3003050417 0 0) 0x7f319004c6e0 con 0x7f319c08d190 2026-02-13T18:17:37.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.730+0000 7f31a1aed640 10 monclient: get_auth_request con 0x7f316c03d450 auth_method 0 2026-02-13T18:17:37.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.734+0000 7f31a12ec640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c152f70 legacy=0x7f319c07b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209548052 0 0) 0x7f319c153340 con 0x7f319c152f70 2026-02-13T18:17:37.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient(hunting): my global_id is 84373 2026-02-13T18:17:37.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f319c081200 con 0x7f319c152f70 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3596959252 0 0) 0x7f319c081200 con 0x7f319c152f70 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f319c153340 con 0x7f319c152f70 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f318c003090 con 0x7f319c152f70 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient: dump: 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.863 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1604251258 0 0) 0x7f319c153340 con 0x7f319c152f70 2026-02-13T18:17:37.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f319c0853d0 con 0x7f319c152f70 2026-02-13T18:17:37.865 INFO:tasks.rados.rados.0.trial187.stdout:2601: done (0 left) 2026-02-13T18:17:37.865 INFO:tasks.rados.rados.0.trial187.stdout:2602: write oid 11 current snap is 287 2026-02-13T18:17:37.865 INFO:tasks.rados.rados.0.trial187.stdout:2602: seq_num 870 ranges {622090=730872,1760393=607307} 2026-02-13T18:17:37.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f318c003490 con 0x7f319c152f70 2026-02-13T18:17:37.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:37.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c152f70 legacy=0x7f319c07b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.850+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c152f70 legacy=0x7f319c07b550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:37.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.854+0000 7f31a3577640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:37.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.854+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f319c08f620 con 0x7f319c04d200 2026-02-13T18:17:37.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a12ec640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c04d200 legacy=0x7f319c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330031468 0 0) 0x7f319c088910 con 0x7f319c04d200 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient(hunting): my global_id is 84376 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f319c153340 con 0x7f319c04d200 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3961168533 0 0) 0x7f319c153340 con 0x7f319c04d200 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f319c088910 con 0x7f319c04d200 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f318c004cb0 con 0x7f319c04d200 2026-02-13T18:17:37.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient: dump: 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.872 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 380976411 0 0) 0x7f319c088910 con 0x7f319c04d200 2026-02-13T18:17:37.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f319c090810 con 0x7f319c04d200 2026-02-13T18:17:37.873 INFO:tasks.rados.rados.0.trial187.stdout:2602: writing trial18717860-11 from 622090 to 1352962 tid 1 2026-02-13T18:17:37.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 3888270260) 0x7f318c0059d0 con 0x7f319c04d200 2026-02-13T18:17:37.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:37.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:37.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c04d200 legacy=0x7f319c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f3189ffb640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6789/0 conn(0x7f319c04d200 legacy=0x7f319c198120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 44, 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 286025, 2026-02-13T18:17:37.875 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.876 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.877 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.878 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:37.879 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:37.880 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:37.881 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.882 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.883 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.884 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:37.885 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:37.886 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.887 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.888 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:37.889 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:37.890 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:37.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.187:6812/2668687789 conn(0x7f316c03d450 legacy=0x7f316c05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 10 monclient: shutdown 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 >> v1:10.20.193.78:6790/0 conn(0x7f319c08d190 legacy=0x7f319c1942d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a1aed640 1 -- 10.20.193.78:0/719808652 reap_dead start 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a1aed640 1 -- 10.20.193.78:0/719808652 reap_dead start 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 shutdown_connections 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 >> 10.20.193.78:0/719808652 conn(0x7f319c091720 msgr2=0x7f319c05ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 shutdown_connections 2026-02-13T18:17:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.858+0000 7f31a3577640 1 -- 10.20.193.78:0/719808652 wait complete. 2026-02-13T18:17:37.893 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:17:37.893 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T18:17:37.893 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:17:37.893 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T18:17:37.893 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T18:17:37.894 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T18:17:37.894 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2602: writing trial18717860-11 from 1760393 to 2367700 tid 2 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2603: read oid 16 snap -1 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2603: expect (ObjNum 865 snap 285 seq_num 865) 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2602: finishing write tid 1 to trial18717860-11 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2604: read oid 47 snap -1 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2604: expect deleted 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2605: read oid 50 snap -1 2026-02-13T18:17:37.895 INFO:tasks.rados.rados.0.trial187.stdout:2605: expect deleted 2026-02-13T18:17:37.896 INFO:tasks.rados.rados.0.trial187.stdout:2606: write oid 5 current snap is 287 2026-02-13T18:17:37.896 INFO:tasks.rados.rados.0.trial187.stdout:2606: seq_num 871 ranges {638897=406121,1818875=750965} 2026-02-13T18:17:37.896 INFO:tasks.rados.rados.0.trial187.stdout:2606: writing trial18717860-5 from 638897 to 1045018 tid 1 2026-02-13T18:17:37.896 INFO:tasks.rados.rados.0.trial187.stdout:2606: writing trial18717860-5 from 1818875 to 2569840 tid 2 2026-02-13T18:17:37.897 INFO:tasks.rados.rados.0.trial187.stdout:2607: rollback oid 20 current snap is 287 2026-02-13T18:17:37.897 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 283 2026-02-13T18:17:37.897 INFO:tasks.rados.rados.0.trial187.stdout:2602: finishing write tid 2 to trial18717860-11 2026-02-13T18:17:37.897 INFO:tasks.rados.rados.0.trial187.stdout:2602: finishing write tid 3 to trial18717860-11 2026-02-13T18:17:37.897 INFO:tasks.rados.rados.0.trial187.stdout:2605: done (5 left) 2026-02-13T18:17:37.897 INFO:tasks.rados.rados.0.trial187.stdout:2608: snap_remove snap 284 2026-02-13T18:17:37.908 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T18:17:37.908 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:17:37.908 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:17:37.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 10 monclient: get_monmap_and_config 2026-02-13T18:17:37.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 10 monclient: monmap: 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:37.968899+0000 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:37.968899+0000 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 1 Processor -- start 2026-02-13T18:17:37.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 1 -- start start 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 10 monclient: init 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.962+0000 7fcb5d11c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient(hunting): picked mon.noname-c con 0x7fcb5808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient(hunting): picked mon.noname-b con 0x7fcb5808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient(hunting): picked mon.noname-a con 0x7fcb5808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb58089e80 con 0x7fcb5808cdd0 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb58088c20 con 0x7fcb5808c2f0 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb58089ba0 con 0x7fcb5808dc80 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient(hunting): authenticate will time out at 1289.024050s 2026-02-13T18:17:37.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb56d76640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7fcb5808c2f0 legacy=0x7fcb5808c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:37.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb56575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fcb5808dc80 0x7fcb58181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45622/0 (socket says 10.20.193.78:45622) 2026-02-13T18:17:37.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb56575640 1 -- 10.20.193.78:0/1507817364 learned_addr learned my addr 10.20.193.78:0/1507817364 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb56575640 1 -- 10.20.193.78:0/1507817364 >> v1:10.20.193.78:6790/0 conn(0x7fcb5808dc80 legacy=0x7fcb58181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb57577640 1 -- 10.20.193.78:0/1507817364 >> v1:10.20.193.78:6789/0 conn(0x7fcb5808cdd0 legacy=0x7fcb581a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457080278 0 0) 0x7fcb58089ba0 con 0x7fcb5808dc80 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): my global_id is 104159 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb44003620 con 0x7fcb5808dc80 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313764227 0 0) 0x7fcb58089e80 con 0x7fcb5808cdd0 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient(hunting): my global_id is 94284 2026-02-13T18:17:37.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb58089ba0 con 0x7fcb5808cdd0 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 879786000 0 0) 0x7fcb44003620 con 0x7fcb5808dc80 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 >> v1:10.20.193.187:6789/0 conn(0x7fcb5808c2f0 legacy=0x7fcb5808c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 >> v1:10.20.193.78:6789/0 conn(0x7fcb5808cdd0 legacy=0x7fcb581a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 monclient: found mon.noname-b 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5808d370 con 0x7fcb5808dc80 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb40003110 con 0x7fcb5808dc80 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: dump: 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.988 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 5 monclient: authenticate success, global_id 104159 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb400033e0 con 0x7fcb5808dc80 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 1 -- 10.20.193.78:0/1507817364 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb40004b50 con 0x7fcb5808dc80 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb55d74640 10 monclient: dump: 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 4 set_mon_vals no callback set 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient: shutdown 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- 10.20.193.78:0/1507817364 >> v1:10.20.193.78:6790/0 conn(0x7fcb5808dc80 legacy=0x7fcb58181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- 10.20.193.78:0/1507817364 shutdown_connections 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- 10.20.193.78:0/1507817364 >> 10.20.193.78:0/1507817364 conn(0x7fcb58091720 msgr2=0x7fcb58091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- 10.20.193.78:0/1507817364 shutdown_connections 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 1 -- 10.20.193.78:0/1507817364 wait complete. 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient: build_initial_monmap 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.966+0000 7fcb5d11c640 10 monclient: monmap: 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:37.991 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 Processor -- start 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- start start 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: init 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient(hunting): picked mon.noname-b con 0x7fcb5808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient(hunting): picked mon.noname-c con 0x7fcb5808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient(hunting): picked mon.noname-a con 0x7fcb5808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb58082010 con 0x7fcb5808dc80 2026-02-13T18:17:37.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb580822f0 con 0x7fcb5808c2f0 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb5805d4b0 con 0x7fcb5808cdd0 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient(hunting): authenticate will time out at 1289.028636s 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb56d76640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7fcb5808c2f0 legacy=0x7fcb58152eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb56575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fcb5808cdd0 0x7fcb58083800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:45624/0 (socket says 10.20.193.78:45624) 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb56575640 1 -- 10.20.193.78:0/3393952906 learned_addr learned my addr 10.20.193.78:0/3393952906 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb56575640 1 -- 10.20.193.78:0/3393952906 >> v1:10.20.193.78:6790/0 conn(0x7fcb5808cdd0 legacy=0x7fcb58083800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb57577640 1 -- 10.20.193.78:0/3393952906 >> v1:10.20.193.78:6789/0 conn(0x7fcb5808dc80 legacy=0x7fcb58195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156319646 0 0) 0x7fcb5805d4b0 con 0x7fcb5808cdd0 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): my global_id is 104162 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb24003620 con 0x7fcb5808cdd0 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567035684 0 0) 0x7fcb58082010 con 0x7fcb5808dc80 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): my global_id is 94287 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb5805d4b0 con 0x7fcb5808dc80 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1973207755 0 0) 0x7fcb24003620 con 0x7fcb5808cdd0 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb58082010 con 0x7fcb5808cdd0 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb40002b70 con 0x7fcb5808cdd0 2026-02-13T18:17:37.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): dump: 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.995 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb57577640 1 --1- 10.20.193.78:0/3393952906 >> v1:10.20.193.78:6789/0 conn(0x7fcb5808dc80 0x7fcb58195240 :-1 s=OPENED pgs=347 gs=3 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fcb48004900 mon_map magic: 0 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2963332114 0 0) 0x7fcb5805d4b0 con 0x7fcb5808dc80 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb24003620 con 0x7fcb5808dc80 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2117734986 0 0) 0x7fcb58082010 con 0x7fcb5808cdd0 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 >> v1:10.20.193.187:6789/0 conn(0x7fcb5808c2f0 legacy=0x7fcb58152eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 >> v1:10.20.193.78:6789/0 conn(0x7fcb5808dc80 legacy=0x7fcb58195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: _finish_hunting 0 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 monclient: found mon.c 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb58081d30 con 0x7fcb5808cdd0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: _finish_auth 0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: _check_auth_tickets 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb48004900 con 0x7fcb5808dc80 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 5 monclient: authenticate success, global_id 104162 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _renew_subs 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb58083f10 con 0x7fcb5808cdd0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _renew_subs 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb58196b30 con 0x7fcb5808cdd0 2026-02-13T18:17:37.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb40004b10 con 0x7fcb5808cdd0 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcb40005170 con 0x7fcb5808cdd0 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb377fe640 10 monclient: dump: 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:37.998 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb55573640 4 set_mon_vals no callback set 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.970+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5808f600 con 0x7fcb5808cdd0 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.974+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fcb40011800 con 0x7fcb5808cdd0 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.974+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(593..593 src has 292..593) ==== 3991+0+0 (unknown 2343326299 0 0) 0x7fcb4004c730 con 0x7fcb5808cdd0 2026-02-13T18:17:37.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.974+0000 7fcb56d76640 10 monclient: get_auth_request con 0x7fcb2403d580 auth_method 0 2026-02-13T18:17:38.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.974+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fcb40017690 con 0x7fcb5808cdd0 2026-02-13T18:17:38.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.974+0000 7fcb377fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:38.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:37.974+0000 7fcb377fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb58088910 con 0x7fcb5808cdd0 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb377fe640 1 -- 10.20.193.78:0/3393952906 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3818044177) 0x7fcb4001c950 con 0x7fcb5808cdd0 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb377fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb377fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:38.106 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:17:38.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 >> v1:10.20.193.187:6812/2668687789 conn(0x7fcb2403d580 legacy=0x7fcb2405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 10 monclient: shutdown 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 >> v1:10.20.193.78:6790/0 conn(0x7fcb5808cdd0 legacy=0x7fcb58083800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 shutdown_connections 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 >> 10.20.193.78:0/3393952906 conn(0x7fcb58091720 msgr2=0x7fcb58058ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 shutdown_connections 2026-02-13T18:17:38.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:38.094+0000 7fcb5d11c640 1 -- 10.20.193.78:0/3393952906 wait complete. 2026-02-13T18:17:41.115 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:17:41.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient: get_monmap_and_config 2026-02-13T18:17:41.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient: build_initial_monmap 2026-02-13T18:17:41.187 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient: monmap: 2026-02-13T18:17:41.187 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:41.179257+0000 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:41.179257+0000 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 1 Processor -- start 2026-02-13T18:17:41.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 1 -- start start 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient: init 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient(hunting): picked mon.noname-b con 0x7fad5008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient(hunting): picked mon.noname-a con 0x7fad5008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient(hunting): picked mon.noname-c con 0x7fad5008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad50089e80 con 0x7fad5008dc80 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad50088c20 con 0x7fad5008cdd0 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad50089ba0 con 0x7fad5008c2f0 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad553e5640 10 monclient(hunting): authenticate will time out at 1292.234500s 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad4effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fad5008c2f0 0x7fad5008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38896/0 (socket says 10.20.193.78:38896) 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad4effd640 1 -- 10.20.193.78:0/4249610700 learned_addr learned my addr 10.20.193.78:0/4249610700 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:41.189 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.174+0000 7fad4f7fe640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7fad5008cdd0 legacy=0x7fad501a3410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:41.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4e7fc640 1 -- 10.20.193.78:0/4249610700 >> v1:10.20.193.78:6789/0 conn(0x7fad5008dc80 legacy=0x7fad50181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:41.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4effd640 1 -- 10.20.193.78:0/4249610700 >> v1:10.20.193.78:6790/0 conn(0x7fad5008c2f0 legacy=0x7fad5008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:41.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198412803 0 0) 0x7fad50089ba0 con 0x7fad5008c2f0 2026-02-13T18:17:41.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:17:41.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:41.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient(hunting): my global_id is 104165 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad3c003620 con 0x7fad5008c2f0 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109119569 0 0) 0x7fad3c003620 con 0x7fad5008c2f0 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 >> v1:10.20.193.187:6789/0 conn(0x7fad5008cdd0 legacy=0x7fad501a3410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 >> v1:10.20.193.78:6789/0 conn(0x7fad5008dc80 legacy=0x7fad50181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 monclient: found mon.noname-b 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5008d370 con 0x7fad5008c2f0 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: _finish_auth 0 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 5 monclient: authenticate success, global_id 104165 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fad44003040 con 0x7fad5008c2f0 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: dump: 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:41.194 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad44003310 con 0x7fad5008c2f0 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 1 -- 10.20.193.78:0/4249610700 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fad440049a0 con 0x7fad5008c2f0 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4dffb640 10 monclient: dump: 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:41.195 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 4 set_mon_vals no callback set 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: shutdown 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- 10.20.193.78:0/4249610700 >> v1:10.20.193.78:6790/0 conn(0x7fad5008c2f0 legacy=0x7fad5008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- 10.20.193.78:0/4249610700 shutdown_connections 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- 10.20.193.78:0/4249610700 >> 10.20.193.78:0/4249610700 conn(0x7fad50091720 msgr2=0x7fad50091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- 10.20.193.78:0/4249610700 shutdown_connections 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- 10.20.193.78:0/4249610700 wait complete. 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: build_initial_monmap 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: monmap: 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:41.196 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 Processor -- start 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- start start 2026-02-13T18:17:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: init 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient(hunting): picked mon.noname-c con 0x7fad5008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient(hunting): picked mon.noname-a con 0x7fad5008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient(hunting): picked mon.noname-b con 0x7fad5008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad500822e0 con 0x7fad5008cdd0 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad500825c0 con 0x7fad5008dc80 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad50087280 con 0x7fad5008c2f0 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:41.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad553e5640 10 monclient(hunting): authenticate will time out at 1292.239088s 2026-02-13T18:17:41.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fad5008c2f0 0x7fad50153270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38906/0 (socket says 10.20.193.78:38906) 2026-02-13T18:17:41.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4effd640 1 -- 10.20.193.78:0/1837719918 learned_addr learned my addr 10.20.193.78:0/1837719918 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:41.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.178+0000 7fad4f7fe640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.187:6789/0 conn(0x7fad5008dc80 legacy=0x7fad501955e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad4effd640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.78:6790/0 conn(0x7fad5008c2f0 legacy=0x7fad50153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad4e7fc640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.78:6789/0 conn(0x7fad5008cdd0 legacy=0x7fad500839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679171845 0 0) 0x7fad50087280 con 0x7fad5008c2f0 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): my global_id is 104168 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad1c003620 con 0x7fad5008c2f0 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4170920038 0 0) 0x7fad1c003620 con 0x7fad5008c2f0 2026-02-13T18:17:41.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad50087280 con 0x7fad5008c2f0 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fad440034c0 con 0x7fad5008c2f0 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): dump: 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:41.203 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4101538402 0 0) 0x7fad50087280 con 0x7fad5008c2f0 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.187:6789/0 conn(0x7fad5008dc80 legacy=0x7fad501955e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.78:6789/0 conn(0x7fad5008cdd0 legacy=0x7fad500839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 monclient: found mon.c 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad50080dc0 con 0x7fad5008c2f0 2026-02-13T18:17:41.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: _finish_auth 0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 5 monclient: authenticate success, global_id 104168 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 monclient: _renew_subs 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad50084100 con 0x7fad5008c2f0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 monclient: _renew_subs 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fad50196ed0 con 0x7fad5008c2f0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad440032b0 con 0x7fad5008c2f0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fad44005170 con 0x7fad5008c2f0 2026-02-13T18:17:41.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 10 monclient: dump: 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:41.206 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad4d7fa640 4 set_mon_vals no callback set 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5008f620 con 0x7fad5008c2f0 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fad44011800 con 0x7fad5008c2f0 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(593..593 src has 292..593) ==== 3991+0+0 (unknown 2343326299 0 0) 0x7fad4404c700 con 0x7fad5008c2f0 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.182+0000 7fad4e7fc640 10 monclient: get_auth_request con 0x7fad1c03d390 auth_method 0 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.186+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fad5008f620 con 0x7fad5008c2f0 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.186+0000 7fad2f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:41.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.186+0000 7fad2f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fad500583c0 con 0x7fad5008c2f0 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad2f7fe640 1 -- 10.20.193.78:0/1837719918 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3801099012) 0x7fad440176c0 con 0x7fad5008c2f0 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad2f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad2f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:41.322 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.187:6812/2668687789 conn(0x7fad1c03d390 legacy=0x7fad1c05d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 10 monclient: shutdown 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 >> v1:10.20.193.78:6790/0 conn(0x7fad5008c2f0 legacy=0x7fad50153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 shutdown_connections 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 >> 10.20.193.78:0/1837719918 conn(0x7fad50091720 msgr2=0x7fad50058bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 shutdown_connections 2026-02-13T18:17:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:41.310+0000 7fad553e5640 1 -- 10.20.193.78:0/1837719918 wait complete. 2026-02-13T18:17:44.333 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:17:44.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient: get_monmap_and_config 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient: build_initial_monmap 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient: monmap: 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:44.387461+0000 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:44.387461+0000 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:44.396 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 1 Processor -- start 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 1 -- start start 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient: init 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient(hunting): picked mon.noname-a con 0x7f4f5c084930 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient(hunting): picked mon.noname-b con 0x7f4f5c08d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient(hunting): picked mon.noname-c con 0x7f4f5c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:44.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c08da30 con 0x7f4f5c084930 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c089e60 con 0x7f4f5c1831f0 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c085410 con 0x7f4f5c08d5f0 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f6206c640 10 monclient(hunting): authenticate will time out at 1295.442820s 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f5affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 0x7f4f5c181ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38922/0 (socket says 10.20.193.78:38922) 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 learned_addr learned my addr 10.20.193.78:0/2939537185 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:44.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.382+0000 7f4f5bfff640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c1a35d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:44.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.386+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f5c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:44.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.386+0000 7f4f5b7fe640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f5c084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:44.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.586+0000 7f4f5bfff640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c1a35d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:45.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:44.990+0000 7f4f5bfff640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c1a35d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:45.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:45.794+0000 7f4f5bfff640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c1a35d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): tick 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 monclient(hunting): continuing hunt 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f5c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c1a35d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f5c084d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:47.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): picked mon.noname-c con 0x7f4f5c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): picked mon.noname-b con 0x7f4f5c08d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): picked mon.noname-a con 0x7f4f5c084930 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c089b80 con 0x7f4f5c084930 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c089e60 con 0x7f4f5c1831f0 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3806a0c0 con 0x7f4f5c08d5f0 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f5b7fe640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f38023900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:47.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.382+0000 7f4f597fa640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:47.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.386+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f380450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:47.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.386+0000 7f4f5bfff640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f380668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:47.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.586+0000 7f4f5b7fe640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f38023900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:48.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:47.990+0000 7f4f5b7fe640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f38023900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:48.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:48.794+0000 7f4f5b7fe640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f38023900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:50.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): tick 2026-02-13T18:17:50.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:17:50.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 monclient(hunting): continuing hunt 2026-02-13T18:17:50.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:17:50.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f380450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:50.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f38023900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f380668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): picked mon.noname-b con 0x7f4f5c08d5f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): picked mon.noname-c con 0x7f4f5c1831f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): picked mon.noname-a con 0x7f4f5c084930 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3806b3c0 con 0x7f4f5c084930 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c089e60 con 0x7f4f5c1831f0 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3806a4b0 con 0x7f4f5c08d5f0 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f597fa640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:50.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.382+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f380238c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:50.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.386+0000 7f4f5bfff640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f380668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:50.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.386+0000 7f4f5b7fe640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f38045050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:50.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.586+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f380238c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:51.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:50.990+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f380238c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:51.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:51.794+0000 7f4f5affd640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f380238c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:52.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4021207479 0 0) 0x7f4f3806a4b0 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:52.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:52.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:52.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient(hunting): my global_id is 104171 2026-02-13T18:17:52.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f40003620 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3497264686 0 0) 0x7f4f40003620 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c1831f0 legacy=0x7f4f380238c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:52.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f380668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:52.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:17:52.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 monclient: found mon.noname-b 2026-02-13T18:17:52.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3806a740 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4f48003140 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: dump: 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:52.918 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 5 monclient: authenticate success, global_id 104171 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:52.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5b7fe640 1 --1- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 0x7f4f38045050 :-1 s=OPENED pgs=503 gs=15 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f4f480038c0 mon_map magic: 0 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f48003480 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 4 set_mon_vals no callback set 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: shutdown 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- 10.20.193.78:0/2939537185 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f38045050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 1 -- 10.20.193.78:0/2939537185 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4f480038c0 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f5a7fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- 10.20.193.78:0/2939537185 shutdown_connections 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- 10.20.193.78:0/2939537185 >> 10.20.193.78:0/2939537185 conn(0x7f4f5c091720 msgr2=0x7f4f5c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:52.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- 10.20.193.78:0/2939537185 shutdown_connections 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- 10.20.193.78:0/2939537185 wait complete. 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: build_initial_monmap 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: monmap: 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:52.921 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 Processor -- start 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- start start 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: init 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient(hunting): picked mon.noname-b con 0x7f4f5c084930 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient(hunting): picked mon.noname-a con 0x7f4f5c08d5f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 10 monclient(hunting): picked mon.noname-c con 0x7f4f5c1831f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c080600 con 0x7f4f5c08d5f0 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.902+0000 7f4f6206c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c088910 con 0x7f4f5c084930 2026-02-13T18:17:52.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c0871e0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:52.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient(hunting): authenticate will time out at 1303.964021s 2026-02-13T18:17:52.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f5b7fe640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f5c081b10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:52.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f5bfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4f5c1831f0 0x7f4f5c175aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48506/0 (socket says 10.20.193.78:48506) 2026-02-13T18:17:52.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f5bfff640 1 -- 10.20.193.78:0/949458713 learned_addr learned my addr 10.20.193.78:0/949458713 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:52.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f5bfff640 1 -- 10.20.193.78:0/949458713 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c175aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:52.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f5affd640 1 -- 10.20.193.78:0/949458713 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f5c174380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:52.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900280252 0 0) 0x7f4f5c0871e0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:52.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): my global_id is 104174 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f2c003620 con 0x7f4f5c1831f0 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3156667449 0 0) 0x7f4f2c003620 con 0x7f4f5c1831f0 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f5c0871e0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4f50005b70 con 0x7f4f5c1831f0 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): dump: 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:52.927 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2803133743 0 0) 0x7f4f5c0871e0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 >> v1:10.20.193.187:6789/0 conn(0x7f4f5c084930 legacy=0x7f4f5c081b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:17:52.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 >> v1:10.20.193.78:6789/0 conn(0x7f4f5c08d5f0 legacy=0x7f4f5c174380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: _finish_hunting 0 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 monclient: found mon.c 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c07fd60 con 0x7f4f5c1831f0 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: _finish_auth 0 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: _check_auth_tickets 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 5 monclient: authenticate success, global_id 104174 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient: _renew_subs 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:52.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c080040 con 0x7f4f5c1831f0 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient: _renew_subs 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f5c07eae0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f50006070 con 0x7f4f5c1831f0 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4f50006410 con 0x7f4f5c1831f0 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f59ffb640 4 set_mon_vals no callback set 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 10 monclient: dump: 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:52.930 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:52.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f5c0389c0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4f500066e0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.906+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(593..593 src has 292..593) ==== 3991+0+0 (unknown 2343326299 0 0) 0x7f4f5004dd40 con 0x7f4f5c1831f0 2026-02-13T18:17:52.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.910+0000 7f4f5b7fe640 10 monclient: get_auth_request con 0x7f4f2c03d2a0 auth_method 0 2026-02-13T18:17:52.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.914+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f4f50018cb0 con 0x7f4f5c1831f0 2026-02-13T18:17:52.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.914+0000 7f4f37fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:52.932 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:52.914+0000 7f4f37fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:53.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4f5c084370 con 0x7f4f5c1831f0 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f37fff640 1 -- 10.20.193.78:0/949458713 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 2798516062) 0x7f4f5001df60 con 0x7f4f5c1831f0 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f37fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f37fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:53.041 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":48,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:17:53.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 >> v1:10.20.193.187:6812/2668687789 conn(0x7f4f2c03d2a0 legacy=0x7f4f2c05d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 10 monclient: shutdown 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 >> v1:10.20.193.78:6790/0 conn(0x7f4f5c1831f0 legacy=0x7f4f5c175aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 shutdown_connections 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 >> 10.20.193.78:0/949458713 conn(0x7f4f5c091720 msgr2=0x7f4f5c056e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 shutdown_connections 2026-02-13T18:17:53.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.030+0000 7f4f6206c640 1 -- 10.20.193.78:0/949458713 wait complete. 2026-02-13T18:17:53.051 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:17:53.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T18:17:53.052 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:17:53.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient: get_monmap_and_config 2026-02-13T18:17:53.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient: build_initial_monmap 2026-02-13T18:17:53.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient: monmap: 2026-02-13T18:17:53.117 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:53.117 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.117 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:53.108802+0000 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:53.108802+0000 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 1 Processor -- start 2026-02-13T18:17:53.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 1 -- start start 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient: init 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient(hunting): picked mon.noname-a con 0x7f2f1808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient(hunting): picked mon.noname-c con 0x7f2f1808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient(hunting): picked mon.noname-b con 0x7f2f1808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f18089e80 con 0x7f2f1808c2f0 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f18088c20 con 0x7f2f1808dc80 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f18089ba0 con 0x7f2f1808cdd0 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:53.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f1dffa640 10 monclient(hunting): authenticate will time out at 1304.163960s 2026-02-13T18:17:53.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.102+0000 7f2f16ffd640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f2f1808dc80 legacy=0x7f2f18181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:53.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f17fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2f1808cdd0 0x7f2f181a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48508/0 (socket says 10.20.193.78:48508) 2026-02-13T18:17:53.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f17fff640 1 -- 10.20.193.78:0/2498646730 learned_addr learned my addr 10.20.193.78:0/2498646730 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:53.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f177fe640 1 -- 10.20.193.78:0/2498646730 >> v1:10.20.193.78:6789/0 conn(0x7f2f1808c2f0 legacy=0x7f2f1808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f17fff640 1 -- 10.20.193.78:0/2498646730 >> v1:10.20.193.78:6790/0 conn(0x7f2f1808cdd0 legacy=0x7f2f181a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062874247 0 0) 0x7f2f18089e80 con 0x7f2f1808c2f0 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): my global_id is 94290 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2efc003620 con 0x7f2f1808c2f0 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259008509 0 0) 0x7f2f18089ba0 con 0x7f2f1808cdd0 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient(hunting): my global_id is 104177 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f18089e80 con 0x7f2f1808cdd0 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203177810 0 0) 0x7f2efc003620 con 0x7f2f1808c2f0 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 >> v1:10.20.193.78:6790/0 conn(0x7f2f1808cdd0 legacy=0x7f2f181a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 >> v1:10.20.193.187:6789/0 conn(0x7f2f1808dc80 legacy=0x7f2f18181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: _finish_hunting 0 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 monclient: found mon.noname-a 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1808d370 con 0x7f2f1808c2f0 2026-02-13T18:17:53.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: _finish_auth 0 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: _check_auth_tickets 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f04003160 con 0x7f2f1808c2f0 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: dump: 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.127 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 5 monclient: authenticate success, global_id 94290 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f04003430 con 0x7f2f1808c2f0 2026-02-13T18:17:53.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 1 -- 10.20.193.78:0/2498646730 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f040038c0 con 0x7f2f1808c2f0 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f167fc640 10 monclient: dump: 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.129 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 4 set_mon_vals no callback set 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 10 monclient: shutdown 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 1 -- 10.20.193.78:0/2498646730 >> v1:10.20.193.78:6789/0 conn(0x7f2f1808c2f0 legacy=0x7f2f1808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 1 -- 10.20.193.78:0/2498646730 shutdown_connections 2026-02-13T18:17:53.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 1 -- 10.20.193.78:0/2498646730 >> 10.20.193.78:0/2498646730 conn(0x7f2f18091720 msgr2=0x7f2f18091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 1 -- 10.20.193.78:0/2498646730 shutdown_connections 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 1 -- 10.20.193.78:0/2498646730 wait complete. 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 10 monclient: build_initial_monmap 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.106+0000 7f2f1dffa640 10 monclient: monmap: 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:53.131 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 1 Processor -- start 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 1 -- start start 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient: init 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:17:53.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient(hunting): picked mon.noname-a con 0x7f2f1808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient(hunting): picked mon.noname-c con 0x7f2f1808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient(hunting): picked mon.noname-b con 0x7f2f1808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1807f7b0 con 0x7f2f1808c2f0 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f180578a0 con 0x7f2f1808dc80 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f18088910 con 0x7f2f1808cdd0 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f1dffa640 10 monclient(hunting): authenticate will time out at 1304.168580s 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f177fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2f1808c2f0 0x7f2f18151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:33304/0 (socket says 10.20.193.78:33304) 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f177fe640 1 -- 10.20.193.78:0/443241118 learned_addr learned my addr 10.20.193.78:0/443241118 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:53.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f17fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.187:6789/0 conn(0x7f2f1808dc80 legacy=0x7f2f181937a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:53.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f16ffd640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6790/0 conn(0x7f2f1808cdd0 legacy=0x7f2f18192080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:17:53.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.110+0000 7f2f177fe640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1808c2f0 legacy=0x7f2f18151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508811905 0 0) 0x7f2f18088910 con 0x7f2f1808cdd0 2026-02-13T18:17:53.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): my global_id is 104180 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ee8003620 con 0x7f2f1808cdd0 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633860859 0 0) 0x7f2f1808d370 con 0x7f2f1808c2f0 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): my global_id is 94293 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f18088910 con 0x7f2f1808c2f0 2026-02-13T18:17:53.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2125245856 0 0) 0x7f2f18088910 con 0x7f2f1808c2f0 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f1808d370 con 0x7f2f1808c2f0 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f04002bc0 con 0x7f2f1808c2f0 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): dump: 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.142 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4201407015 0 0) 0x7f2ee8003620 con 0x7f2f1808cdd0 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f18088910 con 0x7f2f1808cdd0 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f080044d0 con 0x7f2f1808cdd0 2026-02-13T18:17:53.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient(hunting): dump: 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.144 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3687248322 0 0) 0x7f2f1808d370 con 0x7f2f1808c2f0 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6790/0 conn(0x7f2f1808cdd0 legacy=0x7f2f18192080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.187:6789/0 conn(0x7f2f1808dc80 legacy=0x7f2f181937a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 monclient: found mon.a 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1807dcf0 con 0x7f2f1808c2f0 2026-02-13T18:17:53.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: _finish_auth 0 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 5 monclient: authenticate success, global_id 94293 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 10 monclient: _renew_subs 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f18080a30 con 0x7f2f1808c2f0 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 10 monclient: _renew_subs 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f1807e850 con 0x7f2f1808c2f0 2026-02-13T18:17:53.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f04003430 con 0x7f2f1808c2f0 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f04004090 con 0x7f2f1808c2f0 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f15ffb640 4 set_mon_vals no callback set 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 10 monclient: dump: 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.147 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f1808f600 con 0x7f2f1807d370 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f2f04004270 con 0x7f2f1808c2f0 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(593..593 src has 292..593) ==== 3991+0+0 (unknown 2343326299 0 0) 0x7f2f0404c730 con 0x7f2f1808c2f0 2026-02-13T18:17:53.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.114+0000 7f2f17fff640 10 monclient: get_auth_request con 0x7f2ee803d630 auth_method 0 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2f16ffd640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1807d370 legacy=0x7f2f1805b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689335206 0 0) 0x7f2f1808f600 con 0x7f2f1807d370 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient(hunting): my global_id is 94296 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f1808d370 con 0x7f2f1807d370 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3784670714 0 0) 0x7f2f1808d370 con 0x7f2f1807d370 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f1808f600 con 0x7f2f1807d370 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f08004bd0 con 0x7f2f1807d370 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient: dump: 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.150 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2307795883 0 0) 0x7f2f1808f600 con 0x7f2f1807d370 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f18090810 con 0x7f2f1807d370 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2f080061c0 con 0x7f2f1807d370 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1807d370 legacy=0x7f2f1805b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.118+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1807d370 legacy=0x7f2f1805b360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f180510e0 con 0x7f2f1804d200 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f16ffd640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1804d200 legacy=0x7f2f18195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892605464 0 0) 0x7f2f180510e0 con 0x7f2f1804d200 2026-02-13T18:17:53.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient(hunting): my global_id is 94299 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f1808f600 con 0x7f2f1804d200 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 391740923 0 0) 0x7f2f1808f600 con 0x7f2f1804d200 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f180510e0 con 0x7f2f1804d200 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f080067d0 con 0x7f2f1804d200 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient: dump: 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.152 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2182026787 0 0) 0x7f2f180510e0 con 0x7f2f1804d200 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f1807d740 con 0x7f2f1804d200 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4664 (unknown 0 0 599391868) 0x7f2f08005ce0 con 0x7f2f1804d200 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:53.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1804d200 legacy=0x7f2f18195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2ef3fff640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1804d200 legacy=0x7f2f18195ed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 48, 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 156169, 2026-02-13T18:17:53.154 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:53.155 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:53.156 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:53.157 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:53.158 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:53.159 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:53.160 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:53.161 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:53.162 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:53.163 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:17:53.164 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:53.165 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.187:6812/2668687789 conn(0x7f2ee803d630 legacy=0x7f2ee805dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 10 monclient: shutdown 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 >> v1:10.20.193.78:6789/0 conn(0x7f2f1808c2f0 legacy=0x7f2f18151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f17fff640 1 -- 10.20.193.78:0/443241118 reap_dead start 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f17fff640 1 -- 10.20.193.78:0/443241118 reap_dead start 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 shutdown_connections 2026-02-13T18:17:53.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 >> 10.20.193.78:0/443241118 conn(0x7f2f18091720 msgr2=0x7f2f18058ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:53.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 shutdown_connections 2026-02-13T18:17:53.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.122+0000 7f2f1dffa640 1 -- 10.20.193.78:0/443241118 wait complete. 2026-02-13T18:17:53.167 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:17:53.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:17:53.167 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:17:53.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.214+0000 7f240af91640 10 monclient: get_monmap_and_config 2026-02-13T18:17:53.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.214+0000 7f240af91640 10 monclient: build_initial_monmap 2026-02-13T18:17:53.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.214+0000 7f240af91640 10 monclient: monmap: 2026-02-13T18:17:53.228 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:53.228 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:17:53.221532+0000 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:17:53.221532+0000 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:17:53.229 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 1 Processor -- start 2026-02-13T18:17:53.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 1 -- start start 2026-02-13T18:17:53.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient: init 2026-02-13T18:17:53.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:53.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient(hunting): picked mon.noname-a con 0x7f2404085b00 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient(hunting): picked mon.noname-c con 0x7f2404085ed0 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient(hunting): picked mon.noname-b con 0x7f24040862a0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240408d4e0 con 0x7f2404085b00 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2404054660 con 0x7f2404085ed0 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24041a8b20 con 0x7f24040862a0 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient(hunting): authenticate will time out at 1304.277042s 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fbfff640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f2404085ed0 legacy=0x7f2404183cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f2408d06640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2404085b00 0x7f240408e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:33338/0 (socket says 10.20.193.78:33338) 2026-02-13T18:17:53.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f2408d06640 1 -- 10.20.193.78:0/3894127113 learned_addr learned my addr 10.20.193.78:0/3894127113 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f2408d06640 1 -- 10.20.193.78:0/3894127113 >> v1:10.20.193.78:6789/0 conn(0x7f2404085b00 legacy=0x7f240408e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f2409507640 1 -- 10.20.193.78:0/3894127113 >> v1:10.20.193.78:6790/0 conn(0x7f24040862a0 legacy=0x7f24041a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622904137 0 0) 0x7f240408d4e0 con 0x7f2404085b00 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): my global_id is 94302 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23f0003620 con 0x7f2404085b00 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742774763 0 0) 0x7f24041a8b20 con 0x7f24040862a0 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient(hunting): my global_id is 104183 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f240408d4e0 con 0x7f24040862a0 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 739001171 0 0) 0x7f23f0003620 con 0x7f2404085b00 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 >> v1:10.20.193.78:6790/0 conn(0x7f24040862a0 legacy=0x7f24041a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 >> v1:10.20.193.187:6789/0 conn(0x7f2404085ed0 legacy=0x7f2404183cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 monclient: found mon.noname-a 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041a9d00 con 0x7f2404085b00 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: _finish_auth 0 2026-02-13T18:17:53.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 5 monclient: authenticate success, global_id 94302 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23f4003110 con 0x7f2404085b00 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: dump: 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.238 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23f40033e0 con 0x7f2404085b00 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 1 -- 10.20.193.78:0/3894127113 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23f4004b50 con 0x7f2404085b00 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f23fb7fe640 10 monclient: dump: 2026-02-13T18:17:53.239 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 10 monclient: get_monmap_and_config success 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.218+0000 7f240af91640 4 set_mon_vals no callback set 2026-02-13T18:17:53.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: shutdown 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/3894127113 >> v1:10.20.193.78:6789/0 conn(0x7f2404085b00 legacy=0x7f240408e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/3894127113 shutdown_connections 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/3894127113 >> 10.20.193.78:0/3894127113 conn(0x7f2404056aa0 msgr2=0x7f24040928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/3894127113 shutdown_connections 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/3894127113 wait complete. 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: build_initial_monmap 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: monmap: 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:17:53.241 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 Processor -- start 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- start start 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: init 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: _reopen_session rank -1 2026-02-13T18:17:53.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient(hunting): picked mon.noname-b con 0x7f2404085b00 addr v1:10.20.193.187:6789/0 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient(hunting): picked mon.noname-c con 0x7f2404085ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient(hunting): picked mon.noname-a con 0x7f24040862a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240407ecd0 con 0x7f24040862a0 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240407d0b0 con 0x7f2404085b00 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240405d8f0 con 0x7f2404085ed0 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient(hunting): _renew_subs 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient(hunting): authenticate will time out at 1304.280986s 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f2408d06640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f2404085b00 legacy=0x7f24041da590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23fbfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2404085ed0 0x7f240421b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48520/0 (socket says 10.20.193.78:48520) 2026-02-13T18:17:53.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23fbfff640 1 -- 10.20.193.78:0/1331361698 learned_addr learned my addr 10.20.193.78:0/1331361698 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:17:53.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f2409507640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6789/0 conn(0x7f24040862a0 legacy=0x7f240423c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23fbfff640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f2404085ed0 legacy=0x7f240421b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597438905 0 0) 0x7f240407ecd0 con 0x7f24040862a0 2026-02-13T18:17:53.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): my global_id is 94305 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23d4003620 con 0x7f24040862a0 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139712193 0 0) 0x7f240405d8f0 con 0x7f2404085ed0 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): my global_id is 104186 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f240407ecd0 con 0x7f2404085ed0 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2735345845 0 0) 0x7f23d4003620 con 0x7f24040862a0 2026-02-13T18:17:53.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f240405d8f0 con 0x7f24040862a0 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2400004900 con 0x7f24040862a0 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): dump: 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.251 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23fbfff640 1 --1- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f2404085ed0 0x7f240421b220 :-1 s=OPENED pgs=509 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f23ec004590 mon_map magic: 0 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 77292854 0 0) 0x7f240407ecd0 con 0x7f2404085ed0 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23d4003620 con 0x7f2404085ed0 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 625475369 0 0) 0x7f240405d8f0 con 0x7f24040862a0 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f2404085ed0 legacy=0x7f240421b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.187:6789/0 conn(0x7f2404085b00 legacy=0x7f24041da590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: _finish_hunting 0 2026-02-13T18:17:53.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 monclient: found mon.a 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240407e9f0 con 0x7f24040862a0 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: _finish_auth 0 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: _check_auth_tickets 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23ec004590 con 0x7f2404085ed0 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 5 monclient: authenticate success, global_id 94305 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: _renew_subs 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f240407d530 con 0x7f24040862a0 2026-02-13T18:17:53.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: _renew_subs 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f24041daca0 con 0x7f24040862a0 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2400004ed0 con 0x7f24040862a0 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2400005230 con 0x7f24040862a0 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.222+0000 7f23f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient: dump: 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.254 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23faffd640 4 set_mon_vals no callback set 2026-02-13T18:17:53.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f240af91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f24040008e0 con 0x7f24040907f0 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f24000054c0 con 0x7f24040862a0 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(593..593 src has 292..593) ==== 3991+0+0 (unknown 2343326299 0 0) 0x7f240004db90 con 0x7f24040862a0 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23fbfff640 10 monclient: get_auth_request con 0x7f23d403d570 auth_method 0 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f2408d06640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f24040907f0 legacy=0x7f24040867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779586554 0 0) 0x7f24040008e0 con 0x7f24040907f0 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient(hunting): my global_id is 104189 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f240405d8f0 con 0x7f24040907f0 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4264177074 0 0) 0x7f240405d8f0 con 0x7f24040907f0 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24040008e0 con 0x7f24040907f0 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23f4002d90 con 0x7f24040907f0 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient: dump: 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.257 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1442156208 0 0) 0x7f24040008e0 con 0x7f24040907f0 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24041a8f40 con 0x7f24040907f0 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f23f4002fd0 con 0x7f24040907f0 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f24040907f0 legacy=0x7f24040867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.226+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f24040907f0 legacy=0x7f24040867f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.230+0000 7f240af91640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.230+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f24041a9120 con 0x7f240407c710 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f2408d06640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f240407c710 legacy=0x7f2404086f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:17:53.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415819578 0 0) 0x7f24041a9120 con 0x7f240407c710 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient(hunting): _negotiate 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient(hunting): my global_id is 104192 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24040008e0 con 0x7f240407c710 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1667255470 0 0) 0x7f24040008e0 con 0x7f240407c710 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24041a9120 con 0x7f240407c710 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f23f4005000 con 0x7f240407c710 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient: dump: 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.259 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1478796779 0 0) 0x7f24041a9120 con 0x7f240407c710 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2404087610 con 0x7f240407c710 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4331 (unknown 0 0 559121835) 0x7f23f40051a0 con 0x7f240407c710 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f240407c710 legacy=0x7f2404086f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f23f97fa640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6790/0 conn(0x7f240407c710 legacy=0x7f2404086f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 48, 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 17735, 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:17:53.261 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:53.262 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:53.263 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:17:53.264 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.265 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:17:53.266 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:17:53.267 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.268 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:17:53.269 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:17:53.270 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.187:6812/2668687789 conn(0x7f23d403d570 legacy=0x7f23d405da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 10 monclient: shutdown 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 >> v1:10.20.193.78:6789/0 conn(0x7f24040862a0 legacy=0x7f240423c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f2409507640 1 -- 10.20.193.78:0/1331361698 reap_dead start 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f2409507640 1 -- 10.20.193.78:0/1331361698 reap_dead start 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 shutdown_connections 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 >> 10.20.193.78:0/1331361698 conn(0x7f2404056aa0 msgr2=0x7f2404084070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 shutdown_connections 2026-02-13T18:17:53.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:17:53.234+0000 7f240af91640 1 -- 10.20.193.78:0/1331361698 wait complete. 2026-02-13T18:17:53.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:17:53.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2608: done (5 left) 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2609: read oid 10 snap 269 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2609: expect deleted 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2610: rollback oid 39 current snap is 287 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 278 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2611: copy_from oid 17 from oid 3 current snap is 287 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2612: write oid 24 current snap is 287 2026-02-13T18:17:53.899 INFO:tasks.rados.rados.0.trial187.stdout:2612: seq_num 872 ranges {655704=481370,1761004=494623} 2026-02-13T18:17:53.906 INFO:tasks.rados.rados.0.trial187.stdout:2612: writing trial18717860-24 from 655704 to 1137074 tid 1 2026-02-13T18:17:53.914 INFO:tasks.rados.rados.0.trial187.stdout:2612: writing trial18717860-24 from 1761004 to 2255627 tid 2 2026-02-13T18:17:53.914 INFO:tasks.rados.rados.0.trial187.stdout:2613: write oid 35 current snap is 287 2026-02-13T18:17:53.914 INFO:tasks.rados.rados.0.trial187.stdout:2602: finishing write tid 4 to trial18717860-11 2026-02-13T18:17:53.914 INFO:tasks.rados.rados.0.trial187.stdout:2602: oid 11 updating version 0 to 1032 2026-02-13T18:17:53.914 INFO:tasks.rados.rados.0.trial187.stdout:2602: oid 11 updating version 1032 to 1034 2026-02-13T18:17:53.915 INFO:tasks.rados.rados.0.trial187.stdout:2602: oid 11 version 1034 is already newer than 1033 2026-02-13T18:17:53.915 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1034 (ObjNum 870 snap 287 seq_num 870) dirty exists 2026-02-13T18:17:53.915 INFO:tasks.rados.rados.0.trial187.stdout:2602: left oid 11 (ObjNum 870 snap 287 seq_num 870) 2026-02-13T18:17:53.915 INFO:tasks.rados.rados.0.trial187.stdout:2603: expect (ObjNum 865 snap 285 seq_num 865) 2026-02-13T18:17:53.915 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:53.974 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 263295 2026-02-13T18:17:54.024 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1308283 2026-02-13T18:17:54.053 INFO:tasks.rados.rados.0.trial187.stdout:2606: finishing write tid 1 to trial18717860-5 2026-02-13T18:17:54.053 INFO:tasks.rados.rados.0.trial187.stdout:2613: seq_num 873 ranges {672511=556619,1819486=754634} 2026-02-13T18:17:54.061 INFO:tasks.rados.rados.0.trial187.stdout:2613: writing trial18717860-35 from 672511 to 1229130 tid 1 2026-02-13T18:17:54.071 INFO:tasks.rados.rados.0.trial187.stdout:2613: writing trial18717860-35 from 1819486 to 2574120 tid 2 2026-02-13T18:17:54.071 INFO:tasks.rados.rados.0.trial187.stdout:2602: done (9 left) 2026-02-13T18:17:54.071 INFO:tasks.rados.rados.0.trial187.stdout:2603: done (8 left) 2026-02-13T18:17:54.071 INFO:tasks.rados.rados.0.trial187.stdout:2604: done (7 left) 2026-02-13T18:17:54.071 INFO:tasks.rados.rados.0.trial187.stdout:2614: snap_remove snap 274 2026-02-13T18:17:54.902 INFO:tasks.rados.rados.0.trial187.stdout:2614: done (7 left) 2026-02-13T18:17:54.902 INFO:tasks.rados.rados.0.trial187.stdout:2615: rollback oid 1 current snap is 287 2026-02-13T18:17:54.902 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 1 to 283 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2607: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2607: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1411 (ObjNum 723 snap 256 seq_num 723) dirty exists 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: finishing write tid 2 to trial18717860-5 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: finishing write tid 3 to trial18717860-5 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: finishing write tid 4 to trial18717860-5 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: oid 5 updating version 0 to 1019 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: oid 5 version 1019 is already newer than 1017 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: oid 5 version 1019 is already newer than 1018 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1019 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:17:54.903 INFO:tasks.rados.rados.0.trial187.stdout:2606: left oid 5 (ObjNum 871 snap 287 seq_num 871) 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2606: done (7 left) 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2607: done (6 left) 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2616: delete oid 6 current snap is 287 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2610: finishing rollback tid 0 to trial18717860-39 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2610: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2610: finishing rollback tid 2 to trial18717860-39 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1360 (ObjNum 813 snap 275 seq_num 813) dirty exists 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2611: finishing copy_from to trial18717860-17 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2611: got expected ENOENT (src dne) 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2611: finishing copy_from racing read to trial18717860-17 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2612: finishing write tid 1 to trial18717860-24 2026-02-13T18:17:54.904 INFO:tasks.rados.rados.0.trial187.stdout:2612: finishing write tid 2 to trial18717860-24 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2612: finishing write tid 3 to trial18717860-24 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2612: finishing write tid 4 to trial18717860-24 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2612: oid 24 updating version 0 to 1187 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2612: oid 24 version 1187 is already newer than 1186 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2612: oid 24 updating version 1187 to 1188 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1188 (ObjNum 872 snap 287 seq_num 872) dirty exists 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2612: left oid 24 (ObjNum 872 snap 287 seq_num 872) 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2613: finishing write tid 1 to trial18717860-35 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2613: finishing write tid 2 to trial18717860-35 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2613: finishing write tid 3 to trial18717860-35 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2613: finishing write tid 4 to trial18717860-35 2026-02-13T18:17:54.905 INFO:tasks.rados.rados.0.trial187.stdout:2613: oid 35 updating version 0 to 1595 2026-02-13T18:17:54.906 INFO:tasks.rados.rados.0.trial187.stdout:2613: oid 35 updating version 1595 to 1597 2026-02-13T18:17:54.906 INFO:tasks.rados.rados.0.trial187.stdout:2613: oid 35 version 1597 is already newer than 1596 2026-02-13T18:17:54.906 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1597 (ObjNum 873 snap 287 seq_num 873) dirty exists 2026-02-13T18:17:54.906 INFO:tasks.rados.rados.0.trial187.stdout:2613: left oid 35 (ObjNum 873 snap 287 seq_num 873) 2026-02-13T18:17:54.906 INFO:tasks.rados.rados.0.trial187.stdout:2609: done (6 left) 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2610: done (5 left) 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2611: done (4 left) 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2612: done (3 left) 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2613: done (2 left) 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2616: done (1 left) 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2617: write oid 46 current snap is 287 2026-02-13T18:17:54.907 INFO:tasks.rados.rados.0.trial187.stdout:2617: seq_num 875 ranges {706125=423470,1652803=758303} 2026-02-13T18:17:54.912 INFO:tasks.rados.rados.0.trial187.stdout:2617: writing trial18717860-46 from 706125 to 1129595 tid 1 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2617: writing trial18717860-46 from 1652803 to 2411106 tid 2 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2618: read oid 35 snap -1 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2618: expect (ObjNum 873 snap 287 seq_num 873) 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2619: delete oid 41 current snap is 287 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2615: finishing rollback tid 0 to trial18717860-1 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2615: finishing rollback tid 1 to trial18717860-1 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:2615: finishing rollback tid 2 to trial18717860-1 2026-02-13T18:17:54.922 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 1032 (ObjNum 863 snap 283 seq_num 863) dirty exists 2026-02-13T18:17:54.923 INFO:tasks.rados.rados.0.trial187.stdout:2617: finishing write tid 1 to trial18717860-46 2026-02-13T18:17:54.923 INFO:tasks.rados.rados.0.trial187.stdout:2615: done (3 left) 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2619: done (2 left) 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2620: read oid 23 snap -1 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2620: expect (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2621: copy_from oid 12 from oid 5 current snap is 287 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2622: copy_from oid 38 from oid 42 current snap is 287 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2623: write (excl) oid 48 current snap is 287 2026-02-13T18:17:54.924 INFO:tasks.rados.rados.0.trial187.stdout:2623: seq_num 877 ranges {739739=573968,2053414=686325} 2026-02-13T18:17:54.932 INFO:tasks.rados.rados.0.trial187.stdout:2623: writing trial18717860-48 from 739739 to 1313707 tid 1 2026-02-13T18:17:54.942 INFO:tasks.rados.rados.0.trial187.stdout:2623: writing trial18717860-48 from 2053414 to 2739739 tid 2 2026-02-13T18:17:54.942 INFO:tasks.rados.rados.0.trial187.stdout:2624: write oid 33 current snap is 287 2026-02-13T18:17:54.942 INFO:tasks.rados.rados.0.trial187.stdout:2624: seq_num 878 ranges {756546=649217,2111896=505630} 2026-02-13T18:17:54.951 INFO:tasks.rados.rados.0.trial187.stdout:2624: writing trial18717860-33 from 756546 to 1405763 tid 1 2026-02-13T18:17:54.957 INFO:tasks.rados.rados.0.trial187.stdout:2624: writing trial18717860-33 from 2111896 to 2617526 tid 2 2026-02-13T18:17:54.957 INFO:tasks.rados.rados.0.trial187.stdout:2625: copy_from oid 45 from oid 16 current snap is 287 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: finishing write tid 2 to trial18717860-46 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2626: snap_create 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: finishing write tid 3 to trial18717860-46 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: finishing write tid 4 to trial18717860-46 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: oid 46 updating version 0 to 1063 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: oid 46 updating version 1063 to 1064 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: oid 46 version 1064 is already newer than 1062 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1064 (ObjNum 875 snap 287 seq_num 875) dirty exists 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2617: left oid 46 (ObjNum 875 snap 287 seq_num 875) 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:2618: expect (ObjNum 873 snap 287 seq_num 873) 2026-02-13T18:17:54.958 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:55.010 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:55.043 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:17:55.077 INFO:tasks.rados.rados.0.trial187.stdout:2620: expect (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:17:55.079 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 618743 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:2621: finishing copy_from racing read to trial18717860-12 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:2622: finishing copy_from racing read to trial18717860-38 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:2621: finishing copy_from to trial18717860-12 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1019 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:2622: finishing copy_from to trial18717860-38 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1012 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:17:55.146 INFO:tasks.rados.rados.0.trial187.stdout:2623: finishing write tid 1 to trial18717860-48 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: finishing write tid 2 to trial18717860-48 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: finishing write tid 3 to trial18717860-48 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: finishing write tid 4 to trial18717860-48 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: oid 48 updating version 0 to 1744 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: oid 48 version 1744 is already newer than 1743 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: oid 48 updating version 1744 to 1745 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1745 (ObjNum 877 snap 287 seq_num 877) dirty exists 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2623: left oid 48 (ObjNum 877 snap 287 seq_num 877) 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2624: finishing write tid 1 to trial18717860-33 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2624: finishing write tid 2 to trial18717860-33 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2624: finishing write tid 3 to trial18717860-33 2026-02-13T18:17:55.147 INFO:tasks.rados.rados.0.trial187.stdout:2624: finishing write tid 4 to trial18717860-33 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:2624: oid 33 updating version 0 to 1747 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:2624: oid 33 updating version 1747 to 1749 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:2624: oid 33 version 1749 is already newer than 1748 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1749 (ObjNum 878 snap 287 seq_num 878) dirty exists 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:2624: left oid 33 (ObjNum 878 snap 287 seq_num 878) 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:2625: finishing copy_from racing read to trial18717860-45 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:2625: finishing copy_from to trial18717860-45 2026-02-13T18:17:55.148 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1408 (ObjNum 865 snap 285 seq_num 865) dirty exists 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2617: done (8 left) 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2618: done (7 left) 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2620: done (6 left) 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2621: done (5 left) 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2622: done (4 left) 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2623: done (3 left) 2026-02-13T18:17:55.518 INFO:tasks.rados.rados.0.trial187.stdout:2624: done (2 left) 2026-02-13T18:17:55.519 INFO:tasks.rados.rados.0.trial187.stdout:2625: done (1 left) 2026-02-13T18:17:55.519 INFO:tasks.rados.rados.0.trial187.stdout:2626: done (0 left) 2026-02-13T18:17:55.519 INFO:tasks.rados.rados.0.trial187.stdout:2627: write (excl) oid 4 current snap is 288 2026-02-13T18:17:55.519 INFO:tasks.rados.rados.0.trial187.stdout:2627: seq_num 879 ranges {773353=724466,2170378=602975} 2026-02-13T18:17:55.524 INFO:tasks.rados.rados.0.trial187.stdout:2627: writing trial18717860-4 from 773353 to 1497819 tid 1 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:2627: writing trial18717860-4 from 2170378 to 2773353 tid 2 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:2628: rollback oid 30 current snap is 288 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 278 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:2627: finishing write tid 1 to trial18717860-4 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:2629: rollback oid 7 current snap is 288 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 283 2026-02-13T18:17:55.529 INFO:tasks.rados.rados.0.trial187.stdout:2630: delete oid 5 current snap is 288 2026-02-13T18:17:55.532 INFO:tasks.rados.rados.0.trial187.stdout:2628: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:17:55.532 INFO:tasks.rados.rados.0.trial187.stdout:2630: done (3 left) 2026-02-13T18:17:55.532 INFO:tasks.rados.rados.0.trial187.stdout:2631: rollback oid 29 current snap is 288 2026-02-13T18:17:55.532 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 283 2026-02-13T18:17:55.532 INFO:tasks.rados.rados.0.trial187.stdout:2632: snap_create 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2628: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2628: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1030 (ObjNum 730 snap 256 seq_num 730) dirty exists 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2627: finishing write tid 2 to trial18717860-4 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2627: finishing write tid 3 to trial18717860-4 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2627: finishing write tid 4 to trial18717860-4 2026-02-13T18:17:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2627: oid 4 updating version 0 to 1026 2026-02-13T18:17:55.535 INFO:tasks.rados.rados.0.trial187.stdout:2627: oid 4 version 1026 is already newer than 1025 2026-02-13T18:17:55.535 INFO:tasks.rados.rados.0.trial187.stdout:2627: oid 4 version 1026 is already newer than 1024 2026-02-13T18:17:55.535 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1026 (ObjNum 879 snap 288 seq_num 879) dirty exists 2026-02-13T18:17:55.535 INFO:tasks.rados.rados.0.trial187.stdout:2627: left oid 4 (ObjNum 879 snap 288 seq_num 879) 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:2629: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:2629: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:2631: finishing rollback tid 0 to trial18717860-29 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:2629: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1067 (ObjNum 852 snap 281 seq_num 852) dirty exists 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:2631: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:2631: finishing rollback tid 2 to trial18717860-29 2026-02-13T18:17:55.536 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1035 (ObjNum 851 snap 281 seq_num 851) dirty exists 2026-02-13T18:17:56.574 INFO:tasks.rados.rados.0.trial187.stdout:2627: done (4 left) 2026-02-13T18:17:56.574 INFO:tasks.rados.rados.0.trial187.stdout:2628: done (3 left) 2026-02-13T18:17:56.575 INFO:tasks.rados.rados.0.trial187.stdout:2629: done (2 left) 2026-02-13T18:17:56.575 INFO:tasks.rados.rados.0.trial187.stdout:2631: done (1 left) 2026-02-13T18:17:56.575 INFO:tasks.rados.rados.0.trial187.stdout:2632: done (0 left) 2026-02-13T18:17:56.575 INFO:tasks.rados.rados.0.trial187.stdout:2633: copy_from oid 28 from oid 41 current snap is 289 2026-02-13T18:17:56.575 INFO:tasks.rados.rados.0.trial187.stdout:2634: snap_create 2026-02-13T18:17:56.578 INFO:tasks.rados.rados.0.trial187.stdout:2633: finishing copy_from to trial18717860-28 2026-02-13T18:17:56.578 INFO:tasks.rados.rados.0.trial187.stdout:2633: got expected ENOENT (src dne) 2026-02-13T18:17:56.578 INFO:tasks.rados.rados.0.trial187.stdout:2633: finishing copy_from racing read to trial18717860-28 2026-02-13T18:17:57.575 INFO:tasks.rados.rados.0.trial187.stdout:2633: done (1 left) 2026-02-13T18:17:57.576 INFO:tasks.rados.rados.0.trial187.stdout:2634: done (0 left) 2026-02-13T18:17:57.576 INFO:tasks.rados.rados.0.trial187.stdout:2635: write (excl) oid 19 current snap is 290 2026-02-13T18:17:57.576 INFO:tasks.rados.rados.0.trial187.stdout:2635: seq_num 881 ranges {406967=474964,1370989=769310,2677186=129781} 2026-02-13T18:17:57.581 INFO:tasks.rados.rados.0.trial187.stdout:2635: writing trial18717860-19 from 406967 to 881931 tid 1 2026-02-13T18:17:57.590 INFO:tasks.rados.rados.0.trial187.stdout:2635: writing trial18717860-19 from 1370989 to 2140299 tid 2 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2635: writing trial18717860-19 from 2677186 to 2806967 tid 3 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2636: copy_from oid 21 from oid 32 current snap is 290 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2635: finishing write tid 1 to trial18717860-19 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2635: finishing write tid 2 to trial18717860-19 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2637: read oid 22 snap -1 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2637: expect (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2638: read oid 2 snap -1 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2638: expect deleted 2026-02-13T18:17:57.595 INFO:tasks.rados.rados.0.trial187.stdout:2639: delete oid 33 current snap is 290 2026-02-13T18:17:57.599 INFO:tasks.rados.rados.0.trial187.stdout:2637: expect (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:17:57.613 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 663504 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: finishing write tid 3 to trial18717860-19 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: finishing write tid 4 to trial18717860-19 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: finishing write tid 5 to trial18717860-19 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: oid 19 updating version 0 to 1038 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: oid 19 version 1038 is already newer than 1037 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: oid 19 updating version 1038 to 1039 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: oid 19 version 1039 is already newer than 1036 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1039 (ObjNum 881 snap 290 seq_num 881) dirty exists 2026-02-13T18:17:57.743 INFO:tasks.rados.rados.0.trial187.stdout:2635: left oid 19 (ObjNum 881 snap 290 seq_num 881) 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2636: finishing copy_from racing read to trial18717860-21 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2636: finishing copy_from to trial18717860-21 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 822 (ObjNum 755 snap 263 seq_num 755) dirty exists 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2635: done (4 left) 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2636: done (3 left) 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2637: done (2 left) 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2638: done (1 left) 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2639: done (0 left) 2026-02-13T18:17:57.744 INFO:tasks.rados.rados.0.trial187.stdout:2640: delete oid 35 current snap is 290 2026-02-13T18:17:57.745 INFO:tasks.rados.rados.0.trial187.stdout:2640: done (0 left) 2026-02-13T18:17:57.745 INFO:tasks.rados.rados.0.trial187.stdout:2641: snap_create 2026-02-13T18:17:58.581 INFO:tasks.rados.rados.0.trial187.stdout:2641: done (0 left) 2026-02-13T18:17:58.582 INFO:tasks.rados.rados.0.trial187.stdout:2642: snap_create 2026-02-13T18:17:59.583 INFO:tasks.rados.rados.0.trial187.stdout:2642: done (0 left) 2026-02-13T18:17:59.583 INFO:tasks.rados.rados.0.trial187.stdout:2643: copy_from oid 20 from oid 12 current snap is 292 2026-02-13T18:17:59.583 INFO:tasks.rados.rados.0.trial187.stdout:2644: write (excl) oid 14 current snap is 292 2026-02-13T18:17:59.583 INFO:tasks.rados.rados.0.trial187.stdout:2644: seq_num 884 ranges {457388=417064,1546435=516637,2643102=214286} 2026-02-13T18:17:59.589 INFO:tasks.rados.rados.0.trial187.stdout:2644: writing trial18717860-14 from 457388 to 874452 tid 1 2026-02-13T18:17:59.597 INFO:tasks.rados.rados.0.trial187.stdout:2644: writing trial18717860-14 from 1546435 to 2063072 tid 2 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2644: writing trial18717860-14 from 2643102 to 2857388 tid 3 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2645: copy_from oid 19 from oid 38 current snap is 292 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2644: finishing write tid 1 to trial18717860-14 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2643: finishing copy_from racing read to trial18717860-20 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2643: finishing copy_from to trial18717860-20 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1019 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2644: finishing write tid 2 to trial18717860-14 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2643: done (2 left) 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:2646: rollback oid 27 current snap is 292 2026-02-13T18:17:59.603 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 290 2026-02-13T18:17:59.604 INFO:tasks.rados.rados.0.trial187.stdout:2647: copy_from oid 2 from oid 24 current snap is 292 2026-02-13T18:17:59.604 INFO:tasks.rados.rados.0.trial187.stdout:2648: delete oid 4 current snap is 292 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: finishing write tid 3 to trial18717860-14 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: finishing write tid 4 to trial18717860-14 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: finishing write tid 5 to trial18717860-14 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: oid 14 updating version 0 to 1045 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: oid 14 updating version 1045 to 1048 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: oid 14 version 1048 is already newer than 1046 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: oid 14 version 1048 is already newer than 1047 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1048 (ObjNum 884 snap 292 seq_num 884) dirty exists 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: left oid 14 (ObjNum 884 snap 292 seq_num 884) 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2644: done (4 left) 2026-02-13T18:17:59.605 INFO:tasks.rados.rados.0.trial187.stdout:2648: done (3 left) 2026-02-13T18:17:59.606 INFO:tasks.rados.rados.0.trial187.stdout:2649: delete oid 10 current snap is 292 2026-02-13T18:17:59.607 INFO:tasks.rados.rados.0.trial187.stdout:2646: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:17:59.607 INFO:tasks.rados.rados.0.trial187.stdout:2646: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:17:59.607 INFO:tasks.rados.rados.0.trial187.stdout:2646: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:17:59.607 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1017 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:17:59.608 INFO:tasks.rados.rados.0.trial187.stdout:2646: done (3 left) 2026-02-13T18:17:59.609 INFO:tasks.rados.rados.0.trial187.stdout:2649: done (2 left) 2026-02-13T18:17:59.609 INFO:tasks.rados.rados.0.trial187.stdout:2650: write oid 5 current snap is 292 2026-02-13T18:17:59.609 INFO:tasks.rados.rados.0.trial187.stdout:2650: seq_num 887 ranges {507809=642811,1721881=663964} 2026-02-13T18:17:59.613 INFO:tasks.rados.rados.0.trial187.stdout:2650: writing trial18717860-5 from 507809 to 1150620 tid 1 2026-02-13T18:17:59.622 INFO:tasks.rados.rados.0.trial187.stdout:2650: writing trial18717860-5 from 1721881 to 2385845 tid 2 2026-02-13T18:17:59.622 INFO:tasks.rados.rados.0.trial187.stdout:2651: copy_from oid 7 from oid 17 current snap is 292 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2647: finishing copy_from racing read to trial18717860-2 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2645: finishing copy_from racing read to trial18717860-19 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2645: finishing copy_from to trial18717860-19 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1012 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2647: finishing copy_from to trial18717860-2 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1188 (ObjNum 872 snap 287 seq_num 872) dirty exists 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2650: finishing write tid 1 to trial18717860-5 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2645: done (3 left) 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2647: done (2 left) 2026-02-13T18:17:59.623 INFO:tasks.rados.rados.0.trial187.stdout:2652: snap_create 2026-02-13T18:17:59.624 INFO:tasks.rados.rados.0.trial187.stdout:2650: finishing write tid 2 to trial18717860-5 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:2650: finishing write tid 3 to trial18717860-5 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:2650: finishing write tid 4 to trial18717860-5 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:2650: oid 5 updating version 0 to 1410 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:2650: oid 5 updating version 1410 to 1411 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:2650: oid 5 updating version 1411 to 1412 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1412 (ObjNum 887 snap 292 seq_num 887) dirty exists 2026-02-13T18:17:59.625 INFO:tasks.rados.rados.0.trial187.stdout:2650: left oid 5 (ObjNum 887 snap 292 seq_num 887) 2026-02-13T18:17:59.629 INFO:tasks.rados.rados.0.trial187.stdout:2651: finishing copy_from racing read to trial18717860-7 2026-02-13T18:17:59.630 INFO:tasks.rados.rados.0.trial187.stdout:2651: finishing copy_from to trial18717860-7 2026-02-13T18:17:59.630 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1009 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:18:00.519 INFO:tasks.rados.rados.0.trial187.stdout:2650: done (2 left) 2026-02-13T18:18:00.519 INFO:tasks.rados.rados.0.trial187.stdout:2651: done (1 left) 2026-02-13T18:18:00.520 INFO:tasks.rados.rados.0.trial187.stdout:2652: done (0 left) 2026-02-13T18:18:00.520 INFO:tasks.rados.rados.0.trial187.stdout:2653: snap_create 2026-02-13T18:18:01.519 INFO:tasks.rados.rados.0.trial187.stdout:2653: done (0 left) 2026-02-13T18:18:01.519 INFO:tasks.rados.rados.0.trial187.stdout:2654: delete oid 6 current snap is 294 2026-02-13T18:18:01.523 INFO:tasks.rados.rados.0.trial187.stdout:2654: done (0 left) 2026-02-13T18:18:01.523 INFO:tasks.rados.rados.0.trial187.stdout:2655: write (excl) oid 9 current snap is 294 2026-02-13T18:18:01.523 INFO:tasks.rados.rados.0.trial187.stdout:2655: seq_num 889 ranges {541423=793309,2122492=667633} 2026-02-13T18:18:01.532 INFO:tasks.rados.rados.0.trial187.stdout:2655: writing trial18717860-9 from 541423 to 1334732 tid 1 2026-02-13T18:18:01.542 INFO:tasks.rados.rados.0.trial187.stdout:2655: writing trial18717860-9 from 2122492 to 2790125 tid 2 2026-02-13T18:18:01.542 INFO:tasks.rados.rados.0.trial187.stdout:2656: copy_from oid 49 from oid 5 current snap is 294 2026-02-13T18:18:01.543 INFO:tasks.rados.rados.0.trial187.stdout:2655: finishing write tid 1 to trial18717860-9 2026-02-13T18:18:01.543 INFO:tasks.rados.rados.0.trial187.stdout:2657: read oid 31 snap 277 2026-02-13T18:18:01.543 INFO:tasks.rados.rados.0.trial187.stdout:2657: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:18:01.543 INFO:tasks.rados.rados.0.trial187.stdout:2658: rollback oid 45 current snap is 294 2026-02-13T18:18:01.543 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 292 2026-02-13T18:18:01.543 INFO:tasks.rados.rados.0.trial187.stdout:2659: snap_create 2026-02-13T18:18:01.544 INFO:tasks.rados.rados.0.trial187.stdout:2655: finishing write tid 2 to trial18717860-9 2026-02-13T18:18:01.546 INFO:tasks.rados.rados.0.trial187.stdout:2655: finishing write tid 3 to trial18717860-9 2026-02-13T18:18:01.547 INFO:tasks.rados.rados.0.trial187.stdout:2655: finishing write tid 4 to trial18717860-9 2026-02-13T18:18:01.547 INFO:tasks.rados.rados.0.trial187.stdout:2655: oid 9 updating version 0 to 1369 2026-02-13T18:18:01.547 INFO:tasks.rados.rados.0.trial187.stdout:2655: oid 9 version 1369 is already newer than 1368 2026-02-13T18:18:01.547 INFO:tasks.rados.rados.0.trial187.stdout:2655: oid 9 updating version 1369 to 1370 2026-02-13T18:18:01.547 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 1370 (ObjNum 889 snap 294 seq_num 889) dirty exists 2026-02-13T18:18:01.547 INFO:tasks.rados.rados.0.trial187.stdout:2655: left oid 9 (ObjNum 889 snap 294 seq_num 889) 2026-02-13T18:18:01.549 INFO:tasks.rados.rados.0.trial187.stdout:2657: expect (ObjNum 784 snap 268 seq_num 784) 2026-02-13T18:18:01.558 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 788900 2026-02-13T18:18:01.622 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1595970 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:2658: finishing rollback tid 0 to trial18717860-45 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:2658: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:2658: finishing rollback tid 2 to trial18717860-45 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1415 (ObjNum 865 snap 285 seq_num 865) dirty exists 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:2656: finishing copy_from racing read to trial18717860-49 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:2656: finishing copy_from to trial18717860-49 2026-02-13T18:18:01.689 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1412 (ObjNum 887 snap 292 seq_num 887) dirty exists 2026-02-13T18:18:02.521 INFO:tasks.rados.rados.0.trial187.stdout:2655: done (4 left) 2026-02-13T18:18:02.521 INFO:tasks.rados.rados.0.trial187.stdout:2656: done (3 left) 2026-02-13T18:18:02.521 INFO:tasks.rados.rados.0.trial187.stdout:2657: done (2 left) 2026-02-13T18:18:02.521 INFO:tasks.rados.rados.0.trial187.stdout:2658: done (1 left) 2026-02-13T18:18:02.521 INFO:tasks.rados.rados.0.trial187.stdout:2659: done (0 left) 2026-02-13T18:18:02.521 INFO:tasks.rados.rados.0.trial187.stdout:2660: write oid 36 current snap is 295 2026-02-13T18:18:02.522 INFO:tasks.rados.rados.0.trial187.stdout:2660: seq_num 890 ranges {558230=584911,1897327=527644,2923993=34237} 2026-02-13T18:18:02.528 INFO:tasks.rados.rados.0.trial187.stdout:2660: writing trial18717860-36 from 558230 to 1143141 tid 1 2026-02-13T18:18:02.537 INFO:tasks.rados.rados.0.trial187.stdout:2660: writing trial18717860-36 from 1897327 to 2424971 tid 2 2026-02-13T18:18:02.541 INFO:tasks.rados.rados.0.trial187.stdout:2660: writing trial18717860-36 from 2923993 to 2958230 tid 3 2026-02-13T18:18:02.541 INFO:tasks.rados.rados.0.trial187.stdout:2661: read oid 34 snap -1 2026-02-13T18:18:02.541 INFO:tasks.rados.rados.0.trial187.stdout:2661: expect (ObjNum 756 snap 263 seq_num 756) 2026-02-13T18:18:02.541 INFO:tasks.rados.rados.0.trial187.stdout:2662: read oid 29 snap 282 2026-02-13T18:18:02.541 INFO:tasks.rados.rados.0.trial187.stdout:2662: expect (ObjNum 851 snap 281 seq_num 851) 2026-02-13T18:18:02.542 INFO:tasks.rados.rados.0.trial187.stdout:2663: write (excl) oid 15 current snap is 295 2026-02-13T18:18:02.542 INFO:tasks.rados.rados.0.trial187.stdout:2660: finishing write tid 1 to trial18717860-36 2026-02-13T18:18:02.542 INFO:tasks.rados.rados.0.trial187.stdout:2660: finishing write tid 2 to trial18717860-36 2026-02-13T18:18:02.542 INFO:tasks.rados.rados.0.trial187.stdout:2663: seq_num 891 ranges {575037=660160,1955809=671302} 2026-02-13T18:18:02.549 INFO:tasks.rados.rados.0.trial187.stdout:2663: writing trial18717860-15 from 575037 to 1235197 tid 1 2026-02-13T18:18:02.558 INFO:tasks.rados.rados.0.trial187.stdout:2663: writing trial18717860-15 from 1955809 to 2627111 tid 2 2026-02-13T18:18:02.559 INFO:tasks.rados.rados.0.trial187.stdout:2664: write oid 12 current snap is 295 2026-02-13T18:18:02.559 INFO:tasks.rados.rados.0.trial187.stdout:2664: seq_num 892 ranges {591844=735409,1897938=531313,2862486=129358} 2026-02-13T18:18:02.567 INFO:tasks.rados.rados.0.trial187.stdout:2664: writing trial18717860-12 from 591844 to 1327253 tid 1 2026-02-13T18:18:02.572 INFO:tasks.rados.rados.0.trial187.stdout:2664: writing trial18717860-12 from 1897938 to 2429251 tid 2 2026-02-13T18:18:02.574 INFO:tasks.rados.rados.0.trial187.stdout:2664: writing trial18717860-12 from 2862486 to 2991844 tid 3 2026-02-13T18:18:02.575 INFO:tasks.rados.rados.0.trial187.stdout:2665: snap_create 2026-02-13T18:18:02.575 INFO:tasks.rados.rados.0.trial187.stdout:2661: expect (ObjNum 756 snap 263 seq_num 756) 2026-02-13T18:18:02.698 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:02.750 INFO:tasks.rados.rados.0.trial187.stdout:2660: finishing write tid 3 to trial18717860-36 2026-02-13T18:18:02.750 INFO:tasks.rados.rados.0.trial187.stdout:2660: finishing write tid 4 to trial18717860-36 2026-02-13T18:18:02.750 INFO:tasks.rados.rados.0.trial187.stdout:2660: finishing write tid 5 to trial18717860-36 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:2660: oid 36 updating version 0 to 1050 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:2660: oid 36 updating version 1050 to 1052 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:2660: oid 36 version 1052 is already newer than 1051 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:2660: oid 36 version 1052 is already newer than 1049 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1052 (ObjNum 890 snap 295 seq_num 890) dirty exists 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:2660: left oid 36 (ObjNum 890 snap 295 seq_num 890) 2026-02-13T18:18:02.751 INFO:tasks.rados.rados.0.trial187.stdout:2662: expect (ObjNum 851 snap 281 seq_num 851) 2026-02-13T18:18:02.763 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 805574 2026-02-13T18:18:02.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1345590 2026-02-13T18:18:02.785 INFO:tasks.rados.rados.0.trial187.stdout:2663: finishing write tid 1 to trial18717860-15 2026-02-13T18:18:02.785 INFO:tasks.rados.rados.0.trial187.stdout:2663: finishing write tid 2 to trial18717860-15 2026-02-13T18:18:02.785 INFO:tasks.rados.rados.0.trial187.stdout:2663: finishing write tid 3 to trial18717860-15 2026-02-13T18:18:02.785 INFO:tasks.rados.rados.0.trial187.stdout:2663: finishing write tid 4 to trial18717860-15 2026-02-13T18:18:02.785 INFO:tasks.rados.rados.0.trial187.stdout:2663: oid 15 updating version 0 to 1040 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2663: oid 15 updating version 1040 to 1041 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2663: oid 15 updating version 1041 to 1042 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1042 (ObjNum 891 snap 295 seq_num 891) dirty exists 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2663: left oid 15 (ObjNum 891 snap 295 seq_num 891) 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: finishing write tid 1 to trial18717860-12 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: finishing write tid 2 to trial18717860-12 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: finishing write tid 3 to trial18717860-12 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: finishing write tid 4 to trial18717860-12 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: finishing write tid 5 to trial18717860-12 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: oid 12 updating version 0 to 1026 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: oid 12 version 1026 is already newer than 1025 2026-02-13T18:18:02.786 INFO:tasks.rados.rados.0.trial187.stdout:2664: oid 12 version 1026 is already newer than 1023 2026-02-13T18:18:02.787 INFO:tasks.rados.rados.0.trial187.stdout:2664: oid 12 version 1026 is already newer than 1024 2026-02-13T18:18:02.787 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1026 (ObjNum 892 snap 295 seq_num 892) dirty exists 2026-02-13T18:18:02.787 INFO:tasks.rados.rados.0.trial187.stdout:2664: left oid 12 (ObjNum 892 snap 295 seq_num 892) 2026-02-13T18:18:03.523 INFO:tasks.rados.rados.0.trial187.stdout:2660: done (5 left) 2026-02-13T18:18:03.523 INFO:tasks.rados.rados.0.trial187.stdout:2661: done (4 left) 2026-02-13T18:18:03.523 INFO:tasks.rados.rados.0.trial187.stdout:2662: done (3 left) 2026-02-13T18:18:03.523 INFO:tasks.rados.rados.0.trial187.stdout:2663: done (2 left) 2026-02-13T18:18:03.524 INFO:tasks.rados.rados.0.trial187.stdout:2664: done (1 left) 2026-02-13T18:18:03.524 INFO:tasks.rados.rados.0.trial187.stdout:2665: done (0 left) 2026-02-13T18:18:03.524 INFO:tasks.rados.rados.0.trial187.stdout:2666: read oid 5 snap -1 2026-02-13T18:18:03.524 INFO:tasks.rados.rados.0.trial187.stdout:2666: expect (ObjNum 887 snap 292 seq_num 887) 2026-02-13T18:18:03.524 INFO:tasks.rados.rados.0.trial187.stdout:2667: snap_remove snap 292 2026-02-13T18:18:04.523 INFO:tasks.rados.rados.0.trial187.stdout:2667: done (1 left) 2026-02-13T18:18:04.523 INFO:tasks.rados.rados.0.trial187.stdout:2668: delete oid 17 current snap is 296 2026-02-13T18:18:04.523 INFO:tasks.rados.rados.0.trial187.stdout:2666: expect (ObjNum 887 snap 292 seq_num 887) 2026-02-13T18:18:04.523 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:04.584 INFO:tasks.rados.rados.0.trial187.stdout:2666: done (1 left) 2026-02-13T18:18:04.584 INFO:tasks.rados.rados.0.trial187.stdout:2668: done (0 left) 2026-02-13T18:18:04.584 INFO:tasks.rados.rados.0.trial187.stdout:2669: snap_remove snap 277 2026-02-13T18:18:05.529 INFO:tasks.rados.rados.0.trial187.stdout:2669: done (0 left) 2026-02-13T18:18:05.530 INFO:tasks.rados.rados.0.trial187.stdout:2670: delete oid 30 current snap is 296 2026-02-13T18:18:05.534 INFO:tasks.rados.rados.0.trial187.stdout:2670: done (0 left) 2026-02-13T18:18:05.535 INFO:tasks.rados.rados.0.trial187.stdout:2671: snap_create 2026-02-13T18:18:06.533 INFO:tasks.rados.rados.0.trial187.stdout:2671: done (0 left) 2026-02-13T18:18:06.533 INFO:tasks.rados.rados.0.trial187.stdout:2672: snap_remove snap 294 2026-02-13T18:18:07.575 INFO:tasks.rados.rados.0.trial187.stdout:2672: done (0 left) 2026-02-13T18:18:07.576 INFO:tasks.rados.rados.0.trial187.stdout:2673: snap_remove snap 293 2026-02-13T18:18:08.577 INFO:tasks.rados.rados.0.trial187.stdout:2673: done (0 left) 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:2674: rollback oid 5 current snap is 297 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 296 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:2675: rollback oid 49 current snap is 297 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 285 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:2676: read oid 23 snap 288 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:2676: expect (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:2677: rollback oid 14 current snap is 297 2026-02-13T18:18:08.578 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 295 2026-02-13T18:18:08.579 INFO:tasks.rados.rados.0.trial187.stdout:2678: write oid 17 current snap is 297 2026-02-13T18:18:08.579 INFO:tasks.rados.rados.0.trial187.stdout:2678: seq_num 895 ranges {642265=561156,1673384=678640,2828402=213863} 2026-02-13T18:18:08.585 INFO:tasks.rados.rados.0.trial187.stdout:2678: writing trial18717860-17 from 642265 to 1203421 tid 1 2026-02-13T18:18:08.593 INFO:tasks.rados.rados.0.trial187.stdout:2678: writing trial18717860-17 from 1673384 to 2352024 tid 2 2026-02-13T18:18:08.598 INFO:tasks.rados.rados.0.trial187.stdout:2678: writing trial18717860-17 from 2828402 to 3042265 tid 3 2026-02-13T18:18:08.598 INFO:tasks.rados.rados.0.trial187.stdout:2679: snap_create 2026-02-13T18:18:08.599 INFO:tasks.rados.rados.0.trial187.stdout:2676: expect (ObjNum 838 snap 280 seq_num 838) 2026-02-13T18:18:08.599 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:08.665 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:08.690 INFO:tasks.rados.rados.0.trial187.stdout:2675: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:18:08.690 INFO:tasks.rados.rados.0.trial187.stdout:2675: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:18:08.690 INFO:tasks.rados.rados.0.trial187.stdout:2675: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1415 (ObjNum 843 snap 280 seq_num 843) dirty exists 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2677: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2677: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2677: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1055 (ObjNum 884 snap 292 seq_num 884) dirty exists 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2674: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2674: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2674: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1418 (ObjNum 887 snap 292 seq_num 887) dirty exists 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2678: finishing write tid 1 to trial18717860-17 2026-02-13T18:18:08.691 INFO:tasks.rados.rados.0.trial187.stdout:2678: finishing write tid 2 to trial18717860-17 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: finishing write tid 3 to trial18717860-17 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: finishing write tid 4 to trial18717860-17 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: finishing write tid 5 to trial18717860-17 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: oid 17 updating version 0 to 1388 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: oid 17 version 1388 is already newer than 1387 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: oid 17 version 1388 is already newer than 1386 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: oid 17 version 1388 is already newer than 1385 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1388 (ObjNum 895 snap 297 seq_num 895) dirty exists 2026-02-13T18:18:08.692 INFO:tasks.rados.rados.0.trial187.stdout:2678: left oid 17 (ObjNum 895 snap 297 seq_num 895) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2674: done (5 left) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2675: done (4 left) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2676: done (3 left) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2677: done (2 left) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2678: done (1 left) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2679: done (0 left) 2026-02-13T18:18:09.578 INFO:tasks.rados.rados.0.trial187.stdout:2680: snap_create 2026-02-13T18:18:10.520 INFO:tasks.rados.rados.0.trial187.stdout:2680: done (0 left) 2026-02-13T18:18:10.521 INFO:tasks.rados.rados.0.trial187.stdout:2681: delete oid 30 current snap is 299 2026-02-13T18:18:10.523 INFO:tasks.rados.rados.0.trial187.stdout:2681: done (0 left) 2026-02-13T18:18:10.523 INFO:tasks.rados.rados.0.trial187.stdout:2682: delete oid 44 current snap is 299 2026-02-13T18:18:10.527 INFO:tasks.rados.rados.0.trial187.stdout:2682: done (0 left) 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2683: rollback oid 49 current snap is 299 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 269 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2684: read oid 31 snap -1 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2684: expect (ObjNum 859 snap 282 seq_num 859) 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2685: rollback oid 32 current snap is 299 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 283 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2686: read oid 22 snap -1 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2686: expect (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:18:10.528 INFO:tasks.rados.rados.0.trial187.stdout:2687: snap_remove snap 295 2026-02-13T18:18:11.521 INFO:tasks.rados.rados.0.trial187.stdout:2687: done (4 left) 2026-02-13T18:18:11.522 INFO:tasks.rados.rados.0.trial187.stdout:2688: write (excl) oid 42 current snap is 299 2026-02-13T18:18:11.522 INFO:tasks.rados.rados.0.trial187.stdout:2688: seq_num 898 ranges {692686=503256,1848830=425967,2910671=182015} 2026-02-13T18:18:11.529 INFO:tasks.rados.rados.0.trial187.stdout:2688: writing trial18717860-42 from 692686 to 1195942 tid 1 2026-02-13T18:18:11.537 INFO:tasks.rados.rados.0.trial187.stdout:2688: writing trial18717860-42 from 1848830 to 2274797 tid 2 2026-02-13T18:18:11.542 INFO:tasks.rados.rados.0.trial187.stdout:2688: writing trial18717860-42 from 2910671 to 3092686 tid 3 2026-02-13T18:18:11.542 INFO:tasks.rados.rados.0.trial187.stdout:2689: write oid 43 current snap is 299 2026-02-13T18:18:11.543 INFO:tasks.rados.rados.0.trial187.stdout:2689: seq_num 899 ranges {709493=578505,1907312=685978} 2026-02-13T18:18:11.551 INFO:tasks.rados.rados.0.trial187.stdout:2689: writing trial18717860-43 from 709493 to 1287998 tid 1 2026-02-13T18:18:11.560 INFO:tasks.rados.rados.0.trial187.stdout:2689: writing trial18717860-43 from 1907312 to 2593290 tid 2 2026-02-13T18:18:11.560 INFO:tasks.rados.rados.0.trial187.stdout:2690: rollback oid 35 current snap is 299 2026-02-13T18:18:11.560 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 35 to 283 2026-02-13T18:18:11.560 INFO:tasks.rados.rados.0.trial187.stdout:2683: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:18:11.560 INFO:tasks.rados.rados.0.trial187.stdout:2683: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:18:11.561 INFO:tasks.rados.rados.0.trial187.stdout:2685: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:18:11.561 INFO:tasks.rados.rados.0.trial187.stdout:2683: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:18:11.561 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1418 (ObjNum 796 snap 269 seq_num 796) dirty exists 2026-02-13T18:18:11.561 INFO:tasks.rados.rados.0.trial187.stdout:2686: expect (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:18:11.624 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:11.668 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:11.712 INFO:tasks.rados.rados.0.trial187.stdout:2685: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:18:11.712 INFO:tasks.rados.rados.0.trial187.stdout:2685: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:18:11.713 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1034 (ObjNum 755 snap 263 seq_num 755) dirty exists 2026-02-13T18:18:11.713 INFO:tasks.rados.rados.0.trial187.stdout:2684: expect (ObjNum 859 snap 282 seq_num 859) 2026-02-13T18:18:11.752 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1706824 2026-02-13T18:18:11.762 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: finishing write tid 1 to trial18717860-42 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: finishing write tid 2 to trial18717860-42 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: finishing write tid 3 to trial18717860-42 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: finishing write tid 4 to trial18717860-42 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: finishing write tid 5 to trial18717860-42 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: oid 42 updating version 0 to 1030 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: oid 42 updating version 1030 to 1031 2026-02-13T18:18:11.793 INFO:tasks.rados.rados.0.trial187.stdout:2688: oid 42 updating version 1031 to 1032 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2688: oid 42 updating version 1032 to 1033 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1033 (ObjNum 898 snap 299 seq_num 898) dirty exists 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2688: left oid 42 (ObjNum 898 snap 299 seq_num 898) 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2689: finishing write tid 1 to trial18717860-43 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2683: done (6 left) 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2684: done (5 left) 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2685: done (4 left) 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2686: done (3 left) 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2688: done (2 left) 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2691: delete oid 31 current snap is 299 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2689: finishing write tid 2 to trial18717860-43 2026-02-13T18:18:11.794 INFO:tasks.rados.rados.0.trial187.stdout:2689: finishing write tid 3 to trial18717860-43 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2689: finishing write tid 4 to trial18717860-43 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2689: oid 43 updating version 0 to 1760 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2689: oid 43 version 1760 is already newer than 1759 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2689: oid 43 version 1760 is already newer than 1758 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1760 (ObjNum 899 snap 299 seq_num 899) dirty exists 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2689: left oid 43 (ObjNum 899 snap 299 seq_num 899) 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2690: finishing rollback tid 1 to trial18717860-35 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:2690: finishing rollback tid 2 to trial18717860-35 2026-02-13T18:18:11.795 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1600 (ObjNum 732 snap 256 seq_num 732) dirty exists 2026-02-13T18:18:11.796 INFO:tasks.rados.rados.0.trial187.stdout:2689: done (2 left) 2026-02-13T18:18:11.796 INFO:tasks.rados.rados.0.trial187.stdout:2690: done (1 left) 2026-02-13T18:18:11.796 INFO:tasks.rados.rados.0.trial187.stdout:2691: done (0 left) 2026-02-13T18:18:11.796 INFO:tasks.rados.rados.0.trial187.stdout:2692: rollback oid 32 current snap is 299 2026-02-13T18:18:11.796 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 286 2026-02-13T18:18:11.797 INFO:tasks.rados.rados.0.trial187.stdout:2693: rollback oid 14 current snap is 299 2026-02-13T18:18:11.797 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 283 2026-02-13T18:18:11.797 INFO:tasks.rados.rados.0.trial187.stdout:2694: rollback oid 27 current snap is 299 2026-02-13T18:18:11.797 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 286 2026-02-13T18:18:11.797 INFO:tasks.rados.rados.0.trial187.stdout:2695: snap_create 2026-02-13T18:18:11.798 INFO:tasks.rados.rados.0.trial187.stdout:2693: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:18:11.798 INFO:tasks.rados.rados.0.trial187.stdout:2693: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:18:11.798 INFO:tasks.rados.rados.0.trial187.stdout:2693: finishing rollback tid 2 to trial18717860-14 2026-02-13T18:18:11.798 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1058 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:2694: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:2692: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:2694: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:2692: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:2692: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1037 (ObjNum 755 snap 263 seq_num 755) dirty exists 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:2694: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:18:11.799 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1020 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:18:12.584 INFO:tasks.rados.rados.0.trial187.stdout:2692: done (3 left) 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2693: done (2 left) 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2694: done (1 left) 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2695: done (0 left) 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2696: read oid 11 snap -1 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2696: expect (ObjNum 870 snap 287 seq_num 870) 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2697: rollback oid 18 current snap is 300 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 296 2026-02-13T18:18:12.585 INFO:tasks.rados.rados.0.trial187.stdout:2698: snap_remove snap 298 2026-02-13T18:18:13.594 INFO:tasks.rados.rados.0.trial187.stdout:2698: done (2 left) 2026-02-13T18:18:13.595 INFO:tasks.rados.rados.0.trial187.stdout:2699: copy_from oid 40 from oid 36 current snap is 300 2026-02-13T18:18:13.595 INFO:tasks.rados.rados.0.trial187.stdout:2697: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:18:13.595 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 866 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:18:13.595 INFO:tasks.rados.rados.0.trial187.stdout:2696: expect (ObjNum 870 snap 287 seq_num 870) 2026-02-13T18:18:13.662 INFO:tasks.rados.rados.0.trial187.stdout:2699: finishing copy_from racing read to trial18717860-40 2026-02-13T18:18:13.662 INFO:tasks.rados.rados.0.trial187.stdout:2699: finishing copy_from to trial18717860-40 2026-02-13T18:18:13.662 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1052 (ObjNum 890 snap 295 seq_num 890) dirty exists 2026-02-13T18:18:13.662 INFO:tasks.rados.rados.0.trial187.stdout:2696: done (2 left) 2026-02-13T18:18:13.662 INFO:tasks.rados.rados.0.trial187.stdout:2697: done (1 left) 2026-02-13T18:18:13.663 INFO:tasks.rados.rados.0.trial187.stdout:2699: done (0 left) 2026-02-13T18:18:13.663 INFO:tasks.rados.rados.0.trial187.stdout:2700: read oid 39 snap 283 2026-02-13T18:18:13.663 INFO:tasks.rados.rados.0.trial187.stdout:2700: expect (ObjNum 813 snap 275 seq_num 813) 2026-02-13T18:18:13.663 INFO:tasks.rados.rados.0.trial187.stdout:2701: write oid 30 current snap is 300 2026-02-13T18:18:13.663 INFO:tasks.rados.rados.0.trial187.stdout:2701: seq_num 901 ranges {743107=729003,1907923=689647} 2026-02-13T18:18:13.667 INFO:tasks.rados.rados.0.trial187.stdout:2701: writing trial18717860-30 from 743107 to 1472110 tid 1 2026-02-13T18:18:13.672 INFO:tasks.rados.rados.0.trial187.stdout:2701: writing trial18717860-30 from 1907923 to 2597570 tid 2 2026-02-13T18:18:13.672 INFO:tasks.rados.rados.0.trial187.stdout:2702: read oid 17 snap -1 2026-02-13T18:18:13.672 INFO:tasks.rados.rados.0.trial187.stdout:2702: expect (ObjNum 895 snap 297 seq_num 895) 2026-02-13T18:18:13.672 INFO:tasks.rados.rados.0.trial187.stdout:2703: rollback oid 38 current snap is 300 2026-02-13T18:18:13.672 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 287 2026-02-13T18:18:13.672 INFO:tasks.rados.rados.0.trial187.stdout:2700: expect (ObjNum 813 snap 275 seq_num 813) 2026-02-13T18:18:13.733 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 435388 2026-02-13T18:18:13.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:13.821 INFO:tasks.rados.rados.0.trial187.stdout:2701: finishing write tid 1 to trial18717860-30 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2701: finishing write tid 2 to trial18717860-30 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2701: finishing write tid 3 to trial18717860-30 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2700: done (3 left) 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2704: read oid 36 snap -1 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2704: expect (ObjNum 890 snap 295 seq_num 890) 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2705: snap_create 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2701: finishing write tid 4 to trial18717860-30 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2701: oid 30 updating version 0 to 1040 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2701: oid 30 version 1040 is already newer than 1039 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:2701: oid 30 version 1040 is already newer than 1038 2026-02-13T18:18:13.822 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1040 (ObjNum 901 snap 300 seq_num 901) dirty exists 2026-02-13T18:18:13.823 INFO:tasks.rados.rados.0.trial187.stdout:2701: left oid 30 (ObjNum 901 snap 300 seq_num 901) 2026-02-13T18:18:13.823 INFO:tasks.rados.rados.0.trial187.stdout:2702: expect (ObjNum 895 snap 297 seq_num 895) 2026-02-13T18:18:13.828 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2029703 2026-02-13T18:18:13.853 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:13.875 INFO:tasks.rados.rados.0.trial187.stdout:2703: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:18:13.875 INFO:tasks.rados.rados.0.trial187.stdout:2703: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:18:13.875 INFO:tasks.rados.rados.0.trial187.stdout:2703: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:18:13.876 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1603 (ObjNum 773 snap 265 seq_num 773) dirty exists 2026-02-13T18:18:13.876 INFO:tasks.rados.rados.0.trial187.stdout:2704: expect (ObjNum 890 snap 295 seq_num 890) 2026-02-13T18:18:13.876 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 320501 2026-02-13T18:18:14.600 INFO:tasks.rados.rados.0.trial187.stdout:2701: done (4 left) 2026-02-13T18:18:14.600 INFO:tasks.rados.rados.0.trial187.stdout:2702: done (3 left) 2026-02-13T18:18:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2703: done (2 left) 2026-02-13T18:18:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2704: done (1 left) 2026-02-13T18:18:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2705: done (0 left) 2026-02-13T18:18:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2706: copy_from oid 46 from oid 31 current snap is 301 2026-02-13T18:18:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2707: snap_remove snap 281 2026-02-13T18:18:15.521 INFO:tasks.rados.rados.0.trial187.stdout:2707: done (1 left) 2026-02-13T18:18:15.522 INFO:tasks.rados.rados.0.trial187.stdout:2708: snap_remove snap 285 2026-02-13T18:18:16.522 INFO:tasks.rados.rados.0.trial187.stdout:2708: done (1 left) 2026-02-13T18:18:16.522 INFO:tasks.rados.rados.0.trial187.stdout:2709: delete oid 26 current snap is 301 2026-02-13T18:18:16.522 INFO:tasks.rados.rados.0.trial187.stdout:2706: finishing copy_from to trial18717860-46 2026-02-13T18:18:16.523 INFO:tasks.rados.rados.0.trial187.stdout:2706: got expected ENOENT (src dne) 2026-02-13T18:18:16.523 INFO:tasks.rados.rados.0.trial187.stdout:2706: finishing copy_from racing read to trial18717860-46 2026-02-13T18:18:16.526 INFO:tasks.rados.rados.0.trial187.stdout:2706: done (1 left) 2026-02-13T18:18:16.526 INFO:tasks.rados.rados.0.trial187.stdout:2709: done (0 left) 2026-02-13T18:18:16.526 INFO:tasks.rados.rados.0.trial187.stdout:2710: write (excl) oid 48 current snap is 301 2026-02-13T18:18:16.526 INFO:tasks.rados.rados.0.trial187.stdout:2710: seq_num 903 ranges {776721=479501,2024887=693316} 2026-02-13T18:18:16.531 INFO:tasks.rados.rados.0.trial187.stdout:2710: writing trial18717860-48 from 776721 to 1256222 tid 1 2026-02-13T18:18:16.537 INFO:tasks.rados.rados.0.trial187.stdout:2710: writing trial18717860-48 from 2024887 to 2718203 tid 2 2026-02-13T18:18:16.537 INFO:tasks.rados.rados.0.trial187.stdout:2711: copy_from oid 37 from oid 13 current snap is 301 2026-02-13T18:18:16.537 INFO:tasks.rados.rados.0.trial187.stdout:2712: snap_remove snap 269 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2712: done (2 left) 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2713: copy_from oid 29 from oid 21 current snap is 301 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2711: finishing copy_from to trial18717860-37 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2711: got expected ENOENT (src dne) 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2711: finishing copy_from racing read to trial18717860-37 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2710: finishing write tid 1 to trial18717860-48 2026-02-13T18:18:17.524 INFO:tasks.rados.rados.0.trial187.stdout:2710: finishing write tid 2 to trial18717860-48 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: finishing write tid 3 to trial18717860-48 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: finishing write tid 4 to trial18717860-48 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: oid 48 updating version 0 to 1778 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: oid 48 updating version 1778 to 1780 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: oid 48 version 1780 is already newer than 1779 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1780 (ObjNum 903 snap 301 seq_num 903) dirty exists 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: left oid 48 (ObjNum 903 snap 301 seq_num 903) 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2710: done (2 left) 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2711: done (1 left) 2026-02-13T18:18:17.525 INFO:tasks.rados.rados.0.trial187.stdout:2714: snap_remove snap 286 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:2714: done (1 left) 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:2715: copy_from oid 12 from oid 28 current snap is 301 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:2713: finishing copy_from racing read to trial18717860-29 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:2713: finishing copy_from to trial18717860-29 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 822 (ObjNum 755 snap 263 seq_num 755) dirty exists 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:2713: done (1 left) 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:2716: rollback oid 48 current snap is 301 2026-02-13T18:18:18.526 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 48 to 288 2026-02-13T18:18:18.527 INFO:tasks.rados.rados.0.trial187.stdout:2717: read oid 24 snap -1 2026-02-13T18:18:18.527 INFO:tasks.rados.rados.0.trial187.stdout:2717: expect (ObjNum 872 snap 287 seq_num 872) 2026-02-13T18:18:18.527 INFO:tasks.rados.rados.0.trial187.stdout:2718: delete oid 2 current snap is 301 2026-02-13T18:18:18.530 INFO:tasks.rados.rados.0.trial187.stdout:2718: done (3 left) 2026-02-13T18:18:18.530 INFO:tasks.rados.rados.0.trial187.stdout:2719: write oid 38 current snap is 301 2026-02-13T18:18:18.531 INFO:tasks.rados.rados.0.trial187.stdout:2719: seq_num 905 ranges {410335=746352,1741851=696985,3102632=107703} 2026-02-13T18:18:18.535 INFO:tasks.rados.rados.0.trial187.stdout:2719: writing trial18717860-38 from 410335 to 1156687 tid 1 2026-02-13T18:18:18.540 INFO:tasks.rados.rados.0.trial187.stdout:2719: writing trial18717860-38 from 1741851 to 2438836 tid 2 2026-02-13T18:18:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2719: writing trial18717860-38 from 3102632 to 3210335 tid 3 2026-02-13T18:18:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2720: delete oid 32 current snap is 301 2026-02-13T18:18:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2716: finishing rollback tid 0 to trial18717860-48 2026-02-13T18:18:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2716: finishing rollback tid 1 to trial18717860-48 2026-02-13T18:18:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2716: finishing rollback tid 2 to trial18717860-48 2026-02-13T18:18:18.544 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1799 (ObjNum 877 snap 287 seq_num 877) dirty exists 2026-02-13T18:18:18.544 INFO:tasks.rados.rados.0.trial187.stdout:2717: expect (ObjNum 872 snap 287 seq_num 872) 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2719: finishing write tid 1 to trial18717860-38 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2715: finishing copy_from racing read to trial18717860-12 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2716: done (4 left) 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2717: done (3 left) 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2720: done (2 left) 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2721: read oid 36 snap -1 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2721: expect (ObjNum 890 snap 295 seq_num 890) 2026-02-13T18:18:18.653 INFO:tasks.rados.rados.0.trial187.stdout:2722: read oid 20 snap -1 2026-02-13T18:18:18.654 INFO:tasks.rados.rados.0.trial187.stdout:2722: expect (ObjNum 871 snap 287 seq_num 871) 2026-02-13T18:18:18.654 INFO:tasks.rados.rados.0.trial187.stdout:2723: write oid 6 current snap is 301 2026-02-13T18:18:18.654 INFO:tasks.rados.rados.0.trial187.stdout:2723: seq_num 907 ranges {443949=496850,1458815=584301,2641125=602824} 2026-02-13T18:18:18.659 INFO:tasks.rados.rados.0.trial187.stdout:2723: writing trial18717860-6 from 443949 to 940799 tid 1 2026-02-13T18:18:18.667 INFO:tasks.rados.rados.0.trial187.stdout:2723: writing trial18717860-6 from 1458815 to 2043116 tid 2 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2723: writing trial18717860-6 from 2641125 to 3243949 tid 3 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2724: write (excl) oid 14 current snap is 301 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: finishing write tid 2 to trial18717860-38 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: finishing write tid 3 to trial18717860-38 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: finishing write tid 4 to trial18717860-38 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: finishing write tid 5 to trial18717860-38 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: oid 38 updating version 0 to 1607 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: oid 38 version 1607 is already newer than 1604 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: oid 38 version 1607 is already newer than 1606 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:2719: oid 38 version 1607 is already newer than 1605 2026-02-13T18:18:18.676 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1607 (ObjNum 905 snap 301 seq_num 905) dirty exists 2026-02-13T18:18:18.677 INFO:tasks.rados.rados.0.trial187.stdout:2719: left oid 38 (ObjNum 905 snap 301 seq_num 905) 2026-02-13T18:18:18.677 INFO:tasks.rados.rados.0.trial187.stdout:2715: finishing copy_from to trial18717860-12 2026-02-13T18:18:18.677 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 995 (ObjNum 735 snap 257 seq_num 735) dirty exists 2026-02-13T18:18:18.677 INFO:tasks.rados.rados.0.trial187.stdout:2721: expect (ObjNum 890 snap 295 seq_num 890) 2026-02-13T18:18:18.728 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:18.834 INFO:tasks.rados.rados.0.trial187.stdout:2722: expect (ObjNum 871 snap 287 seq_num 871) 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: finishing write tid 1 to trial18717860-6 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: finishing write tid 2 to trial18717860-6 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: finishing write tid 3 to trial18717860-6 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: finishing write tid 4 to trial18717860-6 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: finishing write tid 5 to trial18717860-6 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: oid 6 updating version 0 to 1191 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: oid 6 version 1191 is already newer than 1190 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: oid 6 updating version 1191 to 1192 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:2723: oid 6 updating version 1192 to 1193 2026-02-13T18:18:18.973 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1193 (ObjNum 907 snap 301 seq_num 907) dirty exists 2026-02-13T18:18:18.974 INFO:tasks.rados.rados.0.trial187.stdout:2723: left oid 6 (ObjNum 907 snap 301 seq_num 907) 2026-02-13T18:18:18.974 INFO:tasks.rados.rados.0.trial187.stdout:2724: seq_num 908 ranges {460756=572099,1517297=444312,2668548=472870} 2026-02-13T18:18:18.980 INFO:tasks.rados.rados.0.trial187.stdout:2724: writing trial18717860-14 from 460756 to 1032855 tid 1 2026-02-13T18:18:18.986 INFO:tasks.rados.rados.0.trial187.stdout:2724: writing trial18717860-14 from 1517297 to 1961609 tid 2 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2724: writing trial18717860-14 from 2668548 to 3141418 tid 3 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2715: done (5 left) 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2719: done (4 left) 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2721: done (3 left) 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2722: done (2 left) 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2723: done (1 left) 2026-02-13T18:18:18.995 INFO:tasks.rados.rados.0.trial187.stdout:2725: snap_remove snap 290 2026-02-13T18:18:19.533 INFO:tasks.rados.rados.0.trial187.stdout:2725: done (1 left) 2026-02-13T18:18:19.533 INFO:tasks.rados.rados.0.trial187.stdout:2726: write oid 16 current snap is 301 2026-02-13T18:18:19.533 INFO:tasks.rados.rados.0.trial187.stdout:2726: seq_num 909 ranges {477563=647348,1859426=587970,2979618=297945} 2026-02-13T18:18:19.540 INFO:tasks.rados.rados.0.trial187.stdout:2726: writing trial18717860-16 from 477563 to 1124911 tid 1 2026-02-13T18:18:19.549 INFO:tasks.rados.rados.0.trial187.stdout:2726: writing trial18717860-16 from 1859426 to 2447396 tid 2 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2726: writing trial18717860-16 from 2979618 to 3277563 tid 3 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2727: delete oid 30 current snap is 301 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: finishing write tid 1 to trial18717860-14 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: finishing write tid 2 to trial18717860-14 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: finishing write tid 3 to trial18717860-14 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: finishing write tid 4 to trial18717860-14 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: finishing write tid 5 to trial18717860-14 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: oid 14 updating version 0 to 1062 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: oid 14 version 1062 is already newer than 1061 2026-02-13T18:18:19.556 INFO:tasks.rados.rados.0.trial187.stdout:2724: oid 14 version 1062 is already newer than 1059 2026-02-13T18:18:19.557 INFO:tasks.rados.rados.0.trial187.stdout:2724: oid 14 version 1062 is already newer than 1060 2026-02-13T18:18:19.557 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1062 (ObjNum 908 snap 301 seq_num 908) dirty exists 2026-02-13T18:18:19.557 INFO:tasks.rados.rados.0.trial187.stdout:2724: left oid 14 (ObjNum 908 snap 301 seq_num 908) 2026-02-13T18:18:19.557 INFO:tasks.rados.rados.0.trial187.stdout:2726: finishing write tid 1 to trial18717860-16 2026-02-13T18:18:19.557 INFO:tasks.rados.rados.0.trial187.stdout:2726: finishing write tid 2 to trial18717860-16 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2724: done (2 left) 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2727: done (1 left) 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2728: delete oid 34 current snap is 301 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2726: finishing write tid 3 to trial18717860-16 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2726: finishing write tid 4 to trial18717860-16 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2726: finishing write tid 5 to trial18717860-16 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2726: oid 16 updating version 0 to 1412 2026-02-13T18:18:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2726: oid 16 updating version 1412 to 1414 2026-02-13T18:18:19.559 INFO:tasks.rados.rados.0.trial187.stdout:2726: oid 16 version 1414 is already newer than 1413 2026-02-13T18:18:19.559 INFO:tasks.rados.rados.0.trial187.stdout:2726: oid 16 updating version 1414 to 1415 2026-02-13T18:18:19.559 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1415 (ObjNum 909 snap 301 seq_num 909) dirty exists 2026-02-13T18:18:19.559 INFO:tasks.rados.rados.0.trial187.stdout:2726: left oid 16 (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:18:19.559 INFO:tasks.rados.rados.0.trial187.stdout:2726: done (1 left) 2026-02-13T18:18:19.560 INFO:tasks.rados.rados.0.trial187.stdout:2728: done (0 left) 2026-02-13T18:18:19.560 INFO:tasks.rados.rados.0.trial187.stdout:2729: copy_from oid 13 from oid 26 current snap is 301 2026-02-13T18:18:19.560 INFO:tasks.rados.rados.0.trial187.stdout:2730: write oid 12 current snap is 301 2026-02-13T18:18:19.560 INFO:tasks.rados.rados.0.trial187.stdout:2730: seq_num 912 ranges {527984=473095,1634872=451650,2661887=634311} 2026-02-13T18:18:19.566 INFO:tasks.rados.rados.0.trial187.stdout:2730: writing trial18717860-12 from 527984 to 1001079 tid 1 2026-02-13T18:18:19.573 INFO:tasks.rados.rados.0.trial187.stdout:2730: writing trial18717860-12 from 1634872 to 2086522 tid 2 2026-02-13T18:18:19.582 INFO:tasks.rados.rados.0.trial187.stdout:2730: writing trial18717860-12 from 2661887 to 3296198 tid 3 2026-02-13T18:18:19.582 INFO:tasks.rados.rados.0.trial187.stdout:2731: snap_remove snap 299 2026-02-13T18:18:20.523 INFO:tasks.rados.rados.0.trial187.stdout:2731: done (2 left) 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2732: delete oid 31 current snap is 301 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2729: finishing copy_from to trial18717860-13 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2729: got expected ENOENT (src dne) 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2729: finishing copy_from racing read to trial18717860-13 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2730: finishing write tid 1 to trial18717860-12 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2730: finishing write tid 2 to trial18717860-12 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2730: finishing write tid 3 to trial18717860-12 2026-02-13T18:18:20.524 INFO:tasks.rados.rados.0.trial187.stdout:2730: finishing write tid 4 to trial18717860-12 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:2730: finishing write tid 5 to trial18717860-12 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:2730: oid 12 updating version 0 to 1029 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:2730: oid 12 updating version 1029 to 1030 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:2730: oid 12 version 1030 is already newer than 1027 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:2730: oid 12 version 1030 is already newer than 1028 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1030 (ObjNum 912 snap 301 seq_num 912) dirty exists 2026-02-13T18:18:20.525 INFO:tasks.rados.rados.0.trial187.stdout:2730: left oid 12 (ObjNum 912 snap 301 seq_num 912) 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:2729: done (2 left) 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:2730: done (1 left) 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:2732: done (0 left) 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:2733: rollback oid 5 current snap is 301 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 289 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:2734: read oid 34 snap -1 2026-02-13T18:18:20.527 INFO:tasks.rados.rados.0.trial187.stdout:2734: expect deleted 2026-02-13T18:18:20.528 INFO:tasks.rados.rados.0.trial187.stdout:2735: snap_remove snap 288 2026-02-13T18:18:21.523 INFO:tasks.rados.rados.0.trial187.stdout:2735: done (2 left) 2026-02-13T18:18:21.524 INFO:tasks.rados.rados.0.trial187.stdout:2736: snap_remove snap 278 2026-02-13T18:18:22.525 INFO:tasks.rados.rados.0.trial187.stdout:2736: done (2 left) 2026-02-13T18:18:22.525 INFO:tasks.rados.rados.0.trial187.stdout:2737: read oid 2 snap -1 2026-02-13T18:18:22.525 INFO:tasks.rados.rados.0.trial187.stdout:2737: expect deleted 2026-02-13T18:18:22.526 INFO:tasks.rados.rados.0.trial187.stdout:2738: read oid 44 snap -1 2026-02-13T18:18:22.526 INFO:tasks.rados.rados.0.trial187.stdout:2738: expect deleted 2026-02-13T18:18:22.526 INFO:tasks.rados.rados.0.trial187.stdout:2739: read oid 15 snap -1 2026-02-13T18:18:22.526 INFO:tasks.rados.rados.0.trial187.stdout:2739: expect (ObjNum 891 snap 295 seq_num 891) 2026-02-13T18:18:22.526 INFO:tasks.rados.rados.0.trial187.stdout:2740: write oid 7 current snap is 301 2026-02-13T18:18:22.526 INFO:tasks.rados.rados.0.trial187.stdout:2740: seq_num 914 ranges {561598=739946,1751836=455319,2716733=644865} 2026-02-13T18:18:22.534 INFO:tasks.rados.rados.0.trial187.stdout:2740: writing trial18717860-7 from 561598 to 1301544 tid 1 2026-02-13T18:18:22.540 INFO:tasks.rados.rados.0.trial187.stdout:2740: writing trial18717860-7 from 1751836 to 2207155 tid 2 2026-02-13T18:18:22.548 INFO:tasks.rados.rados.0.trial187.stdout:2740: writing trial18717860-7 from 2716733 to 3361598 tid 3 2026-02-13T18:18:22.548 INFO:tasks.rados.rados.0.trial187.stdout:2741: snap_remove snap 287 2026-02-13T18:18:23.577 INFO:tasks.rados.rados.0.trial187.stdout:2741: done (6 left) 2026-02-13T18:18:23.577 INFO:tasks.rados.rados.0.trial187.stdout:2742: write oid 39 current snap is 301 2026-02-13T18:18:23.577 INFO:tasks.rados.rados.0.trial187.stdout:2742: seq_num 915 ranges {578405=415195,1410318=598977,2744156=584480} 2026-02-13T18:18:23.583 INFO:tasks.rados.rados.0.trial187.stdout:2742: writing trial18717860-39 from 578405 to 993600 tid 1 2026-02-13T18:18:23.590 INFO:tasks.rados.rados.0.trial187.stdout:2742: writing trial18717860-39 from 1410318 to 2009295 tid 2 2026-02-13T18:18:23.600 INFO:tasks.rados.rados.0.trial187.stdout:2742: writing trial18717860-39 from 2744156 to 3328636 tid 3 2026-02-13T18:18:23.600 INFO:tasks.rados.rados.0.trial187.stdout:2743: write oid 37 current snap is 301 2026-02-13T18:18:23.600 INFO:tasks.rados.rados.0.trial187.stdout:2733: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:18:23.600 INFO:tasks.rados.rados.0.trial187.stdout:2733: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:18:23.600 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1420 (ObjNum 129 snap 0 seq_num 3013740448) dirty dne 2026-02-13T18:18:23.600 INFO:tasks.rados.rados.0.trial187.stdout:2743: seq_num 916 ranges {595212=490444,1868800=458988,2887932=507280} 2026-02-13T18:18:23.607 INFO:tasks.rados.rados.0.trial187.stdout:2743: writing trial18717860-37 from 595212 to 1085656 tid 1 2026-02-13T18:18:23.615 INFO:tasks.rados.rados.0.trial187.stdout:2743: writing trial18717860-37 from 1868800 to 2327788 tid 2 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2743: writing trial18717860-37 from 2887932 to 3395212 tid 3 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2733: done (7 left) 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2734: done (6 left) 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2737: done (5 left) 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2738: done (4 left) 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2744: snap_create 2026-02-13T18:18:23.623 INFO:tasks.rados.rados.0.trial187.stdout:2739: expect (ObjNum 891 snap 295 seq_num 891) 2026-02-13T18:18:23.627 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 700092 2026-02-13T18:18:23.669 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 332195 2026-02-13T18:18:23.699 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:23.731 INFO:tasks.rados.rados.0.trial187.stdout:2740: finishing write tid 1 to trial18717860-7 2026-02-13T18:18:23.731 INFO:tasks.rados.rados.0.trial187.stdout:2740: finishing write tid 2 to trial18717860-7 2026-02-13T18:18:23.731 INFO:tasks.rados.rados.0.trial187.stdout:2740: finishing write tid 3 to trial18717860-7 2026-02-13T18:18:23.731 INFO:tasks.rados.rados.0.trial187.stdout:2740: finishing write tid 4 to trial18717860-7 2026-02-13T18:18:23.731 INFO:tasks.rados.rados.0.trial187.stdout:2740: finishing write tid 5 to trial18717860-7 2026-02-13T18:18:23.731 INFO:tasks.rados.rados.0.trial187.stdout:2740: oid 7 updating version 0 to 1095 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2740: oid 7 updating version 1095 to 1098 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2740: oid 7 version 1098 is already newer than 1097 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2740: oid 7 version 1098 is already newer than 1096 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1098 (ObjNum 914 snap 301 seq_num 914) dirty exists 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2740: left oid 7 (ObjNum 914 snap 301 seq_num 914) 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: finishing write tid 1 to trial18717860-39 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: finishing write tid 2 to trial18717860-39 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: finishing write tid 3 to trial18717860-39 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: finishing write tid 4 to trial18717860-39 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: finishing write tid 5 to trial18717860-39 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: oid 39 updating version 0 to 1447 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: oid 39 version 1447 is already newer than 1446 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: oid 39 updating version 1447 to 1448 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: oid 39 updating version 1448 to 1449 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 1449 (ObjNum 915 snap 301 seq_num 915) dirty exists 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2742: left oid 39 (ObjNum 915 snap 301 seq_num 915) 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: finishing write tid 1 to trial18717860-37 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: finishing write tid 2 to trial18717860-37 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: finishing write tid 3 to trial18717860-37 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: finishing write tid 4 to trial18717860-37 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: finishing write tid 5 to trial18717860-37 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: oid 37 updating version 0 to 1830 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: oid 37 version 1830 is already newer than 1828 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: oid 37 version 1830 is already newer than 1827 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: oid 37 version 1830 is already newer than 1829 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1830 (ObjNum 916 snap 301 seq_num 916) dirty exists 2026-02-13T18:18:23.732 INFO:tasks.rados.rados.0.trial187.stdout:2743: left oid 37 (ObjNum 916 snap 301 seq_num 916) 2026-02-13T18:18:24.580 INFO:tasks.rados.rados.0.trial187.stdout:2739: done (4 left) 2026-02-13T18:18:24.580 INFO:tasks.rados.rados.0.trial187.stdout:2740: done (3 left) 2026-02-13T18:18:24.580 INFO:tasks.rados.rados.0.trial187.stdout:2742: done (2 left) 2026-02-13T18:18:24.580 INFO:tasks.rados.rados.0.trial187.stdout:2743: done (1 left) 2026-02-13T18:18:24.580 INFO:tasks.rados.rados.0.trial187.stdout:2744: done (0 left) 2026-02-13T18:18:24.580 INFO:tasks.rados.rados.0.trial187.stdout:2745: delete oid 28 current snap is 302 2026-02-13T18:18:24.583 INFO:tasks.rados.rados.0.trial187.stdout:2745: done (0 left) 2026-02-13T18:18:24.583 INFO:tasks.rados.rados.0.trial187.stdout:2746: delete oid 4 current snap is 302 2026-02-13T18:18:24.584 INFO:tasks.rados.rados.0.trial187.stdout:2746: done (0 left) 2026-02-13T18:18:24.584 INFO:tasks.rados.rados.0.trial187.stdout:2747: write oid 41 current snap is 302 2026-02-13T18:18:24.584 INFO:tasks.rados.rados.0.trial187.stdout:2747: seq_num 919 ranges {645633=716191,1927893=606315,3137495=308138} 2026-02-13T18:18:24.594 INFO:tasks.rados.rados.0.trial187.stdout:2747: writing trial18717860-41 from 645633 to 1361824 tid 1 2026-02-13T18:18:24.602 INFO:tasks.rados.rados.0.trial187.stdout:2747: writing trial18717860-41 from 1927893 to 2534208 tid 2 2026-02-13T18:18:24.608 INFO:tasks.rados.rados.0.trial187.stdout:2747: writing trial18717860-41 from 3137495 to 3445633 tid 3 2026-02-13T18:18:24.608 INFO:tasks.rados.rados.0.trial187.stdout:2748: snap_remove snap 301 2026-02-13T18:18:25.524 INFO:tasks.rados.rados.0.trial187.stdout:2748: done (1 left) 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2747: finishing write tid 1 to trial18717860-41 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2747: finishing write tid 2 to trial18717860-41 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2749: read oid 12 snap 296 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2749: expect (ObjNum 892 snap 295 seq_num 892) 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2750: delete oid 31 current snap is 302 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2747: finishing write tid 3 to trial18717860-41 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2747: finishing write tid 4 to trial18717860-41 2026-02-13T18:18:25.525 INFO:tasks.rados.rados.0.trial187.stdout:2747: finishing write tid 5 to trial18717860-41 2026-02-13T18:18:25.526 INFO:tasks.rados.rados.0.trial187.stdout:2747: oid 41 updating version 0 to 1035 2026-02-13T18:18:25.526 INFO:tasks.rados.rados.0.trial187.stdout:2747: oid 41 version 1035 is already newer than 1034 2026-02-13T18:18:25.526 INFO:tasks.rados.rados.0.trial187.stdout:2747: oid 41 updating version 1035 to 1036 2026-02-13T18:18:25.526 INFO:tasks.rados.rados.0.trial187.stdout:2747: oid 41 updating version 1036 to 1037 2026-02-13T18:18:25.526 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1037 (ObjNum 919 snap 302 seq_num 919) dirty exists 2026-02-13T18:18:25.526 INFO:tasks.rados.rados.0.trial187.stdout:2747: left oid 41 (ObjNum 919 snap 302 seq_num 919) 2026-02-13T18:18:25.531 INFO:tasks.rados.rados.0.trial187.stdout:2749: expect (ObjNum 892 snap 295 seq_num 892) 2026-02-13T18:18:25.532 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:25.616 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 849907 2026-02-13T18:18:25.727 INFO:tasks.rados.rados.0.trial187.stdout:2747: done (2 left) 2026-02-13T18:18:25.727 INFO:tasks.rados.rados.0.trial187.stdout:2749: done (1 left) 2026-02-13T18:18:25.727 INFO:tasks.rados.rados.0.trial187.stdout:2750: done (0 left) 2026-02-13T18:18:25.727 INFO:tasks.rados.rados.0.trial187.stdout:2751: delete oid 12 current snap is 302 2026-02-13T18:18:25.728 INFO:tasks.rados.rados.0.trial187.stdout:2751: done (0 left) 2026-02-13T18:18:25.728 INFO:tasks.rados.rados.0.trial187.stdout:2752: write oid 19 current snap is 302 2026-02-13T18:18:25.728 INFO:tasks.rados.rados.0.trial187.stdout:2752: seq_num 922 ranges {696054=658291,2103339=753642} 2026-02-13T18:18:25.737 INFO:tasks.rados.rados.0.trial187.stdout:2752: writing trial18717860-19 from 696054 to 1354345 tid 1 2026-02-13T18:18:25.748 INFO:tasks.rados.rados.0.trial187.stdout:2752: writing trial18717860-19 from 2103339 to 2856981 tid 2 2026-02-13T18:18:25.748 INFO:tasks.rados.rados.0.trial187.stdout:2753: snap_create 2026-02-13T18:18:25.748 INFO:tasks.rados.rados.0.trial187.stdout:2752: finishing write tid 1 to trial18717860-19 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: finishing write tid 2 to trial18717860-19 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: finishing write tid 3 to trial18717860-19 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: finishing write tid 4 to trial18717860-19 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: oid 19 updating version 0 to 1043 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: oid 19 updating version 1043 to 1044 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: oid 19 updating version 1044 to 1045 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1045 (ObjNum 922 snap 302 seq_num 922) dirty exists 2026-02-13T18:18:25.752 INFO:tasks.rados.rados.0.trial187.stdout:2752: left oid 19 (ObjNum 922 snap 302 seq_num 922) 2026-02-13T18:18:26.585 INFO:tasks.rados.rados.0.trial187.stdout:2752: done (1 left) 2026-02-13T18:18:26.585 INFO:tasks.rados.rados.0.trial187.stdout:2753: done (0 left) 2026-02-13T18:18:26.585 INFO:tasks.rados.rados.0.trial187.stdout:2754: read oid 5 snap -1 2026-02-13T18:18:26.585 INFO:tasks.rados.rados.0.trial187.stdout:2754: expect deleted 2026-02-13T18:18:26.585 INFO:tasks.rados.rados.0.trial187.stdout:2755: copy_from oid 24 from oid 38 current snap is 303 2026-02-13T18:18:26.586 INFO:tasks.rados.rados.0.trial187.stdout:2756: read oid 33 snap -1 2026-02-13T18:18:26.586 INFO:tasks.rados.rados.0.trial187.stdout:2756: expect deleted 2026-02-13T18:18:26.586 INFO:tasks.rados.rados.0.trial187.stdout:2757: delete oid 44 current snap is 303 2026-02-13T18:18:26.587 INFO:tasks.rados.rados.0.trial187.stdout:2754: done (3 left) 2026-02-13T18:18:26.587 INFO:tasks.rados.rados.0.trial187.stdout:2756: done (2 left) 2026-02-13T18:18:26.587 INFO:tasks.rados.rados.0.trial187.stdout:2757: done (1 left) 2026-02-13T18:18:26.587 INFO:tasks.rados.rados.0.trial187.stdout:2758: write (excl) oid 41 current snap is 303 2026-02-13T18:18:26.587 INFO:tasks.rados.rados.0.trial187.stdout:2758: seq_num 924 ranges {729668=408789,1820303=757311,3274610=255058} 2026-02-13T18:18:26.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: writing trial18717860-41 from 729668 to 1138457 tid 1 2026-02-13T18:18:26.604 INFO:tasks.rados.rados.0.trial187.stdout:2758: writing trial18717860-41 from 1820303 to 2577614 tid 2 2026-02-13T18:18:26.611 INFO:tasks.rados.rados.0.trial187.stdout:2758: writing trial18717860-41 from 3274610 to 3529668 tid 3 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2759: copy_from oid 17 from oid 18 current snap is 303 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2755: finishing copy_from racing read to trial18717860-24 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2755: finishing copy_from to trial18717860-24 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1607 (ObjNum 905 snap 301 seq_num 905) dirty exists 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2755: done (2 left) 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2760: copy_from oid 5 from oid 16 current snap is 303 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2758: finishing write tid 1 to trial18717860-41 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2758: finishing write tid 2 to trial18717860-41 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2761: write oid 2 current snap is 303 2026-02-13T18:18:26.612 INFO:tasks.rados.rados.0.trial187.stdout:2761: seq_num 925 ranges {746475=484038,1762432=617322,2785680=529906} 2026-02-13T18:18:26.619 INFO:tasks.rados.rados.0.trial187.stdout:2761: writing trial18717860-2 from 746475 to 1230513 tid 1 2026-02-13T18:18:26.627 INFO:tasks.rados.rados.0.trial187.stdout:2761: writing trial18717860-2 from 1762432 to 2379754 tid 2 2026-02-13T18:18:26.634 INFO:tasks.rados.rados.0.trial187.stdout:2761: writing trial18717860-2 from 2785680 to 3315586 tid 3 2026-02-13T18:18:26.634 INFO:tasks.rados.rados.0.trial187.stdout:2762: snap_remove snap 297 2026-02-13T18:18:27.588 INFO:tasks.rados.rados.0.trial187.stdout:2762: done (4 left) 2026-02-13T18:18:27.589 INFO:tasks.rados.rados.0.trial187.stdout:2763: snap_remove snap 300 2026-02-13T18:18:28.593 INFO:tasks.rados.rados.0.trial187.stdout:2763: done (4 left) 2026-02-13T18:18:28.593 INFO:tasks.rados.rados.0.trial187.stdout:2764: copy_from oid 29 from oid 4 current snap is 303 2026-02-13T18:18:28.593 INFO:tasks.rados.rados.0.trial187.stdout:2759: finishing copy_from to trial18717860-17 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2759: got expected ENOENT (src dne) 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2759: finishing copy_from racing read to trial18717860-17 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: finishing write tid 3 to trial18717860-41 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: finishing write tid 4 to trial18717860-41 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: finishing write tid 5 to trial18717860-41 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: oid 41 updating version 0 to 1041 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: oid 41 version 1041 is already newer than 1039 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: oid 41 version 1041 is already newer than 1040 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: oid 41 version 1041 is already newer than 1038 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1041 (ObjNum 924 snap 303 seq_num 924) dirty exists 2026-02-13T18:18:28.594 INFO:tasks.rados.rados.0.trial187.stdout:2758: left oid 41 (ObjNum 924 snap 303 seq_num 924) 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2760: finishing copy_from racing read to trial18717860-5 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2760: finishing copy_from to trial18717860-5 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1415 (ObjNum 909 snap 301 seq_num 909) dirty exists 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: finishing write tid 1 to trial18717860-2 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: finishing write tid 2 to trial18717860-2 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: finishing write tid 3 to trial18717860-2 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: finishing write tid 4 to trial18717860-2 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: finishing write tid 5 to trial18717860-2 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: oid 2 updating version 0 to 1190 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: oid 2 updating version 1190 to 1193 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: oid 2 version 1193 is already newer than 1191 2026-02-13T18:18:28.595 INFO:tasks.rados.rados.0.trial187.stdout:2761: oid 2 version 1193 is already newer than 1192 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1193 (ObjNum 925 snap 303 seq_num 925) dirty exists 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2761: left oid 2 (ObjNum 925 snap 303 seq_num 925) 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2758: done (4 left) 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2759: done (3 left) 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2760: done (2 left) 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2761: done (1 left) 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2765: copy_from oid 28 from oid 42 current snap is 303 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2766: rollback oid 6 current snap is 303 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 282 2026-02-13T18:18:28.596 INFO:tasks.rados.rados.0.trial187.stdout:2767: snap_remove snap 291 2026-02-13T18:18:29.595 INFO:tasks.rados.rados.0.trial187.stdout:2767: done (3 left) 2026-02-13T18:18:29.595 INFO:tasks.rados.rados.0.trial187.stdout:2768: write oid 13 current snap is 303 2026-02-13T18:18:29.595 INFO:tasks.rados.rados.0.trial187.stdout:2768: seq_num 926 ranges {763282=559287,1820914=760980,3213103=350179} 2026-02-13T18:18:29.603 INFO:tasks.rados.rados.0.trial187.stdout:2768: writing trial18717860-13 from 763282 to 1322569 tid 1 2026-02-13T18:18:29.612 INFO:tasks.rados.rados.0.trial187.stdout:2768: writing trial18717860-13 from 1820914 to 2581894 tid 2 2026-02-13T18:18:29.619 INFO:tasks.rados.rados.0.trial187.stdout:2768: writing trial18717860-13 from 3213103 to 3563282 tid 3 2026-02-13T18:18:29.619 INFO:tasks.rados.rados.0.trial187.stdout:2769: rollback oid 40 current snap is 303 2026-02-13T18:18:29.619 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 296 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2764: finishing copy_from to trial18717860-29 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2764: got expected ENOENT (src dne) 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2764: finishing copy_from racing read to trial18717860-29 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2766: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2765: finishing copy_from racing read to trial18717860-28 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2766: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2766: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1610 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2765: finishing copy_from to trial18717860-28 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1033 (ObjNum 898 snap 299 seq_num 898) dirty exists 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2768: finishing write tid 1 to trial18717860-13 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2768: finishing write tid 2 to trial18717860-13 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2764: done (4 left) 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2765: done (3 left) 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2766: done (2 left) 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2770: read oid 42 snap -1 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2770: expect (ObjNum 898 snap 299 seq_num 898) 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2771: delete oid 31 current snap is 303 2026-02-13T18:18:29.620 INFO:tasks.rados.rados.0.trial187.stdout:2771: done (3 left) 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2772: snap_create 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2769: finishing rollback tid 0 to trial18717860-40 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: finishing write tid 3 to trial18717860-13 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: finishing write tid 4 to trial18717860-13 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2769: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1422 (ObjNum 33 snap 0 seq_num 3013801584) dirty dne 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: finishing write tid 5 to trial18717860-13 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: oid 13 updating version 0 to 1195 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: oid 13 updating version 1195 to 1196 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: oid 13 updating version 1196 to 1197 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: oid 13 version 1197 is already newer than 1194 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1197 (ObjNum 926 snap 303 seq_num 926) dirty exists 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2768: left oid 13 (ObjNum 926 snap 303 seq_num 926) 2026-02-13T18:18:29.621 INFO:tasks.rados.rados.0.trial187.stdout:2770: expect (ObjNum 898 snap 299 seq_num 898) 2026-02-13T18:18:29.671 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2483304 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2768: done (3 left) 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2769: done (2 left) 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2770: done (1 left) 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2772: done (0 left) 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2773: read oid 44 snap -1 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2773: expect deleted 2026-02-13T18:18:30.525 INFO:tasks.rados.rados.0.trial187.stdout:2774: delete oid 21 current snap is 304 2026-02-13T18:18:30.529 INFO:tasks.rados.rados.0.trial187.stdout:2773: done (1 left) 2026-02-13T18:18:30.529 INFO:tasks.rados.rados.0.trial187.stdout:2774: done (0 left) 2026-02-13T18:18:30.529 INFO:tasks.rados.rados.0.trial187.stdout:2775: snap_remove snap 283 2026-02-13T18:18:31.526 INFO:tasks.rados.rados.0.trial187.stdout:2775: done (0 left) 2026-02-13T18:18:31.526 INFO:tasks.rados.rados.0.trial187.stdout:2776: write oid 4 current snap is 304 2026-02-13T18:18:31.526 INFO:tasks.rados.rados.0.trial187.stdout:2776: seq_num 929 ranges {413703=501387,1596360=624660,2895372=691347} 2026-02-13T18:18:31.532 INFO:tasks.rados.rados.0.trial187.stdout:2776: writing trial18717860-4 from 413703 to 915090 tid 1 2026-02-13T18:18:31.541 INFO:tasks.rados.rados.0.trial187.stdout:2776: writing trial18717860-4 from 1596360 to 2221020 tid 2 2026-02-13T18:18:31.550 INFO:tasks.rados.rados.0.trial187.stdout:2776: writing trial18717860-4 from 2895372 to 3586719 tid 3 2026-02-13T18:18:31.550 INFO:tasks.rados.rados.0.trial187.stdout:2777: snap_remove snap 289 2026-02-13T18:18:32.529 INFO:tasks.rados.rados.0.trial187.stdout:2777: done (1 left) 2026-02-13T18:18:32.529 INFO:tasks.rados.rados.0.trial187.stdout:2778: write oid 23 current snap is 304 2026-02-13T18:18:32.529 INFO:tasks.rados.rados.0.trial187.stdout:2778: seq_num 930 ranges {430510=576636,1654842=768318,2922795=502619} 2026-02-13T18:18:32.536 INFO:tasks.rados.rados.0.trial187.stdout:2778: writing trial18717860-23 from 430510 to 1007146 tid 1 2026-02-13T18:18:32.545 INFO:tasks.rados.rados.0.trial187.stdout:2778: writing trial18717860-23 from 1654842 to 2423160 tid 2 2026-02-13T18:18:32.552 INFO:tasks.rados.rados.0.trial187.stdout:2778: writing trial18717860-23 from 2922795 to 3425414 tid 3 2026-02-13T18:18:32.552 INFO:tasks.rados.rados.0.trial187.stdout:2779: write (excl) oid 21 current snap is 304 2026-02-13T18:18:32.552 INFO:tasks.rados.rados.0.trial187.stdout:2779: seq_num 931 ranges {447317=651885,1713324=628329,3066571=580746} 2026-02-13T18:18:32.559 INFO:tasks.rados.rados.0.trial187.stdout:2779: writing trial18717860-21 from 447317 to 1099202 tid 1 2026-02-13T18:18:32.568 INFO:tasks.rados.rados.0.trial187.stdout:2779: writing trial18717860-21 from 1713324 to 2341653 tid 2 2026-02-13T18:18:32.575 INFO:tasks.rados.rados.0.trial187.stdout:2779: writing trial18717860-21 from 3066571 to 3647317 tid 3 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2780: read oid 42 snap -1 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2780: expect (ObjNum 898 snap 299 seq_num 898) 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2781: read oid 34 snap -1 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2781: expect deleted 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2782: read oid 43 snap -1 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2782: expect (ObjNum 899 snap 299 seq_num 899) 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2783: write (excl) oid 3 current snap is 304 2026-02-13T18:18:32.576 INFO:tasks.rados.rados.0.trial187.stdout:2783: seq_num 932 ranges {464124=727134,1771806=771987,2977641=641516} 2026-02-13T18:18:32.580 INFO:tasks.rados.rados.0.trial187.stdout:2783: writing trial18717860-3 from 464124 to 1191258 tid 1 2026-02-13T18:18:32.585 INFO:tasks.rados.rados.0.trial187.stdout:2783: writing trial18717860-3 from 1771806 to 2543793 tid 2 2026-02-13T18:18:32.589 INFO:tasks.rados.rados.0.trial187.stdout:2783: writing trial18717860-3 from 2977641 to 3619157 tid 3 2026-02-13T18:18:32.589 INFO:tasks.rados.rados.0.trial187.stdout:2784: rollback oid 30 current snap is 304 2026-02-13T18:18:32.589 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 303 2026-02-13T18:18:32.590 INFO:tasks.rados.rados.0.trial187.stdout:2776: finishing write tid 1 to trial18717860-4 2026-02-13T18:18:32.590 INFO:tasks.rados.rados.0.trial187.stdout:2785: write (excl) oid 17 current snap is 304 2026-02-13T18:18:32.590 INFO:tasks.rados.rados.0.trial187.stdout:2776: finishing write tid 2 to trial18717860-4 2026-02-13T18:18:32.590 INFO:tasks.rados.rados.0.trial187.stdout:2776: finishing write tid 3 to trial18717860-4 2026-02-13T18:18:32.590 INFO:tasks.rados.rados.0.trial187.stdout:2785: seq_num 933 ranges {480931=402383,1313935=515645,2488711=452788,3443230=237701} 2026-02-13T18:18:32.593 INFO:tasks.rados.rados.0.trial187.stdout:2785: writing trial18717860-17 from 480931 to 883314 tid 1 2026-02-13T18:18:32.596 INFO:tasks.rados.rados.0.trial187.stdout:2785: writing trial18717860-17 from 1313935 to 1829580 tid 2 2026-02-13T18:18:32.600 INFO:tasks.rados.rados.0.trial187.stdout:2785: writing trial18717860-17 from 2488711 to 2941499 tid 3 2026-02-13T18:18:32.603 INFO:tasks.rados.rados.0.trial187.stdout:2785: writing trial18717860-17 from 3443230 to 3680931 tid 4 2026-02-13T18:18:32.603 INFO:tasks.rados.rados.0.trial187.stdout:2786: write oid 35 current snap is 304 2026-02-13T18:18:32.603 INFO:tasks.rados.rados.0.trial187.stdout:2786: seq_num 934 ranges {497738=477632,1772417=775656,3316134=381604} 2026-02-13T18:18:32.607 INFO:tasks.rados.rados.0.trial187.stdout:2786: writing trial18717860-35 from 497738 to 975370 tid 1 2026-02-13T18:18:32.613 INFO:tasks.rados.rados.0.trial187.stdout:2786: writing trial18717860-35 from 1772417 to 2548073 tid 2 2026-02-13T18:18:32.617 INFO:tasks.rados.rados.0.trial187.stdout:2786: writing trial18717860-35 from 3316134 to 3697738 tid 3 2026-02-13T18:18:32.618 INFO:tasks.rados.rados.0.trial187.stdout:2787: snap_remove snap 302 2026-02-13T18:18:33.600 INFO:tasks.rados.rados.0.trial187.stdout:2787: done (10 left) 2026-02-13T18:18:33.600 INFO:tasks.rados.rados.0.trial187.stdout:2788: write (excl) oid 29 current snap is 304 2026-02-13T18:18:33.600 INFO:tasks.rados.rados.0.trial187.stdout:2788: seq_num 935 ranges {514545=552881,1830899=519314,2943557=475332} 2026-02-13T18:18:33.604 INFO:tasks.rados.rados.0.trial187.stdout:2788: writing trial18717860-29 from 514545 to 1067426 tid 1 2026-02-13T18:18:33.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: writing trial18717860-29 from 1830899 to 2350213 tid 2 2026-02-13T18:18:33.613 INFO:tasks.rados.rados.0.trial187.stdout:2788: writing trial18717860-29 from 2943557 to 3418889 tid 3 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2789: read oid 13 snap -1 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2789: expect (ObjNum 926 snap 303 seq_num 926) 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2776: finishing write tid 4 to trial18717860-4 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2776: finishing write tid 5 to trial18717860-4 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2776: oid 4 updating version 0 to 1030 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2776: oid 4 updating version 1030 to 1032 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2776: oid 4 version 1032 is already newer than 1031 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:2776: oid 4 version 1032 is already newer than 1029 2026-02-13T18:18:33.615 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1032 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:18:33.616 INFO:tasks.rados.rados.0.trial187.stdout:2776: left oid 4 (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:18:33.616 INFO:tasks.rados.rados.0.trial187.stdout:2778: finishing write tid 1 to trial18717860-23 2026-02-13T18:18:33.616 INFO:tasks.rados.rados.0.trial187.stdout:2776: done (11 left) 2026-02-13T18:18:33.616 INFO:tasks.rados.rados.0.trial187.stdout:2790: write (excl) oid 41 current snap is 304 2026-02-13T18:18:33.616 INFO:tasks.rados.rados.0.trial187.stdout:2790: seq_num 936 ranges {531352=744483,2005734=779325,3487333=244019} 2026-02-13T18:18:33.619 INFO:tasks.rados.rados.0.trial187.stdout:2790: writing trial18717860-41 from 531352 to 1275835 tid 1 2026-02-13T18:18:33.624 INFO:tasks.rados.rados.0.trial187.stdout:2790: writing trial18717860-41 from 2005734 to 2785059 tid 2 2026-02-13T18:18:33.628 INFO:tasks.rados.rados.0.trial187.stdout:2790: writing trial18717860-41 from 3487333 to 3731352 tid 3 2026-02-13T18:18:33.628 INFO:tasks.rados.rados.0.trial187.stdout:2791: delete oid 46 current snap is 304 2026-02-13T18:18:33.628 INFO:tasks.rados.rados.0.trial187.stdout:2778: finishing write tid 2 to trial18717860-23 2026-02-13T18:18:33.628 INFO:tasks.rados.rados.0.trial187.stdout:2778: finishing write tid 3 to trial18717860-23 2026-02-13T18:18:33.628 INFO:tasks.rados.rados.0.trial187.stdout:2778: finishing write tid 4 to trial18717860-23 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2778: finishing write tid 5 to trial18717860-23 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2778: oid 23 updating version 0 to 1063 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2778: oid 23 updating version 1063 to 1065 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2778: oid 23 version 1065 is already newer than 1064 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2778: oid 23 updating version 1065 to 1066 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1066 (ObjNum 930 snap 304 seq_num 930) dirty exists 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2778: left oid 23 (ObjNum 930 snap 304 seq_num 930) 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2779: finishing write tid 1 to trial18717860-21 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2779: finishing write tid 2 to trial18717860-21 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2779: finishing write tid 3 to trial18717860-21 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2779: finishing write tid 4 to trial18717860-21 2026-02-13T18:18:33.629 INFO:tasks.rados.rados.0.trial187.stdout:2779: finishing write tid 5 to trial18717860-21 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:2779: oid 21 updating version 0 to 1122 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:2779: oid 21 updating version 1122 to 1124 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:2779: oid 21 version 1124 is already newer than 1121 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:2779: oid 21 version 1124 is already newer than 1123 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1124 (ObjNum 931 snap 304 seq_num 931) dirty exists 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:2779: left oid 21 (ObjNum 931 snap 304 seq_num 931) 2026-02-13T18:18:33.630 INFO:tasks.rados.rados.0.trial187.stdout:2780: expect (ObjNum 898 snap 299 seq_num 898) 2026-02-13T18:18:33.691 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:33.744 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:33.796 INFO:tasks.rados.rados.0.trial187.stdout:2783: finishing write tid 1 to trial18717860-3 2026-02-13T18:18:33.796 INFO:tasks.rados.rados.0.trial187.stdout:2782: expect (ObjNum 899 snap 299 seq_num 899) 2026-02-13T18:18:33.796 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:33.914 INFO:tasks.rados.rados.0.trial187.stdout:2783: finishing write tid 2 to trial18717860-3 2026-02-13T18:18:33.914 INFO:tasks.rados.rados.0.trial187.stdout:2784: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:18:33.914 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1042 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2783: finishing write tid 3 to trial18717860-3 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2783: finishing write tid 4 to trial18717860-3 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2778: done (12 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2779: done (11 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2780: done (10 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2781: done (9 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2782: done (8 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2784: done (7 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2791: done (6 left) 2026-02-13T18:18:33.915 INFO:tasks.rados.rados.0.trial187.stdout:2792: snap_remove snap 296 2026-02-13T18:18:34.605 INFO:tasks.rados.rados.0.trial187.stdout:2792: done (6 left) 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2793: snap_create 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2783: finishing write tid 5 to trial18717860-3 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2783: oid 3 updating version 0 to 1484 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2783: oid 3 version 1484 is already newer than 1483 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2783: oid 3 version 1484 is already newer than 1482 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2783: oid 3 updating version 1484 to 1485 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1485 (ObjNum 932 snap 304 seq_num 932) dirty exists 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2783: left oid 3 (ObjNum 932 snap 304 seq_num 932) 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2785: finishing write tid 1 to trial18717860-17 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2785: finishing write tid 2 to trial18717860-17 2026-02-13T18:18:34.606 INFO:tasks.rados.rados.0.trial187.stdout:2785: finishing write tid 3 to trial18717860-17 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: finishing write tid 4 to trial18717860-17 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: finishing write tid 5 to trial18717860-17 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: finishing write tid 6 to trial18717860-17 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: oid 17 updating version 0 to 1491 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: oid 17 version 1491 is already newer than 1489 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: oid 17 version 1491 is already newer than 1487 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: oid 17 version 1491 is already newer than 1488 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: oid 17 version 1491 is already newer than 1490 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1491 (ObjNum 933 snap 304 seq_num 933) dirty exists 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2785: left oid 17 (ObjNum 933 snap 304 seq_num 933) 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2786: finishing write tid 1 to trial18717860-35 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2786: finishing write tid 2 to trial18717860-35 2026-02-13T18:18:34.607 INFO:tasks.rados.rados.0.trial187.stdout:2786: finishing write tid 3 to trial18717860-35 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: finishing write tid 4 to trial18717860-35 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: finishing write tid 5 to trial18717860-35 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: oid 35 updating version 0 to 1609 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: oid 35 updating version 1609 to 1610 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: oid 35 version 1610 is already newer than 1608 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: oid 35 updating version 1610 to 1611 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1611 (ObjNum 934 snap 304 seq_num 934) dirty exists 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2786: left oid 35 (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2788: finishing write tid 1 to trial18717860-29 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2788: finishing write tid 2 to trial18717860-29 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2788: finishing write tid 3 to trial18717860-29 2026-02-13T18:18:34.608 INFO:tasks.rados.rados.0.trial187.stdout:2788: finishing write tid 4 to trial18717860-29 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: finishing write tid 5 to trial18717860-29 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: oid 29 updating version 0 to 1067 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: oid 29 version 1067 is already newer than 1066 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: oid 29 version 1067 is already newer than 1065 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: oid 29 version 1067 is already newer than 1064 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1067 (ObjNum 935 snap 304 seq_num 935) dirty exists 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2788: left oid 29 (ObjNum 935 snap 304 seq_num 935) 2026-02-13T18:18:34.609 INFO:tasks.rados.rados.0.trial187.stdout:2789: expect (ObjNum 926 snap 303 seq_num 926) 2026-02-13T18:18:34.658 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:34.686 INFO:tasks.rados.rados.0.trial187.stdout:2790: finishing write tid 1 to trial18717860-41 2026-02-13T18:18:34.686 INFO:tasks.rados.rados.0.trial187.stdout:2790: finishing write tid 2 to trial18717860-41 2026-02-13T18:18:34.686 INFO:tasks.rados.rados.0.trial187.stdout:2790: finishing write tid 3 to trial18717860-41 2026-02-13T18:18:34.686 INFO:tasks.rados.rados.0.trial187.stdout:2790: finishing write tid 4 to trial18717860-41 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:2790: finishing write tid 5 to trial18717860-41 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:2790: oid 41 updating version 0 to 1043 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:2790: oid 41 version 1043 is already newer than 1042 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:2790: oid 41 updating version 1043 to 1044 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:2790: oid 41 updating version 1044 to 1045 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1045 (ObjNum 936 snap 304 seq_num 936) dirty exists 2026-02-13T18:18:34.687 INFO:tasks.rados.rados.0.trial187.stdout:2790: left oid 41 (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:35.526 INFO:tasks.rados.rados.0.trial187.stdout:2783: done (6 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2785: done (5 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2786: done (4 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2788: done (3 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2789: done (2 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2790: done (1 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2793: done (0 left) 2026-02-13T18:18:35.527 INFO:tasks.rados.rados.0.trial187.stdout:2794: snap_create 2026-02-13T18:18:36.527 INFO:tasks.rados.rados.0.trial187.stdout:2794: done (0 left) 2026-02-13T18:18:36.527 INFO:tasks.rados.rados.0.trial187.stdout:2795: write (excl) oid 10 current snap is 306 2026-02-13T18:18:36.527 INFO:tasks.rados.rados.0.trial187.stdout:2795: seq_num 938 ranges {564966=494981,1606345=782994,3025826=425501} 2026-02-13T18:18:36.534 INFO:tasks.rados.rados.0.trial187.stdout:2795: writing trial18717860-10 from 564966 to 1059947 tid 1 2026-02-13T18:18:36.543 INFO:tasks.rados.rados.0.trial187.stdout:2795: writing trial18717860-10 from 1606345 to 2389339 tid 2 2026-02-13T18:18:36.550 INFO:tasks.rados.rados.0.trial187.stdout:2795: writing trial18717860-10 from 3025826 to 3451327 tid 3 2026-02-13T18:18:36.551 INFO:tasks.rados.rados.0.trial187.stdout:2796: read oid 12 snap -1 2026-02-13T18:18:36.551 INFO:tasks.rados.rados.0.trial187.stdout:2796: expect deleted 2026-02-13T18:18:36.551 INFO:tasks.rados.rados.0.trial187.stdout:2797: write (excl) oid 33 current snap is 306 2026-02-13T18:18:36.551 INFO:tasks.rados.rados.0.trial187.stdout:2797: seq_num 939 ranges {581773=570230,1664827=526652,2653249=636773} 2026-02-13T18:18:36.558 INFO:tasks.rados.rados.0.trial187.stdout:2797: writing trial18717860-33 from 581773 to 1152003 tid 1 2026-02-13T18:18:36.565 INFO:tasks.rados.rados.0.trial187.stdout:2797: writing trial18717860-33 from 1664827 to 2191479 tid 2 2026-02-13T18:18:36.573 INFO:tasks.rados.rados.0.trial187.stdout:2797: writing trial18717860-33 from 2653249 to 3290022 tid 3 2026-02-13T18:18:36.573 INFO:tasks.rados.rados.0.trial187.stdout:2798: delete oid 16 current snap is 306 2026-02-13T18:18:36.573 INFO:tasks.rados.rados.0.trial187.stdout:2795: finishing write tid 1 to trial18717860-10 2026-02-13T18:18:36.573 INFO:tasks.rados.rados.0.trial187.stdout:2795: finishing write tid 2 to trial18717860-10 2026-02-13T18:18:36.573 INFO:tasks.rados.rados.0.trial187.stdout:2795: finishing write tid 3 to trial18717860-10 2026-02-13T18:18:36.573 INFO:tasks.rados.rados.0.trial187.stdout:2795: finishing write tid 4 to trial18717860-10 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2795: finishing write tid 5 to trial18717860-10 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2795: oid 10 updating version 0 to 1034 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2795: oid 10 version 1034 is already newer than 1033 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2795: oid 10 updating version 1034 to 1035 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2795: oid 10 version 1035 is already newer than 1032 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1035 (ObjNum 938 snap 306 seq_num 938) dirty exists 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2795: left oid 10 (ObjNum 938 snap 306 seq_num 938) 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2797: finishing write tid 1 to trial18717860-33 2026-02-13T18:18:36.574 INFO:tasks.rados.rados.0.trial187.stdout:2797: finishing write tid 2 to trial18717860-33 2026-02-13T18:18:36.575 INFO:tasks.rados.rados.0.trial187.stdout:2795: done (3 left) 2026-02-13T18:18:36.575 INFO:tasks.rados.rados.0.trial187.stdout:2796: done (2 left) 2026-02-13T18:18:36.575 INFO:tasks.rados.rados.0.trial187.stdout:2798: done (1 left) 2026-02-13T18:18:36.575 INFO:tasks.rados.rados.0.trial187.stdout:2799: copy_from oid 16 from oid 24 current snap is 306 2026-02-13T18:18:36.575 INFO:tasks.rados.rados.0.trial187.stdout:2800: snap_remove snap 305 2026-02-13T18:18:37.534 INFO:tasks.rados.rados.0.trial187.stdout:2800: done (2 left) 2026-02-13T18:18:37.534 INFO:tasks.rados.rados.0.trial187.stdout:2801: write oid 43 current snap is 306 2026-02-13T18:18:37.535 INFO:tasks.rados.rados.0.trial187.stdout:2801: seq_num 941 ranges {615387=720728,1781791=530321,3108095=707292} 2026-02-13T18:18:37.543 INFO:tasks.rados.rados.0.trial187.stdout:2801: writing trial18717860-43 from 615387 to 1336115 tid 1 2026-02-13T18:18:37.550 INFO:tasks.rados.rados.0.trial187.stdout:2801: writing trial18717860-43 from 1781791 to 2312112 tid 2 2026-02-13T18:18:37.560 INFO:tasks.rados.rados.0.trial187.stdout:2801: writing trial18717860-43 from 3108095 to 3815387 tid 3 2026-02-13T18:18:37.560 INFO:tasks.rados.rados.0.trial187.stdout:2802: read oid 13 snap 282 2026-02-13T18:18:37.561 INFO:tasks.rados.rados.0.trial187.stdout:2802: expect deleted 2026-02-13T18:18:37.561 INFO:tasks.rados.rados.0.trial187.stdout:2803: snap_remove snap 304 2026-02-13T18:18:38.537 INFO:tasks.rados.rados.0.trial187.stdout:2803: done (4 left) 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2804: rollback oid 49 current snap is 306 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 303 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: finishing write tid 3 to trial18717860-33 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: finishing write tid 4 to trial18717860-33 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: finishing write tid 5 to trial18717860-33 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: oid 33 updating version 0 to 1872 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: oid 33 updating version 1872 to 1873 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: oid 33 version 1873 is already newer than 1871 2026-02-13T18:18:38.538 INFO:tasks.rados.rados.0.trial187.stdout:2797: oid 33 version 1873 is already newer than 1870 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1873 (ObjNum 939 snap 306 seq_num 939) dirty exists 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:2797: left oid 33 (ObjNum 939 snap 306 seq_num 939) 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:2797: done (4 left) 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:2805: delete oid 45 current snap is 306 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:2799: finishing copy_from racing read to trial18717860-16 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:2799: finishing copy_from to trial18717860-16 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1607 (ObjNum 905 snap 301 seq_num 905) dirty exists 2026-02-13T18:18:38.539 INFO:tasks.rados.rados.0.trial187.stdout:2801: finishing write tid 1 to trial18717860-43 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: finishing write tid 2 to trial18717860-43 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: finishing write tid 3 to trial18717860-43 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: finishing write tid 4 to trial18717860-43 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: finishing write tid 5 to trial18717860-43 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: oid 43 updating version 0 to 1877 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: oid 43 updating version 1877 to 1878 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: oid 43 version 1878 is already newer than 1875 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: oid 43 version 1878 is already newer than 1876 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1878 (ObjNum 941 snap 306 seq_num 941) dirty exists 2026-02-13T18:18:38.540 INFO:tasks.rados.rados.0.trial187.stdout:2801: left oid 43 (ObjNum 941 snap 306 seq_num 941) 2026-02-13T18:18:38.541 INFO:tasks.rados.rados.0.trial187.stdout:2799: done (4 left) 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2801: done (3 left) 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2802: done (2 left) 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2805: done (1 left) 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2806: snap_create 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2804: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2804: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:2804: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:18:38.542 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1422 (ObjNum 796 snap 269 seq_num 796) dirty exists 2026-02-13T18:18:39.539 INFO:tasks.rados.rados.0.trial187.stdout:2804: done (1 left) 2026-02-13T18:18:39.540 INFO:tasks.rados.rados.0.trial187.stdout:2806: done (0 left) 2026-02-13T18:18:39.540 INFO:tasks.rados.rados.0.trial187.stdout:2807: read oid 7 snap -1 2026-02-13T18:18:39.540 INFO:tasks.rados.rados.0.trial187.stdout:2807: expect (ObjNum 914 snap 301 seq_num 914) 2026-02-13T18:18:39.540 INFO:tasks.rados.rados.0.trial187.stdout:2808: write (excl) oid 29 current snap is 307 2026-02-13T18:18:39.540 INFO:tasks.rados.rados.0.trial187.stdout:2808: seq_num 943 ranges {649001=587579,1898755=533990,3162941=686060} 2026-02-13T18:18:39.547 INFO:tasks.rados.rados.0.trial187.stdout:2808: writing trial18717860-29 from 649001 to 1236580 tid 1 2026-02-13T18:18:39.555 INFO:tasks.rados.rados.0.trial187.stdout:2808: writing trial18717860-29 from 1898755 to 2432745 tid 2 2026-02-13T18:18:39.565 INFO:tasks.rados.rados.0.trial187.stdout:2808: writing trial18717860-29 from 3162941 to 3849001 tid 3 2026-02-13T18:18:39.565 INFO:tasks.rados.rados.0.trial187.stdout:2809: write oid 45 current snap is 307 2026-02-13T18:18:39.565 INFO:tasks.rados.rados.0.trial187.stdout:2809: seq_num 944 ranges {665808=662828,1957237=677648,3074011=609486} 2026-02-13T18:18:39.574 INFO:tasks.rados.rados.0.trial187.stdout:2809: writing trial18717860-45 from 665808 to 1328636 tid 1 2026-02-13T18:18:39.583 INFO:tasks.rados.rados.0.trial187.stdout:2809: writing trial18717860-45 from 1957237 to 2634885 tid 2 2026-02-13T18:18:39.588 INFO:tasks.rados.rados.0.trial187.stdout:2809: writing trial18717860-45 from 3074011 to 3683497 tid 3 2026-02-13T18:18:39.588 INFO:tasks.rados.rados.0.trial187.stdout:2810: write oid 22 current snap is 307 2026-02-13T18:18:39.589 INFO:tasks.rados.rados.0.trial187.stdout:2810: seq_num 945 ranges {682615=738077,2015719=537659,3217787=420758} 2026-02-13T18:18:39.594 INFO:tasks.rados.rados.0.trial187.stdout:2810: writing trial18717860-22 from 682615 to 1420692 tid 1 2026-02-13T18:18:39.599 INFO:tasks.rados.rados.0.trial187.stdout:2810: writing trial18717860-22 from 2015719 to 2553378 tid 2 2026-02-13T18:18:39.603 INFO:tasks.rados.rados.0.trial187.stdout:2810: writing trial18717860-22 from 3217787 to 3638545 tid 3 2026-02-13T18:18:39.603 INFO:tasks.rados.rados.0.trial187.stdout:2811: write (excl) oid 10 current snap is 307 2026-02-13T18:18:39.603 INFO:tasks.rados.rados.0.trial187.stdout:2811: seq_num 946 ranges {699422=413326,1557848=681317,3012504=748383} 2026-02-13T18:18:39.607 INFO:tasks.rados.rados.0.trial187.stdout:2811: writing trial18717860-10 from 699422 to 1112748 tid 1 2026-02-13T18:18:39.611 INFO:tasks.rados.rados.0.trial187.stdout:2811: writing trial18717860-10 from 1557848 to 2239165 tid 2 2026-02-13T18:18:39.617 INFO:tasks.rados.rados.0.trial187.stdout:2811: writing trial18717860-10 from 3012504 to 3760887 tid 3 2026-02-13T18:18:39.618 INFO:tasks.rados.rados.0.trial187.stdout:2812: snap_create 2026-02-13T18:18:39.618 INFO:tasks.rados.rados.0.trial187.stdout:2807: expect (ObjNum 914 snap 301 seq_num 914) 2026-02-13T18:18:39.663 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:39.716 INFO:tasks.rados.rados.0.trial187.stdout:2808: finishing write tid 1 to trial18717860-29 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: finishing write tid 2 to trial18717860-29 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: finishing write tid 3 to trial18717860-29 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: finishing write tid 4 to trial18717860-29 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: finishing write tid 5 to trial18717860-29 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: oid 29 updating version 0 to 1075 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: oid 29 version 1075 is already newer than 1073 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: oid 29 updating version 1075 to 1076 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: oid 29 version 1076 is already newer than 1074 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1076 (ObjNum 943 snap 307 seq_num 943) dirty exists 2026-02-13T18:18:39.717 INFO:tasks.rados.rados.0.trial187.stdout:2808: left oid 29 (ObjNum 943 snap 307 seq_num 943) 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: finishing write tid 1 to trial18717860-45 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: finishing write tid 2 to trial18717860-45 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: finishing write tid 3 to trial18717860-45 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: finishing write tid 4 to trial18717860-45 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: finishing write tid 5 to trial18717860-45 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: oid 45 updating version 0 to 1426 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: oid 45 updating version 1426 to 1427 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: oid 45 version 1427 is already newer than 1424 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: oid 45 version 1427 is already newer than 1425 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1427 (ObjNum 944 snap 307 seq_num 944) dirty exists 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2809: left oid 45 (ObjNum 944 snap 307 seq_num 944) 2026-02-13T18:18:39.718 INFO:tasks.rados.rados.0.trial187.stdout:2810: finishing write tid 1 to trial18717860-22 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: finishing write tid 2 to trial18717860-22 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: finishing write tid 3 to trial18717860-22 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: finishing write tid 4 to trial18717860-22 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: finishing write tid 5 to trial18717860-22 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: oid 22 updating version 0 to 1883 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: oid 22 updating version 1883 to 1884 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: oid 22 updating version 1884 to 1885 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: oid 22 version 1885 is already newer than 1882 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1885 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2810: left oid 22 (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2811: finishing write tid 1 to trial18717860-10 2026-02-13T18:18:39.719 INFO:tasks.rados.rados.0.trial187.stdout:2811: finishing write tid 2 to trial18717860-10 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: finishing write tid 3 to trial18717860-10 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: finishing write tid 4 to trial18717860-10 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: finishing write tid 5 to trial18717860-10 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: oid 10 updating version 0 to 1038 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: oid 10 version 1038 is already newer than 1037 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: oid 10 version 1038 is already newer than 1036 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: oid 10 updating version 1038 to 1039 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1039 (ObjNum 946 snap 307 seq_num 946) dirty exists 2026-02-13T18:18:39.720 INFO:tasks.rados.rados.0.trial187.stdout:2811: left oid 10 (ObjNum 946 snap 307 seq_num 946) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2807: done (5 left) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2808: done (4 left) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2809: done (3 left) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2810: done (2 left) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2811: done (1 left) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2812: done (0 left) 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:2813: rollback oid 32 current snap is 308 2026-02-13T18:18:40.527 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 282 2026-02-13T18:18:40.528 INFO:tasks.rados.rados.0.trial187.stdout:2814: snap_create 2026-02-13T18:18:40.531 INFO:tasks.rados.rados.0.trial187.stdout:2813: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:18:40.531 INFO:tasks.rados.rados.0.trial187.stdout:2813: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:18:40.531 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1044 (ObjNum 755 snap 263 seq_num 755) dirty exists 2026-02-13T18:18:41.527 INFO:tasks.rados.rados.0.trial187.stdout:2813: done (1 left) 2026-02-13T18:18:41.528 INFO:tasks.rados.rados.0.trial187.stdout:2814: done (0 left) 2026-02-13T18:18:41.528 INFO:tasks.rados.rados.0.trial187.stdout:2815: read oid 22 snap 306 2026-02-13T18:18:41.528 INFO:tasks.rados.rados.0.trial187.stdout:2815: expect (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:18:41.528 INFO:tasks.rados.rados.0.trial187.stdout:2816: copy_from oid 2 from oid 20 current snap is 309 2026-02-13T18:18:41.528 INFO:tasks.rados.rados.0.trial187.stdout:2817: write (excl) oid 17 current snap is 309 2026-02-13T18:18:41.528 INFO:tasks.rados.rados.0.trial187.stdout:2817: seq_num 947 ranges {716229=488575,1616330=541328,2756280=559655} 2026-02-13T18:18:41.534 INFO:tasks.rados.rados.0.trial187.stdout:2817: writing trial18717860-17 from 716229 to 1204804 tid 1 2026-02-13T18:18:41.538 INFO:tasks.rados.rados.0.trial187.stdout:2817: writing trial18717860-17 from 1616330 to 2157658 tid 2 2026-02-13T18:18:41.542 INFO:tasks.rados.rados.0.trial187.stdout:2817: writing trial18717860-17 from 2756280 to 3315935 tid 3 2026-02-13T18:18:41.542 INFO:tasks.rados.rados.0.trial187.stdout:2818: delete oid 50 current snap is 309 2026-02-13T18:18:41.543 INFO:tasks.rados.rados.0.trial187.stdout:2815: expect (ObjNum 846 snap 280 seq_num 846) 2026-02-13T18:18:41.683 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1854628 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2817: finishing write tid 1 to trial18717860-17 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2817: finishing write tid 2 to trial18717860-17 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2816: finishing copy_from racing read to trial18717860-2 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2815: done (3 left) 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2818: done (2 left) 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2819: snap_create 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:2816: finishing copy_from to trial18717860-2 2026-02-13T18:18:41.691 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1019 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: finishing write tid 3 to trial18717860-17 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: finishing write tid 4 to trial18717860-17 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: finishing write tid 5 to trial18717860-17 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: oid 17 updating version 0 to 1502 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: oid 17 version 1502 is already newer than 1499 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: oid 17 version 1502 is already newer than 1501 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: oid 17 version 1502 is already newer than 1500 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1502 (ObjNum 947 snap 309 seq_num 947) dirty exists 2026-02-13T18:18:41.692 INFO:tasks.rados.rados.0.trial187.stdout:2817: left oid 17 (ObjNum 947 snap 309 seq_num 947) 2026-02-13T18:18:42.544 INFO:tasks.rados.rados.0.trial187.stdout:2816: done (2 left) 2026-02-13T18:18:42.544 INFO:tasks.rados.rados.0.trial187.stdout:2817: done (1 left) 2026-02-13T18:18:42.544 INFO:tasks.rados.rados.0.trial187.stdout:2819: done (0 left) 2026-02-13T18:18:42.544 INFO:tasks.rados.rados.0.trial187.stdout:2820: rollback oid 20 current snap is 310 2026-02-13T18:18:42.544 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 306 2026-02-13T18:18:42.544 INFO:tasks.rados.rados.0.trial187.stdout:2821: delete oid 28 current snap is 310 2026-02-13T18:18:42.549 INFO:tasks.rados.rados.0.trial187.stdout:2821: done (1 left) 2026-02-13T18:18:42.549 INFO:tasks.rados.rados.0.trial187.stdout:2822: read oid 49 snap -1 2026-02-13T18:18:42.549 INFO:tasks.rados.rados.0.trial187.stdout:2822: expect (ObjNum 796 snap 269 seq_num 796) 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2823: read oid 33 snap -1 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2823: expect (ObjNum 939 snap 306 seq_num 939) 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2824: read oid 9 snap -1 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2824: expect (ObjNum 889 snap 294 seq_num 889) 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2825: snap_create 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2820: finishing rollback tid 0 to trial18717860-20 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2820: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:2820: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:18:42.550 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1610 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:18:42.554 INFO:tasks.rados.rados.0.trial187.stdout:2824: expect (ObjNum 889 snap 294 seq_num 889) 2026-02-13T18:18:42.558 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1547410 2026-02-13T18:18:42.610 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:42.650 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:42.691 INFO:tasks.rados.rados.0.trial187.stdout:2822: expect (ObjNum 796 snap 269 seq_num 796) 2026-02-13T18:18:42.691 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 207729 2026-02-13T18:18:42.714 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:42.763 INFO:tasks.rados.rados.0.trial187.stdout:2823: expect (ObjNum 939 snap 306 seq_num 939) 2026-02-13T18:18:42.769 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2457378 2026-02-13T18:18:42.781 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2820: done (4 left) 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2822: done (3 left) 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2823: done (2 left) 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2824: done (1 left) 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2825: done (0 left) 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2826: write (excl) oid 33 current snap is 311 2026-02-13T18:18:43.547 INFO:tasks.rados.rados.0.trial187.stdout:2826: seq_num 950 ranges {766650=714322,2075423=688655,3522196=444454} 2026-02-13T18:18:43.557 INFO:tasks.rados.rados.0.trial187.stdout:2826: writing trial18717860-33 from 766650 to 1480972 tid 1 2026-02-13T18:18:43.565 INFO:tasks.rados.rados.0.trial187.stdout:2826: writing trial18717860-33 from 2075423 to 2764078 tid 2 2026-02-13T18:18:43.574 INFO:tasks.rados.rados.0.trial187.stdout:2826: writing trial18717860-33 from 3522196 to 3966650 tid 3 2026-02-13T18:18:43.574 INFO:tasks.rados.rados.0.trial187.stdout:2827: write (excl) oid 8 current snap is 311 2026-02-13T18:18:43.574 INFO:tasks.rados.rados.0.trial187.stdout:2827: seq_num 951 ranges {783457=505924,1850258=548666,2865972=721096} 2026-02-13T18:18:43.582 INFO:tasks.rados.rados.0.trial187.stdout:2827: writing trial18717860-8 from 783457 to 1289381 tid 1 2026-02-13T18:18:43.590 INFO:tasks.rados.rados.0.trial187.stdout:2827: writing trial18717860-8 from 1850258 to 2398924 tid 2 2026-02-13T18:18:43.595 INFO:tasks.rados.rados.0.trial187.stdout:2827: writing trial18717860-8 from 2865972 to 3587068 tid 3 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2828: delete oid 9 current snap is 311 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: finishing write tid 1 to trial18717860-33 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: finishing write tid 2 to trial18717860-33 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: finishing write tid 3 to trial18717860-33 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: finishing write tid 4 to trial18717860-33 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: finishing write tid 5 to trial18717860-33 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: oid 33 updating version 0 to 1888 2026-02-13T18:18:43.596 INFO:tasks.rados.rados.0.trial187.stdout:2826: oid 33 updating version 1888 to 1889 2026-02-13T18:18:43.597 INFO:tasks.rados.rados.0.trial187.stdout:2826: oid 33 updating version 1889 to 1890 2026-02-13T18:18:43.597 INFO:tasks.rados.rados.0.trial187.stdout:2826: oid 33 version 1890 is already newer than 1887 2026-02-13T18:18:43.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1890 (ObjNum 950 snap 311 seq_num 950) dirty exists 2026-02-13T18:18:43.597 INFO:tasks.rados.rados.0.trial187.stdout:2826: left oid 33 (ObjNum 950 snap 311 seq_num 950) 2026-02-13T18:18:43.597 INFO:tasks.rados.rados.0.trial187.stdout:2827: finishing write tid 1 to trial18717860-8 2026-02-13T18:18:43.597 INFO:tasks.rados.rados.0.trial187.stdout:2827: finishing write tid 2 to trial18717860-8 2026-02-13T18:18:43.598 INFO:tasks.rados.rados.0.trial187.stdout:2827: finishing write tid 3 to trial18717860-8 2026-02-13T18:18:43.598 INFO:tasks.rados.rados.0.trial187.stdout:2827: finishing write tid 4 to trial18717860-8 2026-02-13T18:18:43.598 INFO:tasks.rados.rados.0.trial187.stdout:2827: finishing write tid 5 to trial18717860-8 2026-02-13T18:18:43.598 INFO:tasks.rados.rados.0.trial187.stdout:2827: oid 8 updating version 0 to 1048 2026-02-13T18:18:43.598 INFO:tasks.rados.rados.0.trial187.stdout:2827: oid 8 version 1048 is already newer than 1047 2026-02-13T18:18:43.598 INFO:tasks.rados.rados.0.trial187.stdout:2827: oid 8 version 1048 is already newer than 1045 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:2827: oid 8 version 1048 is already newer than 1046 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 1048 (ObjNum 951 snap 311 seq_num 951) dirty exists 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:2827: left oid 8 (ObjNum 951 snap 311 seq_num 951) 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:2826: done (2 left) 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:2827: done (1 left) 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:2828: done (0 left) 2026-02-13T18:18:43.599 INFO:tasks.rados.rados.0.trial187.stdout:2829: snap_remove snap 303 2026-02-13T18:18:44.550 INFO:tasks.rados.rados.0.trial187.stdout:2829: done (0 left) 2026-02-13T18:18:44.550 INFO:tasks.rados.rados.0.trial187.stdout:2830: delete oid 39 current snap is 311 2026-02-13T18:18:44.556 INFO:tasks.rados.rados.0.trial187.stdout:2830: done (0 left) 2026-02-13T18:18:44.557 INFO:tasks.rados.rados.0.trial187.stdout:2831: read oid 32 snap 307 2026-02-13T18:18:44.557 INFO:tasks.rados.rados.0.trial187.stdout:2831: expect deleted 2026-02-13T18:18:44.557 INFO:tasks.rados.rados.0.trial187.stdout:2832: rollback oid 23 current snap is 311 2026-02-13T18:18:44.557 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 23 to 306 2026-02-13T18:18:44.557 INFO:tasks.rados.rados.0.trial187.stdout:2833: write (excl) oid 15 current snap is 311 2026-02-13T18:18:44.557 INFO:tasks.rados.rados.0.trial187.stdout:2833: seq_num 954 ranges {433878=731671,1909351=124527} 2026-02-13T18:18:44.564 INFO:tasks.rados.rados.0.trial187.stdout:2833: writing trial18717860-15 from 433878 to 1165549 tid 1 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2833: writing trial18717860-15 from 1909351 to 2033878 tid 2 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2834: copy_from oid 38 from oid 6 current snap is 311 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2832: finishing rollback tid 0 to trial18717860-23 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2832: finishing rollback tid 1 to trial18717860-23 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2832: finishing rollback tid 2 to trial18717860-23 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1069 (ObjNum 930 snap 304 seq_num 930) dirty exists 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2833: finishing write tid 1 to trial18717860-15 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2831: done (3 left) 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2832: done (2 left) 2026-02-13T18:18:44.571 INFO:tasks.rados.rados.0.trial187.stdout:2835: delete oid 28 current snap is 311 2026-02-13T18:18:44.572 INFO:tasks.rados.rados.0.trial187.stdout:2835: done (2 left) 2026-02-13T18:18:44.572 INFO:tasks.rados.rados.0.trial187.stdout:2836: snap_remove snap 307 2026-02-13T18:18:45.529 INFO:tasks.rados.rados.0.trial187.stdout:2836: done (2 left) 2026-02-13T18:18:45.529 INFO:tasks.rados.rados.0.trial187.stdout:2837: read oid 47 snap -1 2026-02-13T18:18:45.529 INFO:tasks.rados.rados.0.trial187.stdout:2837: expect deleted 2026-02-13T18:18:45.530 INFO:tasks.rados.rados.0.trial187.stdout:2838: write (excl) oid 35 current snap is 311 2026-02-13T18:18:45.530 INFO:tasks.rados.rados.0.trial187.stdout:2838: seq_num 956 ranges {467492=482169,1626315=441177} 2026-02-13T18:18:45.535 INFO:tasks.rados.rados.0.trial187.stdout:2838: writing trial18717860-35 from 467492 to 949661 tid 1 2026-02-13T18:18:45.543 INFO:tasks.rados.rados.0.trial187.stdout:2838: writing trial18717860-35 from 1626315 to 2067492 tid 2 2026-02-13T18:18:45.543 INFO:tasks.rados.rados.0.trial187.stdout:2839: rollback oid 50 current snap is 311 2026-02-13T18:18:45.543 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 309 2026-02-13T18:18:45.543 INFO:tasks.rados.rados.0.trial187.stdout:2833: finishing write tid 2 to trial18717860-15 2026-02-13T18:18:45.543 INFO:tasks.rados.rados.0.trial187.stdout:2840: write (excl) oid 28 current snap is 311 2026-02-13T18:18:45.543 INFO:tasks.rados.rados.0.trial187.stdout:2840: seq_num 957 ranges {484299=557418,1684797=399502} 2026-02-13T18:18:45.549 INFO:tasks.rados.rados.0.trial187.stdout:2840: writing trial18717860-28 from 484299 to 1041717 tid 1 2026-02-13T18:18:45.557 INFO:tasks.rados.rados.0.trial187.stdout:2840: writing trial18717860-28 from 1684797 to 2084299 tid 2 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2841: delete oid 1 current snap is 311 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2833: finishing write tid 3 to trial18717860-15 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2833: finishing write tid 4 to trial18717860-15 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2833: oid 15 updating version 0 to 1082 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2833: oid 15 version 1082 is already newer than 1080 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2833: oid 15 version 1082 is already newer than 1081 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1082 (ObjNum 954 snap 311 seq_num 954) dirty exists 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2833: left oid 15 (ObjNum 954 snap 311 seq_num 954) 2026-02-13T18:18:45.558 INFO:tasks.rados.rados.0.trial187.stdout:2834: finishing copy_from racing read to trial18717860-38 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2834: finishing copy_from to trial18717860-38 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1610 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: finishing write tid 1 to trial18717860-35 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2839: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 0 (ObjNum 49 snap 0 seq_num 2975093040) dirty dne 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: finishing write tid 2 to trial18717860-35 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: finishing write tid 3 to trial18717860-35 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: finishing write tid 4 to trial18717860-35 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: oid 35 updating version 0 to 1613 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: oid 35 version 1613 is already newer than 1612 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: oid 35 updating version 1613 to 1614 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1614 (ObjNum 956 snap 311 seq_num 956) dirty exists 2026-02-13T18:18:45.559 INFO:tasks.rados.rados.0.trial187.stdout:2838: left oid 35 (ObjNum 956 snap 311 seq_num 956) 2026-02-13T18:18:45.560 INFO:tasks.rados.rados.0.trial187.stdout:2840: finishing write tid 1 to trial18717860-28 2026-02-13T18:18:45.561 INFO:tasks.rados.rados.0.trial187.stdout:2833: done (6 left) 2026-02-13T18:18:45.561 INFO:tasks.rados.rados.0.trial187.stdout:2834: done (5 left) 2026-02-13T18:18:45.561 INFO:tasks.rados.rados.0.trial187.stdout:2837: done (4 left) 2026-02-13T18:18:45.561 INFO:tasks.rados.rados.0.trial187.stdout:2838: done (3 left) 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2839: done (2 left) 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2841: done (1 left) 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2842: read oid 41 snap 308 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2842: expect (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2843: read oid 32 snap -1 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2843: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2844: read oid 18 snap -1 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2844: expect deleted 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2845: copy_from oid 44 from oid 48 current snap is 311 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2846: read oid 1 snap -1 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2846: expect deleted 2026-02-13T18:18:45.562 INFO:tasks.rados.rados.0.trial187.stdout:2847: read oid 37 snap -1 2026-02-13T18:18:45.563 INFO:tasks.rados.rados.0.trial187.stdout:2847: expect (ObjNum 916 snap 301 seq_num 916) 2026-02-13T18:18:45.563 INFO:tasks.rados.rados.0.trial187.stdout:2848: write (excl) oid 3 current snap is 311 2026-02-13T18:18:45.563 INFO:tasks.rados.rados.0.trial187.stdout:2848: seq_num 959 ranges {517913=424269,1401761=446989} 2026-02-13T18:18:45.565 INFO:tasks.rados.rados.0.trial187.stdout:2848: writing trial18717860-3 from 517913 to 942182 tid 1 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2848: writing trial18717860-3 from 1401761 to 1848750 tid 2 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2849: rollback oid 31 current snap is 311 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 308 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2840: finishing write tid 2 to trial18717860-28 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2840: finishing write tid 3 to trial18717860-28 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2844: done (8 left) 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2846: done (7 left) 2026-02-13T18:18:45.572 INFO:tasks.rados.rados.0.trial187.stdout:2850: snap_remove snap 309 2026-02-13T18:18:46.554 INFO:tasks.rados.rados.0.trial187.stdout:2850: done (7 left) 2026-02-13T18:18:46.554 INFO:tasks.rados.rados.0.trial187.stdout:2851: read oid 45 snap 310 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2851: expect (ObjNum 944 snap 307 seq_num 944) 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2852: snap_create 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2840: finishing write tid 4 to trial18717860-28 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2840: oid 28 updating version 0 to 1613 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2840: oid 28 version 1613 is already newer than 1612 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2840: oid 28 updating version 1613 to 1614 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1614 (ObjNum 957 snap 311 seq_num 957) dirty exists 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2840: left oid 28 (ObjNum 957 snap 311 seq_num 957) 2026-02-13T18:18:46.555 INFO:tasks.rados.rados.0.trial187.stdout:2842: expect (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:46.699 INFO:tasks.rados.rados.0.trial187.stdout:2843: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:18:46.729 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:46.750 INFO:tasks.rados.rados.0.trial187.stdout:2848: finishing write tid 1 to trial18717860-3 2026-02-13T18:18:46.750 INFO:tasks.rados.rados.0.trial187.stdout:2847: expect (ObjNum 916 snap 301 seq_num 916) 2026-02-13T18:18:46.750 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:46.809 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:46.844 INFO:tasks.rados.rados.0.trial187.stdout:2849: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:18:46.844 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1028 (ObjNum 33 snap 0 seq_num 3012893168) dirty dne 2026-02-13T18:18:46.844 INFO:tasks.rados.rados.0.trial187.stdout:2848: finishing write tid 2 to trial18717860-3 2026-02-13T18:18:46.844 INFO:tasks.rados.rados.0.trial187.stdout:2848: finishing write tid 3 to trial18717860-3 2026-02-13T18:18:46.844 INFO:tasks.rados.rados.0.trial187.stdout:2848: finishing write tid 4 to trial18717860-3 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2848: oid 3 updating version 0 to 1518 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2848: oid 3 updating version 1518 to 1519 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2848: oid 3 updating version 1519 to 1520 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1520 (ObjNum 959 snap 311 seq_num 959) dirty exists 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2848: left oid 3 (ObjNum 959 snap 311 seq_num 959) 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2845: finishing copy_from racing read to trial18717860-44 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2845: finishing copy_from to trial18717860-44 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1799 (ObjNum 877 snap 287 seq_num 877) dirty exists 2026-02-13T18:18:46.845 INFO:tasks.rados.rados.0.trial187.stdout:2851: expect (ObjNum 944 snap 307 seq_num 944) 2026-02-13T18:18:46.857 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3499163 2026-02-13T18:18:46.859 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:46.888 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 149494 2026-02-13T18:18:47.555 INFO:tasks.rados.rados.0.trial187.stdout:2840: done (8 left) 2026-02-13T18:18:47.555 INFO:tasks.rados.rados.0.trial187.stdout:2842: done (7 left) 2026-02-13T18:18:47.555 INFO:tasks.rados.rados.0.trial187.stdout:2843: done (6 left) 2026-02-13T18:18:47.555 INFO:tasks.rados.rados.0.trial187.stdout:2845: done (5 left) 2026-02-13T18:18:47.555 INFO:tasks.rados.rados.0.trial187.stdout:2847: done (4 left) 2026-02-13T18:18:47.556 INFO:tasks.rados.rados.0.trial187.stdout:2848: done (3 left) 2026-02-13T18:18:47.556 INFO:tasks.rados.rados.0.trial187.stdout:2849: done (2 left) 2026-02-13T18:18:47.556 INFO:tasks.rados.rados.0.trial187.stdout:2851: done (1 left) 2026-02-13T18:18:47.556 INFO:tasks.rados.rados.0.trial187.stdout:2852: done (0 left) 2026-02-13T18:18:47.556 INFO:tasks.rados.rados.0.trial187.stdout:2853: write (excl) oid 12 current snap is 312 2026-02-13T18:18:47.556 INFO:tasks.rados.rados.0.trial187.stdout:2853: seq_num 960 ranges {534720=499518,1460243=674477} 2026-02-13T18:18:47.562 INFO:tasks.rados.rados.0.trial187.stdout:2853: writing trial18717860-12 from 534720 to 1034238 tid 1 2026-02-13T18:18:47.569 INFO:tasks.rados.rados.0.trial187.stdout:2853: writing trial18717860-12 from 1460243 to 2134720 tid 2 2026-02-13T18:18:47.569 INFO:tasks.rados.rados.0.trial187.stdout:2854: write (excl) oid 48 current snap is 312 2026-02-13T18:18:47.570 INFO:tasks.rados.rados.0.trial187.stdout:2854: seq_num 961 ranges {551527=574767,1918725=232802} 2026-02-13T18:18:47.577 INFO:tasks.rados.rados.0.trial187.stdout:2854: writing trial18717860-48 from 551527 to 1126294 tid 1 2026-02-13T18:18:47.584 INFO:tasks.rados.rados.0.trial187.stdout:2854: writing trial18717860-48 from 1918725 to 2151527 tid 2 2026-02-13T18:18:47.584 INFO:tasks.rados.rados.0.trial187.stdout:2855: write oid 46 current snap is 312 2026-02-13T18:18:47.584 INFO:tasks.rados.rados.0.trial187.stdout:2855: seq_num 962 ranges {568334=650016,1860854=307480} 2026-02-13T18:18:47.593 INFO:tasks.rados.rados.0.trial187.stdout:2855: writing trial18717860-46 from 568334 to 1218350 tid 1 2026-02-13T18:18:47.600 INFO:tasks.rados.rados.0.trial187.stdout:2855: writing trial18717860-46 from 1860854 to 2168334 tid 2 2026-02-13T18:18:47.600 INFO:tasks.rados.rados.0.trial187.stdout:2856: read oid 16 snap -1 2026-02-13T18:18:47.600 INFO:tasks.rados.rados.0.trial187.stdout:2856: expect (ObjNum 905 snap 301 seq_num 905) 2026-02-13T18:18:47.600 INFO:tasks.rados.rados.0.trial187.stdout:2857: write (excl) oid 11 current snap is 312 2026-02-13T18:18:47.600 INFO:tasks.rados.rados.0.trial187.stdout:2857: seq_num 963 ranges {585141=725265,1919336=265805} 2026-02-13T18:18:47.605 INFO:tasks.rados.rados.0.trial187.stdout:2857: writing trial18717860-11 from 585141 to 1310406 tid 1 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2857: writing trial18717860-11 from 1919336 to 2185141 tid 2 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2858: delete oid 10 current snap is 312 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: finishing write tid 1 to trial18717860-12 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: finishing write tid 2 to trial18717860-12 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: finishing write tid 3 to trial18717860-12 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: finishing write tid 4 to trial18717860-12 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: oid 12 updating version 0 to 1041 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: oid 12 updating version 1041 to 1042 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:2853: oid 12 version 1042 is already newer than 1040 2026-02-13T18:18:47.610 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1042 (ObjNum 960 snap 312 seq_num 960) dirty exists 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2853: left oid 12 (ObjNum 960 snap 312 seq_num 960) 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: finishing write tid 1 to trial18717860-48 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: finishing write tid 2 to trial18717860-48 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: finishing write tid 3 to trial18717860-48 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: finishing write tid 4 to trial18717860-48 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: oid 48 updating version 0 to 1903 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: oid 48 version 1903 is already newer than 1902 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: oid 48 version 1903 is already newer than 1901 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1903 (ObjNum 961 snap 312 seq_num 961) dirty exists 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2854: left oid 48 (ObjNum 961 snap 312 seq_num 961) 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2855: finishing write tid 1 to trial18717860-46 2026-02-13T18:18:47.611 INFO:tasks.rados.rados.0.trial187.stdout:2855: finishing write tid 2 to trial18717860-46 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2855: finishing write tid 3 to trial18717860-46 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2855: finishing write tid 4 to trial18717860-46 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2855: oid 46 updating version 0 to 1141 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2855: oid 46 version 1141 is already newer than 1139 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2855: oid 46 version 1141 is already newer than 1140 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1141 (ObjNum 962 snap 312 seq_num 962) dirty exists 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2855: left oid 46 (ObjNum 962 snap 312 seq_num 962) 2026-02-13T18:18:47.612 INFO:tasks.rados.rados.0.trial187.stdout:2856: expect (ObjNum 905 snap 301 seq_num 905) 2026-02-13T18:18:47.680 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 363522 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: finishing write tid 1 to trial18717860-11 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: finishing write tid 2 to trial18717860-11 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: finishing write tid 3 to trial18717860-11 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: finishing write tid 4 to trial18717860-11 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: oid 11 updating version 0 to 1423 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: oid 11 updating version 1423 to 1424 2026-02-13T18:18:47.786 INFO:tasks.rados.rados.0.trial187.stdout:2857: oid 11 updating version 1424 to 1425 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1425 (ObjNum 963 snap 312 seq_num 963) dirty exists 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2857: left oid 11 (ObjNum 963 snap 312 seq_num 963) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2853: done (5 left) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2854: done (4 left) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2855: done (3 left) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2856: done (2 left) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2857: done (1 left) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2858: done (0 left) 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2859: write oid 26 current snap is 312 2026-02-13T18:18:47.787 INFO:tasks.rados.rados.0.trial187.stdout:2859: seq_num 965 ranges {618755=475763,1636300=457996} 2026-02-13T18:18:47.790 INFO:tasks.rados.rados.0.trial187.stdout:2859: writing trial18717860-26 from 618755 to 1094518 tid 1 2026-02-13T18:18:47.797 INFO:tasks.rados.rados.0.trial187.stdout:2859: writing trial18717860-26 from 1636300 to 2094296 tid 2 2026-02-13T18:18:47.797 INFO:tasks.rados.rados.0.trial187.stdout:2860: delete oid 35 current snap is 312 2026-02-13T18:18:47.797 INFO:tasks.rados.rados.0.trial187.stdout:2859: finishing write tid 1 to trial18717860-26 2026-02-13T18:18:47.799 INFO:tasks.rados.rados.0.trial187.stdout:2859: finishing write tid 2 to trial18717860-26 2026-02-13T18:18:47.800 INFO:tasks.rados.rados.0.trial187.stdout:2859: finishing write tid 3 to trial18717860-26 2026-02-13T18:18:47.800 INFO:tasks.rados.rados.0.trial187.stdout:2859: finishing write tid 4 to trial18717860-26 2026-02-13T18:18:47.800 INFO:tasks.rados.rados.0.trial187.stdout:2859: oid 26 updating version 0 to 1527 2026-02-13T18:18:47.800 INFO:tasks.rados.rados.0.trial187.stdout:2859: oid 26 updating version 1527 to 1529 2026-02-13T18:18:47.800 INFO:tasks.rados.rados.0.trial187.stdout:2859: oid 26 version 1529 is already newer than 1528 2026-02-13T18:18:47.801 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 1529 (ObjNum 965 snap 312 seq_num 965) dirty exists 2026-02-13T18:18:47.801 INFO:tasks.rados.rados.0.trial187.stdout:2859: left oid 26 (ObjNum 965 snap 312 seq_num 965) 2026-02-13T18:18:47.801 INFO:tasks.rados.rados.0.trial187.stdout:2859: done (1 left) 2026-02-13T18:18:47.801 INFO:tasks.rados.rados.0.trial187.stdout:2860: done (0 left) 2026-02-13T18:18:47.802 INFO:tasks.rados.rados.0.trial187.stdout:2861: copy_from oid 25 from oid 18 current snap is 312 2026-02-13T18:18:47.802 INFO:tasks.rados.rados.0.trial187.stdout:2862: delete oid 8 current snap is 312 2026-02-13T18:18:47.802 INFO:tasks.rados.rados.0.trial187.stdout:2861: finishing copy_from to trial18717860-25 2026-02-13T18:18:47.802 INFO:tasks.rados.rados.0.trial187.stdout:2861: got expected ENOENT (src dne) 2026-02-13T18:18:47.802 INFO:tasks.rados.rados.0.trial187.stdout:2861: finishing copy_from racing read to trial18717860-25 2026-02-13T18:18:47.803 INFO:tasks.rados.rados.0.trial187.stdout:2861: done (1 left) 2026-02-13T18:18:47.803 INFO:tasks.rados.rados.0.trial187.stdout:2862: done (0 left) 2026-02-13T18:18:47.803 INFO:tasks.rados.rados.0.trial187.stdout:2863: read oid 41 snap -1 2026-02-13T18:18:47.803 INFO:tasks.rados.rados.0.trial187.stdout:2863: expect (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:47.803 INFO:tasks.rados.rados.0.trial187.stdout:2864: delete oid 29 current snap is 312 2026-02-13T18:18:47.807 INFO:tasks.rados.rados.0.trial187.stdout:2864: done (1 left) 2026-02-13T18:18:47.807 INFO:tasks.rados.rados.0.trial187.stdout:2865: write oid 11 current snap is 312 2026-02-13T18:18:47.807 INFO:tasks.rados.rados.0.trial187.stdout:2865: seq_num 969 ranges {685983=493112,1870228=415755} 2026-02-13T18:18:47.815 INFO:tasks.rados.rados.0.trial187.stdout:2865: writing trial18717860-11 from 685983 to 1179095 tid 1 2026-02-13T18:18:47.823 INFO:tasks.rados.rados.0.trial187.stdout:2865: writing trial18717860-11 from 1870228 to 2285983 tid 2 2026-02-13T18:18:47.824 INFO:tasks.rados.rados.0.trial187.stdout:2866: rollback oid 17 current snap is 312 2026-02-13T18:18:47.824 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 282 2026-02-13T18:18:47.824 INFO:tasks.rados.rados.0.trial187.stdout:2863: expect (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:47.875 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:47.978 INFO:tasks.rados.rados.0.trial187.stdout:2865: finishing write tid 1 to trial18717860-11 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: finishing write tid 2 to trial18717860-11 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: finishing write tid 3 to trial18717860-11 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: finishing write tid 4 to trial18717860-11 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: oid 11 updating version 0 to 1428 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: oid 11 version 1428 is already newer than 1427 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: oid 11 version 1428 is already newer than 1426 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1428 (ObjNum 969 snap 312 seq_num 969) dirty exists 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2865: left oid 11 (ObjNum 969 snap 312 seq_num 969) 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2866: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2866: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:2866: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:18:47.979 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1533 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:18:47.980 INFO:tasks.rados.rados.0.trial187.stdout:2863: done (2 left) 2026-02-13T18:18:47.980 INFO:tasks.rados.rados.0.trial187.stdout:2865: done (1 left) 2026-02-13T18:18:47.980 INFO:tasks.rados.rados.0.trial187.stdout:2866: done (0 left) 2026-02-13T18:18:47.980 INFO:tasks.rados.rados.0.trial187.stdout:2867: write (excl) oid 3 current snap is 312 2026-02-13T18:18:47.980 INFO:tasks.rados.rados.0.trial187.stdout:2867: seq_num 970 ranges {702790=568361,1812357=490433} 2026-02-13T18:18:47.987 INFO:tasks.rados.rados.0.trial187.stdout:2867: writing trial18717860-3 from 702790 to 1271151 tid 1 2026-02-13T18:18:47.994 INFO:tasks.rados.rados.0.trial187.stdout:2867: writing trial18717860-3 from 1812357 to 2302790 tid 2 2026-02-13T18:18:47.994 INFO:tasks.rados.rados.0.trial187.stdout:2868: snap_remove snap 282 2026-02-13T18:18:48.560 INFO:tasks.rados.rados.0.trial187.stdout:2868: done (1 left) 2026-02-13T18:18:48.560 INFO:tasks.rados.rados.0.trial187.stdout:2869: snap_create 2026-02-13T18:18:48.560 INFO:tasks.rados.rados.0.trial187.stdout:2867: finishing write tid 1 to trial18717860-3 2026-02-13T18:18:48.560 INFO:tasks.rados.rados.0.trial187.stdout:2867: finishing write tid 2 to trial18717860-3 2026-02-13T18:18:48.560 INFO:tasks.rados.rados.0.trial187.stdout:2867: finishing write tid 3 to trial18717860-3 2026-02-13T18:18:48.561 INFO:tasks.rados.rados.0.trial187.stdout:2867: finishing write tid 4 to trial18717860-3 2026-02-13T18:18:48.561 INFO:tasks.rados.rados.0.trial187.stdout:2867: oid 3 updating version 0 to 1537 2026-02-13T18:18:48.561 INFO:tasks.rados.rados.0.trial187.stdout:2867: oid 3 version 1537 is already newer than 1535 2026-02-13T18:18:48.561 INFO:tasks.rados.rados.0.trial187.stdout:2867: oid 3 version 1537 is already newer than 1536 2026-02-13T18:18:48.561 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1537 (ObjNum 970 snap 312 seq_num 970) dirty exists 2026-02-13T18:18:48.561 INFO:tasks.rados.rados.0.trial187.stdout:2867: left oid 3 (ObjNum 970 snap 312 seq_num 970) 2026-02-13T18:18:49.561 INFO:tasks.rados.rados.0.trial187.stdout:2867: done (1 left) 2026-02-13T18:18:49.561 INFO:tasks.rados.rados.0.trial187.stdout:2869: done (0 left) 2026-02-13T18:18:49.561 INFO:tasks.rados.rados.0.trial187.stdout:2870: rollback oid 11 current snap is 313 2026-02-13T18:18:49.562 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 310 2026-02-13T18:18:49.562 INFO:tasks.rados.rados.0.trial187.stdout:2871: write oid 29 current snap is 313 2026-02-13T18:18:49.562 INFO:tasks.rados.rados.0.trial187.stdout:2871: seq_num 971 ranges {719597=643610,1870839=448758} 2026-02-13T18:18:49.570 INFO:tasks.rados.rados.0.trial187.stdout:2871: writing trial18717860-29 from 719597 to 1363207 tid 1 2026-02-13T18:18:49.576 INFO:tasks.rados.rados.0.trial187.stdout:2871: writing trial18717860-29 from 1870839 to 2319597 tid 2 2026-02-13T18:18:49.577 INFO:tasks.rados.rados.0.trial187.stdout:2872: read oid 26 snap 306 2026-02-13T18:18:49.577 INFO:tasks.rados.rados.0.trial187.stdout:2872: expect deleted 2026-02-13T18:18:49.577 INFO:tasks.rados.rados.0.trial187.stdout:2873: snap_remove snap 312 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2873: done (3 left) 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2874: copy_from oid 17 from oid 50 current snap is 313 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2870: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2870: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2870: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1431 (ObjNum 870 snap 287 seq_num 870) dirty exists 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2870: done (3 left) 2026-02-13T18:18:50.529 INFO:tasks.rados.rados.0.trial187.stdout:2875: snap_remove snap 310 2026-02-13T18:18:51.531 INFO:tasks.rados.rados.0.trial187.stdout:2875: done (3 left) 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2876: copy_from oid 35 from oid 44 current snap is 313 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2871: finishing write tid 1 to trial18717860-29 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2871: finishing write tid 2 to trial18717860-29 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2872: done (3 left) 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2877: read oid 32 snap 311 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2877: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2878: read oid 38 snap -1 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2878: expect (ObjNum 854 snap 281 seq_num 854) 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2879: read oid 41 snap -1 2026-02-13T18:18:51.532 INFO:tasks.rados.rados.0.trial187.stdout:2879: expect (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2880: read oid 16 snap -1 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2880: expect (ObjNum 905 snap 301 seq_num 905) 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2881: copy_from oid 21 from oid 40 current snap is 313 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2871: finishing write tid 3 to trial18717860-29 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2871: finishing write tid 4 to trial18717860-29 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2871: oid 29 updating version 0 to 1097 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2871: oid 29 updating version 1097 to 1099 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2871: oid 29 version 1099 is already newer than 1098 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1099 (ObjNum 971 snap 313 seq_num 971) dirty exists 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2871: left oid 29 (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:18:51.533 INFO:tasks.rados.rados.0.trial187.stdout:2874: finishing copy_from to trial18717860-17 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2874: got expected ENOENT (src dne) 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2874: finishing copy_from racing read to trial18717860-17 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2871: done (7 left) 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2874: done (6 left) 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2882: copy_from oid 28 from oid 50 current snap is 313 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2883: copy_from oid 18 from oid 30 current snap is 313 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2884: rollback oid 49 current snap is 313 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 306 2026-02-13T18:18:51.534 INFO:tasks.rados.rados.0.trial187.stdout:2885: delete oid 24 current snap is 313 2026-02-13T18:18:51.535 INFO:tasks.rados.rados.0.trial187.stdout:2880: expect (ObjNum 905 snap 301 seq_num 905) 2026-02-13T18:18:51.584 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2630948 2026-02-13T18:18:51.649 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:51.700 INFO:tasks.rados.rados.0.trial187.stdout:2877: expect (ObjNum 755 snap 263 seq_num 755) 2026-02-13T18:18:51.759 INFO:tasks.rados.rados.0.trial187.stdout:2878: expect (ObjNum 854 snap 281 seq_num 854) 2026-02-13T18:18:51.770 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:51.790 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1312428 2026-02-13T18:18:51.800 INFO:tasks.rados.rados.0.trial187.stdout:2883: finishing copy_from to trial18717860-18 2026-02-13T18:18:51.800 INFO:tasks.rados.rados.0.trial187.stdout:2883: got expected ENOENT (src dne) 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2877: done (9 left) 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2878: done (8 left) 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2880: done (7 left) 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2885: done (6 left) 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2886: copy_from oid 3 from oid 9 current snap is 313 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2881: finishing copy_from to trial18717860-21 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2881: got expected ENOENT (src dne) 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2883: finishing copy_from racing read to trial18717860-18 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2881: finishing copy_from racing read to trial18717860-21 2026-02-13T18:18:51.801 INFO:tasks.rados.rados.0.trial187.stdout:2884: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:18:51.802 INFO:tasks.rados.rados.0.trial187.stdout:2879: expect (ObjNum 936 snap 304 seq_num 936) 2026-02-13T18:18:51.850 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:51.950 INFO:tasks.rados.rados.0.trial187.stdout:2882: finishing copy_from to trial18717860-28 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2882: got expected ENOENT (src dne) 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2882: finishing copy_from racing read to trial18717860-28 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2884: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2884: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1434 (ObjNum 796 snap 269 seq_num 796) dirty exists 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2876: finishing copy_from racing read to trial18717860-35 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2876: finishing copy_from to trial18717860-35 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1799 (ObjNum 877 snap 287 seq_num 877) dirty exists 2026-02-13T18:18:51.951 INFO:tasks.rados.rados.0.trial187.stdout:2886: finishing copy_from to trial18717860-3 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2886: got expected ENOENT (src dne) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2886: finishing copy_from racing read to trial18717860-3 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2876: done (6 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2879: done (5 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2881: done (4 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2882: done (3 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2883: done (2 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2884: done (1 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2886: done (0 left) 2026-02-13T18:18:51.952 INFO:tasks.rados.rados.0.trial187.stdout:2887: snap_remove snap 311 2026-02-13T18:18:52.569 INFO:tasks.rados.rados.0.trial187.stdout:2887: done (0 left) 2026-02-13T18:18:52.569 INFO:tasks.rados.rados.0.trial187.stdout:2888: write (excl) oid 40 current snap is 313 2026-02-13T18:18:52.569 INFO:tasks.rados.rados.0.trial187.stdout:2888: seq_num 973 ranges {753211=794108,1987803=365408} 2026-02-13T18:18:52.579 INFO:tasks.rados.rados.0.trial187.stdout:2888: writing trial18717860-40 from 753211 to 1547319 tid 1 2026-02-13T18:18:52.585 INFO:tasks.rados.rados.0.trial187.stdout:2888: writing trial18717860-40 from 1987803 to 2353211 tid 2 2026-02-13T18:18:52.586 INFO:tasks.rados.rados.0.trial187.stdout:2889: rollback oid 11 current snap is 313 2026-02-13T18:18:52.586 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 306 2026-02-13T18:18:52.586 INFO:tasks.rados.rados.0.trial187.stdout:2888: finishing write tid 1 to trial18717860-40 2026-02-13T18:18:52.586 INFO:tasks.rados.rados.0.trial187.stdout:2890: snap_remove snap 308 2026-02-13T18:18:53.580 INFO:tasks.rados.rados.0.trial187.stdout:2890: done (2 left) 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2891: read oid 15 snap -1 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2891: expect (ObjNum 954 snap 311 seq_num 954) 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2892: delete oid 24 current snap is 313 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2889: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2889: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2888: finishing write tid 2 to trial18717860-40 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2889: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1437 (ObjNum 870 snap 287 seq_num 870) dirty exists 2026-02-13T18:18:53.581 INFO:tasks.rados.rados.0.trial187.stdout:2888: finishing write tid 3 to trial18717860-40 2026-02-13T18:18:53.582 INFO:tasks.rados.rados.0.trial187.stdout:2888: finishing write tid 4 to trial18717860-40 2026-02-13T18:18:53.582 INFO:tasks.rados.rados.0.trial187.stdout:2888: oid 40 updating version 0 to 1430 2026-02-13T18:18:53.582 INFO:tasks.rados.rados.0.trial187.stdout:2888: oid 40 version 1430 is already newer than 1428 2026-02-13T18:18:53.582 INFO:tasks.rados.rados.0.trial187.stdout:2888: oid 40 version 1430 is already newer than 1429 2026-02-13T18:18:53.582 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1430 (ObjNum 973 snap 313 seq_num 973) dirty exists 2026-02-13T18:18:53.582 INFO:tasks.rados.rados.0.trial187.stdout:2888: left oid 40 (ObjNum 973 snap 313 seq_num 973) 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2888: done (3 left) 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2889: done (2 left) 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2892: done (1 left) 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2893: rollback oid 35 current snap is 313 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 35 to 306 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2894: read oid 1 snap -1 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2894: expect deleted 2026-02-13T18:18:53.584 INFO:tasks.rados.rados.0.trial187.stdout:2895: delete oid 19 current snap is 313 2026-02-13T18:18:53.587 INFO:tasks.rados.rados.0.trial187.stdout:2891: expect (ObjNum 954 snap 311 seq_num 954) 2026-02-13T18:18:53.633 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:53.659 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:18:53.685 INFO:tasks.rados.rados.0.trial187.stdout:2893: finishing rollback tid 0 to trial18717860-35 2026-02-13T18:18:53.685 INFO:tasks.rados.rados.0.trial187.stdout:2893: finishing rollback tid 1 to trial18717860-35 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2893: finishing rollback tid 2 to trial18717860-35 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1802 (ObjNum 934 snap 304 seq_num 934) dirty exists 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2891: done (3 left) 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2893: done (2 left) 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2894: done (1 left) 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2895: done (0 left) 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2896: read oid 35 snap -1 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2896: expect (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:18:53.686 INFO:tasks.rados.rados.0.trial187.stdout:2897: delete oid 12 current snap is 313 2026-02-13T18:18:53.687 INFO:tasks.rados.rados.0.trial187.stdout:2897: done (1 left) 2026-02-13T18:18:53.687 INFO:tasks.rados.rados.0.trial187.stdout:2898: snap_create 2026-02-13T18:18:53.689 INFO:tasks.rados.rados.0.trial187.stdout:2896: expect (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:18:53.810 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2180903 2026-02-13T18:18:54.582 INFO:tasks.rados.rados.0.trial187.stdout:2896: done (1 left) 2026-02-13T18:18:54.583 INFO:tasks.rados.rados.0.trial187.stdout:2898: done (0 left) 2026-02-13T18:18:54.583 INFO:tasks.rados.rados.0.trial187.stdout:2899: delete oid 28 current snap is 314 2026-02-13T18:18:54.585 INFO:tasks.rados.rados.0.trial187.stdout:2899: done (0 left) 2026-02-13T18:18:54.585 INFO:tasks.rados.rados.0.trial187.stdout:2900: write oid 2 current snap is 314 2026-02-13T18:18:54.585 INFO:tasks.rados.rados.0.trial187.stdout:2900: seq_num 978 ranges {437246=486706,1363860=623668} 2026-02-13T18:18:54.592 INFO:tasks.rados.rados.0.trial187.stdout:2900: writing trial18717860-2 from 437246 to 923952 tid 1 2026-02-13T18:18:54.599 INFO:tasks.rados.rados.0.trial187.stdout:2900: writing trial18717860-2 from 1363860 to 1987528 tid 2 2026-02-13T18:18:54.599 INFO:tasks.rados.rados.0.trial187.stdout:2901: snap_remove snap 306 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2901: done (1 left) 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2902: copy_from oid 43 from oid 39 current snap is 314 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: finishing write tid 1 to trial18717860-2 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: finishing write tid 2 to trial18717860-2 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: finishing write tid 3 to trial18717860-2 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: finishing write tid 4 to trial18717860-2 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: oid 2 updating version 0 to 1198 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: oid 2 updating version 1198 to 1200 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: oid 2 version 1200 is already newer than 1199 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1200 (ObjNum 978 snap 314 seq_num 978) dirty exists 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: left oid 2 (ObjNum 978 snap 314 seq_num 978) 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2900: done (1 left) 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2903: read oid 18 snap -1 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2903: expect deleted 2026-02-13T18:18:55.530 INFO:tasks.rados.rados.0.trial187.stdout:2904: delete oid 37 current snap is 314 2026-02-13T18:18:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2902: finishing copy_from to trial18717860-43 2026-02-13T18:18:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2902: got expected ENOENT (src dne) 2026-02-13T18:18:55.534 INFO:tasks.rados.rados.0.trial187.stdout:2902: finishing copy_from racing read to trial18717860-43 2026-02-13T18:18:55.537 INFO:tasks.rados.rados.0.trial187.stdout:2902: done (2 left) 2026-02-13T18:18:55.537 INFO:tasks.rados.rados.0.trial187.stdout:2903: done (1 left) 2026-02-13T18:18:55.537 INFO:tasks.rados.rados.0.trial187.stdout:2904: done (0 left) 2026-02-13T18:18:55.537 INFO:tasks.rados.rados.0.trial187.stdout:2905: snap_create 2026-02-13T18:18:56.580 INFO:tasks.rados.rados.0.trial187.stdout:2905: done (0 left) 2026-02-13T18:18:56.580 INFO:tasks.rados.rados.0.trial187.stdout:2906: snap_remove snap 313 2026-02-13T18:18:57.581 INFO:tasks.rados.rados.0.trial187.stdout:2906: done (0 left) 2026-02-13T18:18:57.581 INFO:tasks.rados.rados.0.trial187.stdout:2907: rollback oid 34 current snap is 315 2026-02-13T18:18:57.581 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 34 to 314 2026-02-13T18:18:57.582 INFO:tasks.rados.rados.0.trial187.stdout:2908: copy_from oid 50 from oid 5 current snap is 315 2026-02-13T18:18:57.582 INFO:tasks.rados.rados.0.trial187.stdout:2909: delete oid 41 current snap is 315 2026-02-13T18:18:57.582 INFO:tasks.rados.rados.0.trial187.stdout:2907: finishing rollback tid 1 to trial18717860-34 2026-02-13T18:18:57.582 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:18:57.586 INFO:tasks.rados.rados.0.trial187.stdout:2907: done (2 left) 2026-02-13T18:18:57.586 INFO:tasks.rados.rados.0.trial187.stdout:2909: done (1 left) 2026-02-13T18:18:57.586 INFO:tasks.rados.rados.0.trial187.stdout:2910: delete oid 16 current snap is 315 2026-02-13T18:18:57.590 INFO:tasks.rados.rados.0.trial187.stdout:2910: done (1 left) 2026-02-13T18:18:57.590 INFO:tasks.rados.rados.0.trial187.stdout:2911: snap_remove snap 314 2026-02-13T18:18:58.587 INFO:tasks.rados.rados.0.trial187.stdout:2911: done (1 left) 2026-02-13T18:18:58.587 INFO:tasks.rados.rados.0.trial187.stdout:2912: write oid 40 current snap is 315 2026-02-13T18:18:58.588 INFO:tasks.rados.rados.0.trial187.stdout:2912: seq_num 982 ranges {504474=504055,1714141=631006} 2026-02-13T18:18:58.594 INFO:tasks.rados.rados.0.trial187.stdout:2912: writing trial18717860-40 from 504474 to 1008529 tid 1 2026-02-13T18:18:58.604 INFO:tasks.rados.rados.0.trial187.stdout:2912: writing trial18717860-40 from 1714141 to 2345147 tid 2 2026-02-13T18:18:58.604 INFO:tasks.rados.rados.0.trial187.stdout:2913: write (excl) oid 43 current snap is 315 2026-02-13T18:18:58.604 INFO:tasks.rados.rados.0.trial187.stdout:2913: seq_num 983 ranges {521281=579304,1656270=774664} 2026-02-13T18:18:58.611 INFO:tasks.rados.rados.0.trial187.stdout:2913: writing trial18717860-43 from 521281 to 1100585 tid 1 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2913: writing trial18717860-43 from 1656270 to 2430934 tid 2 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2914: snap_create 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2908: finishing copy_from racing read to trial18717860-50 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2908: finishing copy_from to trial18717860-50 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1415 (ObjNum 909 snap 301 seq_num 909) dirty exists 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2912: finishing write tid 1 to trial18717860-40 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2912: finishing write tid 2 to trial18717860-40 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2912: finishing write tid 3 to trial18717860-40 2026-02-13T18:18:58.621 INFO:tasks.rados.rados.0.trial187.stdout:2912: finishing write tid 4 to trial18717860-40 2026-02-13T18:18:58.622 INFO:tasks.rados.rados.0.trial187.stdout:2912: oid 40 updating version 0 to 1433 2026-02-13T18:18:58.622 INFO:tasks.rados.rados.0.trial187.stdout:2912: oid 40 version 1433 is already newer than 1432 2026-02-13T18:18:58.622 INFO:tasks.rados.rados.0.trial187.stdout:2912: oid 40 version 1433 is already newer than 1431 2026-02-13T18:18:58.622 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1433 (ObjNum 982 snap 315 seq_num 982) dirty exists 2026-02-13T18:18:58.622 INFO:tasks.rados.rados.0.trial187.stdout:2912: left oid 40 (ObjNum 982 snap 315 seq_num 982) 2026-02-13T18:18:58.622 INFO:tasks.rados.rados.0.trial187.stdout:2913: finishing write tid 1 to trial18717860-43 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:2913: finishing write tid 2 to trial18717860-43 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:2913: finishing write tid 3 to trial18717860-43 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:2913: finishing write tid 4 to trial18717860-43 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:2913: oid 43 updating version 0 to 1936 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:2913: oid 43 version 1936 is already newer than 1935 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:2913: oid 43 version 1936 is already newer than 1934 2026-02-13T18:18:58.624 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1936 (ObjNum 983 snap 315 seq_num 983) dirty exists 2026-02-13T18:18:58.625 INFO:tasks.rados.rados.0.trial187.stdout:2913: left oid 43 (ObjNum 983 snap 315 seq_num 983) 2026-02-13T18:18:59.587 INFO:tasks.rados.rados.0.trial187.stdout:2908: done (3 left) 2026-02-13T18:18:59.587 INFO:tasks.rados.rados.0.trial187.stdout:2912: done (2 left) 2026-02-13T18:18:59.587 INFO:tasks.rados.rados.0.trial187.stdout:2913: done (1 left) 2026-02-13T18:18:59.587 INFO:tasks.rados.rados.0.trial187.stdout:2914: done (0 left) 2026-02-13T18:18:59.588 INFO:tasks.rados.rados.0.trial187.stdout:2915: delete oid 8 current snap is 316 2026-02-13T18:18:59.590 INFO:tasks.rados.rados.0.trial187.stdout:2915: done (0 left) 2026-02-13T18:18:59.590 INFO:tasks.rados.rados.0.trial187.stdout:2916: snap_create 2026-02-13T18:19:00.531 INFO:tasks.rados.rados.0.trial187.stdout:2916: done (0 left) 2026-02-13T18:19:00.531 INFO:tasks.rados.rados.0.trial187.stdout:2917: snap_remove snap 315 2026-02-13T18:19:01.532 INFO:tasks.rados.rados.0.trial187.stdout:2917: done (0 left) 2026-02-13T18:19:01.533 INFO:tasks.rados.rados.0.trial187.stdout:2918: snap_create 2026-02-13T18:19:02.534 INFO:tasks.rados.rados.0.trial187.stdout:2918: done (0 left) 2026-02-13T18:19:02.534 INFO:tasks.rados.rados.0.trial187.stdout:2919: read oid 43 snap -1 2026-02-13T18:19:02.534 INFO:tasks.rados.rados.0.trial187.stdout:2919: expect (ObjNum 983 snap 315 seq_num 983) 2026-02-13T18:19:02.534 INFO:tasks.rados.rados.0.trial187.stdout:2920: write oid 44 current snap is 318 2026-02-13T18:19:02.534 INFO:tasks.rados.rados.0.trial187.stdout:2920: seq_num 985 ranges {554895=729802,1773234=778333} 2026-02-13T18:19:02.542 INFO:tasks.rados.rados.0.trial187.stdout:2920: writing trial18717860-44 from 554895 to 1284697 tid 1 2026-02-13T18:19:02.551 INFO:tasks.rados.rados.0.trial187.stdout:2920: writing trial18717860-44 from 1773234 to 2551567 tid 2 2026-02-13T18:19:02.551 INFO:tasks.rados.rados.0.trial187.stdout:2921: delete oid 32 current snap is 318 2026-02-13T18:19:02.551 INFO:tasks.rados.rados.0.trial187.stdout:2919: expect (ObjNum 983 snap 315 seq_num 983) 2026-02-13T18:19:02.611 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:02.693 INFO:tasks.rados.rados.0.trial187.stdout:2920: finishing write tid 1 to trial18717860-44 2026-02-13T18:19:02.694 INFO:tasks.rados.rados.0.trial187.stdout:2920: finishing write tid 2 to trial18717860-44 2026-02-13T18:19:02.694 INFO:tasks.rados.rados.0.trial187.stdout:2919: done (2 left) 2026-02-13T18:19:02.694 INFO:tasks.rados.rados.0.trial187.stdout:2921: done (1 left) 2026-02-13T18:19:02.694 INFO:tasks.rados.rados.0.trial187.stdout:2922: snap_remove snap 317 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2922: done (1 left) 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2923: read oid 9 snap -1 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2923: expect deleted 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2924: read oid 47 snap 316 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2924: expect deleted 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2925: snap_create 2026-02-13T18:19:03.596 INFO:tasks.rados.rados.0.trial187.stdout:2920: finishing write tid 3 to trial18717860-44 2026-02-13T18:19:03.597 INFO:tasks.rados.rados.0.trial187.stdout:2920: finishing write tid 4 to trial18717860-44 2026-02-13T18:19:03.597 INFO:tasks.rados.rados.0.trial187.stdout:2920: oid 44 updating version 0 to 1939 2026-02-13T18:19:03.597 INFO:tasks.rados.rados.0.trial187.stdout:2920: oid 44 version 1939 is already newer than 1938 2026-02-13T18:19:03.597 INFO:tasks.rados.rados.0.trial187.stdout:2920: oid 44 updating version 1939 to 1940 2026-02-13T18:19:03.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1940 (ObjNum 985 snap 318 seq_num 985) dirty exists 2026-02-13T18:19:03.597 INFO:tasks.rados.rados.0.trial187.stdout:2920: left oid 44 (ObjNum 985 snap 318 seq_num 985) 2026-02-13T18:19:04.598 INFO:tasks.rados.rados.0.trial187.stdout:2920: done (3 left) 2026-02-13T18:19:04.599 INFO:tasks.rados.rados.0.trial187.stdout:2923: done (2 left) 2026-02-13T18:19:04.599 INFO:tasks.rados.rados.0.trial187.stdout:2924: done (1 left) 2026-02-13T18:19:04.599 INFO:tasks.rados.rados.0.trial187.stdout:2925: done (0 left) 2026-02-13T18:19:04.599 INFO:tasks.rados.rados.0.trial187.stdout:2926: snap_remove snap 318 2026-02-13T18:19:05.533 INFO:tasks.rados.rados.0.trial187.stdout:2926: done (0 left) 2026-02-13T18:19:05.533 INFO:tasks.rados.rados.0.trial187.stdout:2927: rollback oid 50 current snap is 319 2026-02-13T18:19:05.533 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 50 to 316 2026-02-13T18:19:05.533 INFO:tasks.rados.rados.0.trial187.stdout:2928: write (excl) oid 40 current snap is 319 2026-02-13T18:19:05.533 INFO:tasks.rados.rados.0.trial187.stdout:2928: seq_num 987 ranges {588509=480300,1773845=782002} 2026-02-13T18:19:05.540 INFO:tasks.rados.rados.0.trial187.stdout:2928: writing trial18717860-40 from 588509 to 1068809 tid 1 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2928: writing trial18717860-40 from 1773845 to 2555847 tid 2 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2929: read oid 30 snap -1 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2929: expect deleted 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2930: read oid 21 snap -1 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2930: expect (ObjNum 931 snap 304 seq_num 931) 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2931: snap_create 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2927: finishing rollback tid 0 to trial18717860-50 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2927: finishing rollback tid 1 to trial18717860-50 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:2927: finishing rollback tid 2 to trial18717860-50 2026-02-13T18:19:05.551 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1418 (ObjNum 909 snap 301 seq_num 909) dirty exists 2026-02-13T18:19:05.552 INFO:tasks.rados.rados.0.trial187.stdout:2928: finishing write tid 1 to trial18717860-40 2026-02-13T18:19:05.553 INFO:tasks.rados.rados.0.trial187.stdout:2928: finishing write tid 2 to trial18717860-40 2026-02-13T18:19:05.553 INFO:tasks.rados.rados.0.trial187.stdout:2928: finishing write tid 3 to trial18717860-40 2026-02-13T18:19:05.554 INFO:tasks.rados.rados.0.trial187.stdout:2928: finishing write tid 4 to trial18717860-40 2026-02-13T18:19:05.554 INFO:tasks.rados.rados.0.trial187.stdout:2928: oid 40 updating version 0 to 1435 2026-02-13T18:19:05.554 INFO:tasks.rados.rados.0.trial187.stdout:2928: oid 40 version 1435 is already newer than 1434 2026-02-13T18:19:05.554 INFO:tasks.rados.rados.0.trial187.stdout:2928: oid 40 updating version 1435 to 1436 2026-02-13T18:19:05.554 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1436 (ObjNum 987 snap 319 seq_num 987) dirty exists 2026-02-13T18:19:05.554 INFO:tasks.rados.rados.0.trial187.stdout:2928: left oid 40 (ObjNum 987 snap 319 seq_num 987) 2026-02-13T18:19:05.555 INFO:tasks.rados.rados.0.trial187.stdout:2930: expect (ObjNum 931 snap 304 seq_num 931) 2026-02-13T18:19:05.580 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3635595 2026-02-13T18:19:06.536 INFO:tasks.rados.rados.0.trial187.stdout:2927: done (4 left) 2026-02-13T18:19:06.536 INFO:tasks.rados.rados.0.trial187.stdout:2928: done (3 left) 2026-02-13T18:19:06.536 INFO:tasks.rados.rados.0.trial187.stdout:2929: done (2 left) 2026-02-13T18:19:06.536 INFO:tasks.rados.rados.0.trial187.stdout:2930: done (1 left) 2026-02-13T18:19:06.536 INFO:tasks.rados.rados.0.trial187.stdout:2931: done (0 left) 2026-02-13T18:19:06.536 INFO:tasks.rados.rados.0.trial187.stdout:2932: delete oid 43 current snap is 320 2026-02-13T18:19:06.540 INFO:tasks.rados.rados.0.trial187.stdout:2932: done (0 left) 2026-02-13T18:19:06.540 INFO:tasks.rados.rados.0.trial187.stdout:2933: write oid 21 current snap is 320 2026-02-13T18:19:06.540 INFO:tasks.rados.rados.0.trial187.stdout:2933: seq_num 989 ranges {622123=747151,2007162=614961} 2026-02-13T18:19:06.550 INFO:tasks.rados.rados.0.trial187.stdout:2933: writing trial18717860-21 from 622123 to 1369274 tid 1 2026-02-13T18:19:06.559 INFO:tasks.rados.rados.0.trial187.stdout:2933: writing trial18717860-21 from 2007162 to 2622123 tid 2 2026-02-13T18:19:06.559 INFO:tasks.rados.rados.0.trial187.stdout:2934: delete oid 43 current snap is 320 2026-02-13T18:19:06.559 INFO:tasks.rados.rados.0.trial187.stdout:2933: finishing write tid 1 to trial18717860-21 2026-02-13T18:19:06.562 INFO:tasks.rados.rados.0.trial187.stdout:2933: finishing write tid 2 to trial18717860-21 2026-02-13T18:19:06.562 INFO:tasks.rados.rados.0.trial187.stdout:2933: finishing write tid 3 to trial18717860-21 2026-02-13T18:19:06.562 INFO:tasks.rados.rados.0.trial187.stdout:2934: done (1 left) 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2935: read oid 1 snap -1 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2935: expect deleted 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2936: snap_create 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2933: finishing write tid 4 to trial18717860-21 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2933: oid 21 updating version 0 to 1149 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2933: oid 21 version 1149 is already newer than 1148 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2933: oid 21 version 1149 is already newer than 1147 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1149 (ObjNum 989 snap 320 seq_num 989) dirty exists 2026-02-13T18:19:06.563 INFO:tasks.rados.rados.0.trial187.stdout:2933: left oid 21 (ObjNum 989 snap 320 seq_num 989) 2026-02-13T18:19:07.540 INFO:tasks.rados.rados.0.trial187.stdout:2933: done (2 left) 2026-02-13T18:19:07.540 INFO:tasks.rados.rados.0.trial187.stdout:2935: done (1 left) 2026-02-13T18:19:07.540 INFO:tasks.rados.rados.0.trial187.stdout:2936: done (0 left) 2026-02-13T18:19:07.541 INFO:tasks.rados.rados.0.trial187.stdout:2937: read oid 15 snap -1 2026-02-13T18:19:07.541 INFO:tasks.rados.rados.0.trial187.stdout:2937: expect (ObjNum 954 snap 311 seq_num 954) 2026-02-13T18:19:07.541 INFO:tasks.rados.rados.0.trial187.stdout:2938: write (excl) oid 47 current snap is 321 2026-02-13T18:19:07.541 INFO:tasks.rados.rados.0.trial187.stdout:2938: seq_num 991 ranges {655737=497649,1607773=789340} 2026-02-13T18:19:07.547 INFO:tasks.rados.rados.0.trial187.stdout:2938: writing trial18717860-47 from 655737 to 1153386 tid 1 2026-02-13T18:19:07.556 INFO:tasks.rados.rados.0.trial187.stdout:2938: writing trial18717860-47 from 1607773 to 2397113 tid 2 2026-02-13T18:19:07.557 INFO:tasks.rados.rados.0.trial187.stdout:2939: rollback oid 18 current snap is 321 2026-02-13T18:19:07.557 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 320 2026-02-13T18:19:07.557 INFO:tasks.rados.rados.0.trial187.stdout:2940: write (excl) oid 2 current snap is 321 2026-02-13T18:19:07.557 INFO:tasks.rados.rados.0.trial187.stdout:2940: seq_num 992 ranges {672544=572898,1666255=532998} 2026-02-13T18:19:07.564 INFO:tasks.rados.rados.0.trial187.stdout:2940: writing trial18717860-2 from 672544 to 1245442 tid 1 2026-02-13T18:19:07.571 INFO:tasks.rados.rados.0.trial187.stdout:2940: writing trial18717860-2 from 1666255 to 2199253 tid 2 2026-02-13T18:19:07.571 INFO:tasks.rados.rados.0.trial187.stdout:2941: write oid 42 current snap is 321 2026-02-13T18:19:07.571 INFO:tasks.rados.rados.0.trial187.stdout:2941: seq_num 993 ranges {689351=648147,2124737=564614} 2026-02-13T18:19:07.579 INFO:tasks.rados.rados.0.trial187.stdout:2941: writing trial18717860-42 from 689351 to 1337498 tid 1 2026-02-13T18:19:07.588 INFO:tasks.rados.rados.0.trial187.stdout:2941: writing trial18717860-42 from 2124737 to 2689351 tid 2 2026-02-13T18:19:07.588 INFO:tasks.rados.rados.0.trial187.stdout:2942: read oid 46 snap 316 2026-02-13T18:19:07.588 INFO:tasks.rados.rados.0.trial187.stdout:2942: expect (ObjNum 962 snap 312 seq_num 962) 2026-02-13T18:19:07.588 INFO:tasks.rados.rados.0.trial187.stdout:2943: snap_create 2026-02-13T18:19:07.589 INFO:tasks.rados.rados.0.trial187.stdout:2937: expect (ObjNum 954 snap 311 seq_num 954) 2026-02-13T18:19:07.589 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:07.638 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1337540 2026-02-13T18:19:07.653 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:07.679 INFO:tasks.rados.rados.0.trial187.stdout:2938: finishing write tid 1 to trial18717860-47 2026-02-13T18:19:07.679 INFO:tasks.rados.rados.0.trial187.stdout:2939: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: finishing write tid 2 to trial18717860-47 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: finishing write tid 3 to trial18717860-47 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: finishing write tid 4 to trial18717860-47 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: oid 47 updating version 0 to 1612 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: oid 47 updating version 1612 to 1614 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: oid 47 version 1614 is already newer than 1613 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1614 (ObjNum 991 snap 321 seq_num 991) dirty exists 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2938: left oid 47 (ObjNum 991 snap 321 seq_num 991) 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2940: finishing write tid 1 to trial18717860-2 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2940: finishing write tid 2 to trial18717860-2 2026-02-13T18:19:07.680 INFO:tasks.rados.rados.0.trial187.stdout:2940: finishing write tid 3 to trial18717860-2 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2940: finishing write tid 4 to trial18717860-2 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2940: oid 2 updating version 0 to 1202 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2940: oid 2 version 1202 is already newer than 1201 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2940: oid 2 updating version 1202 to 1203 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1203 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2940: left oid 2 (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: finishing write tid 1 to trial18717860-42 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: finishing write tid 2 to trial18717860-42 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: finishing write tid 3 to trial18717860-42 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: finishing write tid 4 to trial18717860-42 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: oid 42 updating version 0 to 1421 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: oid 42 version 1421 is already newer than 1420 2026-02-13T18:19:07.681 INFO:tasks.rados.rados.0.trial187.stdout:2941: oid 42 version 1421 is already newer than 1419 2026-02-13T18:19:07.682 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1421 (ObjNum 993 snap 321 seq_num 993) dirty exists 2026-02-13T18:19:07.682 INFO:tasks.rados.rados.0.trial187.stdout:2941: left oid 42 (ObjNum 993 snap 321 seq_num 993) 2026-02-13T18:19:07.682 INFO:tasks.rados.rados.0.trial187.stdout:2942: expect (ObjNum 962 snap 312 seq_num 962) 2026-02-13T18:19:07.682 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:07.697 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1419372 2026-02-13T18:19:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2937: done (6 left) 2026-02-13T18:19:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2938: done (5 left) 2026-02-13T18:19:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2939: done (4 left) 2026-02-13T18:19:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2940: done (3 left) 2026-02-13T18:19:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2941: done (2 left) 2026-02-13T18:19:08.544 INFO:tasks.rados.rados.0.trial187.stdout:2942: done (1 left) 2026-02-13T18:19:08.545 INFO:tasks.rados.rados.0.trial187.stdout:2943: done (0 left) 2026-02-13T18:19:08.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: write (excl) oid 17 current snap is 322 2026-02-13T18:19:08.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: seq_num 994 ranges {706158=723396,2183219=522939} 2026-02-13T18:19:08.550 INFO:tasks.rados.rados.0.trial187.stdout:2944: writing trial18717860-17 from 706158 to 1429554 tid 1 2026-02-13T18:19:08.555 INFO:tasks.rados.rados.0.trial187.stdout:2944: writing trial18717860-17 from 2183219 to 2706158 tid 2 2026-02-13T18:19:08.555 INFO:tasks.rados.rados.0.trial187.stdout:2945: snap_remove snap 320 2026-02-13T18:19:09.544 INFO:tasks.rados.rados.0.trial187.stdout:2945: done (1 left) 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2946: delete oid 30 current snap is 322 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: finishing write tid 1 to trial18717860-17 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: finishing write tid 2 to trial18717860-17 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: finishing write tid 3 to trial18717860-17 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: finishing write tid 4 to trial18717860-17 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: oid 17 updating version 0 to 1573 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: oid 17 updating version 1573 to 1575 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:2944: oid 17 version 1575 is already newer than 1574 2026-02-13T18:19:09.545 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1575 (ObjNum 994 snap 322 seq_num 994) dirty exists 2026-02-13T18:19:09.546 INFO:tasks.rados.rados.0.trial187.stdout:2944: left oid 17 (ObjNum 994 snap 322 seq_num 994) 2026-02-13T18:19:09.548 INFO:tasks.rados.rados.0.trial187.stdout:2944: done (1 left) 2026-02-13T18:19:09.548 INFO:tasks.rados.rados.0.trial187.stdout:2946: done (0 left) 2026-02-13T18:19:09.548 INFO:tasks.rados.rados.0.trial187.stdout:2947: read oid 28 snap -1 2026-02-13T18:19:09.548 INFO:tasks.rados.rados.0.trial187.stdout:2947: expect deleted 2026-02-13T18:19:09.548 INFO:tasks.rados.rados.0.trial187.stdout:2948: rollback oid 17 current snap is 322 2026-02-13T18:19:09.548 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 321 2026-02-13T18:19:09.549 INFO:tasks.rados.rados.0.trial187.stdout:2949: delete oid 10 current snap is 322 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:2948: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:2948: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:2948: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1580 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:2947: done (2 left) 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:2948: done (1 left) 2026-02-13T18:19:09.551 INFO:tasks.rados.rados.0.trial187.stdout:2949: done (0 left) 2026-02-13T18:19:09.552 INFO:tasks.rados.rados.0.trial187.stdout:2950: snap_create 2026-02-13T18:19:10.534 INFO:tasks.rados.rados.0.trial187.stdout:2950: done (0 left) 2026-02-13T18:19:10.534 INFO:tasks.rados.rados.0.trial187.stdout:2951: delete oid 38 current snap is 323 2026-02-13T18:19:10.536 INFO:tasks.rados.rados.0.trial187.stdout:2951: done (0 left) 2026-02-13T18:19:10.536 INFO:tasks.rados.rados.0.trial187.stdout:2952: read oid 35 snap -1 2026-02-13T18:19:10.536 INFO:tasks.rados.rados.0.trial187.stdout:2952: expect (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:19:10.536 INFO:tasks.rados.rados.0.trial187.stdout:2953: write (excl) oid 44 current snap is 323 2026-02-13T18:19:10.537 INFO:tasks.rados.rados.0.trial187.stdout:2953: seq_num 998 ranges {773386=740745,2017147=544005} 2026-02-13T18:19:10.546 INFO:tasks.rados.rados.0.trial187.stdout:2953: writing trial18717860-44 from 773386 to 1514131 tid 1 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2953: writing trial18717860-44 from 2017147 to 2561152 tid 2 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2954: read oid 33 snap -1 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2954: expect (ObjNum 950 snap 311 seq_num 950) 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2955: read oid 18 snap -1 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2955: expect deleted 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2956: read oid 32 snap -1 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2956: expect deleted 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2957: snap_create 2026-02-13T18:19:10.554 INFO:tasks.rados.rados.0.trial187.stdout:2952: expect (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:19:10.585 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2320772 2026-02-13T18:19:10.644 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:10.685 INFO:tasks.rados.rados.0.trial187.stdout:2953: finishing write tid 1 to trial18717860-44 2026-02-13T18:19:10.685 INFO:tasks.rados.rados.0.trial187.stdout:2953: finishing write tid 2 to trial18717860-44 2026-02-13T18:19:10.685 INFO:tasks.rados.rados.0.trial187.stdout:2953: finishing write tid 3 to trial18717860-44 2026-02-13T18:19:10.685 INFO:tasks.rados.rados.0.trial187.stdout:2953: finishing write tid 4 to trial18717860-44 2026-02-13T18:19:10.686 INFO:tasks.rados.rados.0.trial187.stdout:2953: oid 44 updating version 0 to 1947 2026-02-13T18:19:10.686 INFO:tasks.rados.rados.0.trial187.stdout:2953: oid 44 updating version 1947 to 1948 2026-02-13T18:19:10.686 INFO:tasks.rados.rados.0.trial187.stdout:2953: oid 44 updating version 1948 to 1949 2026-02-13T18:19:10.686 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1949 (ObjNum 998 snap 323 seq_num 998) dirty exists 2026-02-13T18:19:10.686 INFO:tasks.rados.rados.0.trial187.stdout:2953: left oid 44 (ObjNum 998 snap 323 seq_num 998) 2026-02-13T18:19:10.686 INFO:tasks.rados.rados.0.trial187.stdout:2954: expect (ObjNum 950 snap 311 seq_num 950) 2026-02-13T18:19:10.722 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:10.769 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1698722 2026-02-13T18:19:11.553 INFO:tasks.rados.rados.0.trial187.stdout:2952: done (5 left) 2026-02-13T18:19:11.553 INFO:tasks.rados.rados.0.trial187.stdout:2953: done (4 left) 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2954: done (3 left) 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2955: done (2 left) 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2956: done (1 left) 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2957: done (0 left) 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2958: rollback oid 37 current snap is 324 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 319 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2959: rollback oid 18 current snap is 324 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 319 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2960: read oid 26 snap -1 2026-02-13T18:19:11.554 INFO:tasks.rados.rados.0.trial187.stdout:2960: expect (ObjNum 965 snap 312 seq_num 965) 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:2961: read oid 31 snap -1 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:2961: expect deleted 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:2962: rollback oid 16 current snap is 324 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 321 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:2963: delete oid 28 current snap is 324 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:2962: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:19:11.555 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:19:11.556 INFO:tasks.rados.rados.0.trial187.stdout:2958: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:19:11.556 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:19:11.556 INFO:tasks.rados.rados.0.trial187.stdout:2958: done (5 left) 2026-02-13T18:19:11.556 INFO:tasks.rados.rados.0.trial187.stdout:2961: done (4 left) 2026-02-13T18:19:11.556 INFO:tasks.rados.rados.0.trial187.stdout:2962: done (3 left) 2026-02-13T18:19:11.557 INFO:tasks.rados.rados.0.trial187.stdout:2963: done (2 left) 2026-02-13T18:19:11.557 INFO:tasks.rados.rados.0.trial187.stdout:2964: read oid 4 snap -1 2026-02-13T18:19:11.557 INFO:tasks.rados.rados.0.trial187.stdout:2964: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:19:11.557 INFO:tasks.rados.rados.0.trial187.stdout:2965: snap_remove snap 316 2026-02-13T18:19:12.556 INFO:tasks.rados.rados.0.trial187.stdout:2965: done (3 left) 2026-02-13T18:19:12.556 INFO:tasks.rados.rados.0.trial187.stdout:2966: copy_from oid 42 from oid 11 current snap is 324 2026-02-13T18:19:12.556 INFO:tasks.rados.rados.0.trial187.stdout:2960: expect (ObjNum 965 snap 312 seq_num 965) 2026-02-13T18:19:12.559 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1515327 2026-02-13T18:19:12.567 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:12.596 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1167576 2026-02-13T18:19:12.607 INFO:tasks.rados.rados.0.trial187.stdout:2959: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:19:12.607 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 0 (ObjNum 81 snap 0 seq_num 4017029163) dirty dne 2026-02-13T18:19:12.607 INFO:tasks.rados.rados.0.trial187.stdout:2964: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:19:12.607 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:12.634 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:12.669 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2050303 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2966: finishing copy_from racing read to trial18717860-42 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2966: finishing copy_from to trial18717860-42 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1437 (ObjNum 870 snap 287 seq_num 870) dirty exists 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2959: done (3 left) 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2960: done (2 left) 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2964: done (1 left) 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2966: done (0 left) 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2967: copy_from oid 15 from oid 5 current snap is 324 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2968: write (excl) oid 36 current snap is 324 2026-02-13T18:19:12.680 INFO:tasks.rados.rados.0.trial187.stdout:2968: seq_num 1000 ranges {407000=491243,1617758=547674,2595228=211772} 2026-02-13T18:19:12.686 INFO:tasks.rados.rados.0.trial187.stdout:2968: writing trial18717860-36 from 407000 to 898243 tid 1 2026-02-13T18:19:12.695 INFO:tasks.rados.rados.0.trial187.stdout:2968: writing trial18717860-36 from 1617758 to 2165432 tid 2 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2968: writing trial18717860-36 from 2595228 to 2807000 tid 3 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2969: rollback oid 21 current snap is 324 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 322 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2967: finishing copy_from racing read to trial18717860-15 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2968: finishing write tid 1 to trial18717860-36 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2967: finishing copy_from to trial18717860-15 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1415 (ObjNum 909 snap 301 seq_num 909) dirty exists 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2968: finishing write tid 2 to trial18717860-36 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2967: done (2 left) 2026-02-13T18:19:12.700 INFO:tasks.rados.rados.0.trial187.stdout:2970: snap_create 2026-02-13T18:19:12.701 INFO:tasks.rados.rados.0.trial187.stdout:2968: finishing write tid 3 to trial18717860-36 2026-02-13T18:19:12.701 INFO:tasks.rados.rados.0.trial187.stdout:2968: finishing write tid 4 to trial18717860-36 2026-02-13T18:19:12.701 INFO:tasks.rados.rados.0.trial187.stdout:2968: finishing write tid 5 to trial18717860-36 2026-02-13T18:19:12.701 INFO:tasks.rados.rados.0.trial187.stdout:2968: oid 36 updating version 0 to 1073 2026-02-13T18:19:12.702 INFO:tasks.rados.rados.0.trial187.stdout:2968: oid 36 version 1073 is already newer than 1072 2026-02-13T18:19:12.702 INFO:tasks.rados.rados.0.trial187.stdout:2968: oid 36 version 1073 is already newer than 1070 2026-02-13T18:19:12.702 INFO:tasks.rados.rados.0.trial187.stdout:2968: oid 36 version 1073 is already newer than 1071 2026-02-13T18:19:12.702 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1073 (ObjNum 1000 snap 324 seq_num 1000) dirty exists 2026-02-13T18:19:12.702 INFO:tasks.rados.rados.0.trial187.stdout:2968: left oid 36 (ObjNum 1000 snap 324 seq_num 1000) 2026-02-13T18:19:12.703 INFO:tasks.rados.rados.0.trial187.stdout:2969: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:19:12.703 INFO:tasks.rados.rados.0.trial187.stdout:2969: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:19:12.703 INFO:tasks.rados.rados.0.trial187.stdout:2969: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:19:12.704 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1155 (ObjNum 989 snap 320 seq_num 989) dirty exists 2026-02-13T18:19:13.556 INFO:tasks.rados.rados.0.trial187.stdout:2968: done (2 left) 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2969: done (1 left) 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2970: done (0 left) 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2971: read oid 22 snap -1 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2971: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2972: copy_from oid 48 from oid 7 current snap is 325 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2973: rollback oid 16 current snap is 325 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 319 2026-02-13T18:19:13.557 INFO:tasks.rados.rados.0.trial187.stdout:2974: copy_from oid 33 from oid 21 current snap is 325 2026-02-13T18:19:13.558 INFO:tasks.rados.rados.0.trial187.stdout:2975: snap_create 2026-02-13T18:19:13.559 INFO:tasks.rados.rados.0.trial187.stdout:2973: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:19:13.559 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:19:13.564 INFO:tasks.rados.rados.0.trial187.stdout:2971: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:19:13.583 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1151584 2026-02-13T18:19:13.725 INFO:tasks.rados.rados.0.trial187.stdout:2974: finishing copy_from racing read to trial18717860-33 2026-02-13T18:19:13.725 INFO:tasks.rados.rados.0.trial187.stdout:2972: finishing copy_from racing read to trial18717860-48 2026-02-13T18:19:13.726 INFO:tasks.rados.rados.0.trial187.stdout:2972: finishing copy_from to trial18717860-48 2026-02-13T18:19:13.726 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1098 (ObjNum 914 snap 301 seq_num 914) dirty exists 2026-02-13T18:19:13.726 INFO:tasks.rados.rados.0.trial187.stdout:2974: finishing copy_from to trial18717860-33 2026-02-13T18:19:13.726 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1155 (ObjNum 989 snap 320 seq_num 989) dirty exists 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2971: done (4 left) 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2972: done (3 left) 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2973: done (2 left) 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2974: done (1 left) 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2975: done (0 left) 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2976: write (excl) oid 48 current snap is 326 2026-02-13T18:19:14.558 INFO:tasks.rados.rados.0.trial187.stdout:2976: seq_num 1001 ranges {423807=566492,1676240=407685,2739004=84803} 2026-02-13T18:19:14.564 INFO:tasks.rados.rados.0.trial187.stdout:2976: writing trial18717860-48 from 423807 to 990299 tid 1 2026-02-13T18:19:14.572 INFO:tasks.rados.rados.0.trial187.stdout:2976: writing trial18717860-48 from 1676240 to 2083925 tid 2 2026-02-13T18:19:14.577 INFO:tasks.rados.rados.0.trial187.stdout:2976: writing trial18717860-48 from 2739004 to 2823807 tid 3 2026-02-13T18:19:14.577 INFO:tasks.rados.rados.0.trial187.stdout:2977: delete oid 11 current snap is 326 2026-02-13T18:19:14.577 INFO:tasks.rados.rados.0.trial187.stdout:2976: finishing write tid 1 to trial18717860-48 2026-02-13T18:19:14.577 INFO:tasks.rados.rados.0.trial187.stdout:2976: finishing write tid 2 to trial18717860-48 2026-02-13T18:19:14.579 INFO:tasks.rados.rados.0.trial187.stdout:2976: finishing write tid 3 to trial18717860-48 2026-02-13T18:19:14.579 INFO:tasks.rados.rados.0.trial187.stdout:2976: finishing write tid 4 to trial18717860-48 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:2976: finishing write tid 5 to trial18717860-48 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:2976: oid 48 updating version 0 to 1962 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:2976: oid 48 version 1962 is already newer than 1961 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:2976: oid 48 version 1962 is already newer than 1960 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:2976: oid 48 version 1962 is already newer than 1959 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1962 (ObjNum 1001 snap 326 seq_num 1001) dirty exists 2026-02-13T18:19:14.580 INFO:tasks.rados.rados.0.trial187.stdout:2976: left oid 48 (ObjNum 1001 snap 326 seq_num 1001) 2026-02-13T18:19:14.581 INFO:tasks.rados.rados.0.trial187.stdout:2976: done (1 left) 2026-02-13T18:19:14.581 INFO:tasks.rados.rados.0.trial187.stdout:2977: done (0 left) 2026-02-13T18:19:14.581 INFO:tasks.rados.rados.0.trial187.stdout:2978: write oid 47 current snap is 326 2026-02-13T18:19:14.581 INFO:tasks.rados.rados.0.trial187.stdout:2978: seq_num 1003 ranges {457421=716990,1676851=411354,2677497=179924} 2026-02-13T18:19:14.588 INFO:tasks.rados.rados.0.trial187.stdout:2978: writing trial18717860-47 from 457421 to 1174411 tid 1 2026-02-13T18:19:14.595 INFO:tasks.rados.rados.0.trial187.stdout:2978: writing trial18717860-47 from 1676851 to 2088205 tid 2 2026-02-13T18:19:14.600 INFO:tasks.rados.rados.0.trial187.stdout:2978: writing trial18717860-47 from 2677497 to 2857421 tid 3 2026-02-13T18:19:14.600 INFO:tasks.rados.rados.0.trial187.stdout:2979: read oid 45 snap -1 2026-02-13T18:19:14.600 INFO:tasks.rados.rados.0.trial187.stdout:2979: expect (ObjNum 944 snap 307 seq_num 944) 2026-02-13T18:19:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2980: delete oid 18 current snap is 326 2026-02-13T18:19:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2978: finishing write tid 1 to trial18717860-47 2026-02-13T18:19:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2978: finishing write tid 2 to trial18717860-47 2026-02-13T18:19:14.601 INFO:tasks.rados.rados.0.trial187.stdout:2978: finishing write tid 3 to trial18717860-47 2026-02-13T18:19:14.602 INFO:tasks.rados.rados.0.trial187.stdout:2978: finishing write tid 4 to trial18717860-47 2026-02-13T18:19:14.602 INFO:tasks.rados.rados.0.trial187.stdout:2978: finishing write tid 5 to trial18717860-47 2026-02-13T18:19:14.602 INFO:tasks.rados.rados.0.trial187.stdout:2978: oid 47 updating version 0 to 1617 2026-02-13T18:19:14.602 INFO:tasks.rados.rados.0.trial187.stdout:2978: oid 47 updating version 1617 to 1618 2026-02-13T18:19:14.603 INFO:tasks.rados.rados.0.trial187.stdout:2978: oid 47 version 1618 is already newer than 1615 2026-02-13T18:19:14.603 INFO:tasks.rados.rados.0.trial187.stdout:2978: oid 47 version 1618 is already newer than 1616 2026-02-13T18:19:14.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1618 (ObjNum 1003 snap 326 seq_num 1003) dirty exists 2026-02-13T18:19:14.603 INFO:tasks.rados.rados.0.trial187.stdout:2978: left oid 47 (ObjNum 1003 snap 326 seq_num 1003) 2026-02-13T18:19:14.604 INFO:tasks.rados.rados.0.trial187.stdout:2979: expect (ObjNum 944 snap 307 seq_num 944) 2026-02-13T18:19:14.702 INFO:tasks.rados.rados.0.trial187.stdout:2978: done (2 left) 2026-02-13T18:19:14.702 INFO:tasks.rados.rados.0.trial187.stdout:2979: done (1 left) 2026-02-13T18:19:14.702 INFO:tasks.rados.rados.0.trial187.stdout:2980: done (0 left) 2026-02-13T18:19:14.702 INFO:tasks.rados.rados.0.trial187.stdout:2981: copy_from oid 15 from oid 30 current snap is 326 2026-02-13T18:19:14.702 INFO:tasks.rados.rados.0.trial187.stdout:2982: write oid 38 current snap is 326 2026-02-13T18:19:14.702 INFO:tasks.rados.rados.0.trial187.stdout:2982: seq_num 1005 ranges {491035=583841,1510168=698670,2732343=158692} 2026-02-13T18:19:14.709 INFO:tasks.rados.rados.0.trial187.stdout:2982: writing trial18717860-38 from 491035 to 1074876 tid 1 2026-02-13T18:19:14.717 INFO:tasks.rados.rados.0.trial187.stdout:2982: writing trial18717860-38 from 1510168 to 2208838 tid 2 2026-02-13T18:19:14.722 INFO:tasks.rados.rados.0.trial187.stdout:2982: writing trial18717860-38 from 2732343 to 2891035 tid 3 2026-02-13T18:19:14.722 INFO:tasks.rados.rados.0.trial187.stdout:2983: rollback oid 39 current snap is 326 2026-02-13T18:19:14.722 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 325 2026-02-13T18:19:14.722 INFO:tasks.rados.rados.0.trial187.stdout:2981: finishing copy_from to trial18717860-15 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2981: got expected ENOENT (src dne) 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2981: finishing copy_from racing read to trial18717860-15 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2982: finishing write tid 1 to trial18717860-38 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2982: finishing write tid 2 to trial18717860-38 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2981: done (2 left) 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2984: write oid 23 current snap is 326 2026-02-13T18:19:14.723 INFO:tasks.rados.rados.0.trial187.stdout:2984: seq_num 1006 ranges {507842=659090,1568650=558681,2759766=148076} 2026-02-13T18:19:14.730 INFO:tasks.rados.rados.0.trial187.stdout:2984: writing trial18717860-23 from 507842 to 1166932 tid 1 2026-02-13T18:19:14.736 INFO:tasks.rados.rados.0.trial187.stdout:2984: writing trial18717860-23 from 1568650 to 2127331 tid 2 2026-02-13T18:19:14.742 INFO:tasks.rados.rados.0.trial187.stdout:2984: writing trial18717860-23 from 2759766 to 2907842 tid 3 2026-02-13T18:19:14.742 INFO:tasks.rados.rados.0.trial187.stdout:2985: delete oid 41 current snap is 326 2026-02-13T18:19:14.742 INFO:tasks.rados.rados.0.trial187.stdout:2983: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:19:14.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: finishing write tid 3 to trial18717860-38 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: finishing write tid 4 to trial18717860-38 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: finishing write tid 5 to trial18717860-38 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: oid 38 updating version 0 to 1805 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: oid 38 updating version 1805 to 1806 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: oid 38 version 1806 is already newer than 1804 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: oid 38 updating version 1806 to 1807 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1807 (ObjNum 1005 snap 326 seq_num 1005) dirty exists 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2982: left oid 38 (ObjNum 1005 snap 326 seq_num 1005) 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2984: finishing write tid 1 to trial18717860-23 2026-02-13T18:19:14.743 INFO:tasks.rados.rados.0.trial187.stdout:2984: finishing write tid 2 to trial18717860-23 2026-02-13T18:19:14.744 INFO:tasks.rados.rados.0.trial187.stdout:2982: done (3 left) 2026-02-13T18:19:14.744 INFO:tasks.rados.rados.0.trial187.stdout:2983: done (2 left) 2026-02-13T18:19:14.744 INFO:tasks.rados.rados.0.trial187.stdout:2985: done (1 left) 2026-02-13T18:19:14.744 INFO:tasks.rados.rados.0.trial187.stdout:2986: write (excl) oid 28 current snap is 326 2026-02-13T18:19:14.744 INFO:tasks.rados.rados.0.trial187.stdout:2986: seq_num 1008 ranges {541456=409588,1569261=562350,2814612=126844} 2026-02-13T18:19:14.750 INFO:tasks.rados.rados.0.trial187.stdout:2986: writing trial18717860-28 from 541456 to 951044 tid 1 2026-02-13T18:19:14.757 INFO:tasks.rados.rados.0.trial187.stdout:2986: writing trial18717860-28 from 1569261 to 2131611 tid 2 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2986: writing trial18717860-28 from 2814612 to 2941456 tid 3 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2987: snap_create 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: finishing write tid 3 to trial18717860-23 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: finishing write tid 4 to trial18717860-23 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: finishing write tid 5 to trial18717860-23 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: oid 23 updating version 0 to 1076 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: oid 23 version 1076 is already newer than 1074 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: oid 23 updating version 1076 to 1077 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:2984: oid 23 version 1077 is already newer than 1075 2026-02-13T18:19:14.762 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1077 (ObjNum 1006 snap 326 seq_num 1006) dirty exists 2026-02-13T18:19:14.763 INFO:tasks.rados.rados.0.trial187.stdout:2984: left oid 23 (ObjNum 1006 snap 326 seq_num 1006) 2026-02-13T18:19:14.763 INFO:tasks.rados.rados.0.trial187.stdout:2986: finishing write tid 1 to trial18717860-28 2026-02-13T18:19:14.763 INFO:tasks.rados.rados.0.trial187.stdout:2986: finishing write tid 2 to trial18717860-28 2026-02-13T18:19:14.763 INFO:tasks.rados.rados.0.trial187.stdout:2986: finishing write tid 3 to trial18717860-28 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: finishing write tid 4 to trial18717860-28 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: finishing write tid 5 to trial18717860-28 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: oid 28 updating version 0 to 1619 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: oid 28 updating version 1619 to 1620 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: oid 28 version 1620 is already newer than 1617 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: oid 28 version 1620 is already newer than 1618 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1620 (ObjNum 1008 snap 326 seq_num 1008) dirty exists 2026-02-13T18:19:14.764 INFO:tasks.rados.rados.0.trial187.stdout:2986: left oid 28 (ObjNum 1008 snap 326 seq_num 1008) 2026-02-13T18:19:15.535 INFO:tasks.rados.rados.0.trial187.stdout:2984: done (2 left) 2026-02-13T18:19:15.536 INFO:tasks.rados.rados.0.trial187.stdout:2986: done (1 left) 2026-02-13T18:19:15.536 INFO:tasks.rados.rados.0.trial187.stdout:2987: done (0 left) 2026-02-13T18:19:15.536 INFO:tasks.rados.rados.0.trial187.stdout:2988: read oid 3 snap 324 2026-02-13T18:19:15.536 INFO:tasks.rados.rados.0.trial187.stdout:2988: expect (ObjNum 970 snap 312 seq_num 970) 2026-02-13T18:19:15.536 INFO:tasks.rados.rados.0.trial187.stdout:2989: copy_from oid 49 from oid 25 current snap is 327 2026-02-13T18:19:15.536 INFO:tasks.rados.rados.0.trial187.stdout:2990: snap_create 2026-02-13T18:19:15.539 INFO:tasks.rados.rados.0.trial187.stdout:2988: expect (ObjNum 970 snap 312 seq_num 970) 2026-02-13T18:19:15.560 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 347299 2026-02-13T18:19:15.591 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1222771 2026-02-13T18:19:15.602 INFO:tasks.rados.rados.0.trial187.stdout:2989: finishing copy_from racing read to trial18717860-49 2026-02-13T18:19:15.603 INFO:tasks.rados.rados.0.trial187.stdout:2989: finishing copy_from to trial18717860-49 2026-02-13T18:19:15.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1014 (ObjNum 781 snap 267 seq_num 781) dirty exists 2026-02-13T18:19:16.535 INFO:tasks.rados.rados.0.trial187.stdout:2988: done (2 left) 2026-02-13T18:19:16.536 INFO:tasks.rados.rados.0.trial187.stdout:2989: done (1 left) 2026-02-13T18:19:16.536 INFO:tasks.rados.rados.0.trial187.stdout:2990: done (0 left) 2026-02-13T18:19:16.536 INFO:tasks.rados.rados.0.trial187.stdout:2991: snap_remove snap 325 2026-02-13T18:19:17.536 INFO:tasks.rados.rados.0.trial187.stdout:2991: done (0 left) 2026-02-13T18:19:17.537 INFO:tasks.rados.rados.0.trial187.stdout:2992: delete oid 28 current snap is 328 2026-02-13T18:19:17.550 INFO:tasks.rados.rados.0.trial187.stdout:2992: done (0 left) 2026-02-13T18:19:17.550 INFO:tasks.rados.rados.0.trial187.stdout:2993: write oid 27 current snap is 328 2026-02-13T18:19:17.551 INFO:tasks.rados.rados.0.trial187.stdout:2993: seq_num 1010 ranges {575070=560086,1686225=566019,2869458=105612} 2026-02-13T18:19:17.558 INFO:tasks.rados.rados.0.trial187.stdout:2993: writing trial18717860-27 from 575070 to 1135156 tid 1 2026-02-13T18:19:17.566 INFO:tasks.rados.rados.0.trial187.stdout:2993: writing trial18717860-27 from 1686225 to 2252244 tid 2 2026-02-13T18:19:17.571 INFO:tasks.rados.rados.0.trial187.stdout:2993: writing trial18717860-27 from 2869458 to 2975070 tid 3 2026-02-13T18:19:17.571 INFO:tasks.rados.rados.0.trial187.stdout:2994: read oid 2 snap -1 2026-02-13T18:19:17.571 INFO:tasks.rados.rados.0.trial187.stdout:2994: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:19:17.571 INFO:tasks.rados.rados.0.trial187.stdout:2995: snap_create 2026-02-13T18:19:17.571 INFO:tasks.rados.rados.0.trial187.stdout:2993: finishing write tid 1 to trial18717860-27 2026-02-13T18:19:17.572 INFO:tasks.rados.rados.0.trial187.stdout:2993: finishing write tid 2 to trial18717860-27 2026-02-13T18:19:17.575 INFO:tasks.rados.rados.0.trial187.stdout:2993: finishing write tid 3 to trial18717860-27 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: finishing write tid 4 to trial18717860-27 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: finishing write tid 5 to trial18717860-27 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: oid 27 updating version 0 to 1024 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: oid 27 version 1024 is already newer than 1022 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: oid 27 version 1024 is already newer than 1021 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: oid 27 version 1024 is already newer than 1023 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1024 (ObjNum 1010 snap 328 seq_num 1010) dirty exists 2026-02-13T18:19:17.576 INFO:tasks.rados.rados.0.trial187.stdout:2993: left oid 27 (ObjNum 1010 snap 328 seq_num 1010) 2026-02-13T18:19:17.578 INFO:tasks.rados.rados.0.trial187.stdout:2994: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:19:17.578 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:18.542 INFO:tasks.rados.rados.0.trial187.stdout:2993: done (2 left) 2026-02-13T18:19:18.542 INFO:tasks.rados.rados.0.trial187.stdout:2994: done (1 left) 2026-02-13T18:19:18.542 INFO:tasks.rados.rados.0.trial187.stdout:2995: done (0 left) 2026-02-13T18:19:18.542 INFO:tasks.rados.rados.0.trial187.stdout:2996: read oid 40 snap -1 2026-02-13T18:19:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2996: expect (ObjNum 987 snap 319 seq_num 987) 2026-02-13T18:19:18.543 INFO:tasks.rados.rados.0.trial187.stdout:2997: snap_create 2026-02-13T18:19:18.550 INFO:tasks.rados.rados.0.trial187.stdout:2996: expect (ObjNum 987 snap 319 seq_num 987) 2026-02-13T18:19:18.550 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:18.614 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:19.542 INFO:tasks.rados.rados.0.trial187.stdout:2996: done (1 left) 2026-02-13T18:19:19.542 INFO:tasks.rados.rados.0.trial187.stdout:2997: done (0 left) 2026-02-13T18:19:19.542 INFO:tasks.rados.rados.0.trial187.stdout:2998: write oid 30 current snap is 330 2026-02-13T18:19:19.543 INFO:tasks.rados.rados.0.trial187.stdout:2998: seq_num 1011 ranges {591877=635335,1628354=709677} 2026-02-13T18:19:19.550 INFO:tasks.rados.rados.0.trial187.stdout:2998: writing trial18717860-30 from 591877 to 1227212 tid 1 2026-02-13T18:19:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2998: writing trial18717860-30 from 1628354 to 2338031 tid 2 2026-02-13T18:19:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2999: read oid 17 snap 324 2026-02-13T18:19:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2999: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:19:19.558 INFO:tasks.rados.rados.0.trial187.stdout:3000: delete oid 14 current snap is 330 2026-02-13T18:19:19.558 INFO:tasks.rados.rados.0.trial187.stdout:2998: finishing write tid 1 to trial18717860-30 2026-02-13T18:19:19.561 INFO:tasks.rados.rados.0.trial187.stdout:2998: finishing write tid 2 to trial18717860-30 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: finishing write tid 3 to trial18717860-30 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: finishing write tid 4 to trial18717860-30 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: oid 30 updating version 0 to 1052 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: oid 30 updating version 1052 to 1053 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: oid 30 version 1053 is already newer than 1051 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1053 (ObjNum 1011 snap 330 seq_num 1011) dirty exists 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: left oid 30 (ObjNum 1011 snap 330 seq_num 1011) 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:2998: done (2 left) 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:3000: done (1 left) 2026-02-13T18:19:19.562 INFO:tasks.rados.rados.0.trial187.stdout:3001: delete oid 26 current snap is 330 2026-02-13T18:19:19.563 INFO:tasks.rados.rados.0.trial187.stdout:2999: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:19:19.563 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:19.594 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 925256 2026-02-13T18:19:19.631 INFO:tasks.rados.rados.0.trial187.stdout:2999: done (1 left) 2026-02-13T18:19:19.632 INFO:tasks.rados.rados.0.trial187.stdout:3001: done (0 left) 2026-02-13T18:19:19.632 INFO:tasks.rados.rados.0.trial187.stdout:3002: rollback oid 29 current snap is 330 2026-02-13T18:19:19.632 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 328 2026-02-13T18:19:19.632 INFO:tasks.rados.rados.0.trial187.stdout:3003: write oid 3 current snap is 330 2026-02-13T18:19:19.632 INFO:tasks.rados.rados.0.trial187.stdout:3003: seq_num 1014 ranges {642298=577435,1920153=573357,2979150=63148} 2026-02-13T18:19:19.639 INFO:tasks.rados.rados.0.trial187.stdout:3003: writing trial18717860-3 from 642298 to 1219733 tid 1 2026-02-13T18:19:19.648 INFO:tasks.rados.rados.0.trial187.stdout:3003: writing trial18717860-3 from 1920153 to 2493510 tid 2 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3003: writing trial18717860-3 from 2979150 to 3042298 tid 3 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3004: rollback oid 28 current snap is 330 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 28 to 329 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3002: finishing rollback tid 0 to trial18717860-29 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3002: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3002: finishing rollback tid 2 to trial18717860-29 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1418 (ObjNum 971 snap 313 seq_num 971) dirty exists 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3003: finishing write tid 1 to trial18717860-3 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3003: finishing write tid 2 to trial18717860-3 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3002: done (2 left) 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:3005: rollback oid 41 current snap is 330 2026-02-13T18:19:19.652 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 324 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3006: copy_from oid 12 from oid 19 current snap is 330 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3007: rollback oid 30 current snap is 330 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 328 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3008: rollback oid 21 current snap is 330 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 322 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3009: delete oid 49 current snap is 330 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3005: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 0 (ObjNum 97 snap 0 seq_num 2975098712) dirty dne 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3007: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3003: finishing write tid 3 to trial18717860-3 2026-02-13T18:19:19.653 INFO:tasks.rados.rados.0.trial187.stdout:3003: finishing write tid 4 to trial18717860-3 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3003: finishing write tid 5 to trial18717860-3 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3003: oid 3 updating version 0 to 1588 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3003: oid 3 version 1588 is already newer than 1586 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3003: oid 3 version 1588 is already newer than 1587 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3003: oid 3 updating version 1588 to 1589 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1589 (ObjNum 1014 snap 330 seq_num 1014) dirty exists 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3003: left oid 3 (ObjNum 1014 snap 330 seq_num 1014) 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:3007: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:19:19.654 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1055 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:19:19.655 INFO:tasks.rados.rados.0.trial187.stdout:3004: finishing rollback tid 1 to trial18717860-28 2026-02-13T18:19:19.655 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1621 (ObjNum 33 snap 0 seq_num 3012729280) dirty dne 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3003: done (6 left) 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3004: done (5 left) 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3005: done (4 left) 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3007: done (3 left) 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3009: done (2 left) 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3010: read oid 16 snap 329 2026-02-13T18:19:19.656 INFO:tasks.rados.rados.0.trial187.stdout:3010: expect deleted 2026-02-13T18:19:19.657 INFO:tasks.rados.rados.0.trial187.stdout:3011: read oid 29 snap -1 2026-02-13T18:19:19.657 INFO:tasks.rados.rados.0.trial187.stdout:3011: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:19:19.657 INFO:tasks.rados.rados.0.trial187.stdout:3012: write (excl) oid 5 current snap is 330 2026-02-13T18:19:19.657 INFO:tasks.rados.rados.0.trial187.stdout:3012: seq_num 1016 ranges {675912=727933,1920764=460673,2801290=274622} 2026-02-13T18:19:19.665 INFO:tasks.rados.rados.0.trial187.stdout:3012: writing trial18717860-5 from 675912 to 1403845 tid 1 2026-02-13T18:19:19.671 INFO:tasks.rados.rados.0.trial187.stdout:3012: writing trial18717860-5 from 1920764 to 2381437 tid 2 2026-02-13T18:19:19.676 INFO:tasks.rados.rados.0.trial187.stdout:3012: writing trial18717860-5 from 2801290 to 3075912 tid 3 2026-02-13T18:19:19.677 INFO:tasks.rados.rados.0.trial187.stdout:3013: read oid 37 snap 329 2026-02-13T18:19:19.677 INFO:tasks.rados.rados.0.trial187.stdout:3013: expect deleted 2026-02-13T18:19:19.677 INFO:tasks.rados.rados.0.trial187.stdout:3014: snap_create 2026-02-13T18:19:19.677 INFO:tasks.rados.rados.0.trial187.stdout:3011: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3008: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3008: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3008: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1159 (ObjNum 989 snap 320 seq_num 989) dirty exists 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3006: finishing copy_from to trial18717860-12 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3006: got expected ENOENT (src dne) 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3006: finishing copy_from racing read to trial18717860-12 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3012: finishing write tid 1 to trial18717860-5 2026-02-13T18:19:19.740 INFO:tasks.rados.rados.0.trial187.stdout:3012: finishing write tid 2 to trial18717860-5 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: finishing write tid 3 to trial18717860-5 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: finishing write tid 4 to trial18717860-5 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: finishing write tid 5 to trial18717860-5 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: oid 5 updating version 0 to 1439 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: oid 5 updating version 1439 to 1440 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: oid 5 version 1440 is already newer than 1437 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: oid 5 version 1440 is already newer than 1438 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1440 (ObjNum 1016 snap 330 seq_num 1016) dirty exists 2026-02-13T18:19:19.741 INFO:tasks.rados.rados.0.trial187.stdout:3012: left oid 5 (ObjNum 1016 snap 330 seq_num 1016) 2026-02-13T18:19:20.536 INFO:tasks.rados.rados.0.trial187.stdout:3006: done (6 left) 2026-02-13T18:19:20.536 INFO:tasks.rados.rados.0.trial187.stdout:3008: done (5 left) 2026-02-13T18:19:20.536 INFO:tasks.rados.rados.0.trial187.stdout:3010: done (4 left) 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3011: done (3 left) 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3012: done (2 left) 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3013: done (1 left) 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3014: done (0 left) 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3015: read oid 9 snap -1 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3015: expect deleted 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3016: read oid 10 snap 327 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3016: expect deleted 2026-02-13T18:19:20.537 INFO:tasks.rados.rados.0.trial187.stdout:3017: snap_remove snap 323 2026-02-13T18:19:21.536 INFO:tasks.rados.rados.0.trial187.stdout:3017: done (2 left) 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:3018: read oid 50 snap -1 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:3018: expect (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:3019: rollback oid 2 current snap is 331 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 326 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:3015: done (3 left) 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:3016: done (2 left) 2026-02-13T18:19:21.537 INFO:tasks.rados.rados.0.trial187.stdout:3020: delete oid 41 current snap is 331 2026-02-13T18:19:21.542 INFO:tasks.rados.rados.0.trial187.stdout:3019: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:19:21.542 INFO:tasks.rados.rados.0.trial187.stdout:3019: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:19:21.542 INFO:tasks.rados.rados.0.trial187.stdout:3019: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:19:21.542 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1206 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:19:21.544 INFO:tasks.rados.rados.0.trial187.stdout:3018: expect (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:19:21.738 INFO:tasks.rados.rados.0.trial187.stdout:3018: done (2 left) 2026-02-13T18:19:21.738 INFO:tasks.rados.rados.0.trial187.stdout:3019: done (1 left) 2026-02-13T18:19:21.738 INFO:tasks.rados.rados.0.trial187.stdout:3020: done (0 left) 2026-02-13T18:19:21.739 INFO:tasks.rados.rados.0.trial187.stdout:3021: read oid 36 snap -1 2026-02-13T18:19:21.739 INFO:tasks.rados.rados.0.trial187.stdout:3021: expect (ObjNum 1000 snap 324 seq_num 1000) 2026-02-13T18:19:21.739 INFO:tasks.rados.rados.0.trial187.stdout:3022: write oid 48 current snap is 331 2026-02-13T18:19:21.739 INFO:tasks.rados.rados.0.trial187.stdout:3022: seq_num 1018 ranges {709526=478431,1637728=464342,2856136=253390} 2026-02-13T18:19:21.746 INFO:tasks.rados.rados.0.trial187.stdout:3022: writing trial18717860-48 from 709526 to 1187957 tid 1 2026-02-13T18:19:21.752 INFO:tasks.rados.rados.0.trial187.stdout:3022: writing trial18717860-48 from 1637728 to 2102070 tid 2 2026-02-13T18:19:21.759 INFO:tasks.rados.rados.0.trial187.stdout:3022: writing trial18717860-48 from 2856136 to 3109526 tid 3 2026-02-13T18:19:21.759 INFO:tasks.rados.rados.0.trial187.stdout:3023: write oid 21 current snap is 331 2026-02-13T18:19:21.759 INFO:tasks.rados.rados.0.trial187.stdout:3023: seq_num 1019 ranges {726333=670033,2096210=724353} 2026-02-13T18:19:21.768 INFO:tasks.rados.rados.0.trial187.stdout:3023: writing trial18717860-21 from 726333 to 1396366 tid 1 2026-02-13T18:19:21.778 INFO:tasks.rados.rados.0.trial187.stdout:3023: writing trial18717860-21 from 2096210 to 2820563 tid 2 2026-02-13T18:19:21.778 INFO:tasks.rados.rados.0.trial187.stdout:3024: write (excl) oid 10 current snap is 331 2026-02-13T18:19:21.778 INFO:tasks.rados.rados.0.trial187.stdout:3024: seq_num 1020 ranges {743140=745282,2154692=468011} 2026-02-13T18:19:21.786 INFO:tasks.rados.rados.0.trial187.stdout:3024: writing trial18717860-10 from 743140 to 1488422 tid 1 2026-02-13T18:19:21.791 INFO:tasks.rados.rados.0.trial187.stdout:3024: writing trial18717860-10 from 2154692 to 2622703 tid 2 2026-02-13T18:19:21.791 INFO:tasks.rados.rados.0.trial187.stdout:3025: read oid 18 snap 329 2026-02-13T18:19:21.791 INFO:tasks.rados.rados.0.trial187.stdout:3025: expect deleted 2026-02-13T18:19:21.791 INFO:tasks.rados.rados.0.trial187.stdout:3026: read oid 17 snap -1 2026-02-13T18:19:21.791 INFO:tasks.rados.rados.0.trial187.stdout:3026: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:19:21.791 INFO:tasks.rados.rados.0.trial187.stdout:3027: read oid 4 snap -1 2026-02-13T18:19:21.792 INFO:tasks.rados.rados.0.trial187.stdout:3027: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:19:21.792 INFO:tasks.rados.rados.0.trial187.stdout:3028: delete oid 26 current snap is 331 2026-02-13T18:19:21.792 INFO:tasks.rados.rados.0.trial187.stdout:3021: expect (ObjNum 1000 snap 324 seq_num 1000) 2026-02-13T18:19:21.792 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:21.904 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1793235 2026-02-13T18:19:21.920 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:21.978 INFO:tasks.rados.rados.0.trial187.stdout:3022: finishing write tid 1 to trial18717860-48 2026-02-13T18:19:21.978 INFO:tasks.rados.rados.0.trial187.stdout:3022: finishing write tid 2 to trial18717860-48 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: finishing write tid 3 to trial18717860-48 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3021: done (7 left) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3028: done (6 left) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3029: read oid 8 snap -1 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3029: expect deleted 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3030: rollback oid 27 current snap is 331 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 327 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: finishing write tid 4 to trial18717860-48 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: finishing write tid 5 to trial18717860-48 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: oid 48 updating version 0 to 1973 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: oid 48 version 1973 is already newer than 1972 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: oid 48 version 1973 is already newer than 1971 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: oid 48 version 1973 is already newer than 1970 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1973 (ObjNum 1018 snap 331 seq_num 1018) dirty exists 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: left oid 48 (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: finishing write tid 1 to trial18717860-21 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: finishing write tid 2 to trial18717860-21 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: finishing write tid 3 to trial18717860-21 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: finishing write tid 4 to trial18717860-21 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: oid 21 updating version 0 to 1165 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: oid 21 version 1165 is already newer than 1163 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: oid 21 version 1165 is already newer than 1164 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1165 (ObjNum 1019 snap 331 seq_num 1019) dirty exists 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: left oid 21 (ObjNum 1019 snap 331 seq_num 1019) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3024: finishing write tid 1 to trial18717860-10 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3022: done (7 left) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3023: done (6 left) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3031: delete oid 34 current snap is 331 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:3026: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:19:21.979 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1276649 2026-02-13T18:19:21.996 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1419918 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: finishing write tid 2 to trial18717860-10 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: finishing write tid 3 to trial18717860-10 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: finishing write tid 4 to trial18717860-10 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: oid 10 updating version 0 to 1046 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: oid 10 version 1046 is already newer than 1045 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: oid 10 updating version 1046 to 1047 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1047 (ObjNum 1020 snap 331 seq_num 1020) dirty exists 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3024: left oid 10 (ObjNum 1020 snap 331 seq_num 1020) 2026-02-13T18:19:22.022 INFO:tasks.rados.rados.0.trial187.stdout:3027: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:19:22.037 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 522117 2026-02-13T18:19:22.070 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3003536 2026-02-13T18:19:22.073 INFO:tasks.rados.rados.0.trial187.stdout:3030: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:19:22.073 INFO:tasks.rados.rados.0.trial187.stdout:3030: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:19:22.073 INFO:tasks.rados.rados.0.trial187.stdout:3030: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:19:22.073 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1027 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3024: done (6 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3025: done (5 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3026: done (4 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3027: done (3 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3029: done (2 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3030: done (1 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3031: done (0 left) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3032: read oid 48 snap 322 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3032: expect (ObjNum 961 snap 312 seq_num 961) 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3033: write (excl) oid 45 current snap is 331 2026-02-13T18:19:22.074 INFO:tasks.rados.rados.0.trial187.stdout:3033: seq_num 1023 ranges {793561=571029,1813785=731691,2993251=200310} 2026-02-13T18:19:22.082 INFO:tasks.rados.rados.0.trial187.stdout:3033: writing trial18717860-45 from 793561 to 1364590 tid 1 2026-02-13T18:19:22.090 INFO:tasks.rados.rados.0.trial187.stdout:3033: writing trial18717860-45 from 1813785 to 2545476 tid 2 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3033: writing trial18717860-45 from 2993251 to 3193561 tid 3 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3034: read oid 44 snap 329 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3034: expect (ObjNum 998 snap 323 seq_num 998) 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3035: read oid 10 snap -1 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3035: expect (ObjNum 1020 snap 331 seq_num 1020) 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3036: delete oid 30 current snap is 331 2026-02-13T18:19:22.096 INFO:tasks.rados.rados.0.trial187.stdout:3032: expect (ObjNum 961 snap 312 seq_num 961) 2026-02-13T18:19:22.097 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:22.129 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 333774 2026-02-13T18:19:22.195 INFO:tasks.rados.rados.0.trial187.stdout:3033: finishing write tid 1 to trial18717860-45 2026-02-13T18:19:22.195 INFO:tasks.rados.rados.0.trial187.stdout:3033: finishing write tid 2 to trial18717860-45 2026-02-13T18:19:22.195 INFO:tasks.rados.rados.0.trial187.stdout:3032: done (4 left) 2026-02-13T18:19:22.195 INFO:tasks.rados.rados.0.trial187.stdout:3036: done (3 left) 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3037: delete oid 43 current snap is 331 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: finishing write tid 3 to trial18717860-45 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: finishing write tid 4 to trial18717860-45 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: finishing write tid 5 to trial18717860-45 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: oid 45 updating version 0 to 1441 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: oid 45 updating version 1441 to 1444 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: oid 45 version 1444 is already newer than 1442 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: oid 45 version 1444 is already newer than 1443 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1444 (ObjNum 1023 snap 331 seq_num 1023) dirty exists 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3033: left oid 45 (ObjNum 1023 snap 331 seq_num 1023) 2026-02-13T18:19:22.196 INFO:tasks.rados.rados.0.trial187.stdout:3034: expect (ObjNum 998 snap 323 seq_num 998) 2026-02-13T18:19:22.233 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 816211 2026-02-13T18:19:22.294 INFO:tasks.rados.rados.0.trial187.stdout:3035: expect (ObjNum 1020 snap 331 seq_num 1020) 2026-02-13T18:19:22.302 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3105231 2026-02-13T18:19:22.305 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:22.337 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2179990 2026-02-13T18:19:22.345 INFO:tasks.rados.rados.0.trial187.stdout:3033: done (3 left) 2026-02-13T18:19:22.345 INFO:tasks.rados.rados.0.trial187.stdout:3034: done (2 left) 2026-02-13T18:19:22.345 INFO:tasks.rados.rados.0.trial187.stdout:3035: done (1 left) 2026-02-13T18:19:22.345 INFO:tasks.rados.rados.0.trial187.stdout:3037: done (0 left) 2026-02-13T18:19:22.345 INFO:tasks.rados.rados.0.trial187.stdout:3038: read oid 17 snap -1 2026-02-13T18:19:22.345 INFO:tasks.rados.rados.0.trial187.stdout:3038: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:19:22.346 INFO:tasks.rados.rados.0.trial187.stdout:3039: read oid 22 snap 327 2026-02-13T18:19:22.346 INFO:tasks.rados.rados.0.trial187.stdout:3039: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:19:22.346 INFO:tasks.rados.rados.0.trial187.stdout:3040: delete oid 32 current snap is 331 2026-02-13T18:19:22.346 INFO:tasks.rados.rados.0.trial187.stdout:3040: done (2 left) 2026-02-13T18:19:22.346 INFO:tasks.rados.rados.0.trial187.stdout:3041: write oid 47 current snap is 331 2026-02-13T18:19:22.347 INFO:tasks.rados.rados.0.trial187.stdout:3041: seq_num 1027 ranges {460789=588378,1764066=739029,3219296=41493} 2026-02-13T18:19:22.353 INFO:tasks.rados.rados.0.trial187.stdout:3041: writing trial18717860-47 from 460789 to 1049167 tid 1 2026-02-13T18:19:22.363 INFO:tasks.rados.rados.0.trial187.stdout:3041: writing trial18717860-47 from 1764066 to 2503095 tid 2 2026-02-13T18:19:22.368 INFO:tasks.rados.rados.0.trial187.stdout:3041: writing trial18717860-47 from 3219296 to 3260789 tid 3 2026-02-13T18:19:22.368 INFO:tasks.rados.rados.0.trial187.stdout:3042: snap_create 2026-02-13T18:19:22.368 INFO:tasks.rados.rados.0.trial187.stdout:3038: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:19:22.398 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:22.416 INFO:tasks.rados.rados.0.trial187.stdout:3039: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:19:22.462 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: finishing write tid 1 to trial18717860-47 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: finishing write tid 2 to trial18717860-47 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: finishing write tid 3 to trial18717860-47 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: finishing write tid 4 to trial18717860-47 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: finishing write tid 5 to trial18717860-47 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: oid 47 updating version 0 to 1621 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: oid 47 version 1621 is already newer than 1619 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: oid 47 updating version 1621 to 1622 2026-02-13T18:19:22.564 INFO:tasks.rados.rados.0.trial187.stdout:3041: oid 47 version 1622 is already newer than 1620 2026-02-13T18:19:22.565 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1622 (ObjNum 1027 snap 331 seq_num 1027) dirty exists 2026-02-13T18:19:22.565 INFO:tasks.rados.rados.0.trial187.stdout:3041: left oid 47 (ObjNum 1027 snap 331 seq_num 1027) 2026-02-13T18:19:22.582 INFO:tasks.rados.rados.0.trial187.stdout:3038: done (3 left) 2026-02-13T18:19:22.582 INFO:tasks.rados.rados.0.trial187.stdout:3039: done (2 left) 2026-02-13T18:19:22.582 INFO:tasks.rados.rados.0.trial187.stdout:3041: done (1 left) 2026-02-13T18:19:22.583 INFO:tasks.rados.rados.0.trial187.stdout:3042: done (0 left) 2026-02-13T18:19:22.583 INFO:tasks.rados.rados.0.trial187.stdout:3043: read oid 15 snap -1 2026-02-13T18:19:22.583 INFO:tasks.rados.rados.0.trial187.stdout:3043: expect (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:19:22.583 INFO:tasks.rados.rados.0.trial187.stdout:3044: copy_from oid 44 from oid 22 current snap is 332 2026-02-13T18:19:22.583 INFO:tasks.rados.rados.0.trial187.stdout:3045: write oid 13 current snap is 332 2026-02-13T18:19:22.583 INFO:tasks.rados.rados.0.trial187.stdout:3045: seq_num 1028 ranges {477596=663627,1706195=482687,2614013=567041} 2026-02-13T18:19:22.589 INFO:tasks.rados.rados.0.trial187.stdout:3045: writing trial18717860-13 from 477596 to 1141223 tid 1 2026-02-13T18:19:22.597 INFO:tasks.rados.rados.0.trial187.stdout:3045: writing trial18717860-13 from 1706195 to 2188882 tid 2 2026-02-13T18:19:22.603 INFO:tasks.rados.rados.0.trial187.stdout:3045: writing trial18717860-13 from 2614013 to 3181054 tid 3 2026-02-13T18:19:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3046: snap_create 2026-02-13T18:19:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3043: expect (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:19:22.639 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2087257 2026-02-13T18:19:22.768 INFO:tasks.rados.rados.0.trial187.stdout:3045: finishing write tid 1 to trial18717860-13 2026-02-13T18:19:22.768 INFO:tasks.rados.rados.0.trial187.stdout:3044: finishing copy_from racing read to trial18717860-44 2026-02-13T18:19:22.768 INFO:tasks.rados.rados.0.trial187.stdout:3044: finishing copy_from to trial18717860-44 2026-02-13T18:19:22.768 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1885 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:19:22.768 INFO:tasks.rados.rados.0.trial187.stdout:3045: finishing write tid 2 to trial18717860-13 2026-02-13T18:19:22.768 INFO:tasks.rados.rados.0.trial187.stdout:3045: finishing write tid 3 to trial18717860-13 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: finishing write tid 4 to trial18717860-13 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: finishing write tid 5 to trial18717860-13 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: oid 13 updating version 0 to 1207 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: oid 13 updating version 1207 to 1209 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: oid 13 version 1209 is already newer than 1208 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: oid 13 updating version 1209 to 1210 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1210 (ObjNum 1028 snap 332 seq_num 1028) dirty exists 2026-02-13T18:19:22.769 INFO:tasks.rados.rados.0.trial187.stdout:3045: left oid 13 (ObjNum 1028 snap 332 seq_num 1028) 2026-02-13T18:19:23.273 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T18:19:23.273 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T18:19:23.273 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T18:19:23.274 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T18:19:23.276 INFO:tasks.ceph.mon.b:Started 2026-02-13T18:19:23.276 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:19:23.277 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:19:23.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient: get_monmap_and_config 2026-02-13T18:19:23.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient: monmap: 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:23.344141+0000 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:23.344141+0000 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:23.352 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 1 Processor -- start 2026-02-13T18:19:23.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 1 -- start start 2026-02-13T18:19:23.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient: init 2026-02-13T18:19:23.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient(hunting): picked mon.noname-b con 0x7fb83413f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient(hunting): picked mon.noname-a con 0x7fb83405e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient(hunting): picked mon.noname-c con 0x7fb8341853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb834095530 con 0x7fb83405e4b0 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb834140390 con 0x7fb8341853c0 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83405d230 con 0x7fb83413f8b0 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb83c138640 10 monclient(hunting): authenticate will time out at 1394.399780s 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb8396ac640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb83405e4b0 0x7fb834183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:56990/0 (socket says 10.20.193.78:56990) 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb8396ac640 1 -- 10.20.193.78:0/655177003 learned_addr learned my addr 10.20.193.78:0/655177003 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.338+0000 7fb839ead640 1 --1- 10.20.193.78:0/655177003 >> v1:10.20.193.78:6790/0 conn(0x7fb83413f8b0 0x7fb83413fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34180/0 (socket says 10.20.193.78:34180) 2026-02-13T18:19:23.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb8396ac640 1 -- 10.20.193.78:0/655177003 >> v1:10.20.193.78:6789/0 conn(0x7fb83405e4b0 legacy=0x7fb834183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb839ead640 1 -- 10.20.193.78:0/655177003 >> v1:10.20.193.78:6790/0 conn(0x7fb83413f8b0 legacy=0x7fb83413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970814733 0 0) 0x7fb83405d230 con 0x7fb83413f8b0 2026-02-13T18:19:23.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): my global_id is 104195 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb81c003620 con 0x7fb83413f8b0 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219622339 0 0) 0x7fb828002c60 con 0x7fb83405e4b0 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient(hunting): my global_id is 94308 2026-02-13T18:19:23.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb83405d230 con 0x7fb83405e4b0 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83a6ae640 1 -- 10.20.193.78:0/655177003 >> v1:10.20.193.187:6789/0 conn(0x7fb8341853c0 legacy=0x7fb8341a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960375715 0 0) 0x7fb81c003620 con 0x7fb83413f8b0 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 >> v1:10.20.193.187:6789/0 conn(0x7fb8341853c0 legacy=0x7fb8341a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 >> v1:10.20.193.78:6789/0 conn(0x7fb83405e4b0 legacy=0x7fb834183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 monclient: found mon.noname-b 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83405d510 con 0x7fb83413f8b0 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb824003110 con 0x7fb83413f8b0 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 5 monclient: authenticate success, global_id 104195 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: dump: 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.363 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8240033e0 con 0x7fb83413f8b0 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 1 -- 10.20.193.78:0/655177003 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb824004a90 con 0x7fb83413f8b0 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb838eab640 10 monclient: dump: 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:23.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 4 set_mon_vals no callback set 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: shutdown 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- 10.20.193.78:0/655177003 >> v1:10.20.193.78:6790/0 conn(0x7fb83413f8b0 legacy=0x7fb83413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- 10.20.193.78:0/655177003 shutdown_connections 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- 10.20.193.78:0/655177003 >> 10.20.193.78:0/655177003 conn(0x7fb8340545d0 msgr2=0x7fb8340549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- 10.20.193.78:0/655177003 shutdown_connections 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- 10.20.193.78:0/655177003 wait complete. 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: monmap: 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 Processor -- start 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- start start 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: init 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient(hunting): picked mon.noname-c con 0x7fb83405e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient(hunting): picked mon.noname-a con 0x7fb83413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient(hunting): picked mon.noname-b con 0x7fb8341853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb834111530 con 0x7fb83413f8b0 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb834057e50 con 0x7fb8341853c0 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb834110040 con 0x7fb83405e4b0 2026-02-13T18:19:23.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb83c138640 10 monclient(hunting): authenticate will time out at 1394.403778s 2026-02-13T18:19:23.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb8396ac640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb83413f8b0 0x7fb834180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57004/0 (socket says 10.20.193.78:57004) 2026-02-13T18:19:23.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.342+0000 7fb8396ac640 1 -- 10.20.193.78:0/386064498 learned_addr learned my addr 10.20.193.78:0/386064498 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.346+0000 7fb8396ac640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.78:6789/0 conn(0x7fb83413f8b0 legacy=0x7fb834180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.346+0000 7fb839ead640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.78:6790/0 conn(0x7fb83405e4b0 legacy=0x7fb83413eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.346+0000 7fb83a6ae640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.187:6789/0 conn(0x7fb8341853c0 legacy=0x7fb834181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442521558 0 0) 0x7fb834111530 con 0x7fb83413f8b0 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): my global_id is 94311 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb804003620 con 0x7fb83413f8b0 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3731266499 0 0) 0x7fb804003620 con 0x7fb83413f8b0 2026-02-13T18:19:23.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb834111530 con 0x7fb83413f8b0 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb8280034e0 con 0x7fb83413f8b0 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): dump: 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.546 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1522285641 0 0) 0x7fb834111530 con 0x7fb83413f8b0 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.78:6790/0 conn(0x7fb83405e4b0 legacy=0x7fb83413eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.187:6789/0 conn(0x7fb8341853c0 legacy=0x7fb834181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 monclient: found mon.a 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8341123a0 con 0x7fb83413f8b0 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 5 monclient: authenticate success, global_id 94311 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 monclient: _renew_subs 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb83412e3c0 con 0x7fb83413f8b0 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 monclient: _renew_subs 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb834110d70 con 0x7fb83413f8b0 2026-02-13T18:19:23.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb828004b90 con 0x7fb83413f8b0 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb828004f30 con 0x7fb83413f8b0 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 10 monclient: dump: 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.549 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb823fff640 4 set_mon_vals no callback set 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8340008e0 con 0x7fb83413f8b0 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.530+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb828005200 con 0x7fb83413f8b0 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.534+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(683..683 src has 292..683) ==== 3915+0+0 (unknown 331353200 0 0) 0x7fb82804c640 con 0x7fb83413f8b0 2026-02-13T18:19:23.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.534+0000 7fb839ead640 10 monclient: get_auth_request con 0x7fb80403d450 auth_method 0 2026-02-13T18:19:23.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.534+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fb834095530 con 0x7fb83413f8b0 2026-02-13T18:19:23.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.534+0000 7fb8227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.534+0000 7fb8227fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3043: done (3 left) 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3044: done (2 left) 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3045: done (1 left) 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3046: done (0 left) 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3047: copy_from oid 33 from oid 31 current snap is 333 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3048: read oid 48 snap -1 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3048: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:19:23.586 INFO:tasks.rados.rados.0.trial187.stdout:3049: snap_create 2026-02-13T18:19:23.593 INFO:tasks.rados.rados.0.trial187.stdout:3047: finishing copy_from to trial18717860-33 2026-02-13T18:19:23.593 INFO:tasks.rados.rados.0.trial187.stdout:3047: got expected ENOENT (src dne) 2026-02-13T18:19:23.593 INFO:tasks.rados.rados.0.trial187.stdout:3047: finishing copy_from racing read to trial18717860-33 2026-02-13T18:19:23.593 INFO:tasks.rados.rados.0.trial187.stdout:3048: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:19:23.662 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:23.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:19:23.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:23.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb834093020 con 0x7fb83413f8b0 2026-02-13T18:19:23.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb8227fc640 1 -- 10.20.193.78:0/386064498 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 91988399) 0x7fb8280175f0 con 0x7fb83413f8b0 2026-02-13T18:19:23.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb8227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:23.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb8227fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:23.673 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:19:23.674 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb80403d450 legacy=0x7fb80405d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 10 monclient: shutdown 2026-02-13T18:19:23.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 >> v1:10.20.193.78:6789/0 conn(0x7fb83413f8b0 legacy=0x7fb834180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 shutdown_connections 2026-02-13T18:19:23.675 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 >> 10.20.193.78:0/386064498 conn(0x7fb8340545d0 msgr2=0x7fb8341a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 shutdown_connections 2026-02-13T18:19:23.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.658+0000 7fb83c138640 1 -- 10.20.193.78:0/386064498 wait complete. 2026-02-13T18:19:23.683 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:19:23.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:19:23.684 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.730+0000 7fbf0df42640 10 monclient: get_monmap_and_config 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.730+0000 7fbf0df42640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.730+0000 7fbf0df42640 10 monclient: monmap: 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:23.737441+0000 2026-02-13T18:19:23.746 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:23.737441+0000 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 Processor -- start 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- start start 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient: init 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:19:23.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient(hunting): picked mon.noname-c con 0x7fbf0808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient(hunting): picked mon.noname-b con 0x7fbf0808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient(hunting): picked mon.noname-a con 0x7fbf0808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf08089e80 con 0x7fbf0808cdd0 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf08088c20 con 0x7fbf0808c2f0 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf08089ba0 con 0x7fbf0808dc80 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient(hunting): authenticate will time out at 1394.792646s 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf06ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fbf0808dc80 0x7fbf08181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34198/0 (socket says 10.20.193.78:34198) 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf07fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbf0808cdd0 0x7fbf081a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57014/0 (socket says 10.20.193.78:57014) 2026-02-13T18:19:23.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf06ffd640 1 -- 10.20.193.78:0/3580267706 learned_addr learned my addr 10.20.193.78:0/3580267706 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf07fff640 1 -- 10.20.193.78:0/3580267706 >> v1:10.20.193.78:6789/0 conn(0x7fbf0808cdd0 legacy=0x7fbf081a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf06ffd640 1 -- 10.20.193.78:0/3580267706 >> v1:10.20.193.78:6790/0 conn(0x7fbf0808dc80 legacy=0x7fbf08181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf077fe640 1 -- 10.20.193.78:0/3580267706 >> v1:10.20.193.187:6789/0 conn(0x7fbf0808c2f0 legacy=0x7fbf0808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031254727 0 0) 0x7fbf08089e80 con 0x7fbf0808cdd0 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): my global_id is 94314 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeec003620 con 0x7fbf0808cdd0 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923030666 0 0) 0x7fbf08089ba0 con 0x7fbf0808dc80 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient(hunting): my global_id is 104198 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf08089e80 con 0x7fbf0808dc80 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1623666346 0 0) 0x7fbeec003620 con 0x7fbf0808cdd0 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 >> v1:10.20.193.78:6790/0 conn(0x7fbf0808dc80 legacy=0x7fbf08181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 >> v1:10.20.193.187:6789/0 conn(0x7fbf0808c2f0 legacy=0x7fbf0808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 monclient: found mon.noname-a 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0808d370 con 0x7fbf0808cdd0 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbefc004620 con 0x7fbf0808cdd0 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:23.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: dump: 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 5 monclient: authenticate success, global_id 94314 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbefc0048f0 con 0x7fbf0808cdd0 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 1 -- 10.20.193.78:0/3580267706 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbefc005fa0 con 0x7fbf0808cdd0 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf067fc640 10 monclient: dump: 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.759 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 4 set_mon_vals no callback set 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 10 monclient: shutdown 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- 10.20.193.78:0/3580267706 >> v1:10.20.193.78:6789/0 conn(0x7fbf0808cdd0 legacy=0x7fbf081a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- 10.20.193.78:0/3580267706 shutdown_connections 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- 10.20.193.78:0/3580267706 >> 10.20.193.78:0/3580267706 conn(0x7fbf08091720 msgr2=0x7fbf08091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- 10.20.193.78:0/3580267706 shutdown_connections 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.734+0000 7fbf0df42640 1 -- 10.20.193.78:0/3580267706 wait complete. 2026-02-13T18:19:23.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient: monmap: 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 1 Processor -- start 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 1 -- start start 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient: init 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient(hunting): picked mon.noname-a con 0x7fbf0808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient(hunting): picked mon.noname-c con 0x7fbf0808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient(hunting): picked mon.noname-b con 0x7fbf0808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf08082130 con 0x7fbf0808c2f0 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf080866a0 con 0x7fbf0808dc80 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf08082410 con 0x7fbf0808cdd0 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf0df42640 10 monclient(hunting): authenticate will time out at 1394.797233s 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf06ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fbf0808cdd0 0x7fbf08085f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34204/0 (socket says 10.20.193.78:34204) 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf06ffd640 1 -- 10.20.193.78:0/531212825 learned_addr learned my addr 10.20.193.78:0/531212825 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf06ffd640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6790/0 conn(0x7fbf0808cdd0 legacy=0x7fbf08085f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf077fe640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf0808c2f0 legacy=0x7fbf08085880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424615075 0 0) 0x7fbf08082410 con 0x7fbf0808cdd0 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): my global_id is 104201 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbed8003620 con 0x7fbf0808cdd0 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205063264 0 0) 0x7fbf08082130 con 0x7fbf0808c2f0 2026-02-13T18:19:23.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): my global_id is 94317 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf08082410 con 0x7fbf0808c2f0 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbf07fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.187:6789/0 conn(0x7fbf0808dc80 legacy=0x7fbf08195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2651930526 0 0) 0x7fbed8003620 con 0x7fbf0808cdd0 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf08082130 con 0x7fbf0808cdd0 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbef8002f00 con 0x7fbf0808cdd0 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): dump: 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.764 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 682652945 0 0) 0x7fbf08082410 con 0x7fbf0808c2f0 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbed8003620 con 0x7fbf0808c2f0 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbef40032e0 con 0x7fbf0808c2f0 2026-02-13T18:19:23.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.738+0000 7fbee3fff640 10 monclient(hunting): dump: 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1719009976 0 0) 0x7fbf08082130 con 0x7fbf0808cdd0 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.187:6789/0 conn(0x7fbf0808dc80 legacy=0x7fbf08195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf0808c2f0 legacy=0x7fbf08085880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 monclient: found mon.c 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf08080ef0 con 0x7fbf0808cdd0 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 5 monclient: authenticate success, global_id 104201 2026-02-13T18:19:23.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 10 monclient: _renew_subs 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf08081e50 con 0x7fbf0808cdd0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 10 monclient: _renew_subs 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf08083e90 con 0x7fbf0808cdd0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbef8004b90 con 0x7fbf0808cdd0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbef8004f30 con 0x7fbf0808cdd0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: dump: 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.768 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf05ffb640 4 set_mon_vals no callback set 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbf0805d540 con 0x7fbf08082fb0 2026-02-13T18:19:23.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fbef8005200 con 0x7fbf0808cdd0 2026-02-13T18:19:23.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(684..684 src has 292..684) ==== 3915+0+0 (unknown 2605969691 0 0) 0x7fbef804c790 con 0x7fbf0808cdd0 2026-02-13T18:19:23.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf07fff640 10 monclient: get_auth_request con 0x7fbed803d6a0 auth_method 0 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbf077fe640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf08082fb0 legacy=0x7fbf0805b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243219480 0 0) 0x7fbf0805d540 con 0x7fbf08082fb0 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient(hunting): my global_id is 94320 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf08082130 con 0x7fbf08082fb0 2026-02-13T18:19:23.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1951425764 0 0) 0x7fbf08082130 con 0x7fbf08082fb0 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf0805d540 con 0x7fbf08082fb0 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbef4003b30 con 0x7fbf08082fb0 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: dump: 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.774 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3525811016 0 0) 0x7fbf0805d540 con 0x7fbf08082fb0 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf08083380 con 0x7fbf08082fb0 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbef40058c0 con 0x7fbf08082fb0 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf08082fb0 legacy=0x7fbf0805b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.742+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf08082fb0 legacy=0x7fbf0805b3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.746+0000 7fbf0df42640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.746+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbf0808f5e0 con 0x7fbf0804d200 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf077fe640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf0804d200 legacy=0x7fbf08198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587564653 0 0) 0x7fbf0808f5e0 con 0x7fbf0804d200 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient(hunting): my global_id is 94323 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf0805d540 con 0x7fbf0804d200 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3820790901 0 0) 0x7fbf0805d540 con 0x7fbf0804d200 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf0808f5e0 con 0x7fbf0804d200 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbef4004140 con 0x7fbf0804d200 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient: dump: 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.776 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2830588578 0 0) 0x7fbf0808f5e0 con 0x7fbf0804d200 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf08090810 con 0x7fbf0804d200 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 3099450066) 0x7fbef40044c0 con 0x7fbf0804d200 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:23.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf0804d200 legacy=0x7fbf08198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbee3fff640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6789/0 conn(0x7fbf0804d200 legacy=0x7fbf08198550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 50, 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 246797, 2026-02-13T18:19:23.778 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:23.779 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:23.780 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.781 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:23.782 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:23.783 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:23.784 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.785 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.786 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.787 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.788 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:23.789 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.789 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.789 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.789 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:23.789 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.187:6812/2668687789 conn(0x7fbed803d6a0 legacy=0x7fbed805db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 10 monclient: shutdown 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 >> v1:10.20.193.78:6790/0 conn(0x7fbf0808cdd0 legacy=0x7fbf08085f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf07fff640 1 -- 10.20.193.78:0/531212825 reap_dead start 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf07fff640 1 -- 10.20.193.78:0/531212825 reap_dead start 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 shutdown_connections 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 >> 10.20.193.78:0/531212825 conn(0x7fbf08091720 msgr2=0x7fbf08058b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 shutdown_connections 2026-02-13T18:19:23.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.750+0000 7fbf0df42640 1 -- 10.20.193.78:0/531212825 wait complete. 2026-02-13T18:19:23.791 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:19:23.791 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:19:23.791 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 10 monclient: get_monmap_and_config 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 10 monclient: monmap: 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:23.856757+0000 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:23.856757+0000 2026-02-13T18:19:23.864 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.865 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.865 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.865 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:23.865 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:23.865 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 1 Processor -- start 2026-02-13T18:19:23.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 1 -- start start 2026-02-13T18:19:23.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 10 monclient: init 2026-02-13T18:19:23.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.850+0000 7efe0aa48640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient(hunting): picked mon.noname-c con 0x7efe0413f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient(hunting): picked mon.noname-a con 0x7efe0405e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient(hunting): picked mon.noname-b con 0x7efe041853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe04095530 con 0x7efe0405e4b0 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe04140390 con 0x7efe0413f8b0 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe0405d230 con 0x7efe041853c0 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient(hunting): authenticate will time out at 1394.912077s 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe037fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efe0405e4b0 0x7efe04183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57066/0 (socket says 10.20.193.78:57066) 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe037fe640 1 -- 10.20.193.78:0/2077347338 learned_addr learned my addr 10.20.193.78:0/2077347338 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe08fbe640 1 --1- 10.20.193.78:0/2077347338 >> v1:10.20.193.78:6790/0 conn(0x7efe041853c0 0x7efe041a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34206/0 (socket says 10.20.193.78:34206) 2026-02-13T18:19:23.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe08fbe640 1 -- 10.20.193.78:0/2077347338 >> v1:10.20.193.78:6790/0 conn(0x7efe041853c0 legacy=0x7efe041a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe037fe640 1 -- 10.20.193.78:0/2077347338 >> v1:10.20.193.78:6789/0 conn(0x7efe0405e4b0 legacy=0x7efe04183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe03fff640 1 -- 10.20.193.78:0/2077347338 >> v1:10.20.193.187:6789/0 conn(0x7efe0413f8b0 legacy=0x7efe0413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615976365 0 0) 0x7efe0405d230 con 0x7efe041853c0 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): my global_id is 104204 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde8003620 con 0x7efe041853c0 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450721325 0 0) 0x7efdf4002b90 con 0x7efe0405e4b0 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient(hunting): my global_id is 94326 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe0405d230 con 0x7efe0405e4b0 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 813912147 0 0) 0x7efde8003620 con 0x7efe041853c0 2026-02-13T18:19:23.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 >> v1:10.20.193.187:6789/0 conn(0x7efe0413f8b0 legacy=0x7efe0413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 >> v1:10.20.193.78:6789/0 conn(0x7efe0405e4b0 legacy=0x7efe04183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 monclient: found mon.noname-b 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0405d510 con 0x7efe041853c0 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf8004620 con 0x7efe041853c0 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 5 monclient: authenticate success, global_id 104204 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:23.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: dump: 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdf80048f0 con 0x7efe041853c0 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 1 -- 10.20.193.78:0/2077347338 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf8005fa0 con 0x7efe041853c0 2026-02-13T18:19:23.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe02ffd640 10 monclient: dump: 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 4 set_mon_vals no callback set 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient: shutdown 2026-02-13T18:19:23.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- 10.20.193.78:0/2077347338 >> v1:10.20.193.78:6790/0 conn(0x7efe041853c0 legacy=0x7efe041a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- 10.20.193.78:0/2077347338 shutdown_connections 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- 10.20.193.78:0/2077347338 >> 10.20.193.78:0/2077347338 conn(0x7efe040545d0 msgr2=0x7efe040549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- 10.20.193.78:0/2077347338 shutdown_connections 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 1 -- 10.20.193.78:0/2077347338 wait complete. 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.854+0000 7efe0aa48640 10 monclient: monmap: 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.875 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 Processor -- start 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 -- start start 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: init 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient(hunting): picked mon.noname-b con 0x7efe0405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient(hunting): picked mon.noname-a con 0x7efe0413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient(hunting): picked mon.noname-c con 0x7efe041853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe04111fd0 con 0x7efe0413f8b0 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe04111160 con 0x7efe0405e4b0 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe0410fc70 con 0x7efe041853c0 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient(hunting): authenticate will time out at 1394.916652s 2026-02-13T18:19:23.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe037fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7efe0413f8b0 0x7efe04180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57080/0 (socket says 10.20.193.78:57080) 2026-02-13T18:19:23.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe037fe640 1 -- 10.20.193.78:0/2376947986 learned_addr learned my addr 10.20.193.78:0/2376947986 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe037fe640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6789/0 conn(0x7efe0413f8b0 legacy=0x7efe04180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe08fbe640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe041853c0 legacy=0x7efe04181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800790703 0 0) 0x7efe04111fd0 con 0x7efe0413f8b0 2026-02-13T18:19:23.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): my global_id is 94329 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd4003620 con 0x7efe0413f8b0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709927571 0 0) 0x7efe0410fc70 con 0x7efe041853c0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): my global_id is 104207 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe04111fd0 con 0x7efe041853c0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe03fff640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.187:6789/0 conn(0x7efe0405e4b0 legacy=0x7efe0413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2928354265 0 0) 0x7efdd4003620 con 0x7efe0413f8b0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe0410fc70 con 0x7efe0413f8b0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf4002a60 con 0x7efe0413f8b0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): dump: 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3243577468 0 0) 0x7efe04111fd0 con 0x7efe041853c0 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdd4003620 con 0x7efe041853c0 2026-02-13T18:19:23.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf8005df0 con 0x7efe041853c0 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient(hunting): dump: 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2594251567 0 0) 0x7efe0410fc70 con 0x7efe0413f8b0 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe041853c0 legacy=0x7efe04181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.187:6789/0 conn(0x7efe0405e4b0 legacy=0x7efe0413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 monclient: found mon.a 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe04111730 con 0x7efe0413f8b0 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 5 monclient: authenticate success, global_id 94329 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: _renew_subs 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe0410f6b0 con 0x7efe0413f8b0 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: _renew_subs 2026-02-13T18:19:23.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe0413f470 con 0x7efe0413f8b0 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdf4004b90 con 0x7efe0413f8b0 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf4004f60 con 0x7efe0413f8b0 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe00ff9640 10 monclient: dump: 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.885 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe027fc640 4 set_mon_vals no callback set 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.858+0000 7efe0aa48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efe040008e0 con 0x7efe04110940 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7efdf4005230 con 0x7efe0413f8b0 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(684..684 src has 292..684) ==== 3915+0+0 (unknown 2605969691 0 0) 0x7efdf404c660 con 0x7efe0413f8b0 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe08fbe640 10 monclient: get_auth_request con 0x7efdd403d660 auth_method 0 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe03fff640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe04110940 legacy=0x7efe0408d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784976953 0 0) 0x7efe040008e0 con 0x7efe04110940 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient(hunting): my global_id is 104210 2026-02-13T18:19:23.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe0410fc70 con 0x7efe04110940 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3766271510 0 0) 0x7efe0410fc70 con 0x7efe04110940 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe040008e0 con 0x7efe04110940 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf0003210 con 0x7efe04110940 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient: dump: 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.887 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1240349424 0 0) 0x7efe040008e0 con 0x7efe04110940 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe04093020 con 0x7efe04110940 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efdf00058c0 con 0x7efe04110940 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe04110940 legacy=0x7efe0408d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.862+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe04110940 legacy=0x7efe0408d0d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.866+0000 7efe0aa48640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:23.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.866+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efe0412da10 con 0x7efe0412d610 2026-02-13T18:19:23.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe03fff640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe0412d610 legacy=0x7efe04184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048491358 0 0) 0x7efe0412da10 con 0x7efe0412d610 2026-02-13T18:19:23.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient(hunting): my global_id is 104213 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe040008e0 con 0x7efe0412d610 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2474744308 0 0) 0x7efe040008e0 con 0x7efe0412d610 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe0412da10 con 0x7efe0412d610 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdf0003b30 con 0x7efe0412d610 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient: dump: 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.890 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1289390619 0 0) 0x7efe0412da10 con 0x7efe0412d610 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe04090840 con 0x7efe0412d610 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4510 (unknown 0 0 2546571001) 0x7efdf0005b40 con 0x7efe0412d610 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe0412d610 legacy=0x7efe04184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe00ff9640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6790/0 conn(0x7efe0412d610 legacy=0x7efe04184ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 50, 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 108371, 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:19:23.892 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:23.893 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:23.894 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:23.895 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:23.896 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:23.897 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:23.898 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:23.899 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.900 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:23.901 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.187:6812/2668687789 conn(0x7efdd403d660 legacy=0x7efdd405db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 10 monclient: shutdown 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 >> v1:10.20.193.78:6789/0 conn(0x7efe0413f8b0 legacy=0x7efe04180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe08fbe640 1 -- 10.20.193.78:0/2376947986 reap_dead start 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 shutdown_connections 2026-02-13T18:19:23.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 >> 10.20.193.78:0/2376947986 conn(0x7efe040545d0 msgr2=0x7efe04096590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 shutdown_connections 2026-02-13T18:19:23.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.870+0000 7efe0aa48640 1 -- 10.20.193.78:0/2376947986 wait complete. 2026-02-13T18:19:23.903 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:19:23.903 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:19:23.903 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:19:23.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient: get_monmap_and_config 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient: monmap: 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:23.968533+0000 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:23.968533+0000 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:23.976 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 1 Processor -- start 2026-02-13T18:19:23.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 1 -- start start 2026-02-13T18:19:23.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient: init 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient(hunting): picked mon.noname-b con 0x7f419008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient(hunting): picked mon.noname-c con 0x7f419008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient(hunting): picked mon.noname-a con 0x7f419008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4190089e80 con 0x7f419008cdd0 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4190088c20 con 0x7f419008dc80 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4190089ba0 con 0x7f419008c2f0 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4198194640 10 monclient(hunting): authenticate will time out at 1395.023909s 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.962+0000 7f4195f09640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f419008c2f0 0x7f419008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34248/0 (socket says 10.20.193.78:34248) 2026-02-13T18:19:23.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4195f09640 1 -- 10.20.193.78:0/2784065856 learned_addr learned my addr 10.20.193.78:0/2784065856 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4195f09640 1 -- 10.20.193.78:0/2784065856 >> v1:10.20.193.78:6790/0 conn(0x7f419008c2f0 legacy=0x7f419008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f419670a640 1 -- 10.20.193.78:0/2784065856 >> v1:10.20.193.78:6789/0 conn(0x7f419008cdd0 legacy=0x7f41901a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4195708640 1 -- 10.20.193.78:0/2784065856 >> v1:10.20.193.187:6789/0 conn(0x7f419008dc80 legacy=0x7f4190181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275068051 0 0) 0x7f4190089ba0 con 0x7f419008c2f0 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): my global_id is 104216 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4178003620 con 0x7f419008c2f0 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598815560 0 0) 0x7f4190089e80 con 0x7f419008cdd0 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient(hunting): my global_id is 94332 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4190089ba0 con 0x7f419008cdd0 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2143241078 0 0) 0x7f4178003620 con 0x7f419008c2f0 2026-02-13T18:19:23.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 >> v1:10.20.193.187:6789/0 conn(0x7f419008dc80 legacy=0x7f4190181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 >> v1:10.20.193.78:6789/0 conn(0x7f419008cdd0 legacy=0x7f41901a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 monclient: found mon.noname-b 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419008d370 con 0x7f419008c2f0 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 5 monclient: authenticate success, global_id 104216 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4180003110 con 0x7f419008c2f0 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: dump: 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.982 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41800033e0 con 0x7f419008c2f0 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 1 -- 10.20.193.78:0/2784065856 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4180004b50 con 0x7f419008c2f0 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4194f07640 10 monclient: dump: 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 4 set_mon_vals no callback set 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: shutdown 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- 10.20.193.78:0/2784065856 >> v1:10.20.193.78:6790/0 conn(0x7f419008c2f0 legacy=0x7f419008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- 10.20.193.78:0/2784065856 shutdown_connections 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- 10.20.193.78:0/2784065856 >> 10.20.193.78:0/2784065856 conn(0x7f4190091720 msgr2=0x7f4190091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- 10.20.193.78:0/2784065856 shutdown_connections 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- 10.20.193.78:0/2784065856 wait complete. 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: build_initial_monmap 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: monmap: 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:23.984 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 Processor -- start 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- start start 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: init 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient(hunting): picked mon.noname-a con 0x7f419008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient(hunting): picked mon.noname-b con 0x7f419008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient(hunting): picked mon.noname-c con 0x7f419008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41900579c0 con 0x7f419008c2f0 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419007ddd0 con 0x7f419008cdd0 2026-02-13T18:19:23.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4190080130 con 0x7f419008dc80 2026-02-13T18:19:23.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:23.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.966+0000 7f4198194640 10 monclient(hunting): authenticate will time out at 1395.027965s 2026-02-13T18:19:23.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4195f09640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f419008c2f0 0x7f4190083680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57106/0 (socket says 10.20.193.78:57106) 2026-02-13T18:19:23.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4195f09640 1 -- 10.20.193.78:0/3915748393 learned_addr learned my addr 10.20.193.78:0/3915748393 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4195f09640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.78:6789/0 conn(0x7f419008c2f0 legacy=0x7f4190083680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f419670a640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.78:6790/0 conn(0x7f419008dc80 legacy=0x7f41901938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128190711 0 0) 0x7f41900579c0 con 0x7f419008c2f0 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): my global_id is 94335 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4160003620 con 0x7f419008c2f0 2026-02-13T18:19:23.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2813813290 0 0) 0x7f4190080130 con 0x7f419008dc80 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): my global_id is 104219 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41900579c0 con 0x7f419008dc80 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4195708640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f419008cdd0 legacy=0x7f4190192180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1902571999 0 0) 0x7f4160003620 con 0x7f419008c2f0 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4190080130 con 0x7f419008c2f0 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f41800048e0 con 0x7f419008c2f0 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): dump: 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.989 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 175267602 0 0) 0x7f41900579c0 con 0x7f419008dc80 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4160003620 con 0x7f419008dc80 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f418c004c20 con 0x7f419008dc80 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient(hunting): dump: 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1099790071 0 0) 0x7f4190080130 con 0x7f419008c2f0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.78:6790/0 conn(0x7f419008dc80 legacy=0x7f41901938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f419008cdd0 legacy=0x7f4190192180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 monclient: found mon.a 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419007f890 con 0x7f419008c2f0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 5 monclient: authenticate success, global_id 94335 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 10 monclient: _renew_subs 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4190083d90 con 0x7f419008c2f0 2026-02-13T18:19:23.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 10 monclient: _renew_subs 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f419007eb00 con 0x7f419008c2f0 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41800033c0 con 0x7f419008c2f0 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4180004f60 con 0x7f419008c2f0 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 10 monclient: dump: 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:23.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417ffff640 4 set_mon_vals no callback set 2026-02-13T18:19:23.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:23.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f419008f620 con 0x7f4190150e20 2026-02-13T18:19:23.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4180005230 con 0x7f419008c2f0 2026-02-13T18:19:23.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(684..684 src has 292..684) ==== 3915+0+0 (unknown 2605969691 0 0) 0x7f418004c630 con 0x7f419008c2f0 2026-02-13T18:19:23.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.970+0000 7f419670a640 10 monclient: get_auth_request con 0x7f416003d6c0 auth_method 0 2026-02-13T18:19:23.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:23.974+0000 7f4195708640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f4190150e20 legacy=0x7f419005acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871094426 0 0) 0x7f419007ddd0 con 0x7f4190150e20 2026-02-13T18:19:24.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient(hunting): my global_id is 114100 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4190080130 con 0x7f4190150e20 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2205521215 0 0) 0x7f4190080130 con 0x7f4190150e20 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f419007ddd0 con 0x7f4190150e20 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4184003160 con 0x7f4190150e20 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient: dump: 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.333 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2608045880 0 0) 0x7f419007ddd0 con 0x7f4190150e20 2026-02-13T18:19:24.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f419007fd00 con 0x7f4190150e20 2026-02-13T18:19:24.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f41840058c0 con 0x7f4190150e20 2026-02-13T18:19:24.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:24.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:24.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f4190150e20 legacy=0x7f419005acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f4190150e20 legacy=0x7f419005acc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:24.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f4198194640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:24.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.322+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4190090810 con 0x7f419004d200 2026-02-13T18:19:24.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4195708640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f419004d200 legacy=0x7f4190195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755972163 0 0) 0x7f4190090810 con 0x7f419004d200 2026-02-13T18:19:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient(hunting): my global_id is 114103 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f419007ddd0 con 0x7f419004d200 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2597164435 0 0) 0x7f419007ddd0 con 0x7f419004d200 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4190090810 con 0x7f419004d200 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f41840038c0 con 0x7f419004d200 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient: dump: 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.341 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 148046216 0 0) 0x7f4190090810 con 0x7f419004d200 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41900510e0 con 0x7f419004d200 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4339 (unknown 0 0 2177269364) 0x7f4184005b40 con 0x7f419004d200 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:24.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f419004d200 legacy=0x7f4190195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f417e7fc640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6789/0 conn(0x7f419004d200 legacy=0x7f4190195fd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 50, 2026-02-13T18:19:24.343 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 1023, 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:24.344 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:24.345 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:24.346 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:24.347 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:24.348 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:24.349 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:24.350 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:24.351 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:24.352 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:24.353 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.354 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:24.355 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:24.356 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:24.356 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:24.356 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:24.356 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.187:6812/2668687789 conn(0x7f416003d6c0 legacy=0x7f416005db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 10 monclient: shutdown 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 >> v1:10.20.193.78:6789/0 conn(0x7f419008c2f0 legacy=0x7f4190083680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f419670a640 1 -- 10.20.193.78:0/3915748393 reap_dead start 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f419670a640 1 -- 10.20.193.78:0/3915748393 reap_dead start 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 shutdown_connections 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 >> 10.20.193.78:0/3915748393 conn(0x7f4190091720 msgr2=0x7f419008ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 shutdown_connections 2026-02-13T18:19:24.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.326+0000 7f4198194640 1 -- 10.20.193.78:0/3915748393 wait complete. 2026-02-13T18:19:24.359 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:19:24.359 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:19:24.359 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:19:24.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.414+0000 7f36804eb640 10 monclient: get_monmap_and_config 2026-02-13T18:19:24.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.414+0000 7f36804eb640 10 monclient: build_initial_monmap 2026-02-13T18:19:24.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.414+0000 7f36804eb640 10 monclient: monmap: 2026-02-13T18:19:24.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:24.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:24.421425+0000 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:24.421425+0000 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:24.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:24.433 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 Processor -- start 2026-02-13T18:19:24.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- start start 2026-02-13T18:19:24.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient: init 2026-02-13T18:19:24.433 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:24.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:24.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient(hunting): picked mon.noname-a con 0x7f367808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:24.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient(hunting): picked mon.noname-b con 0x7f367808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:24.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient(hunting): picked mon.noname-c con 0x7f367808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:24.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678089e80 con 0x7f367808c2f0 2026-02-13T18:19:24.434 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678088c20 con 0x7f367808cdd0 2026-02-13T18:19:24.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678089ba0 con 0x7f367808dc80 2026-02-13T18:19:24.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:24.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient(hunting): authenticate will time out at 1395.476543s 2026-02-13T18:19:24.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367e260640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f367808c2f0 0x7f367808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57120/0 (socket says 10.20.193.78:57120) 2026-02-13T18:19:24.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367da5f640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f367808dc80 0x7f3678181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34254/0 (socket says 10.20.193.78:34254) 2026-02-13T18:19:24.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367e260640 1 -- 10.20.193.78:0/3033472420 learned_addr learned my addr 10.20.193.78:0/3033472420 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367da5f640 1 -- 10.20.193.78:0/3033472420 >> v1:10.20.193.78:6790/0 conn(0x7f367808dc80 legacy=0x7f3678181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367e260640 1 -- 10.20.193.78:0/3033472420 >> v1:10.20.193.78:6789/0 conn(0x7f367808c2f0 legacy=0x7f367808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034602655 0 0) 0x7f3678089ba0 con 0x7f367808dc80 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): my global_id is 104222 2026-02-13T18:19:24.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367ea61640 1 -- 10.20.193.78:0/3033472420 >> v1:10.20.193.187:6789/0 conn(0x7f367808cdd0 legacy=0x7f36781a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3660003620 con 0x7f367808dc80 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877820815 0 0) 0x7f3678089e80 con 0x7f367808c2f0 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient(hunting): my global_id is 94338 2026-02-13T18:19:24.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3678089ba0 con 0x7f367808c2f0 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3400530631 0 0) 0x7f3660003620 con 0x7f367808dc80 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 >> v1:10.20.193.187:6789/0 conn(0x7f367808cdd0 legacy=0x7f36781a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 >> v1:10.20.193.78:6789/0 conn(0x7f367808c2f0 legacy=0x7f367808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: _finish_hunting 0 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 monclient: found mon.noname-b 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:24.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367808d370 con 0x7f367808dc80 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: _finish_auth 0 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: _check_auth_tickets 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f366c003110 con 0x7f367808dc80 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: dump: 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.449 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 5 monclient: authenticate success, global_id 104222 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f366c0033e0 con 0x7f367808dc80 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 1 -- 10.20.193.78:0/3033472420 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f366c004a90 con 0x7f367808dc80 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:24.450 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f367d25e640 10 monclient: dump: 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 4 set_mon_vals no callback set 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 10 monclient: shutdown 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- 10.20.193.78:0/3033472420 >> v1:10.20.193.78:6790/0 conn(0x7f367808dc80 legacy=0x7f3678181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- 10.20.193.78:0/3033472420 shutdown_connections 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- 10.20.193.78:0/3033472420 >> 10.20.193.78:0/3033472420 conn(0x7f3678091720 msgr2=0x7f3678091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- 10.20.193.78:0/3033472420 shutdown_connections 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.418+0000 7f36804eb640 1 -- 10.20.193.78:0/3033472420 wait complete. 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: build_initial_monmap 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: monmap: 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:24.452 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 Processor -- start 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 -- start start 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: init 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:24.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient(hunting): picked mon.noname-b con 0x7f367808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient(hunting): picked mon.noname-a con 0x7f367808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient(hunting): picked mon.noname-c con 0x7f367808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36780823b0 con 0x7f367808cdd0 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678057930 con 0x7f367808c2f0 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36780820d0 con 0x7f367808dc80 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient(hunting): authenticate will time out at 1395.481115s 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f367da5f640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f367808cdd0 0x7f36781943d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57124/0 (socket says 10.20.193.78:57124) 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f367da5f640 1 -- 10.20.193.78:0/36574201 learned_addr learned my addr 10.20.193.78:0/36574201 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f367da5f640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.78:6789/0 conn(0x7f367808cdd0 legacy=0x7f36781943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f367ea61640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.78:6790/0 conn(0x7f367808dc80 legacy=0x7f3678195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496673833 0 0) 0x7f36780823b0 con 0x7f367808cdd0 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): my global_id is 94341 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f367e260640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.187:6789/0 conn(0x7f367808c2f0 legacy=0x7f36780838e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3648003620 con 0x7f367808cdd0 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891031319 0 0) 0x7f36780820d0 con 0x7f367808dc80 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): my global_id is 104225 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36780823b0 con 0x7f367808dc80 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317927433 0 0) 0x7f3678057930 con 0x7f367808c2f0 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): my global_id is 114109 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36780820d0 con 0x7f367808c2f0 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2200526386 0 0) 0x7f3648003620 con 0x7f367808cdd0 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3678057930 con 0x7f367808cdd0 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f366c002b70 con 0x7f367808cdd0 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:24.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): dump: 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3638911202 0 0) 0x7f36780823b0 con 0x7f367808dc80 2026-02-13T18:19:24.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3648003620 con 0x7f367808dc80 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3674004890 con 0x7f367808dc80 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient(hunting): dump: 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.458 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 917201080 0 0) 0x7f3678057930 con 0x7f367808cdd0 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.78:6790/0 conn(0x7f367808dc80 legacy=0x7f3678195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.187:6789/0 conn(0x7f367808c2f0 legacy=0x7f36780838e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient: _finish_hunting 0 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 monclient: found mon.a 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3678080bb0 con 0x7f367808cdd0 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient: _finish_auth 0 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 10 monclient: _check_auth_tickets 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f365effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 5 monclient: authenticate success, global_id 94341 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: _renew_subs 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:24.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3678083ff0 con 0x7f367808cdd0 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: _renew_subs 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.422+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3678153240 con 0x7f367808cdd0 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f366c0033c0 con 0x7f367808cdd0 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f366c005260 con 0x7f367808cdd0 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 10 monclient: dump: 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.460 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f367ca5d640 4 set_mon_vals no callback set 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f36804eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f36804eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f36804eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367808f600 con 0x7f367808cdd0 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f366c0118f0 con 0x7f367808cdd0 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(684..684 src has 292..684) ==== 3915+0+0 (unknown 2605969691 0 0) 0x7f366c04c6c0 con 0x7f367808cdd0 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f367e260640 10 monclient: get_auth_request con 0x7f364803d800 auth_method 0 2026-02-13T18:19:24.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f366c0176d0 con 0x7f367808cdd0 2026-02-13T18:19:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:24.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.426+0000 7f365effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:24.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.542+0000 7f36804eb640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:19:24.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.542+0000 7f36804eb640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:19:24.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.542+0000 7f36804eb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:24.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.542+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3678088910 con 0x7f367808cdd0 2026-02-13T18:19:24.565 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.566 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=2,health=12,kv=9,logm=57} crc {auth=1225724474,config=1618278320,health=2506041144,kv=2900068441,logm=2964691339}) 2026-02-13T18:19:24.566 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=11,kv=11,logm=56} crc {auth=1225724474,config=1618278320,health=1145329893,kv=4087868365,logm=406854870}) 2026-02-13T18:19:24.566 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.566 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=2,health=12,kv=9,logm=57} crc {auth=1225724474,config=1618278320,health=2506041144,kv=2900068441,logm=2964691339}) 2026-02-13T18:19:24.566 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=2008816262,config=1618278320,health=1651040866,kv=2081102228,logm=1304381200}) 2026-02-13T18:19:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f365effd640 1 -- 10.20.193.78:0/36574201 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f366c016fb0 con 0x7f367808cdd0 2026-02-13T18:19:24.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f365effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:19:24.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f365effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:24.567 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.567 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4033584450}) 2026-02-13T18:19:24.567 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=621208493}) 2026-02-13T18:19:24.567 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.187:6812/2668687789 conn(0x7f364803d800 legacy=0x7f364805dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.568 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4033584450}) 2026-02-13T18:19:24.568 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3755080276}) 2026-02-13T18:19:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 10 monclient: shutdown 2026-02-13T18:19:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 >> v1:10.20.193.78:6789/0 conn(0x7f367808cdd0 legacy=0x7f36781943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 shutdown_connections 2026-02-13T18:19:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 >> 10.20.193.78:0/36574201 conn(0x7f3678091720 msgr2=0x7f367805dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:24.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 shutdown_connections 2026-02-13T18:19:24.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:24.554+0000 7f36804eb640 1 -- 10.20.193.78:0/36574201 wait complete. 2026-02-13T18:19:24.572 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2419486224}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1137993370}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2419486224}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3703007436}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2598650088}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1122842257}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2598650088}) 2026-02-13T18:19:24.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.554+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2550676283}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2519672070}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282161808}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2519672070}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=271224506}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=778604483}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023854591}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=778604483}) 2026-02-13T18:19:24.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=117866448}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=444384674}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368756625}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=444384674}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1421757780}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3363128207}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620106700}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3363128207}) 2026-02-13T18:19:24.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.558+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2470224947}) 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2081663321}) 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=824495052}) 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2081663321}) 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2905782147}) 2026-02-13T18:19:24.577 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2114860328}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745970057}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2114860328}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=764249134}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1335688782}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3984314640}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1335688782}) 2026-02-13T18:19:24.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4134805111}) 2026-02-13T18:19:24.580 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:19:24.583 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.583 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3772301866}) 2026-02-13T18:19:24.583 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297123328}) 2026-02-13T18:19:24.583 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.583 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3772301866}) 2026-02-13T18:19:24.583 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.562+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=313372732}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=867408584}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477362037}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=867408584}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=369076017}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=689229904}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3276846738}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=689229904}) 2026-02-13T18:19:24.584 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3565596663}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3995293478}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2818239356}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3995293478}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2773720879}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1745655137}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3535145744}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1745655137}) 2026-02-13T18:19:24.585 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.566+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3614376451}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1968917614}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3505054827}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1968917614}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1092446973}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1926655644}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769149991}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1926655644}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1494825821}) 2026-02-13T18:19:24.586 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.587 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2119373185}) 2026-02-13T18:19:24.587 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3867233405}) 2026-02-13T18:19:24.587 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.587 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2119373185}) 2026-02-13T18:19:24.587 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3984269555}) 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3401806870}) 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1189446018}) 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3401806870}) 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.570+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1757541424}) 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.589 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3233851308}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470145860}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3233851308}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1714213095}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2205671700}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2292991105}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2205671700}) 2026-02-13T18:19:24.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.574+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3645082024}) 2026-02-13T18:19:24.591 INFO:tasks.rados.rados.0.trial187.stdout:3047: done (2 left) 2026-02-13T18:19:24.591 INFO:tasks.rados.rados.0.trial187.stdout:3048: done (1 left) 2026-02-13T18:19:24.591 INFO:tasks.rados.rados.0.trial187.stdout:3049: done (0 left) 2026-02-13T18:19:24.591 INFO:tasks.rados.rados.0.trial187.stdout:3050: read oid 29 snap -1 2026-02-13T18:19:24.591 INFO:tasks.rados.rados.0.trial187.stdout:3050: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:19:24.592 INFO:tasks.rados.rados.0.trial187.stdout:3051: write (excl) oid 12 current snap is 334 2026-02-13T18:19:24.592 INFO:tasks.rados.rados.0.trial187.stdout:3051: seq_num 1029 ranges {494403=738876,1764677=626345,3041436=252967} 2026-02-13T18:19:24.592 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.578+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.592 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.578+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4228339671}) 2026-02-13T18:19:24.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.578+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3546523134}) 2026-02-13T18:19:24.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.578+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.578+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4228339671}) 2026-02-13T18:19:24.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.578+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1273725258}) 2026-02-13T18:19:24.594 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.594 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2848120805}) 2026-02-13T18:19:24.594 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2642928564}) 2026-02-13T18:19:24.594 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.594 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2848120805}) 2026-02-13T18:19:24.594 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1967133923}) 2026-02-13T18:19:24.595 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.595 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2716375618}) 2026-02-13T18:19:24.595 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3021211662}) 2026-02-13T18:19:24.595 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.596 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2716375618}) 2026-02-13T18:19:24.596 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3519367974}) 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2576593240}) 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2053782295}) 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2576593240}) 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1189607364}) 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=984618763}) 2026-02-13T18:19:24.597 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107476170}) 2026-02-13T18:19:24.598 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.598 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.582+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=984618763}) 2026-02-13T18:19:24.598 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4278174331}) 2026-02-13T18:19:24.598 INFO:tasks.rados.rados.0.trial187.stdout:3051: writing trial18717860-12 from 494403 to 1233279 tid 1 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4057933654}) 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1453866214}) 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4057933654}) 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1477229626}) 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=40089231}) 2026-02-13T18:19:24.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4165639165}) 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=40089231}) 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1122254489}) 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1732049208}) 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=490381111}) 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1732049208}) 2026-02-13T18:19:24.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3077057885}) 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=12,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=40} crc {logm=4003041733,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=247461687,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=1414269678,osd_snap=260984732}) 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=12,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=39} crc {logm=4003041733,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2554655954,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=1414269678,osd_snap=1197564448}) 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=12,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=40} crc {logm=4003041733,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=247461687,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=1414269678,osd_snap=260984732}) 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.586+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=12,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=40} crc {logm=4003041733,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2554655954,mon_config_key=1421958679,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=3831369246,osd_pg_creating=1414269678,osd_snap=637806628}) 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=81,osdmap=19} crc {osd_snap=1086133399,osdmap=3221278689}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=75,osdmap=25} crc {osd_snap=257669755,osdmap=1328877253}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=81,osdmap=19} crc {osd_snap=1086133399,osdmap=3221278689}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=83,osdmap=17} crc {osd_snap=689548842,osdmap=2676336705}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4146009449}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1447163470}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4146009449}) 2026-02-13T18:19:24.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1150403363}) 2026-02-13T18:19:24.605 INFO:tasks.rados.rados.0.trial187.stdout:3051: writing trial18717860-12 from 1764677 to 2391022 tid 2 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3107226513}) 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=62556501}) 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3107226513}) 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.590+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3613136249}) 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.606 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1245606246}) 2026-02-13T18:19:24.607 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2982760994}) 2026-02-13T18:19:24.607 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.607 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1245606246}) 2026-02-13T18:19:24.607 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2012320132}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3668533878}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2278753615}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3668533878}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1740508128}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=586574446}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=903829863}) 2026-02-13T18:19:24.608 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.609 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=586574446}) 2026-02-13T18:19:24.609 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.594+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2523840957}) 2026-02-13T18:19:24.609 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.598+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.609 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.598+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=56} crc {osdmap=2804779059}) 2026-02-13T18:19:24.609 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.598+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=53} crc {osdmap=1737367712}) 2026-02-13T18:19:24.610 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.598+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:19:24.610 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.598+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=56} crc {osdmap=2804779059}) 2026-02-13T18:19:24.610 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:19:24.598+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=52} crc {osdmap=2342990023}) 2026-02-13T18:19:24.611 INFO:tasks.rados.rados.0.trial187.stdout:3051: writing trial18717860-12 from 3041436 to 3294403 tid 3 2026-02-13T18:19:24.611 INFO:tasks.rados.rados.0.trial187.stdout:3052: copy_from oid 2 from oid 32 current snap is 334 2026-02-13T18:19:24.611 INFO:tasks.rados.rados.0.trial187.stdout:3050: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:19:24.636 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1060082 2026-02-13T18:19:24.646 INFO:tasks.rados.rados.0.trial187.stdout:3051: finishing write tid 1 to trial18717860-12 2026-02-13T18:19:24.646 INFO:tasks.rados.rados.0.trial187.stdout:3051: finishing write tid 2 to trial18717860-12 2026-02-13T18:19:24.646 INFO:tasks.rados.rados.0.trial187.stdout:3051: finishing write tid 3 to trial18717860-12 2026-02-13T18:19:24.646 INFO:tasks.rados.rados.0.trial187.stdout:3051: finishing write tid 4 to trial18717860-12 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3051: finishing write tid 5 to trial18717860-12 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3051: oid 12 updating version 0 to 1048 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3051: oid 12 updating version 1048 to 1050 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3051: oid 12 updating version 1050 to 1051 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3051: oid 12 version 1051 is already newer than 1049 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1051 (ObjNum 1029 snap 334 seq_num 1029) dirty exists 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3051: left oid 12 (ObjNum 1029 snap 334 seq_num 1029) 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3052: finishing copy_from to trial18717860-2 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3052: got expected ENOENT (src dne) 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3052: finishing copy_from racing read to trial18717860-2 2026-02-13T18:19:24.647 INFO:tasks.rados.rados.0.trial187.stdout:3050: done (2 left) 2026-02-13T18:19:24.648 INFO:tasks.rados.rados.0.trial187.stdout:3051: done (1 left) 2026-02-13T18:19:24.648 INFO:tasks.rados.rados.0.trial187.stdout:3052: done (0 left) 2026-02-13T18:19:24.648 INFO:tasks.rados.rados.0.trial187.stdout:3053: copy_from oid 30 from oid 36 current snap is 334 2026-02-13T18:19:24.648 INFO:tasks.rados.rados.0.trial187.stdout:3054: write oid 10 current snap is 334 2026-02-13T18:19:24.648 INFO:tasks.rados.rados.0.trial187.stdout:3054: seq_num 1030 ranges {511210=414125,1423159=486356,2668859=589585} 2026-02-13T18:19:24.651 INFO:tasks.rados.rados.0.trial187.stdout:3054: writing trial18717860-10 from 511210 to 925335 tid 1 2026-02-13T18:19:24.658 INFO:tasks.rados.rados.0.trial187.stdout:3054: writing trial18717860-10 from 1423159 to 1909515 tid 2 2026-02-13T18:19:24.667 INFO:tasks.rados.rados.0.trial187.stdout:3054: writing trial18717860-10 from 2668859 to 3258444 tid 3 2026-02-13T18:19:24.667 INFO:tasks.rados.rados.0.trial187.stdout:3055: rollback oid 33 current snap is 334 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 33 to 319 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:3053: finishing copy_from racing read to trial18717860-30 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:3054: finishing write tid 1 to trial18717860-10 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:3053: finishing copy_from to trial18717860-30 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1073 (ObjNum 1000 snap 324 seq_num 1000) dirty exists 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:3054: finishing write tid 2 to trial18717860-10 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:3053: done (2 left) 2026-02-13T18:19:24.668 INFO:tasks.rados.rados.0.trial187.stdout:3056: snap_create 2026-02-13T18:19:24.669 INFO:tasks.rados.rados.0.trial187.stdout:3054: finishing write tid 3 to trial18717860-10 2026-02-13T18:19:24.669 INFO:tasks.rados.rados.0.trial187.stdout:3054: finishing write tid 4 to trial18717860-10 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:3054: finishing write tid 5 to trial18717860-10 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:3054: oid 10 updating version 0 to 1055 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:3054: oid 10 version 1055 is already newer than 1052 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:3054: oid 10 version 1055 is already newer than 1053 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:3054: oid 10 version 1055 is already newer than 1054 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1055 (ObjNum 1030 snap 334 seq_num 1030) dirty exists 2026-02-13T18:19:24.670 INFO:tasks.rados.rados.0.trial187.stdout:3054: left oid 10 (ObjNum 1030 snap 334 seq_num 1030) 2026-02-13T18:19:24.672 INFO:tasks.rados.rados.0.trial187.stdout:3055: finishing rollback tid 0 to trial18717860-33 2026-02-13T18:19:24.673 INFO:tasks.rados.rados.0.trial187.stdout:3055: finishing rollback tid 1 to trial18717860-33 2026-02-13T18:19:24.673 INFO:tasks.rados.rados.0.trial187.stdout:3055: finishing rollback tid 2 to trial18717860-33 2026-02-13T18:19:24.673 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 1980 (ObjNum 950 snap 311 seq_num 950) dirty exists 2026-02-13T18:19:25.545 INFO:tasks.rados.rados.0.trial187.stdout:3054: done (2 left) 2026-02-13T18:19:25.545 INFO:tasks.rados.rados.0.trial187.stdout:3055: done (1 left) 2026-02-13T18:19:25.545 INFO:tasks.rados.rados.0.trial187.stdout:3056: done (0 left) 2026-02-13T18:19:25.545 INFO:tasks.rados.rados.0.trial187.stdout:3057: rollback oid 44 current snap is 335 2026-02-13T18:19:25.545 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 332 2026-02-13T18:19:25.545 INFO:tasks.rados.rados.0.trial187.stdout:3058: delete oid 37 current snap is 335 2026-02-13T18:19:25.548 INFO:tasks.rados.rados.0.trial187.stdout:3057: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:19:25.549 INFO:tasks.rados.rados.0.trial187.stdout:3057: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:19:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3057: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:19:25.550 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1984 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:19:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3057: done (1 left) 2026-02-13T18:19:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3058: done (0 left) 2026-02-13T18:19:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3059: write oid 35 current snap is 335 2026-02-13T18:19:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3059: seq_num 1032 ranges {544824=564623,1823770=490025,3007352=337472} 2026-02-13T18:19:25.554 INFO:tasks.rados.rados.0.trial187.stdout:3059: writing trial18717860-35 from 544824 to 1109447 tid 1 2026-02-13T18:19:25.562 INFO:tasks.rados.rados.0.trial187.stdout:3059: writing trial18717860-35 from 1823770 to 2313795 tid 2 2026-02-13T18:19:25.569 INFO:tasks.rados.rados.0.trial187.stdout:3059: writing trial18717860-35 from 3007352 to 3344824 tid 3 2026-02-13T18:19:25.569 INFO:tasks.rados.rados.0.trial187.stdout:3060: snap_remove snap 330 2026-02-13T18:19:25.581 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:19:25.581 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.626+0000 7f45b917a640 10 monclient: get_monmap_and_config 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.626+0000 7f45b917a640 10 monclient: build_initial_monmap 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.626+0000 7f45b917a640 10 monclient: monmap: 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:25.633196+0000 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:25.633196+0000 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:25.640 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 Processor -- start 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- start start 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient: init 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient(hunting): picked mon.noname-c con 0x7f45b4085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient(hunting): picked mon.noname-a con 0x7f45b4085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient(hunting): picked mon.noname-b con 0x7f45b4181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b4088400 con 0x7f45b4085b60 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b4088120 con 0x7f45b4085790 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b408c550 con 0x7f45b4181d50 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient(hunting): authenticate will time out at 1396.688563s 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f45b4085b60 0x7f45b4085fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57144/0 (socket says 10.20.193.78:57144) 2026-02-13T18:19:25.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b2575640 1 -- 10.20.193.78:0/3424028679 learned_addr learned my addr 10.20.193.78:0/3424028679 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b2575640 1 -- 10.20.193.78:0/3424028679 >> v1:10.20.193.78:6789/0 conn(0x7f45b4085b60 legacy=0x7f45b4085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b3577640 1 -- 10.20.193.78:0/3424028679 >> v1:10.20.193.78:6790/0 conn(0x7f45b4181d50 legacy=0x7f45b41a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b2d76640 1 -- 10.20.193.78:0/3424028679 >> v1:10.20.193.187:6789/0 conn(0x7f45b4085790 legacy=0x7f45b4089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206510528 0 0) 0x7f45b408c550 con 0x7f45b4181d50 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient(hunting): _negotiate 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient(hunting): my global_id is 104228 2026-02-13T18:19:25.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a00058b0 con 0x7f45b4181d50 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 587282779 0 0) 0x7f45a00058b0 con 0x7f45b4181d50 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 >> v1:10.20.193.187:6789/0 conn(0x7f45b4085790 legacy=0x7f45b4089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 >> v1:10.20.193.78:6789/0 conn(0x7f45b4085b60 legacy=0x7f45b4085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: _finish_hunting 0 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 monclient: found mon.noname-b 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b4087540 con 0x7f45b4181d50 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: _finish_auth 0 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: _check_auth_tickets 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f45a40046f0 con 0x7f45b4181d50 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: dump: 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.644 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 5 monclient: authenticate success, global_id 104228 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45a4004980 con 0x7f45b4181d50 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 4 set_mon_vals no callback set 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 1 -- 10.20.193.78:0/3424028679 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f45a4004dd0 con 0x7f45b4181d50 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b1d74640 10 monclient: dump: 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.645 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 10 monclient: shutdown 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- 10.20.193.78:0/3424028679 >> v1:10.20.193.78:6790/0 conn(0x7f45b4181d50 legacy=0x7f45b41a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- 10.20.193.78:0/3424028679 shutdown_connections 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- 10.20.193.78:0/3424028679 >> 10.20.193.78:0/3424028679 conn(0x7f45b4091720 msgr2=0x7f45b4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- 10.20.193.78:0/3424028679 shutdown_connections 2026-02-13T18:19:25.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.630+0000 7f45b917a640 1 -- 10.20.193.78:0/3424028679 wait complete. 2026-02-13T18:19:25.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: build_initial_monmap 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: monmap: 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:25.651 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 Processor -- start 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 -- start start 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: init 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient(hunting): picked mon.noname-c con 0x7f45b4085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient(hunting): picked mon.noname-a con 0x7f45b4085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient(hunting): picked mon.noname-b con 0x7f45b4181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b405cdd0 con 0x7f45b4085b60 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b4089ea0 con 0x7f45b4181d50 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b405d340 con 0x7f45b4085790 2026-02-13T18:19:25.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient(hunting): authenticate will time out at 1396.692659s 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f45b4085b60 0x7f45b405a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57150/0 (socket says 10.20.193.78:57150) 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b2575640 1 -- 10.20.193.78:0/3532129103 learned_addr learned my addr 10.20.193.78:0/3532129103 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b2575640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.78:6789/0 conn(0x7f45b4085b60 legacy=0x7f45b405a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b2d76640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.78:6790/0 conn(0x7f45b4085790 legacy=0x7f45b4133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345849684 0 0) 0x7f45b405d340 con 0x7f45b4085790 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): _negotiate 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): my global_id is 104231 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4580003620 con 0x7f45b4085790 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b3577640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.187:6789/0 conn(0x7f45b4181d50 legacy=0x7f45b405b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4129954837 0 0) 0x7f4580003620 con 0x7f45b4085790 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45b405d340 con 0x7f45b4085790 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f45a8003380 con 0x7f45b4085790 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): dump: 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.654 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 984108645 0 0) 0x7f45b405d340 con 0x7f45b4085790 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.187:6789/0 conn(0x7f45b4181d50 legacy=0x7f45b405b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.78:6789/0 conn(0x7f45b4085b60 legacy=0x7f45b405a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: _finish_hunting 0 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 monclient: found mon.c 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b411bfb0 con 0x7f45b4085790 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: _finish_auth 0 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: _check_auth_tickets 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:25.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 5 monclient: authenticate success, global_id 104231 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: _renew_subs 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45b405cff0 con 0x7f45b4085790 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: _renew_subs 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f45b4133c40 con 0x7f45b4085790 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45a80039c0 con 0x7f45b4085790 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f45a8003d60 con 0x7f45b4085790 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45937fe640 10 monclient: dump: 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.656 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b1573640 4 set_mon_vals no callback set 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.634+0000 7f45b917a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45b917a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45b917a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b40389c0 con 0x7f45b4085790 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f45a8004030 con 0x7f45b4085790 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(686..686 src has 292..686) ==== 3927+0+0 (unknown 3091217982 0 0) 0x7f45a804c700 con 0x7f45b4085790 2026-02-13T18:19:25.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45b2575640 10 monclient: get_auth_request con 0x7f458003d450 auth_method 0 2026-02-13T18:19:25.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f45a80176a0 con 0x7f45b4085790 2026-02-13T18:19:25.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45937fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:25.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.638+0000 7f45937fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.754+0000 7f45b917a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.754+0000 7f45b917a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.754+0000 7f45b917a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.754+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f45b408f600 con 0x7f45b4085790 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45937fe640 1 -- 10.20.193.78:0/3532129103 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3711951671) 0x7f45a8016f80 con 0x7f45b4085790 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45937fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:25.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45937fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:25.770 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.187:6812/2668687789 conn(0x7f458003d450 legacy=0x7f458005d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 10 monclient: shutdown 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 >> v1:10.20.193.78:6790/0 conn(0x7f45b4085790 legacy=0x7f45b4133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 shutdown_connections 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 >> 10.20.193.78:0/3532129103 conn(0x7f45b4091720 msgr2=0x7f45b4057020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 shutdown_connections 2026-02-13T18:19:25.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.758+0000 7f45b917a640 1 -- 10.20.193.78:0/3532129103 wait complete. 2026-02-13T18:19:25.779 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:19:25.779 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:19:25.779 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:19:25.779 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:19:25.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.826+0000 7f2a26d58640 10 monclient: get_monmap_and_config 2026-02-13T18:19:25.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.826+0000 7f2a26d58640 10 monclient: build_initial_monmap 2026-02-13T18:19:25.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.826+0000 7f2a26d58640 10 monclient: monmap: 2026-02-13T18:19:25.840 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:25.840 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.840 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:25.832864+0000 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:25.832864+0000 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:25.841 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.826+0000 7f2a26d58640 1 Processor -- start 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.826+0000 7f2a26d58640 1 -- start start 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.826+0000 7f2a26d58640 10 monclient: init 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient(hunting): picked mon.noname-b con 0x7f2a2008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient(hunting): picked mon.noname-a con 0x7f2a2008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient(hunting): picked mon.noname-c con 0x7f2a2008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a20089e80 con 0x7f2a2008dc80 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a20088c20 con 0x7f2a2008cdd0 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a20089ba0 con 0x7f2a2008c2f0 2026-02-13T18:19:25.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:25.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient(hunting): authenticate will time out at 1396.888325s 2026-02-13T18:19:25.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a17fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2a2008dc80 0x7f2a20181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57160/0 (socket says 10.20.193.78:57160) 2026-02-13T18:19:25.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a24acd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2a2008c2f0 0x7f2a2008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34308/0 (socket says 10.20.193.78:34308) 2026-02-13T18:19:25.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a17fff640 1 -- 10.20.193.78:0/2775032197 learned_addr learned my addr 10.20.193.78:0/2775032197 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:25.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a24acd640 1 -- 10.20.193.78:0/2775032197 >> v1:10.20.193.78:6790/0 conn(0x7f2a2008c2f0 legacy=0x7f2a2008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a17fff640 1 -- 10.20.193.78:0/2775032197 >> v1:10.20.193.78:6789/0 conn(0x7f2a2008dc80 legacy=0x7f2a20181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577933263 0 0) 0x7f2a20089ba0 con 0x7f2a2008c2f0 2026-02-13T18:19:25.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:19:25.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient(hunting): my global_id is 104234 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a0c003620 con 0x7f2a2008c2f0 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a252ce640 1 -- 10.20.193.78:0/2775032197 >> v1:10.20.193.187:6789/0 conn(0x7f2a2008cdd0 legacy=0x7f2a201a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365046189 0 0) 0x7f2a0c003620 con 0x7f2a2008c2f0 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 >> v1:10.20.193.187:6789/0 conn(0x7f2a2008cdd0 legacy=0x7f2a201a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 >> v1:10.20.193.78:6789/0 conn(0x7f2a2008dc80 legacy=0x7f2a20181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: _finish_hunting 0 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 monclient: found mon.noname-b 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2008d370 con 0x7f2a2008c2f0 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: _finish_auth 0 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: _check_auth_tickets 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 5 monclient: authenticate success, global_id 104234 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2a10003110 con 0x7f2a2008c2f0 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: dump: 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.853 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a100033e0 con 0x7f2a2008c2f0 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 1 -- 10.20.193.78:0/2775032197 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2a10004a90 con 0x7f2a2008c2f0 2026-02-13T18:19:25.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a177fe640 10 monclient: dump: 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 4 set_mon_vals no callback set 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 10 monclient: shutdown 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- 10.20.193.78:0/2775032197 >> v1:10.20.193.78:6790/0 conn(0x7f2a2008c2f0 legacy=0x7f2a2008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- 10.20.193.78:0/2775032197 shutdown_connections 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- 10.20.193.78:0/2775032197 >> 10.20.193.78:0/2775032197 conn(0x7f2a20091720 msgr2=0x7f2a20091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- 10.20.193.78:0/2775032197 shutdown_connections 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.830+0000 7f2a26d58640 1 -- 10.20.193.78:0/2775032197 wait complete. 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: build_initial_monmap 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: monmap: 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:25.856 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 Processor -- start 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 -- start start 2026-02-13T18:19:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: init 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient(hunting): picked mon.noname-a con 0x7f2a2008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient(hunting): picked mon.noname-b con 0x7f2a2008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient(hunting): picked mon.noname-c con 0x7f2a2008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a20057430 con 0x7f2a2008c2f0 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200822c0 con 0x7f2a2008cdd0 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200825a0 con 0x7f2a2008dc80 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient(hunting): authenticate will time out at 1396.892945s 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a24acd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2a2008c2f0 0x7f2a20153170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57170/0 (socket says 10.20.193.78:57170) 2026-02-13T18:19:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a24acd640 1 -- 10.20.193.78:0/1861377041 learned_addr learned my addr 10.20.193.78:0/1861377041 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a24acd640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2008c2f0 legacy=0x7f2a20153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a252ce640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6790/0 conn(0x7f2a2008dc80 legacy=0x7f2a20195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977082318 0 0) 0x7f2a200825a0 con 0x7f2a2008dc80 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): _negotiate 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): my global_id is 104237 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29f0003620 con 0x7f2a2008dc80 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a17fff640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.187:6789/0 conn(0x7f2a2008cdd0 legacy=0x7f2a200839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 828618857 0 0) 0x7f29f0003620 con 0x7f2a2008dc80 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a200825a0 con 0x7f2a2008dc80 2026-02-13T18:19:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2a1c004890 con 0x7f2a2008dc80 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): dump: 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.860 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 466802685 0 0) 0x7f2a200825a0 con 0x7f2a2008dc80 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.187:6789/0 conn(0x7f2a2008cdd0 legacy=0x7f2a200839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2008c2f0 legacy=0x7f2a20153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: _finish_hunting 0 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 monclient: found mon.c 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a20088910 con 0x7f2a2008dc80 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: _finish_auth 0 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: _check_auth_tickets 2026-02-13T18:19:25.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 5 monclient: authenticate success, global_id 104237 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: _renew_subs 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a20081fe0 con 0x7f2a2008dc80 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: _renew_subs 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a20196c20 con 0x7f2a2008dc80 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a1c004ed0 con 0x7f2a2008dc80 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2a1c0052a0 con 0x7f2a2008dc80 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:25.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a16ffd640 4 set_mon_vals no callback set 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.834+0000 7f2a157fa640 10 monclient: dump: 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:25.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.838+0000 7f2a26d58640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:25.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.838+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2a2008f600 con 0x7f2a2005a160 2026-02-13T18:19:25.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.838+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f2a1c005570 con 0x7f2a2008dc80 2026-02-13T18:19:25.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.838+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(686..686 src has 292..686) ==== 3927+0+0 (unknown 3091217982 0 0) 0x7f2a1c04daf0 con 0x7f2a2008dc80 2026-02-13T18:19:25.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.838+0000 7f2a17fff640 10 monclient: get_auth_request con 0x7f29f003d450 auth_method 0 2026-02-13T18:19:25.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.838+0000 7f2a24acd640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2005a160 legacy=0x7f2a2005a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.998+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219074603 0 0) 0x7f2a2008f600 con 0x7f2a2005a160 2026-02-13T18:19:26.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.998+0000 7f2a157fa640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.998+0000 7f2a157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.998+0000 7f2a157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.998+0000 7f2a157fa640 10 monclient(hunting): my global_id is 94344 2026-02-13T18:19:26.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:25.998+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a200825a0 con 0x7f2a2005a160 2026-02-13T18:19:26.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 702898308 0 0) 0x7f2a200825a0 con 0x7f2a2005a160 2026-02-13T18:19:26.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a2008f600 con 0x7f2a2005a160 2026-02-13T18:19:26.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2a10004a90 con 0x7f2a2005a160 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 10 monclient: dump: 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.018 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3844589194 0 0) 0x7f2a2008f600 con 0x7f2a2005a160 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.002+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a200842b0 con 0x7f2a2005a160 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.006+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2a10002d90 con 0x7f2a2005a160 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.006+0000 7f2a157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.006+0000 7f2a157fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.006+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2005a160 legacy=0x7f2a2005a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.006+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2005a160 legacy=0x7f2a2005a530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a26d58640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:26.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2a20090810 con 0x7f2a2005ac40 2026-02-13T18:19:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a24acd640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2005ac40 legacy=0x7f2a20197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152907345 0 0) 0x7f2a20090810 con 0x7f2a2005ac40 2026-02-13T18:19:26.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a157fa640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a157fa640 10 monclient(hunting): my global_id is 94347 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.010+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a2008f600 con 0x7f2a2005ac40 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1900657553 0 0) 0x7f2a2008f600 con 0x7f2a2005ac40 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a20090810 con 0x7f2a2005ac40 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2a100051b0 con 0x7f2a2005ac40 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 10 monclient: dump: 2026-02-13T18:19:26.026 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1195324952 0 0) 0x7f2a20090810 con 0x7f2a2005ac40 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2a200510e0 con 0x7f2a2005ac40 2026-02-13T18:19:26.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 3789939902) 0x7f2a100052e0 con 0x7f2a2005ac40 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2005ac40 legacy=0x7f2a20197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a157fa640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6789/0 conn(0x7f2a2005ac40 legacy=0x7f2a20197f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:26.028 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 50, 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 249061, 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:26.029 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.030 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.031 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:26.032 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:26.033 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.034 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.035 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.036 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.037 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:26.038 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.039 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.040 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:19:26.041 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:26.042 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:26.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.187:6812/2668687789 conn(0x7f29f003d450 legacy=0x7f29f005d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 10 monclient: shutdown 2026-02-13T18:19:26.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 >> v1:10.20.193.78:6790/0 conn(0x7f2a2008dc80 legacy=0x7f2a20195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a252ce640 1 -- 10.20.193.78:0/1861377041 reap_dead start 2026-02-13T18:19:26.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a252ce640 1 -- 10.20.193.78:0/1861377041 reap_dead start 2026-02-13T18:19:26.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 shutdown_connections 2026-02-13T18:19:26.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 >> 10.20.193.78:0/1861377041 conn(0x7f2a20091720 msgr2=0x7f2a2008a380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 shutdown_connections 2026-02-13T18:19:26.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.014+0000 7f2a26d58640 1 -- 10.20.193.78:0/1861377041 wait complete. 2026-02-13T18:19:26.045 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:19:26.045 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:19:26.046 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:19:26.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient: get_monmap_and_config 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient: build_initial_monmap 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient: monmap: 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:26.108125+0000 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:26.108125+0000 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.117 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 1 Processor -- start 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 1 -- start start 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient: init 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient(hunting): picked mon.noname-a con 0x7fbbb008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient(hunting): picked mon.noname-b con 0x7fbbb008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:26.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient(hunting): picked mon.noname-c con 0x7fbbb008cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb0089e80 con 0x7fbbb008c2f0 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb0088c20 con 0x7fbbb008cdd0 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb0089ba0 con 0x7fbbb008dc80 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb8474640 10 monclient(hunting): authenticate will time out at 1397.163424s 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb61e9640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbbb008c2f0 0x7fbbb008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57200/0 (socket says 10.20.193.78:57200) 2026-02-13T18:19:26.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.102+0000 7fbbb61e9640 1 -- 10.20.193.78:0/1696853462 learned_addr learned my addr 10.20.193.78:0/1696853462 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb59e8640 1 -- 10.20.193.78:0/1696853462 >> v1:10.20.193.78:6790/0 conn(0x7fbbb008dc80 legacy=0x7fbbb0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb61e9640 1 -- 10.20.193.78:0/1696853462 >> v1:10.20.193.78:6789/0 conn(0x7fbbb008c2f0 legacy=0x7fbbb008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb69ea640 1 -- 10.20.193.78:0/1696853462 >> v1:10.20.193.187:6789/0 conn(0x7fbbb008cdd0 legacy=0x7fbbb01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863584749 0 0) 0x7fbbb0089ba0 con 0x7fbbb008dc80 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): my global_id is 104240 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb98003620 con 0x7fbbb008dc80 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794107940 0 0) 0x7fbbb0089e80 con 0x7fbbb008c2f0 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): my global_id is 94350 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb0089ba0 con 0x7fbbb008c2f0 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346969398 0 0) 0x7fbbb0088c20 con 0x7fbbb008cdd0 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient(hunting): my global_id is 114112 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb0089e80 con 0x7fbbb008cdd0 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 614456179 0 0) 0x7fbb98003620 con 0x7fbbb008dc80 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 >> v1:10.20.193.187:6789/0 conn(0x7fbbb008cdd0 legacy=0x7fbbb01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 >> v1:10.20.193.78:6789/0 conn(0x7fbbb008c2f0 legacy=0x7fbbb008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: _finish_hunting 0 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 monclient: found mon.noname-b 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb008d370 con 0x7fbbb008dc80 2026-02-13T18:19:26.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: _finish_auth 0 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: _check_auth_tickets 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbba4003160 con 0x7fbbb008dc80 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 5 monclient: authenticate success, global_id 104240 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: dump: 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.131 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbba4003430 con 0x7fbbb008dc80 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 1 -- 10.20.193.78:0/1696853462 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbba40038c0 con 0x7fbbb008dc80 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb51e7640 10 monclient: dump: 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:26.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 4 set_mon_vals no callback set 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: shutdown 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- 10.20.193.78:0/1696853462 >> v1:10.20.193.78:6790/0 conn(0x7fbbb008dc80 legacy=0x7fbbb0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- 10.20.193.78:0/1696853462 shutdown_connections 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- 10.20.193.78:0/1696853462 >> 10.20.193.78:0/1696853462 conn(0x7fbbb0091720 msgr2=0x7fbbb0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- 10.20.193.78:0/1696853462 shutdown_connections 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- 10.20.193.78:0/1696853462 wait complete. 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: build_initial_monmap 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: monmap: 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:26.134 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 Processor -- start 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- start start 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: init 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:19:26.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient(hunting): picked mon.noname-b con 0x7fbbb008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient(hunting): picked mon.noname-c con 0x7fbbb008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient(hunting): picked mon.noname-a con 0x7fbbb008dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb0082360 con 0x7fbbb008dc80 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb0082640 con 0x7fbbb008c2f0 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb007f640 con 0x7fbbb008cdd0 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.106+0000 7fbbb8474640 10 monclient(hunting): authenticate will time out at 1397.167954s 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb69ea640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fbbb008dc80 0x7fbbb01955e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57214/0 (socket says 10.20.193.78:57214) 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb59e8640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fbbb008cdd0 0x7fbbb007ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34334/0 (socket says 10.20.193.78:34334) 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb69ea640 1 -- 10.20.193.78:0/3531995465 learned_addr learned my addr 10.20.193.78:0/3531995465 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb59e8640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb008cdd0 legacy=0x7fbbb007ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb69ea640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6789/0 conn(0x7fbbb008dc80 legacy=0x7fbbb01955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709652445 0 0) 0x7fbbb0082360 con 0x7fbbb008dc80 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): my global_id is 94353 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb80003620 con 0x7fbbb008dc80 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669407651 0 0) 0x7fbbb007f640 con 0x7fbbb008cdd0 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): my global_id is 104243 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb0082360 con 0x7fbbb008cdd0 2026-02-13T18:19:26.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3485933709 0 0) 0x7fbb80003620 con 0x7fbbb008dc80 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb61e9640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.187:6789/0 conn(0x7fbbb008c2f0 legacy=0x7fbbb007e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbb007f640 con 0x7fbbb008dc80 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbbac0049a0 con 0x7fbbb008dc80 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): dump: 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.138 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 112184682 0 0) 0x7fbbb0082360 con 0x7fbbb008cdd0 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb80003620 con 0x7fbbb008cdd0 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbba4002bc0 con 0x7fbbb008cdd0 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient(hunting): dump: 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.139 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2731857615 0 0) 0x7fbbb007f640 con 0x7fbbb008dc80 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb008cdd0 legacy=0x7fbbb007ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.187:6789/0 conn(0x7fbbb008c2f0 legacy=0x7fbbb007e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 monclient: found mon.a 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb005dd30 con 0x7fbbb008dc80 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: _finish_auth 0 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 5 monclient: authenticate success, global_id 94353 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 10 monclient: _renew_subs 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb0088910 con 0x7fbbb008dc80 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 10 monclient: _renew_subs 2026-02-13T18:19:26.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbbb0080e40 con 0x7fbbb008dc80 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbac004c20 con 0x7fbbb008dc80 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbbac005270 con 0x7fbbb008dc80 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb49e6640 4 set_mon_vals no callback set 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 10 monclient: dump: 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.142 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbbb008f620 con 0x7fbbb007a3d0 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fbbac005450 con 0x7fbbb008dc80 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.110+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(686..686 src has 292..686) ==== 3927+0+0 (unknown 3091217982 0 0) 0x7fbbac04db50 con 0x7fbbb008dc80 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbbb59e8640 10 monclient: get_auth_request con 0x7fbb8003d7a0 auth_method 0 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbbb61e9640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb007a3d0 legacy=0x7fbbb007a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976987222 0 0) 0x7fbbb0082640 con 0x7fbbb007a3d0 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient(hunting): my global_id is 104246 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb007f640 con 0x7fbbb007a3d0 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1067813347 0 0) 0x7fbbb007f640 con 0x7fbbb007a3d0 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbb0082640 con 0x7fbbb007a3d0 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbba00031e0 con 0x7fbbb007a3d0 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient: dump: 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.144 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 108746902 0 0) 0x7fbbb0082640 con 0x7fbbb007a3d0 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbb0090810 con 0x7fbbb007a3d0 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbba0003490 con 0x7fbbb007a3d0 2026-02-13T18:19:26.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb007a3d0 legacy=0x7fbbb007a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.114+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb007a3d0 legacy=0x7fbbb007a7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.118+0000 7fbbb8474640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:26.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.118+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbbb00510e0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb61e9640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb007aeb0 legacy=0x7fbbb0197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338898705 0 0) 0x7fbbb00510e0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient(hunting): my global_id is 104249 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb0082640 con 0x7fbbb007aeb0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2902001675 0 0) 0x7fbbb0082640 con 0x7fbbb007aeb0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbb00510e0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fbba0004cc0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient: dump: 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1072665593 0 0) 0x7fbbb00510e0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbbb007b2b0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4510 (unknown 0 0 1596708477) 0x7fbba00059d0 con 0x7fbbb007aeb0 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb007aeb0 legacy=0x7fbbb0197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbb96ffd640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6790/0 conn(0x7fbbb007aeb0 legacy=0x7fbbb0197d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:19:26.150 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 50, 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 110623, 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.151 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.152 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:26.153 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.154 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.155 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.156 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.157 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.158 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:26.159 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.160 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:26.161 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.187:6812/2668687789 conn(0x7fbb8003d7a0 legacy=0x7fbb8005dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 10 monclient: shutdown 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 >> v1:10.20.193.78:6789/0 conn(0x7fbbb008dc80 legacy=0x7fbbb01955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb69ea640 1 -- 10.20.193.78:0/3531995465 reap_dead start 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb69ea640 1 -- 10.20.193.78:0/3531995465 reap_dead start 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 shutdown_connections 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 >> 10.20.193.78:0/3531995465 conn(0x7fbbb0091720 msgr2=0x7fbbb0057b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 shutdown_connections 2026-02-13T18:19:26.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.122+0000 7fbbb8474640 1 -- 10.20.193.78:0/3531995465 wait complete. 2026-02-13T18:19:26.162 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:19:26.163 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:19:26.163 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient: get_monmap_and_config 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient: build_initial_monmap 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient: monmap: 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:26.225888+0000 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:26.225888+0000 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:26.233 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 1 Processor -- start 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 1 -- start start 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient: init 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient(hunting): picked mon.noname-a con 0x7f109413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient(hunting): picked mon.noname-c con 0x7f109405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient(hunting): picked mon.noname-b con 0x7f10941853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1094095530 con 0x7f109413f8b0 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1094140390 con 0x7f109405e4b0 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109405d230 con 0x7f10941853c0 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1099ef0640 10 monclient(hunting): authenticate will time out at 1397.281488s 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10937fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f109413f8b0 0x7f109413fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57220/0 (socket says 10.20.193.78:57220) 2026-02-13T18:19:26.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10937fe640 1 -- 10.20.193.78:0/3195264935 learned_addr learned my addr 10.20.193.78:0/3195264935 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:26.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10937fe640 1 -- 10.20.193.78:0/3195264935 >> v1:10.20.193.78:6789/0 conn(0x7f109413f8b0 legacy=0x7f109413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1093fff640 1 -- 10.20.193.78:0/3195264935 >> v1:10.20.193.78:6790/0 conn(0x7f10941853c0 legacy=0x7f10941a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f1092ffd640 1 -- 10.20.193.78:0/3195264935 >> v1:10.20.193.187:6789/0 conn(0x7f109405e4b0 legacy=0x7f1094183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121211265 0 0) 0x7f1080002c60 con 0x7f109413f8b0 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): my global_id is 94356 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1078003620 con 0x7f109413f8b0 2026-02-13T18:19:26.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287529222 0 0) 0x7f109405d230 con 0x7f10941853c0 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 10 monclient(hunting): my global_id is 104252 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.222+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1080002c60 con 0x7f10941853c0 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831872526 0 0) 0x7f1084002cb0 con 0x7f109405e4b0 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient(hunting): my global_id is 114118 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f109405d230 con 0x7f109405e4b0 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2478117307 0 0) 0x7f1078003620 con 0x7f109413f8b0 2026-02-13T18:19:26.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 >> v1:10.20.193.78:6790/0 conn(0x7f10941853c0 legacy=0x7f10941a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 >> v1:10.20.193.187:6789/0 conn(0x7f109405e4b0 legacy=0x7f1094183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: _finish_hunting 0 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 monclient: found mon.noname-a 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109405d510 con 0x7f109413f8b0 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: _finish_auth 0 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: _check_auth_tickets 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f10800032e0 con 0x7f109413f8b0 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:26.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: dump: 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 5 monclient: authenticate success, global_id 94356 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10800049a0 con 0x7f109413f8b0 2026-02-13T18:19:26.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 1 -- 10.20.193.78:0/3195264935 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1080004d30 con 0x7f109413f8b0 2026-02-13T18:19:26.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:26.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10927fc640 10 monclient: dump: 2026-02-13T18:19:26.258 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.258 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.258 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.258 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 4 set_mon_vals no callback set 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: shutdown 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- 10.20.193.78:0/3195264935 >> v1:10.20.193.78:6789/0 conn(0x7f109413f8b0 legacy=0x7f109413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- 10.20.193.78:0/3195264935 shutdown_connections 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- 10.20.193.78:0/3195264935 >> 10.20.193.78:0/3195264935 conn(0x7f10940545d0 msgr2=0x7f10940549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- 10.20.193.78:0/3195264935 shutdown_connections 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- 10.20.193.78:0/3195264935 wait complete. 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: build_initial_monmap 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: monmap: 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:26.260 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:26.261 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 Processor -- start 2026-02-13T18:19:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- start start 2026-02-13T18:19:26.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: init 2026-02-13T18:19:26.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:26.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient(hunting): picked mon.noname-b con 0x7f109405e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient(hunting): picked mon.noname-a con 0x7f109413f8b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient(hunting): picked mon.noname-c con 0x7f10941853c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109408a330 con 0x7f109413f8b0 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1094057e50 con 0x7f109405e4b0 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109408a960 con 0x7f10941853c0 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1099ef0640 10 monclient(hunting): authenticate will time out at 1397.285538s 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1092ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f109413f8b0 0x7f1094180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:57226/0 (socket says 10.20.193.78:57226) 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1093fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f10941853c0 0x7f1094181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34370/0 (socket says 10.20.193.78:34370) 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1092ffd640 1 -- 10.20.193.78:0/3622258625 learned_addr learned my addr 10.20.193.78:0/3622258625 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:26.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1093fff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.78:6790/0 conn(0x7f10941853c0 legacy=0x7f1094181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f1092ffd640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.78:6789/0 conn(0x7f109413f8b0 legacy=0x7f1094180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552862591 0 0) 0x7f109408a960 con 0x7f10941853c0 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): my global_id is 104255 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1064003620 con 0x7f10941853c0 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f10937fe640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f109405e4b0 legacy=0x7f10941a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569496731 0 0) 0x7f109408a330 con 0x7f109413f8b0 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 10 monclient(hunting): my global_id is 94359 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.226+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f109408a960 con 0x7f109413f8b0 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321968205 0 0) 0x7f1094057e50 con 0x7f109405e4b0 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): my global_id is 114121 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f109408a330 con 0x7f109405e4b0 2026-02-13T18:19:26.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 196649400 0 0) 0x7f109408a960 con 0x7f109413f8b0 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1094057e50 con 0x7f109413f8b0 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1084003710 con 0x7f109413f8b0 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): dump: 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.271 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1505321176 0 0) 0x7f1064003620 con 0x7f10941853c0 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f109408a960 con 0x7f10941853c0 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1088004c20 con 0x7f10941853c0 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): dump: 2026-02-13T18:19:26.272 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1872270690 0 0) 0x7f1094057e50 con 0x7f109413f8b0 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.78:6790/0 conn(0x7f10941853c0 legacy=0x7f1094181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f109405e4b0 legacy=0x7f10941a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 monclient: found mon.a 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10941a5b20 con 0x7f109413f8b0 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: _finish_auth 0 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:19:26.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 5 monclient: authenticate success, global_id 94359 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 10 monclient: _renew_subs 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f109412d5c0 con 0x7f109413f8b0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 10 monclient: _renew_subs 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1094192050 con 0x7f109413f8b0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1084003c90 con 0x7f109413f8b0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1084004060 con 0x7f109413f8b0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: dump: 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1091ffb640 4 set_mon_vals no callback set 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10940008e0 con 0x7f10941a6680 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1084004240 con 0x7f109413f8b0 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(686..686 src has 292..686) ==== 3927+0+0 (unknown 3091217982 0 0) 0x7f108404c790 con 0x7f109413f8b0 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f1093fff640 10 monclient: get_auth_request con 0x7f106403d800 auth_method 0 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f10937fe640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f10941a6680 legacy=0x7f109408e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169020516 0 0) 0x7f10940008e0 con 0x7f10941a6680 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient(hunting): my global_id is 114124 2026-02-13T18:19:26.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1094057e50 con 0x7f10941a6680 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2200081922 0 0) 0x7f1094057e50 con 0x7f10941a6680 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10940008e0 con 0x7f10941a6680 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1080002d00 con 0x7f10941a6680 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.230+0000 7f106ffff640 10 monclient: dump: 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.278 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 765843264 0 0) 0x7f10940008e0 con 0x7f10941a6680 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1094093020 con 0x7f10941a6680 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1080003150 con 0x7f10941a6680 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f10941a6680 legacy=0x7f109408e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f10941a6680 legacy=0x7f109408e9d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:26.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f1099ef0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.234+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1094090840 con 0x7f1094184ba0 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f10937fe640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f1094184ba0 legacy=0x7f109408d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944522941 0 0) 0x7f1094090840 con 0x7f1094184ba0 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient(hunting): my global_id is 114127 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10940008e0 con 0x7f1094184ba0 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 314190011 0 0) 0x7f10940008e0 con 0x7f1094184ba0 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1094090840 con 0x7f1094184ba0 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f10800050a0 con 0x7f1094184ba0 2026-02-13T18:19:26.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient: dump: 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2560567683 0 0) 0x7f1094090840 con 0x7f1094184ba0 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1094090a10 con 0x7f1094184ba0 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4339 (unknown 0 0 3480019779) 0x7f1080005280 con 0x7f1094184ba0 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f1094184ba0 legacy=0x7f109408d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f106ffff640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6789/0 conn(0x7f1094184ba0 legacy=0x7f109408d850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:26.282 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 50, 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 2935, 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.283 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.284 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.285 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:26.286 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:26.287 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:26.288 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:26.289 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.290 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:26.291 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:26.292 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:26.293 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.187:6812/2668687789 conn(0x7f106403d800 legacy=0x7f106405dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 10 monclient: shutdown 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 >> v1:10.20.193.78:6789/0 conn(0x7f109413f8b0 legacy=0x7f1094180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1093fff640 1 -- 10.20.193.78:0/3622258625 reap_dead start 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1093fff640 1 -- 10.20.193.78:0/3622258625 reap_dead start 2026-02-13T18:19:26.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 shutdown_connections 2026-02-13T18:19:26.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 >> 10.20.193.78:0/3622258625 conn(0x7f10940545d0 msgr2=0x7f109408c130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 shutdown_connections 2026-02-13T18:19:26.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.238+0000 7f1099ef0640 1 -- 10.20.193.78:0/3622258625 wait complete. 2026-02-13T18:19:26.295 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:19:26.295 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T18:19:26.295 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:19:26.295 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T18:19:26.295 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T18:19:26.296 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T18:19:26.296 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:19:26.310 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T18:19:26.310 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:19:26.310 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:19:26.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient: get_monmap_and_config 2026-02-13T18:19:26.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient: build_initial_monmap 2026-02-13T18:19:26.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient: monmap: 2026-02-13T18:19:26.411 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:26.411 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.411 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:26.404201+0000 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:26.404201+0000 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:26.412 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 1 Processor -- start 2026-02-13T18:19:26.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 1 -- start start 2026-02-13T18:19:26.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient: init 2026-02-13T18:19:26.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:26.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient(hunting): picked mon.noname-c con 0x7f104808e400 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient(hunting): picked mon.noname-b con 0x7f104808d940 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient(hunting): picked mon.noname-a con 0x7f104808eee0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104808bfe0 con 0x7f104808eee0 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104808d000 con 0x7f104808e400 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104808d1d0 con 0x7f104808d940 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f1050011640 10 monclient(hunting): authenticate will time out at 1397.459337s 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f104e587640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f104808eee0 legacy=0x7f10481a34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f104d585640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f104808d940 0x7f1048181d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34396/0 (socket says 10.20.193.78:34396) 2026-02-13T18:19:26.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.398+0000 7f104d585640 1 -- 10.20.193.78:0/937014955 learned_addr learned my addr 10.20.193.78:0/937014955 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104d585640 1 -- 10.20.193.78:0/937014955 >> v1:10.20.193.78:6790/0 conn(0x7f104808d940 legacy=0x7f1048181d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104dd86640 1 -- 10.20.193.78:0/937014955 >> v1:10.20.193.187:6789/0 conn(0x7f104808e400 legacy=0x7f104808e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409480013 0 0) 0x7f104808d1d0 con 0x7f104808d940 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): my global_id is 104258 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1030003620 con 0x7f104808d940 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231518927 0 0) 0x7f104808d000 con 0x7f104808e400 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient(hunting): my global_id is 114130 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f104808d1d0 con 0x7f104808e400 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2566776538 0 0) 0x7f1030003620 con 0x7f104808d940 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 >> v1:10.20.193.187:6789/0 conn(0x7f104808e400 legacy=0x7f104808e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 >> v1:10.20.193.78:6789/0 conn(0x7f104808eee0 legacy=0x7f10481a34c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: _finish_hunting 0 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 monclient: found mon.noname-b 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104808d3a0 con 0x7f104808d940 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: _finish_auth 0 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: _check_auth_tickets 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 5 monclient: authenticate success, global_id 104258 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f103c003110 con 0x7f104808d940 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: dump: 2026-02-13T18:19:26.418 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f103c003450 con 0x7f104808d940 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 1 -- 10.20.193.78:0/937014955 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f103c004b50 con 0x7f104808d940 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f104cd84640 10 monclient: dump: 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.419 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 4 set_mon_vals no callback set 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: shutdown 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 -- 10.20.193.78:0/937014955 >> v1:10.20.193.78:6790/0 conn(0x7f104808d940 legacy=0x7f1048181d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 -- 10.20.193.78:0/937014955 shutdown_connections 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 -- 10.20.193.78:0/937014955 >> 10.20.193.78:0/937014955 conn(0x7f1048054e30 msgr2=0x7f1048093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 -- 10.20.193.78:0/937014955 shutdown_connections 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 -- 10.20.193.78:0/937014955 wait complete. 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: build_initial_monmap 2026-02-13T18:19:26.420 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: monmap: 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 Processor -- start 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 1 -- start start 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: init 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.402+0000 7f1050011640 10 monclient(hunting): picked mon.noname-a con 0x7f104808d940 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient(hunting): picked mon.noname-c con 0x7f104808e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:26.421 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f104dd86640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f104808d940 legacy=0x7f1048086a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient(hunting): picked mon.noname-b con 0x7f104808eee0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1048056850 con 0x7f104808d940 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104808abf0 con 0x7f104808eee0 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104805df70 con 0x7f104808e400 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient(hunting): authenticate will time out at 1397.464056s 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f104d585640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f104808e400 0x7f1048194730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34398/0 (socket says 10.20.193.78:34398) 2026-02-13T18:19:26.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f104d585640 1 -- 10.20.193.78:0/373429508 learned_addr learned my addr 10.20.193.78:0/373429508 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f104d585640 1 -- 10.20.193.78:0/373429508 >> v1:10.20.193.78:6790/0 conn(0x7f104808e400 legacy=0x7f1048194730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f104e587640 1 -- 10.20.193.78:0/373429508 >> v1:10.20.193.187:6789/0 conn(0x7f104808eee0 legacy=0x7f1048195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675547885 0 0) 0x7f104805df70 con 0x7f104808e400 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): my global_id is 104261 2026-02-13T18:19:26.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1018003620 con 0x7f104808e400 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823842035 0 0) 0x7f104808abf0 con 0x7f104808eee0 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): my global_id is 114133 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f104805df70 con 0x7f104808eee0 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2372651479 0 0) 0x7f1018003620 con 0x7f104808e400 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f104808abf0 con 0x7f104808e400 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f103c002b70 con 0x7f104808e400 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): dump: 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.425 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1340766448 0 0) 0x7f104805df70 con 0x7f104808eee0 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1018003620 con 0x7f104808eee0 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f10440058c0 con 0x7f104808eee0 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient(hunting): dump: 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.426 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3450737310 0 0) 0x7f104808abf0 con 0x7f104808e400 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 >> v1:10.20.193.187:6789/0 conn(0x7f104808eee0 legacy=0x7f1048195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 >> v1:10.20.193.78:6789/0 conn(0x7f104808d940 legacy=0x7f1048086a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: _finish_hunting 0 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 monclient: found mon.c 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104808a300 con 0x7f104808e400 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: _finish_auth 0 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: _check_auth_tickets 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 5 monclient: authenticate success, global_id 104261 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient: _renew_subs 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f104807a470 con 0x7f104808e400 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient: _renew_subs 2026-02-13T18:19:26.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1048087160 con 0x7f104808e400 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f103c003330 con 0x7f104808e400 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f103c005190 con 0x7f104808e400 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 10 monclient: dump: 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1037fff640 4 set_mon_vals no callback set 2026-02-13T18:19:26.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10480008e0 con 0x7f104808e400 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.406+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f103c011820 con 0x7f104808e400 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.410+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(686..686 src has 292..686) ==== 3927+0+0 (unknown 3091217982 0 0) 0x7f103c04c590 con 0x7f104808e400 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.410+0000 7f104dd86640 10 monclient: get_auth_request con 0x7f101803d610 auth_method 0 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.410+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f103c0175f0 con 0x7f104808e400 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.410+0000 7f10367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:26.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.410+0000 7f10367fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:26.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:19:26.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:26.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:26.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f10481a4df0 con 0x7f104808e400 2026-02-13T18:19:26.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f10367fc640 1 -- 10.20.193.78:0/373429508 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2971517563) 0x7f103c016ed0 con 0x7f104808e400 2026-02-13T18:19:26.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f10367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:26.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f10367fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:26.543 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:19:26.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 >> v1:10.20.193.187:6812/2668687789 conn(0x7f101803d610 legacy=0x7f101805dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 10 monclient: shutdown 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 >> v1:10.20.193.78:6790/0 conn(0x7f104808e400 legacy=0x7f1048194730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 shutdown_connections 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 >> 10.20.193.78:0/373429508 conn(0x7f1048054e30 msgr2=0x7f104805e350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 shutdown_connections 2026-02-13T18:19:26.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:26.530+0000 7f1050011640 1 -- 10.20.193.78:0/373429508 wait complete. 2026-02-13T18:19:29.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:19:29.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient: get_monmap_and_config 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient: build_initial_monmap 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient: monmap: 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:29.608607+0000 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:29.608607+0000 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:29.616 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 1 Processor -- start 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 1 -- start start 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient: init 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient(hunting): picked mon.noname-b con 0x7fa93408c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient(hunting): picked mon.noname-a con 0x7fa93408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient(hunting): picked mon.noname-c con 0x7fa93408cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa934089e80 con 0x7fa93408dc80 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa934088c20 con 0x7fa93408cdd0 2026-02-13T18:19:29.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa934089ba0 con 0x7fa93408c2f0 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93b5ea640 10 monclient(hunting): authenticate will time out at 1400.663856s 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa938b5e640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fa93408dc80 legacy=0x7fa934181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93935f640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa93408c2f0 0x7fa93408c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34414/0 (socket says 10.20.193.78:34414) 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.602+0000 7fa93935f640 1 -- 10.20.193.78:0/2276757504 learned_addr learned my addr 10.20.193.78:0/2276757504 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93935f640 1 -- 10.20.193.78:0/2276757504 >> v1:10.20.193.78:6790/0 conn(0x7fa93408c2f0 legacy=0x7fa93408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:29.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa939b60640 1 -- 10.20.193.78:0/2276757504 >> v1:10.20.193.187:6789/0 conn(0x7fa93408cdd0 legacy=0x7fa9341a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264748375 0 0) 0x7fa934089ba0 con 0x7fa93408c2f0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient(hunting): my global_id is 104264 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa91c003620 con 0x7fa93408c2f0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3858107449 0 0) 0x7fa91c003620 con 0x7fa93408c2f0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 >> v1:10.20.193.187:6789/0 conn(0x7fa93408cdd0 legacy=0x7fa9341a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 >> v1:10.20.193.78:6789/0 conn(0x7fa93408dc80 legacy=0x7fa934181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: _finish_hunting 0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 monclient: found mon.noname-b 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93408d370 con 0x7fa93408c2f0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: _finish_auth 0 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: _check_auth_tickets 2026-02-13T18:19:29.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa924003110 con 0x7fa93408c2f0 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: dump: 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 5 monclient: authenticate success, global_id 104264 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9240033e0 con 0x7fa93408c2f0 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 1 -- 10.20.193.78:0/2276757504 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa924004b50 con 0x7fa93408c2f0 2026-02-13T18:19:29.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa923fff640 10 monclient: dump: 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 4 set_mon_vals no callback set 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 10 monclient: shutdown 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 1 -- 10.20.193.78:0/2276757504 >> v1:10.20.193.78:6790/0 conn(0x7fa93408c2f0 legacy=0x7fa93408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 1 -- 10.20.193.78:0/2276757504 shutdown_connections 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 1 -- 10.20.193.78:0/2276757504 >> 10.20.193.78:0/2276757504 conn(0x7fa934091720 msgr2=0x7fa934091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 1 -- 10.20.193.78:0/2276757504 shutdown_connections 2026-02-13T18:19:29.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 1 -- 10.20.193.78:0/2276757504 wait complete. 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 10 monclient: build_initial_monmap 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.606+0000 7fa93b5ea640 10 monclient: monmap: 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 1 Processor -- start 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 1 -- start start 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient: init 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient(hunting): picked mon.noname-a con 0x7fa93408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:29.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient(hunting): picked mon.noname-c con 0x7fa93408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient(hunting): picked mon.noname-b con 0x7fa93408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93935f640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fa93408c2f0 legacy=0x7fa9341510e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa93407e0c0 con 0x7fa93408c2f0 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa934057980 con 0x7fa93408dc80 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa934088910 con 0x7fa93408cdd0 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa93b5ea640 10 monclient(hunting): authenticate will time out at 1400.668535s 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa938b5e640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa93408cdd0 0x7fa934083970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34420/0 (socket says 10.20.193.78:34420) 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa938b5e640 1 -- 10.20.193.78:0/1795828310 learned_addr learned my addr 10.20.193.78:0/1795828310 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa938b5e640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.78:6790/0 conn(0x7fa93408cdd0 legacy=0x7fa934083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa938b5e640 1 --1- 10.20.193.78:0/1795828310 >> v1:10.20.193.78:6790/0 conn(0x7fa93408cdd0 0x7fa934083970 :-1 s=OPENED pgs=569 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7fa934088910 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:19:29.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.610+0000 7fa939b60640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.187:6789/0 conn(0x7fa93408dc80 legacy=0x7fa934193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:29.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:29.814+0000 7fa93935f640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.78:6789/0 conn(0x7fa93408c2f0 legacy=0x7fa9341510e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.218+0000 7fa93935f640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.78:6789/0 conn(0x7fa93408c2f0 legacy=0x7fa9341510e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:30.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498519026 0 0) 0x7fa934088910 con 0x7fa93408cdd0 2026-02-13T18:19:30.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): my global_id is 104267 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa904003620 con 0x7fa93408cdd0 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 194745930 0 0) 0x7fa904003620 con 0x7fa93408cdd0 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa934088910 con 0x7fa93408cdd0 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa928004540 con 0x7fa93408cdd0 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): dump: 2026-02-13T18:19:30.250 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2740518907 0 0) 0x7fa934088910 con 0x7fa93408cdd0 2026-02-13T18:19:30.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.187:6789/0 conn(0x7fa93408dc80 legacy=0x7fa934193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.78:6789/0 conn(0x7fa93408c2f0 legacy=0x7fa9341510e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 monclient: found mon.c 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa934080420 con 0x7fa93408cdd0 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: _finish_auth 0 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 5 monclient: authenticate success, global_id 104267 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 10 monclient: _renew_subs 2026-02-13T18:19:30.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa93407fb80 con 0x7fa93408cdd0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 10 monclient: _renew_subs 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa934084250 con 0x7fa93408cdd0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa928004810 con 0x7fa93408cdd0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa928004ba0 con 0x7fa93408cdd0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa921ffb640 10 monclient: dump: 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:30.253 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa9237fe640 4 set_mon_vals no callback set 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.234+0000 7fa93b5ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa93b5ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:30.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa93b5ea640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:30.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa93408f620 con 0x7fa93408cdd0 2026-02-13T18:19:30.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa928004e70 con 0x7fa93408cdd0 2026-02-13T18:19:30.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(686..686 src has 292..686) ==== 3927+0+0 (unknown 3091217982 0 0) 0x7fa92804c6b0 con 0x7fa93408cdd0 2026-02-13T18:19:30.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa93935f640 10 monclient: get_auth_request con 0x7fa90403d2f0 auth_method 0 2026-02-13T18:19:30.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fa93408f620 con 0x7fa93408cdd0 2026-02-13T18:19:30.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa921ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:30.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.238+0000 7fa921ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:30.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa934090810 con 0x7fa93408cdd0 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa921ffb640 1 -- 10.20.193.78:0/1795828310 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1750798582) 0x7fa928017650 con 0x7fa93408cdd0 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa921ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa921ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:30.374 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":50,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:19:30.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa90403d2f0 legacy=0x7fa90405d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:30.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 10 monclient: shutdown 2026-02-13T18:19:30.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:30.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 >> v1:10.20.193.78:6790/0 conn(0x7fa93408cdd0 legacy=0x7fa934083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:30.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 shutdown_connections 2026-02-13T18:19:30.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 >> 10.20.193.78:0/1795828310 conn(0x7fa934091720 msgr2=0x7fa93405db10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:30.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 shutdown_connections 2026-02-13T18:19:30.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:30.362+0000 7fa93b5ea640 1 -- 10.20.193.78:0/1795828310 wait complete. 2026-02-13T18:19:33.385 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient: get_monmap_and_config 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient: build_initial_monmap 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient: monmap: 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:33.450896+0000 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:33.450896+0000 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:33.458 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 1 Processor -- start 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 1 -- start start 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient: init 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient(hunting): picked mon.noname-a con 0x7fcc0008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient(hunting): picked mon.noname-c con 0x7fcc0008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient(hunting): picked mon.noname-b con 0x7fcc0008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00089e80 con 0x7fcc0008c2f0 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00088c20 con 0x7fcc0008dc80 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00089ba0 con 0x7fcc0008cdd0 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcbfe575640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc0008c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcc04fdc640 10 monclient(hunting): authenticate will time out at 1404.506087s 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcbfed76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 0x7fcc001a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:57846/0 (socket says 10.20.193.78:57846) 2026-02-13T18:19:33.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.446+0000 7fcbfed76640 1 -- 10.20.193.78:0/1807591022 learned_addr learned my addr 10.20.193.78:0/1807591022 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:33.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.450+0000 7fcbfed76640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcc001a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:33.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.450+0000 7fcbfdd74640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.187:6789/0 conn(0x7fcc0008dc80 legacy=0x7fcc00181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:33.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:33.650+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc0008c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:34.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:34.054+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc0008c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:34.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:34.858+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc0008c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): tick 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 monclient(hunting): continuing hunt 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcc001a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.187:6789/0 conn(0x7fcc0008dc80 legacy=0x7fcc00181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc0008c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:36.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): picked mon.noname-a con 0x7fcc0008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): picked mon.noname-b con 0x7fcc0008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): picked mon.noname-c con 0x7fcc0008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0008d370 con 0x7fcc0008c2f0 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00089e80 con 0x7fcc0008dc80 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbdc06a180 con 0x7fcc0008cdd0 2026-02-13T18:19:36.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbe7fff640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:36.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbfdd74640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcbdc0450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:36.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.450+0000 7fcbfed76640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.187:6789/0 conn(0x7fcc0008dc80 legacy=0x7fcbdc0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:36.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:36.654+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:37.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:37.058+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:37.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:37.862+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): tick 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 monclient(hunting): continuing hunt 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcbdc0450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.187:6789/0 conn(0x7fcc0008dc80 legacy=0x7fcbdc0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:39.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): picked mon.noname-c con 0x7fcbdc0692e0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): picked mon.noname-a con 0x7fcc0008c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): picked mon.noname-b con 0x7fcc0008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbdc06b4e0 con 0x7fcc0008c2f0 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0008d370 con 0x7fcbdc0692e0 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbdc046810 con 0x7fcc0008cdd0 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbe7fff640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:39.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbfdd74640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:39.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbfed76640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcbdc0450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:39.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.450+0000 7fcbfe575640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.187:6789/0 conn(0x7fcbdc0692e0 legacy=0x7fcbdc0696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:39.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:39.654+0000 7fcbfdd74640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:40.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:40.058+0000 7fcbfdd74640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:40.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:40.862+0000 7fcbfdd74640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3060: done (1 left) 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3061: rollback oid 31 current snap is 335 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 329 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3059: finishing write tid 1 to trial18717860-35 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3059: finishing write tid 2 to trial18717860-35 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3059: finishing write tid 3 to trial18717860-35 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3059: finishing write tid 4 to trial18717860-35 2026-02-13T18:19:41.065 INFO:tasks.rados.rados.0.trial187.stdout:3059: finishing write tid 5 to trial18717860-35 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3059: oid 35 updating version 0 to 1808 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3059: oid 35 updating version 1808 to 1811 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3059: oid 35 version 1811 is already newer than 1810 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3059: oid 35 version 1811 is already newer than 1809 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1811 (ObjNum 1032 snap 335 seq_num 1032) dirty exists 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3059: left oid 35 (ObjNum 1032 snap 335 seq_num 1032) 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3059: done (1 left) 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3062: copy_from oid 5 from oid 41 current snap is 335 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3063: delete oid 17 current snap is 335 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:3061: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:19:41.066 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 0 (ObjNum 33 snap 0 seq_num 284888954) dirty dne 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3062: finishing copy_from to trial18717860-5 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3062: got expected ENOENT (src dne) 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3062: finishing copy_from racing read to trial18717860-5 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3061: done (2 left) 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3062: done (1 left) 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3063: done (0 left) 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3064: copy_from oid 23 from oid 5 current snap is 335 2026-02-13T18:19:41.067 INFO:tasks.rados.rados.0.trial187.stdout:3065: delete oid 33 current snap is 335 2026-02-13T18:19:41.068 INFO:tasks.rados.rados.0.trial187.stdout:3065: done (1 left) 2026-02-13T18:19:41.069 INFO:tasks.rados.rados.0.trial187.stdout:3066: read oid 4 snap 334 2026-02-13T18:19:41.069 INFO:tasks.rados.rados.0.trial187.stdout:3066: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:19:41.069 INFO:tasks.rados.rados.0.trial187.stdout:3067: snap_create 2026-02-13T18:19:41.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166880725 0 0) 0x7fcbdc046810 con 0x7fcc0008cdd0 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient(hunting): my global_id is 104270 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbec003620 con 0x7fcc0008cdd0 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3280131862 0 0) 0x7fcbec003620 con 0x7fcc0008cdd0 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.187:6789/0 conn(0x7fcbdc0692e0 legacy=0x7fcbdc0696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcbdc0238d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: _finish_hunting 0 2026-02-13T18:19:41.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 monclient: found mon.noname-b 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc0479f0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: _finish_auth 0 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: _check_auth_tickets 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcbf0004580 con 0x7fcc0008cdd0 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: dump: 2026-02-13T18:19:41.074 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 5 monclient: authenticate success, global_id 104270 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:41.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbf0004760 con 0x7fcc0008cdd0 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 4 set_mon_vals no callback set 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 1 -- 10.20.193.78:0/1807591022 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcbf0005eb0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfd573640 10 monclient: dump: 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.076 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: shutdown 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- 10.20.193.78:0/1807591022 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcbdc0450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- 10.20.193.78:0/1807591022 shutdown_connections 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- 10.20.193.78:0/1807591022 >> 10.20.193.78:0/1807591022 conn(0x7fcc00091720 msgr2=0x7fcc00091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:41.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- 10.20.193.78:0/1807591022 shutdown_connections 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- 10.20.193.78:0/1807591022 wait complete. 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: build_initial_monmap 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: monmap: 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:41.078 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:41.079 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:41.079 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:41.079 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:41.079 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:41.079 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:41.079 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 Processor -- start 2026-02-13T18:19:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- start start 2026-02-13T18:19:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: init 2026-02-13T18:19:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:19:41.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient(hunting): picked mon.noname-a con 0x7fcbdc0692e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient(hunting): picked mon.noname-b con 0x7fcc0008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient(hunting): picked mon.noname-c con 0x7fcc0008cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00082710 con 0x7fcbdc0692e0 2026-02-13T18:19:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00086640 con 0x7fcc0008c2f0 2026-02-13T18:19:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc000829f0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcc04fdc640 10 monclient(hunting): authenticate will time out at 1412.111732s 2026-02-13T18:19:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfe575640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7fcbdc0692e0 legacy=0x7fcc00085820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfdd74640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fcc0008c2f0 0x7fcc00085f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:47418/0 (socket says 10.20.193.78:47418) 2026-02-13T18:19:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.050+0000 7fcbfdd74640 1 -- 10.20.193.78:0/41030206 learned_addr learned my addr 10.20.193.78:0/41030206 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.054+0000 7fcbfdd74640 1 -- 10.20.193.78:0/41030206 >> v1:10.20.193.187:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc00085f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.054+0000 7fcbfed76640 1 -- 10.20.193.78:0/41030206 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcc00135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.054+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3948590392 0 0) 0x7fcc000829f0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): my global_id is 104273 2026-02-13T18:19:41.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbcc003620 con 0x7fcc0008cdd0 2026-02-13T18:19:41.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2067718794 0 0) 0x7fcbcc003620 con 0x7fcc0008cdd0 2026-02-13T18:19:41.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc000829f0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcbf0005df0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:41.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:41.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): dump: 2026-02-13T18:19:41.085 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.085 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.085 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.085 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.085 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.086 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.086 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.086 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.086 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 857624316 0 0) 0x7fcc000829f0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 >> v1:10.20.193.187:6789/0 conn(0x7fcc0008c2f0 legacy=0x7fcc00085f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 >> v1:10.20.193.78:6789/0 conn(0x7fcbdc0692e0 legacy=0x7fcc00085820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:19:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:19:41.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 monclient: found mon.c 2026-02-13T18:19:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc000578d0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:19:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:19:41.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 5 monclient: authenticate success, global_id 104273 2026-02-13T18:19:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 monclient: _renew_subs 2026-02-13T18:19:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcc00088910 con 0x7fcc0008cdd0 2026-02-13T18:19:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 monclient: _renew_subs 2026-02-13T18:19:41.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcc00080f70 con 0x7fcc0008cdd0 2026-02-13T18:19:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbf0004760 con 0x7fcc0008cdd0 2026-02-13T18:19:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fcbf0006430 con 0x7fcc0008cdd0 2026-02-13T18:19:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbfcd72640 4 set_mon_vals no callback set 2026-02-13T18:19:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 10 monclient: dump: 2026-02-13T18:19:41.091 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.091 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.091 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.092 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.092 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.092 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.092 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.092 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.092 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.093 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0008f620 con 0x7fcc0008cdd0 2026-02-13T18:19:41.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fcbf00066d0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(687..687 src has 292..687) ==== 3943+0+0 (unknown 1114258888 0 0) 0x7fcbf004d9c0 con 0x7fcc0008cdd0 2026-02-13T18:19:41.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.058+0000 7fcbfe575640 10 monclient: get_auth_request con 0x7fcbcc03d390 auth_method 0 2026-02-13T18:19:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.062+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fcc0008f620 con 0x7fcc0008cdd0 2026-02-13T18:19:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.062+0000 7fcbe6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.062+0000 7fcbe6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:41.096 INFO:tasks.rados.rados.0.trial187.stdout:3066: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:19:41.116 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:41.157 INFO:tasks.rados.rados.0.trial187.stdout:3064: finishing copy_from racing read to trial18717860-23 2026-02-13T18:19:41.158 INFO:tasks.rados.rados.0.trial187.stdout:3064: finishing copy_from to trial18717860-23 2026-02-13T18:19:41.158 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1440 (ObjNum 1016 snap 330 seq_num 1016) dirty exists 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcc00090810 con 0x7fcc0008cdd0 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcbe6ffd640 1 -- 10.20.193.78:0/41030206 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 4186854732) 0x7fcbf0018a70 con 0x7fcc0008cdd0 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcbe6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:19:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcbe6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":54,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 >> v1:10.20.193.187:6812/2668687789 conn(0x7fcbcc03d390 legacy=0x7fcbcc05d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 10 monclient: shutdown 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 >> v1:10.20.193.78:6790/0 conn(0x7fcc0008cdd0 legacy=0x7fcc00135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 shutdown_connections 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 >> 10.20.193.78:0/41030206 conn(0x7fcc00091720 msgr2=0x7fcc0008e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 shutdown_connections 2026-02-13T18:19:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.178+0000 7fcc04fdc640 1 -- 10.20.193.78:0/41030206 wait complete. 2026-02-13T18:19:41.201 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:19:41.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:19:41.201 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:19:41.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient: get_monmap_and_config 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient: build_initial_monmap 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient: monmap: 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:41.264210+0000 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:41.264210+0000 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:41.272 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:41.273 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 1 Processor -- start 2026-02-13T18:19:41.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 1 -- start start 2026-02-13T18:19:41.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient: init 2026-02-13T18:19:41.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient(hunting): picked mon.noname-c con 0x7f1e68085790 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient(hunting): picked mon.noname-a con 0x7f1e68085b60 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient(hunting): picked mon.noname-b con 0x7f1e68181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e68088400 con 0x7f1e68085b60 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e68088120 con 0x7f1e68085790 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6808c550 con 0x7f1e68181d50 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e6df80640 10 monclient(hunting): authenticate will time out at 1412.319632s 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e66ffd640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f1e68085b60 legacy=0x7f1e68085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:41.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e67fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1e68181d50 0x7f1e681a2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:34996/0 (socket says 10.20.193.78:34996) 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.258+0000 7f1e67fff640 1 -- 10.20.193.78:0/4170955944 learned_addr learned my addr 10.20.193.78:0/4170955944 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e67fff640 1 -- 10.20.193.78:0/4170955944 >> v1:10.20.193.78:6790/0 conn(0x7f1e68181d50 legacy=0x7f1e681a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371984158 0 0) 0x7f1e6808c550 con 0x7f1e68181d50 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient(hunting): my global_id is 104276 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e677fe640 1 -- 10.20.193.78:0/4170955944 >> v1:10.20.193.187:6789/0 conn(0x7f1e68085790 legacy=0x7f1e68089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4c003620 con 0x7f1e68181d50 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1666814085 0 0) 0x7f1e4c003620 con 0x7f1e68181d50 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 >> v1:10.20.193.187:6789/0 conn(0x7f1e68085790 legacy=0x7f1e68089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 >> v1:10.20.193.78:6789/0 conn(0x7f1e68085b60 legacy=0x7f1e68085fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: _finish_hunting 0 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 monclient: found mon.noname-b 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e68087540 con 0x7f1e68181d50 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: _finish_auth 0 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: _check_auth_tickets 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 5 monclient: authenticate success, global_id 104276 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e5c004620 con 0x7f1e68181d50 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:41.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: dump: 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.281 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e5c0048f0 con 0x7f1e68181d50 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 1 -- 10.20.193.78:0/4170955944 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e5c006060 con 0x7f1e68181d50 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e667fc640 10 monclient: dump: 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.282 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 4 set_mon_vals no callback set 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 10 monclient: shutdown 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 -- 10.20.193.78:0/4170955944 >> v1:10.20.193.78:6790/0 conn(0x7f1e68181d50 legacy=0x7f1e681a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 -- 10.20.193.78:0/4170955944 shutdown_connections 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 -- 10.20.193.78:0/4170955944 >> 10.20.193.78:0/4170955944 conn(0x7f1e68091720 msgr2=0x7f1e68091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 -- 10.20.193.78:0/4170955944 shutdown_connections 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 -- 10.20.193.78:0/4170955944 wait complete. 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 10 monclient: build_initial_monmap 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 10 monclient: monmap: 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:41.284 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 Processor -- start 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 1 -- start start 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.262+0000 7f1e6df80640 10 monclient: init 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient(hunting): picked mon.noname-a con 0x7f1e68085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient(hunting): picked mon.noname-c con 0x7f1e68085b60 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient(hunting): picked mon.noname-b con 0x7f1e68181d50 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:41.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6813db60 con 0x7f1e68085790 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6813de40 con 0x7f1e68181d50 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e677fe640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f1e68085790 legacy=0x7f1e68057020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6808d9d0 con 0x7f1e68085b60 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient(hunting): authenticate will time out at 1412.324279s 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e66ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1e68085b60 0x7f1e68057730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35008/0 (socket says 10.20.193.78:35008) 2026-02-13T18:19:41.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e66ffd640 1 -- 10.20.193.78:0/4090929888 learned_addr learned my addr 10.20.193.78:0/4090929888 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:41.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e66ffd640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e68085b60 legacy=0x7f1e68057730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874258880 0 0) 0x7f1e6808d9d0 con 0x7f1e68085b60 2026-02-13T18:19:41.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): my global_id is 104279 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e38003620 con 0x7f1e68085b60 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e67fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.187:6789/0 conn(0x7f1e68181d50 legacy=0x7f1e68057e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3519707660 0 0) 0x7f1e38003620 con 0x7f1e68085b60 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e6808d9d0 con 0x7f1e68085b60 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e58004540 con 0x7f1e68085b60 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): dump: 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.292 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797586512 0 0) 0x7f1e6813de40 con 0x7f1e68181d50 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient(hunting): my global_id is 114139 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e38003620 con 0x7f1e68181d50 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2753953572 0 0) 0x7f1e6808d9d0 con 0x7f1e68085b60 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.187:6789/0 conn(0x7f1e68181d50 legacy=0x7f1e68057e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6789/0 conn(0x7f1e68085790 legacy=0x7f1e68057020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: _finish_hunting 0 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 monclient: found mon.c 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e68089b60 con 0x7f1e68085b60 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: _finish_auth 0 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: _check_auth_tickets 2026-02-13T18:19:41.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 5 monclient: authenticate success, global_id 104279 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient: _renew_subs 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6813d880 con 0x7f1e68085b60 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient: _renew_subs 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e681967d0 con 0x7f1e68085b60 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e58004880 con 0x7f1e68085b60 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e58004be0 con 0x7f1e68085b60 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 10 monclient: dump: 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e65ffb640 4 set_mon_vals no callback set 2026-02-13T18:19:41.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e680389c0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.266+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1e58004eb0 con 0x7f1e68085b60 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(687..687 src has 292..687) ==== 3943+0+0 (unknown 1114258888 0 0) 0x7f1e5804c730 con 0x7f1e68085b60 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e67fff640 10 monclient: get_auth_request con 0x7f1e3803d4d0 auth_method 0 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e677fe640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e6805a2c0 legacy=0x7f1e6805a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961219256 0 0) 0x7f1e680389c0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient(hunting): my global_id is 104282 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e6808d9d0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1278533417 0 0) 0x7f1e6808d9d0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e680389c0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e54003190 con 0x7f1e6805a2c0 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient: dump: 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.298 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1550945715 0 0) 0x7f1e680389c0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e6808f600 con 0x7f1e6805a2c0 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1e540058c0 con 0x7f1e6805a2c0 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e6805a2c0 legacy=0x7f1e6805a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.270+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e6805a2c0 legacy=0x7f1e6805a690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.274+0000 7f1e6df80640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:41.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.274+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e68088890 con 0x7f1e6805ada0 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e677fe640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e6805ada0 legacy=0x7f1e68197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2488017623 0 0) 0x7f1e68088890 con 0x7f1e6805ada0 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient(hunting): my global_id is 104285 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e680389c0 con 0x7f1e6805ada0 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1806258075 0 0) 0x7f1e680389c0 con 0x7f1e6805ada0 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e68088890 con 0x7f1e6805ada0 2026-02-13T18:19:41.300 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1e54003b30 con 0x7f1e6805ada0 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient: dump: 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.301 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1183044088 0 0) 0x7f1e68088890 con 0x7f1e6805ada0 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e68090810 con 0x7f1e6805ada0 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4499 (unknown 0 0 2879657441) 0x7f1e54005b20 con 0x7f1e6805ada0 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e6805ada0 legacy=0x7f1e68197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e43fff640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e6805ada0 legacy=0x7f1e68197b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:41.302 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 54, 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 125779, 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.303 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:41.304 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:41.305 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:41.306 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:41.307 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:41.308 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:41.309 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:41.310 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.311 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:41.312 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.313 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.314 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.315 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:41.315 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1e3803d4d0 legacy=0x7f1e3805d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 10 monclient: shutdown 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 >> v1:10.20.193.78:6790/0 conn(0x7f1e68085b60 legacy=0x7f1e68057730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e67fff640 1 -- 10.20.193.78:0/4090929888 reap_dead start 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e67fff640 1 -- 10.20.193.78:0/4090929888 reap_dead start 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 shutdown_connections 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 >> 10.20.193.78:0/4090929888 conn(0x7f1e68091720 msgr2=0x7f1e68191280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 shutdown_connections 2026-02-13T18:19:41.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.278+0000 7f1e6df80640 1 -- 10.20.193.78:0/4090929888 wait complete. 2026-02-13T18:19:41.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:19:41.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:19:41.317 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:19:41.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.370+0000 7f151ccaf640 10 monclient: get_monmap_and_config 2026-02-13T18:19:41.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.370+0000 7f151ccaf640 10 monclient: build_initial_monmap 2026-02-13T18:19:41.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.370+0000 7f151ccaf640 10 monclient: monmap: 2026-02-13T18:19:41.384 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:19:41.377214+0000 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:19:41.377214+0000 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:19:41.385 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 Processor -- start 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- start start 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient: init 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient(hunting): picked mon.noname-a con 0x7f151808e400 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient(hunting): picked mon.noname-b con 0x7f151808d940 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:41.387 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient(hunting): picked mon.noname-c con 0x7f151808eee0 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151808bfe0 con 0x7f151808e400 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151808d000 con 0x7f151808eee0 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151808d1d0 con 0x7f151808d940 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient(hunting): authenticate will time out at 1412.432596s 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1516575640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f151808e400 legacy=0x7f151808e7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f151808d940 0x7f1518181d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35032/0 (socket says 10.20.193.78:35032) 2026-02-13T18:19:41.388 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515d74640 1 -- 10.20.193.78:0/327187500 learned_addr learned my addr 10.20.193.78:0/327187500 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:41.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515d74640 1 -- 10.20.193.78:0/327187500 >> v1:10.20.193.78:6790/0 conn(0x7f151808d940 legacy=0x7f1518181d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642396174 0 0) 0x7f151808d1d0 con 0x7f151808d940 2026-02-13T18:19:41.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient(hunting): my global_id is 104288 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1504003620 con 0x7f151808d940 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1516d76640 1 -- 10.20.193.78:0/327187500 >> v1:10.20.193.187:6789/0 conn(0x7f151808eee0 legacy=0x7f15181a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3917950863 0 0) 0x7f1504003620 con 0x7f151808d940 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 >> v1:10.20.193.187:6789/0 conn(0x7f151808eee0 legacy=0x7f15181a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 >> v1:10.20.193.78:6789/0 conn(0x7f151808e400 legacy=0x7f151808e7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: _finish_hunting 0 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 monclient: found mon.noname-b 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151808d3a0 con 0x7f151808d940 2026-02-13T18:19:41.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: _finish_auth 0 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: _check_auth_tickets 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 5 monclient: authenticate success, global_id 104288 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1500003110 con 0x7f151808d940 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: dump: 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.396 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1500003450 con 0x7f151808d940 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 1 -- 10.20.193.78:0/327187500 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1500004b50 con 0x7f151808d940 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f1515573640 10 monclient: dump: 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient: get_monmap_and_config success 2026-02-13T18:19:41.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 4 set_mon_vals no callback set 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 10 monclient: shutdown 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- 10.20.193.78:0/327187500 >> v1:10.20.193.78:6790/0 conn(0x7f151808d940 legacy=0x7f1518181d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- 10.20.193.78:0/327187500 shutdown_connections 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- 10.20.193.78:0/327187500 >> 10.20.193.78:0/327187500 conn(0x7f1518054e30 msgr2=0x7f1518093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- 10.20.193.78:0/327187500 shutdown_connections 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.374+0000 7f151ccaf640 1 -- 10.20.193.78:0/327187500 wait complete. 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: build_initial_monmap 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: monmap: 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:19:41.399 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 Processor -- start 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 -- start start 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: init 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: _reopen_session rank -1 2026-02-13T18:19:41.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient(hunting): picked mon.noname-b con 0x7f151808d940 addr v1:10.20.193.187:6789/0 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient(hunting): picked mon.noname-c con 0x7f151808e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient(hunting): picked mon.noname-a con 0x7f151808eee0 addr v1:10.20.193.78:6789/0 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15181417e0 con 0x7f151808eee0 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151808abf0 con 0x7f151808d940 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1518057ef0 con 0x7f151808e400 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f1516d76640 1 -- >> v1:10.20.193.78:6789/0 conn(0x7f151808eee0 legacy=0x7f1518195b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6789/0 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient(hunting): _renew_subs 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient(hunting): authenticate will time out at 1412.437082s 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f1515d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f151808e400 0x7f15181943e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:35048/0 (socket says 10.20.193.78:35048) 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f1515d74640 1 -- 10.20.193.78:0/1144218476 learned_addr learned my addr 10.20.193.78:0/1144218476 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:19:41.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f1515d74640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.78:6790/0 conn(0x7f151808e400 legacy=0x7f15181943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908691515 0 0) 0x7f1518057ef0 con 0x7f151808e400 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): my global_id is 104291 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e4003620 con 0x7f151808e400 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f1516575640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f151808d940 legacy=0x7f1518086700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3867673542 0 0) 0x7f14e4003620 con 0x7f151808e400 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1518057ef0 con 0x7f151808e400 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f15000048e0 con 0x7f151808e400 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:19:41.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): dump: 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3341524010 0 0) 0x7f1518057ef0 con 0x7f151808e400 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f151808d940 legacy=0x7f1518086700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.78:6789/0 conn(0x7f151808eee0 legacy=0x7f1518195b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: _finish_hunting 0 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 monclient: found mon.c 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180581d0 con 0x7f151808e400 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: _finish_auth 0 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: _check_auth_tickets 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 5 monclient: authenticate success, global_id 104291 2026-02-13T18:19:41.404 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: _renew_subs 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f151805df30 con 0x7f151808e400 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: _renew_subs 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f15181534b0 con 0x7f151808e400 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1500003320 con 0x7f151808e400 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1500005190 con 0x7f151808e400 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f1514d72640 4 set_mon_vals no callback set 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.378+0000 7f14feffd640 10 monclient: dump: 2026-02-13T18:19:41.405 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f151ccaf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1518057aa0 con 0x7f1518086e10 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f1515d74640 1 --1- 10.20.193.78:0/1144218476 >> v1:10.20.193.78:6790/0 conn(0x7f151808e400 0x7f15181943e0 :-1 s=OPENED pgs=580 gs=2 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f150004c630 osd_map(687..687 src has 292..687) 2026-02-13T18:19:41.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1500011820 con 0x7f151808e400 2026-02-13T18:19:41.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f1516d76640 10 monclient: get_auth_request con 0x7f14e403d340 auth_method 0 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f1516575640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f1518086e10 legacy=0x7f151805c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260034147 0 0) 0x7f150c003e30 con 0x7f1518086e10 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient(hunting): my global_id is 114148 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1518057ef0 con 0x7f1518086e10 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3680084739 0 0) 0x7f1518057ef0 con 0x7f1518086e10 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f150c003e30 con 0x7f1518086e10 2026-02-13T18:19:41.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f150c0043a0 con 0x7f1518086e10 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 10 monclient: dump: 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.411 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1377892422 0 0) 0x7f150c003e30 con 0x7f1518086e10 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.382+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15180871e0 con 0x7f1518086e10 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f150c006780 con 0x7f1518086e10 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f14feffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f14feffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f1518086e10 legacy=0x7f151805c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f1518086e10 legacy=0x7f151805c7b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f151ccaf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.386+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1518050ff0 con 0x7f151804d200 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f1516575640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f151804d200 legacy=0x7f1518198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259649442 0 0) 0x7f1518050ff0 con 0x7f151804d200 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient(hunting): _negotiate 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:19:41.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient(hunting): my global_id is 114151 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f150c003e30 con 0x7f151804d200 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1775763111 0 0) 0x7f150c003e30 con 0x7f151804d200 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1518050ff0 con 0x7f151804d200 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f150c004b40 con 0x7f151804d200 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient: dump: 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:19:41.413 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1918590564 0 0) 0x7f1518050ff0 con 0x7f151804d200 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f15181a4df0 con 0x7f151804d200 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 445454312) 0x7f150c006930 con 0x7f151804d200 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f151804d200 legacy=0x7f1518198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6789/0 conn(0x7f151804d200 legacy=0x7f1518198230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 54, 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 18087, 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.415 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:41.416 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:41.417 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:19:41.418 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:19:41.419 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:41.420 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:19:41.421 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.422 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:19:41.423 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.424 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:19:41.425 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:19:41.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.187:6812/2668687789 conn(0x7f14e403d340 legacy=0x7f14e405d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 10 monclient: shutdown 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 >> v1:10.20.193.78:6790/0 conn(0x7f151808e400 legacy=0x7f15181943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f1516d76640 1 -- 10.20.193.78:0/1144218476 reap_dead start 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f14feffd640 1 -- 10.20.193.78:0/1144218476 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(687..687 src has 292..687) ==== 3943+0+0 (unknown 1114258888 0 0) 0x7f150004c630 con 0x7f151808e400 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f1516d76640 1 -- 10.20.193.78:0/1144218476 reap_dead start 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 shutdown_connections 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 >> 10.20.193.78:0/1144218476 conn(0x7f1518054e30 msgr2=0x7f151808b510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 shutdown_connections 2026-02-13T18:19:41.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:19:41.390+0000 7f151ccaf640 1 -- 10.20.193.78:0/1144218476 wait complete. 2026-02-13T18:19:41.427 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:19:41.427 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:19:42.044 INFO:tasks.rados.rados.0.trial187.stdout:3064: done (2 left) 2026-02-13T18:19:42.044 INFO:tasks.rados.rados.0.trial187.stdout:3066: done (1 left) 2026-02-13T18:19:42.044 INFO:tasks.rados.rados.0.trial187.stdout:3067: done (0 left) 2026-02-13T18:19:42.044 INFO:tasks.rados.rados.0.trial187.stdout:3068: copy_from oid 3 from oid 46 current snap is 336 2026-02-13T18:19:42.044 INFO:tasks.rados.rados.0.trial187.stdout:3069: snap_create 2026-02-13T18:19:42.056 INFO:tasks.rados.rados.0.trial187.stdout:3068: finishing copy_from racing read to trial18717860-3 2026-02-13T18:19:42.056 INFO:tasks.rados.rados.0.trial187.stdout:3068: finishing copy_from to trial18717860-3 2026-02-13T18:19:42.056 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1141 (ObjNum 962 snap 312 seq_num 962) dirty exists 2026-02-13T18:19:43.044 INFO:tasks.rados.rados.0.trial187.stdout:3068: done (1 left) 2026-02-13T18:19:43.044 INFO:tasks.rados.rados.0.trial187.stdout:3069: done (0 left) 2026-02-13T18:19:43.044 INFO:tasks.rados.rados.0.trial187.stdout:3070: snap_remove snap 322 2026-02-13T18:19:44.045 INFO:tasks.rados.rados.0.trial187.stdout:3070: done (0 left) 2026-02-13T18:19:44.045 INFO:tasks.rados.rados.0.trial187.stdout:3071: copy_from oid 20 from oid 37 current snap is 337 2026-02-13T18:19:44.046 INFO:tasks.rados.rados.0.trial187.stdout:3072: rollback oid 40 current snap is 337 2026-02-13T18:19:44.046 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 326 2026-02-13T18:19:44.046 INFO:tasks.rados.rados.0.trial187.stdout:3073: write oid 10 current snap is 337 2026-02-13T18:19:44.046 INFO:tasks.rados.rados.0.trial187.stdout:3073: seq_num 1035 ranges {595245=506723,1715569=637352,2805974=562298} 2026-02-13T18:19:44.052 INFO:tasks.rados.rados.0.trial187.stdout:3073: writing trial18717860-10 from 595245 to 1101968 tid 1 2026-02-13T18:19:44.057 INFO:tasks.rados.rados.0.trial187.stdout:3073: writing trial18717860-10 from 1715569 to 2352921 tid 2 2026-02-13T18:19:44.061 INFO:tasks.rados.rados.0.trial187.stdout:3073: writing trial18717860-10 from 2805974 to 3368272 tid 3 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3074: snap_create 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3071: finishing copy_from to trial18717860-20 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3071: got expected ENOENT (src dne) 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3071: finishing copy_from racing read to trial18717860-20 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3072: finishing rollback tid 0 to trial18717860-40 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3072: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3072: finishing rollback tid 2 to trial18717860-40 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1447 (ObjNum 987 snap 319 seq_num 987) dirty exists 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3073: finishing write tid 1 to trial18717860-10 2026-02-13T18:19:44.062 INFO:tasks.rados.rados.0.trial187.stdout:3073: finishing write tid 2 to trial18717860-10 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: finishing write tid 3 to trial18717860-10 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: finishing write tid 4 to trial18717860-10 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: finishing write tid 5 to trial18717860-10 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: oid 10 updating version 0 to 1059 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: oid 10 version 1059 is already newer than 1057 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: oid 10 version 1059 is already newer than 1056 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: oid 10 version 1059 is already newer than 1058 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1059 (ObjNum 1035 snap 337 seq_num 1035) dirty exists 2026-02-13T18:19:44.064 INFO:tasks.rados.rados.0.trial187.stdout:3073: left oid 10 (ObjNum 1035 snap 337 seq_num 1035) 2026-02-13T18:19:45.050 INFO:tasks.rados.rados.0.trial187.stdout:3071: done (3 left) 2026-02-13T18:19:45.050 INFO:tasks.rados.rados.0.trial187.stdout:3072: done (2 left) 2026-02-13T18:19:45.050 INFO:tasks.rados.rados.0.trial187.stdout:3073: done (1 left) 2026-02-13T18:19:45.051 INFO:tasks.rados.rados.0.trial187.stdout:3074: done (0 left) 2026-02-13T18:19:45.051 INFO:tasks.rados.rados.0.trial187.stdout:3075: read oid 27 snap -1 2026-02-13T18:19:45.051 INFO:tasks.rados.rados.0.trial187.stdout:3075: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:19:45.051 INFO:tasks.rados.rados.0.trial187.stdout:3076: snap_remove snap 333 2026-02-13T18:19:46.200 INFO:tasks.rados.rados.0.trial187.stdout:3076: done (1 left) 2026-02-13T18:19:46.201 INFO:tasks.rados.rados.0.trial187.stdout:3077: delete oid 36 current snap is 338 2026-02-13T18:19:46.201 INFO:tasks.rados.rados.0.trial187.stdout:3075: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:19:46.206 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 913900 2026-02-13T18:19:46.234 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:46.285 INFO:tasks.rados.rados.0.trial187.stdout:3075: done (1 left) 2026-02-13T18:19:46.286 INFO:tasks.rados.rados.0.trial187.stdout:3077: done (0 left) 2026-02-13T18:19:46.286 INFO:tasks.rados.rados.0.trial187.stdout:3078: delete oid 3 current snap is 338 2026-02-13T18:19:46.287 INFO:tasks.rados.rados.0.trial187.stdout:3078: done (0 left) 2026-02-13T18:19:46.287 INFO:tasks.rados.rados.0.trial187.stdout:3079: snap_remove snap 331 2026-02-13T18:19:47.052 INFO:tasks.rados.rados.0.trial187.stdout:3079: done (0 left) 2026-02-13T18:19:47.052 INFO:tasks.rados.rados.0.trial187.stdout:3080: read oid 35 snap 319 2026-02-13T18:19:47.052 INFO:tasks.rados.rados.0.trial187.stdout:3080: expect (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:19:47.052 INFO:tasks.rados.rados.0.trial187.stdout:3081: write (excl) oid 36 current snap is 338 2026-02-13T18:19:47.053 INFO:tasks.rados.rados.0.trial187.stdout:3081: seq_num 1038 ranges {645666=732470,2174662=501032,3288243=157423} 2026-02-13T18:19:47.058 INFO:tasks.rados.rados.0.trial187.stdout:3081: writing trial18717860-36 from 645666 to 1378136 tid 1 2026-02-13T18:19:47.064 INFO:tasks.rados.rados.0.trial187.stdout:3081: writing trial18717860-36 from 2174662 to 2675694 tid 2 2026-02-13T18:19:47.070 INFO:tasks.rados.rados.0.trial187.stdout:3081: writing trial18717860-36 from 3288243 to 3445666 tid 3 2026-02-13T18:19:47.070 INFO:tasks.rados.rados.0.trial187.stdout:3082: copy_from oid 7 from oid 17 current snap is 338 2026-02-13T18:19:47.070 INFO:tasks.rados.rados.0.trial187.stdout:3081: finishing write tid 1 to trial18717860-36 2026-02-13T18:19:47.070 INFO:tasks.rados.rados.0.trial187.stdout:3080: expect (ObjNum 934 snap 304 seq_num 934) 2026-02-13T18:19:47.085 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1678414 2026-02-13T18:19:47.158 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:47.199 INFO:tasks.rados.rados.0.trial187.stdout:3081: finishing write tid 2 to trial18717860-36 2026-02-13T18:19:47.199 INFO:tasks.rados.rados.0.trial187.stdout:3082: finishing copy_from to trial18717860-7 2026-02-13T18:19:47.199 INFO:tasks.rados.rados.0.trial187.stdout:3082: got expected ENOENT (src dne) 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3082: finishing copy_from racing read to trial18717860-7 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: finishing write tid 3 to trial18717860-36 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: finishing write tid 4 to trial18717860-36 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: finishing write tid 5 to trial18717860-36 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: oid 36 updating version 0 to 1442 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: oid 36 updating version 1442 to 1444 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: oid 36 version 1444 is already newer than 1443 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: oid 36 updating version 1444 to 1445 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1445 (ObjNum 1038 snap 338 seq_num 1038) dirty exists 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3081: left oid 36 (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:19:47.200 INFO:tasks.rados.rados.0.trial187.stdout:3080: done (2 left) 2026-02-13T18:19:47.201 INFO:tasks.rados.rados.0.trial187.stdout:3081: done (1 left) 2026-02-13T18:19:47.201 INFO:tasks.rados.rados.0.trial187.stdout:3082: done (0 left) 2026-02-13T18:19:47.201 INFO:tasks.rados.rados.0.trial187.stdout:3083: snap_remove snap 337 2026-02-13T18:19:48.055 INFO:tasks.rados.rados.0.trial187.stdout:3083: done (0 left) 2026-02-13T18:19:48.055 INFO:tasks.rados.rados.0.trial187.stdout:3084: read oid 36 snap -1 2026-02-13T18:19:48.055 INFO:tasks.rados.rados.0.trial187.stdout:3084: expect (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:19:48.055 INFO:tasks.rados.rados.0.trial187.stdout:3085: snap_create 2026-02-13T18:19:48.060 INFO:tasks.rados.rados.0.trial187.stdout:3084: expect (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:19:48.085 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2843916 2026-02-13T18:19:49.058 INFO:tasks.rados.rados.0.trial187.stdout:3084: done (1 left) 2026-02-13T18:19:49.058 INFO:tasks.rados.rados.0.trial187.stdout:3085: done (0 left) 2026-02-13T18:19:49.058 INFO:tasks.rados.rados.0.trial187.stdout:3086: rollback oid 40 current snap is 339 2026-02-13T18:19:49.058 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 324 2026-02-13T18:19:49.058 INFO:tasks.rados.rados.0.trial187.stdout:3087: delete oid 1 current snap is 339 2026-02-13T18:19:49.060 INFO:tasks.rados.rados.0.trial187.stdout:3086: finishing rollback tid 0 to trial18717860-40 2026-02-13T18:19:49.061 INFO:tasks.rados.rados.0.trial187.stdout:3086: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:19:49.061 INFO:tasks.rados.rados.0.trial187.stdout:3086: finishing rollback tid 2 to trial18717860-40 2026-02-13T18:19:49.061 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1450 (ObjNum 987 snap 319 seq_num 987) dirty exists 2026-02-13T18:19:49.061 INFO:tasks.rados.rados.0.trial187.stdout:3086: done (1 left) 2026-02-13T18:19:49.061 INFO:tasks.rados.rados.0.trial187.stdout:3087: done (0 left) 2026-02-13T18:19:49.062 INFO:tasks.rados.rados.0.trial187.stdout:3088: copy_from oid 3 from oid 33 current snap is 339 2026-02-13T18:19:49.062 INFO:tasks.rados.rados.0.trial187.stdout:3089: snap_remove snap 336 2026-02-13T18:19:50.060 INFO:tasks.rados.rados.0.trial187.stdout:3089: done (1 left) 2026-02-13T18:19:50.060 INFO:tasks.rados.rados.0.trial187.stdout:3090: write oid 17 current snap is 339 2026-02-13T18:19:50.061 INFO:tasks.rados.rados.0.trial187.stdout:3090: seq_num 1040 ranges {679280=482968,1775273=788348,3110383=368897} 2026-02-13T18:19:50.068 INFO:tasks.rados.rados.0.trial187.stdout:3090: writing trial18717860-17 from 679280 to 1162248 tid 1 2026-02-13T18:19:50.077 INFO:tasks.rados.rados.0.trial187.stdout:3090: writing trial18717860-17 from 1775273 to 2563621 tid 2 2026-02-13T18:19:50.084 INFO:tasks.rados.rados.0.trial187.stdout:3090: writing trial18717860-17 from 3110383 to 3479280 tid 3 2026-02-13T18:19:50.084 INFO:tasks.rados.rados.0.trial187.stdout:3091: copy_from oid 21 from oid 26 current snap is 339 2026-02-13T18:19:50.084 INFO:tasks.rados.rados.0.trial187.stdout:3088: finishing copy_from to trial18717860-3 2026-02-13T18:19:50.084 INFO:tasks.rados.rados.0.trial187.stdout:3088: got expected ENOENT (src dne) 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3088: finishing copy_from racing read to trial18717860-3 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3090: finishing write tid 1 to trial18717860-17 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3090: finishing write tid 2 to trial18717860-17 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3088: done (2 left) 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3092: read oid 50 snap 328 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3092: expect (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:19:50.085 INFO:tasks.rados.rados.0.trial187.stdout:3093: snap_remove snap 334 2026-02-13T18:19:50.539 INFO:tasks.rados.rados.0.trial187.stdout:3093: done (3 left) 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3094: delete oid 19 current snap is 339 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3090: finishing write tid 3 to trial18717860-17 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3090: finishing write tid 4 to trial18717860-17 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3091: finishing copy_from to trial18717860-21 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3091: got expected ENOENT (src dne) 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3090: finishing write tid 5 to trial18717860-17 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3090: oid 17 updating version 0 to 1622 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3090: oid 17 version 1622 is already newer than 1620 2026-02-13T18:19:50.540 INFO:tasks.rados.rados.0.trial187.stdout:3090: oid 17 version 1622 is already newer than 1621 2026-02-13T18:19:50.541 INFO:tasks.rados.rados.0.trial187.stdout:3090: oid 17 version 1622 is already newer than 1619 2026-02-13T18:19:50.541 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1622 (ObjNum 1040 snap 339 seq_num 1040) dirty exists 2026-02-13T18:19:50.541 INFO:tasks.rados.rados.0.trial187.stdout:3090: left oid 17 (ObjNum 1040 snap 339 seq_num 1040) 2026-02-13T18:19:50.541 INFO:tasks.rados.rados.0.trial187.stdout:3091: finishing copy_from racing read to trial18717860-21 2026-02-13T18:19:50.541 INFO:tasks.rados.rados.0.trial187.stdout:3092: expect (ObjNum 909 snap 301 seq_num 909) 2026-02-13T18:19:50.618 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:50.676 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:19:50.735 INFO:tasks.rados.rados.0.trial187.stdout:3090: done (3 left) 2026-02-13T18:19:50.735 INFO:tasks.rados.rados.0.trial187.stdout:3091: done (2 left) 2026-02-13T18:19:50.735 INFO:tasks.rados.rados.0.trial187.stdout:3092: done (1 left) 2026-02-13T18:19:50.735 INFO:tasks.rados.rados.0.trial187.stdout:3094: done (0 left) 2026-02-13T18:19:50.736 INFO:tasks.rados.rados.0.trial187.stdout:3095: rollback oid 37 current snap is 339 2026-02-13T18:19:50.736 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 326 2026-02-13T18:19:50.736 INFO:tasks.rados.rados.0.trial187.stdout:3096: snap_remove snap 335 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:3096: done (1 left) 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:3097: rollback oid 39 current snap is 339 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 328 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:3095: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 0 (ObjNum 49 snap 0 seq_num 4016942312) dirty dne 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:3095: done (1 left) 2026-02-13T18:19:51.543 INFO:tasks.rados.rados.0.trial187.stdout:3098: rollback oid 23 current snap is 339 2026-02-13T18:19:51.544 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 23 to 326 2026-02-13T18:19:51.544 INFO:tasks.rados.rados.0.trial187.stdout:3099: copy_from oid 3 from oid 10 current snap is 339 2026-02-13T18:19:51.544 INFO:tasks.rados.rados.0.trial187.stdout:3100: write (excl) oid 45 current snap is 339 2026-02-13T18:19:51.544 INFO:tasks.rados.rados.0.trial187.stdout:3100: seq_num 1042 ranges {712894=749819,2008590=792017,3281582=231312} 2026-02-13T18:19:51.552 INFO:tasks.rados.rados.0.trial187.stdout:3100: writing trial18717860-45 from 712894 to 1462713 tid 1 2026-02-13T18:19:51.561 INFO:tasks.rados.rados.0.trial187.stdout:3100: writing trial18717860-45 from 2008590 to 2800607 tid 2 2026-02-13T18:19:51.566 INFO:tasks.rados.rados.0.trial187.stdout:3100: writing trial18717860-45 from 3281582 to 3512894 tid 3 2026-02-13T18:19:51.566 INFO:tasks.rados.rados.0.trial187.stdout:3101: snap_create 2026-02-13T18:19:51.566 INFO:tasks.rados.rados.0.trial187.stdout:3098: finishing rollback tid 0 to trial18717860-23 2026-02-13T18:19:51.566 INFO:tasks.rados.rados.0.trial187.stdout:3098: finishing rollback tid 1 to trial18717860-23 2026-02-13T18:19:51.566 INFO:tasks.rados.rados.0.trial187.stdout:3097: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:19:51.566 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:3098: finishing rollback tid 2 to trial18717860-23 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1448 (ObjNum 1006 snap 326 seq_num 1006) dirty exists 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:3100: finishing write tid 1 to trial18717860-45 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:3099: finishing copy_from racing read to trial18717860-3 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:3099: finishing copy_from to trial18717860-3 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 1059 (ObjNum 1035 snap 337 seq_num 1035) dirty exists 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:3100: finishing write tid 2 to trial18717860-45 2026-02-13T18:19:51.567 INFO:tasks.rados.rados.0.trial187.stdout:3100: finishing write tid 3 to trial18717860-45 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: finishing write tid 4 to trial18717860-45 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: finishing write tid 5 to trial18717860-45 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: oid 45 updating version 0 to 1452 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: oid 45 version 1452 is already newer than 1451 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: oid 45 updating version 1452 to 1454 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: oid 45 version 1454 is already newer than 1453 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1454 (ObjNum 1042 snap 339 seq_num 1042) dirty exists 2026-02-13T18:19:51.568 INFO:tasks.rados.rados.0.trial187.stdout:3100: left oid 45 (ObjNum 1042 snap 339 seq_num 1042) 2026-02-13T18:19:52.544 INFO:tasks.rados.rados.0.trial187.stdout:3097: done (4 left) 2026-02-13T18:19:52.544 INFO:tasks.rados.rados.0.trial187.stdout:3098: done (3 left) 2026-02-13T18:19:52.544 INFO:tasks.rados.rados.0.trial187.stdout:3099: done (2 left) 2026-02-13T18:19:52.544 INFO:tasks.rados.rados.0.trial187.stdout:3100: done (1 left) 2026-02-13T18:19:52.544 INFO:tasks.rados.rados.0.trial187.stdout:3101: done (0 left) 2026-02-13T18:19:52.544 INFO:tasks.rados.rados.0.trial187.stdout:3102: delete oid 24 current snap is 340 2026-02-13T18:19:52.547 INFO:tasks.rados.rados.0.trial187.stdout:3102: done (0 left) 2026-02-13T18:19:52.547 INFO:tasks.rados.rados.0.trial187.stdout:3103: delete oid 46 current snap is 340 2026-02-13T18:19:52.549 INFO:tasks.rados.rados.0.trial187.stdout:3103: done (0 left) 2026-02-13T18:19:52.549 INFO:tasks.rados.rados.0.trial187.stdout:3104: delete oid 45 current snap is 340 2026-02-13T18:19:52.551 INFO:tasks.rados.rados.0.trial187.stdout:3104: done (0 left) 2026-02-13T18:19:52.551 INFO:tasks.rados.rados.0.trial187.stdout:3105: rollback oid 1 current snap is 340 2026-02-13T18:19:52.551 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 1 to 339 2026-02-13T18:19:52.551 INFO:tasks.rados.rados.0.trial187.stdout:3106: snap_remove snap 332 2026-02-13T18:19:53.550 INFO:tasks.rados.rados.0.trial187.stdout:3106: done (1 left) 2026-02-13T18:19:53.550 INFO:tasks.rados.rados.0.trial187.stdout:3107: snap_create 2026-02-13T18:19:53.550 INFO:tasks.rados.rados.0.trial187.stdout:3105: finishing rollback tid 1 to trial18717860-1 2026-02-13T18:19:53.550 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 0 (ObjNum 129 snap 0 seq_num 3013708464) dirty dne 2026-02-13T18:19:54.550 INFO:tasks.rados.rados.0.trial187.stdout:3105: done (1 left) 2026-02-13T18:19:54.551 INFO:tasks.rados.rados.0.trial187.stdout:3107: done (0 left) 2026-02-13T18:19:54.551 INFO:tasks.rados.rados.0.trial187.stdout:3108: snap_create 2026-02-13T18:19:55.540 INFO:tasks.rados.rados.0.trial187.stdout:3108: done (0 left) 2026-02-13T18:19:55.540 INFO:tasks.rados.rados.0.trial187.stdout:3109: write (excl) oid 7 current snap is 342 2026-02-13T18:19:55.540 INFO:tasks.rados.rados.0.trial187.stdout:3109: seq_num 1046 ranges {780122=650815,2126165=799355} 2026-02-13T18:19:55.550 INFO:tasks.rados.rados.0.trial187.stdout:3109: writing trial18717860-7 from 780122 to 1430937 tid 1 2026-02-13T18:19:55.560 INFO:tasks.rados.rados.0.trial187.stdout:3109: writing trial18717860-7 from 2126165 to 2925520 tid 2 2026-02-13T18:19:55.560 INFO:tasks.rados.rados.0.trial187.stdout:3110: read oid 12 snap -1 2026-02-13T18:19:55.560 INFO:tasks.rados.rados.0.trial187.stdout:3110: expect (ObjNum 1029 snap 334 seq_num 1029) 2026-02-13T18:19:55.561 INFO:tasks.rados.rados.0.trial187.stdout:3111: write (excl) oid 15 current snap is 342 2026-02-13T18:19:55.561 INFO:tasks.rados.rados.0.trial187.stdout:3111: seq_num 1047 ranges {796929=726064,2184647=659366,3302344=294585} 2026-02-13T18:19:55.570 INFO:tasks.rados.rados.0.trial187.stdout:3111: writing trial18717860-15 from 796929 to 1522993 tid 1 2026-02-13T18:19:55.579 INFO:tasks.rados.rados.0.trial187.stdout:3111: writing trial18717860-15 from 2184647 to 2844013 tid 2 2026-02-13T18:19:55.584 INFO:tasks.rados.rados.0.trial187.stdout:3111: writing trial18717860-15 from 3302344 to 3596929 tid 3 2026-02-13T18:19:55.584 INFO:tasks.rados.rados.0.trial187.stdout:3112: rollback oid 44 current snap is 342 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 340 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: finishing write tid 1 to trial18717860-7 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: finishing write tid 2 to trial18717860-7 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: finishing write tid 3 to trial18717860-7 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: finishing write tid 4 to trial18717860-7 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: oid 7 updating version 0 to 1177 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: oid 7 version 1177 is already newer than 1176 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: oid 7 version 1177 is already newer than 1175 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1177 (ObjNum 1046 snap 342 seq_num 1046) dirty exists 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3109: left oid 7 (ObjNum 1046 snap 342 seq_num 1046) 2026-02-13T18:19:55.585 INFO:tasks.rados.rados.0.trial187.stdout:3110: expect (ObjNum 1029 snap 334 seq_num 1029) 2026-02-13T18:19:55.633 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1210275 2026-02-13T18:19:55.658 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2330531 2026-02-13T18:19:55.666 INFO:tasks.rados.rados.0.trial187.stdout:3111: finishing write tid 1 to trial18717860-15 2026-02-13T18:19:55.666 INFO:tasks.rados.rados.0.trial187.stdout:3111: finishing write tid 2 to trial18717860-15 2026-02-13T18:19:55.666 INFO:tasks.rados.rados.0.trial187.stdout:3112: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:19:55.666 INFO:tasks.rados.rados.0.trial187.stdout:3109: done (3 left) 2026-02-13T18:19:55.666 INFO:tasks.rados.rados.0.trial187.stdout:3110: done (2 left) 2026-02-13T18:19:55.666 INFO:tasks.rados.rados.0.trial187.stdout:3113: delete oid 10 current snap is 342 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3112: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: finishing write tid 3 to trial18717860-15 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3112: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2020 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: finishing write tid 4 to trial18717860-15 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: finishing write tid 5 to trial18717860-15 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: oid 15 updating version 0 to 1422 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: oid 15 version 1422 is already newer than 1420 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: oid 15 version 1422 is already newer than 1421 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:3111: oid 15 version 1422 is already newer than 1419 2026-02-13T18:19:55.667 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1422 (ObjNum 1047 snap 342 seq_num 1047) dirty exists 2026-02-13T18:19:55.668 INFO:tasks.rados.rados.0.trial187.stdout:3111: left oid 15 (ObjNum 1047 snap 342 seq_num 1047) 2026-02-13T18:19:55.668 INFO:tasks.rados.rados.0.trial187.stdout:3111: done (2 left) 2026-02-13T18:19:55.668 INFO:tasks.rados.rados.0.trial187.stdout:3112: done (1 left) 2026-02-13T18:19:55.668 INFO:tasks.rados.rados.0.trial187.stdout:3113: done (0 left) 2026-02-13T18:19:55.668 INFO:tasks.rados.rados.0.trial187.stdout:3114: snap_create 2026-02-13T18:19:56.541 INFO:tasks.rados.rados.0.trial187.stdout:3114: done (0 left) 2026-02-13T18:19:56.541 INFO:tasks.rados.rados.0.trial187.stdout:3115: snap_create 2026-02-13T18:19:57.547 INFO:tasks.rados.rados.0.trial187.stdout:3115: done (0 left) 2026-02-13T18:19:57.547 INFO:tasks.rados.rados.0.trial187.stdout:3116: read oid 11 snap -1 2026-02-13T18:19:57.548 INFO:tasks.rados.rados.0.trial187.stdout:3116: expect deleted 2026-02-13T18:19:57.548 INFO:tasks.rados.rados.0.trial187.stdout:3117: read oid 8 snap -1 2026-02-13T18:19:57.548 INFO:tasks.rados.rados.0.trial187.stdout:3117: expect deleted 2026-02-13T18:19:57.548 INFO:tasks.rados.rados.0.trial187.stdout:3118: write (excl) oid 30 current snap is 344 2026-02-13T18:19:57.548 INFO:tasks.rados.rados.0.trial187.stdout:3118: seq_num 1049 ranges {430543=476562,1385258=663035,2840837=669165} 2026-02-13T18:19:57.553 INFO:tasks.rados.rados.0.trial187.stdout:3118: writing trial18717860-30 from 430543 to 907105 tid 1 2026-02-13T18:19:57.561 INFO:tasks.rados.rados.0.trial187.stdout:3118: writing trial18717860-30 from 1385258 to 2048293 tid 2 2026-02-13T18:19:57.571 INFO:tasks.rados.rados.0.trial187.stdout:3118: writing trial18717860-30 from 2840837 to 3510002 tid 3 2026-02-13T18:19:57.571 INFO:tasks.rados.rados.0.trial187.stdout:3119: snap_create 2026-02-13T18:19:57.572 INFO:tasks.rados.rados.0.trial187.stdout:3118: finishing write tid 1 to trial18717860-30 2026-02-13T18:19:57.572 INFO:tasks.rados.rados.0.trial187.stdout:3118: finishing write tid 2 to trial18717860-30 2026-02-13T18:19:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3118: finishing write tid 3 to trial18717860-30 2026-02-13T18:19:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3118: finishing write tid 4 to trial18717860-30 2026-02-13T18:19:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3118: finishing write tid 5 to trial18717860-30 2026-02-13T18:19:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3118: oid 30 updating version 0 to 1077 2026-02-13T18:19:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3118: oid 30 version 1077 is already newer than 1075 2026-02-13T18:19:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3118: oid 30 version 1077 is already newer than 1076 2026-02-13T18:19:57.575 INFO:tasks.rados.rados.0.trial187.stdout:3118: oid 30 version 1077 is already newer than 1074 2026-02-13T18:19:57.575 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1077 (ObjNum 1049 snap 344 seq_num 1049) dirty exists 2026-02-13T18:19:57.575 INFO:tasks.rados.rados.0.trial187.stdout:3118: left oid 30 (ObjNum 1049 snap 344 seq_num 1049) 2026-02-13T18:19:58.548 INFO:tasks.rados.rados.0.trial187.stdout:3116: done (3 left) 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3117: done (2 left) 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3118: done (1 left) 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3119: done (0 left) 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3120: read oid 24 snap 344 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3120: expect deleted 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3121: read oid 25 snap 342 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3121: expect (ObjNum 781 snap 267 seq_num 781) 2026-02-13T18:19:58.549 INFO:tasks.rados.rados.0.trial187.stdout:3122: snap_create 2026-02-13T18:19:58.555 INFO:tasks.rados.rados.0.trial187.stdout:3121: expect (ObjNum 781 snap 267 seq_num 781) 2026-02-13T18:19:58.610 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1236508 2026-02-13T18:19:59.549 INFO:tasks.rados.rados.0.trial187.stdout:3120: done (2 left) 2026-02-13T18:19:59.549 INFO:tasks.rados.rados.0.trial187.stdout:3121: done (1 left) 2026-02-13T18:19:59.549 INFO:tasks.rados.rados.0.trial187.stdout:3122: done (0 left) 2026-02-13T18:19:59.549 INFO:tasks.rados.rados.0.trial187.stdout:3123: rollback oid 44 current snap is 346 2026-02-13T18:19:59.549 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 345 2026-02-13T18:19:59.549 INFO:tasks.rados.rados.0.trial187.stdout:3124: delete oid 14 current snap is 346 2026-02-13T18:19:59.552 INFO:tasks.rados.rados.0.trial187.stdout:3124: done (1 left) 2026-02-13T18:19:59.552 INFO:tasks.rados.rados.0.trial187.stdout:3125: snap_create 2026-02-13T18:19:59.555 INFO:tasks.rados.rados.0.trial187.stdout:3123: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:19:59.555 INFO:tasks.rados.rados.0.trial187.stdout:3123: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:19:59.555 INFO:tasks.rados.rados.0.trial187.stdout:3123: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:19:59.555 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2024 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:20:00.541 INFO:tasks.rados.rados.0.trial187.stdout:3123: done (1 left) 2026-02-13T18:20:00.541 INFO:tasks.rados.rados.0.trial187.stdout:3125: done (0 left) 2026-02-13T18:20:00.541 INFO:tasks.rados.rados.0.trial187.stdout:3126: write (excl) oid 33 current snap is 347 2026-02-13T18:20:00.541 INFO:tasks.rados.rados.0.trial187.stdout:3126: seq_num 1051 ranges {464157=743413,1618575=666704,3012036=408062} 2026-02-13T18:20:00.549 INFO:tasks.rados.rados.0.trial187.stdout:3126: writing trial18717860-33 from 464157 to 1207570 tid 1 2026-02-13T18:20:00.556 INFO:tasks.rados.rados.0.trial187.stdout:3126: writing trial18717860-33 from 1618575 to 2285279 tid 2 2026-02-13T18:20:00.565 INFO:tasks.rados.rados.0.trial187.stdout:3126: writing trial18717860-33 from 3012036 to 3420098 tid 3 2026-02-13T18:20:00.565 INFO:tasks.rados.rados.0.trial187.stdout:3127: read oid 26 snap -1 2026-02-13T18:20:00.565 INFO:tasks.rados.rados.0.trial187.stdout:3127: expect deleted 2026-02-13T18:20:00.566 INFO:tasks.rados.rados.0.trial187.stdout:3128: delete oid 50 current snap is 347 2026-02-13T18:20:00.566 INFO:tasks.rados.rados.0.trial187.stdout:3126: finishing write tid 1 to trial18717860-33 2026-02-13T18:20:00.566 INFO:tasks.rados.rados.0.trial187.stdout:3126: finishing write tid 2 to trial18717860-33 2026-02-13T18:20:00.570 INFO:tasks.rados.rados.0.trial187.stdout:3126: finishing write tid 3 to trial18717860-33 2026-02-13T18:20:00.570 INFO:tasks.rados.rados.0.trial187.stdout:3126: finishing write tid 4 to trial18717860-33 2026-02-13T18:20:00.570 INFO:tasks.rados.rados.0.trial187.stdout:3126: finishing write tid 5 to trial18717860-33 2026-02-13T18:20:00.570 INFO:tasks.rados.rados.0.trial187.stdout:3126: oid 33 updating version 0 to 2026 2026-02-13T18:20:00.570 INFO:tasks.rados.rados.0.trial187.stdout:3126: oid 33 updating version 2026 to 2027 2026-02-13T18:20:00.571 INFO:tasks.rados.rados.0.trial187.stdout:3126: oid 33 updating version 2027 to 2028 2026-02-13T18:20:00.571 INFO:tasks.rados.rados.0.trial187.stdout:3126: oid 33 version 2028 is already newer than 2025 2026-02-13T18:20:00.571 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2028 (ObjNum 1051 snap 347 seq_num 1051) dirty exists 2026-02-13T18:20:00.571 INFO:tasks.rados.rados.0.trial187.stdout:3126: left oid 33 (ObjNum 1051 snap 347 seq_num 1051) 2026-02-13T18:20:00.571 INFO:tasks.rados.rados.0.trial187.stdout:3126: done (2 left) 2026-02-13T18:20:00.572 INFO:tasks.rados.rados.0.trial187.stdout:3127: done (1 left) 2026-02-13T18:20:00.572 INFO:tasks.rados.rados.0.trial187.stdout:3128: done (0 left) 2026-02-13T18:20:00.572 INFO:tasks.rados.rados.0.trial187.stdout:3129: rollback oid 17 current snap is 347 2026-02-13T18:20:00.572 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 329 2026-02-13T18:20:00.572 INFO:tasks.rados.rados.0.trial187.stdout:3130: read oid 38 snap -1 2026-02-13T18:20:00.572 INFO:tasks.rados.rados.0.trial187.stdout:3130: expect (ObjNum 1005 snap 326 seq_num 1005) 2026-02-13T18:20:00.573 INFO:tasks.rados.rados.0.trial187.stdout:3131: write (excl) oid 12 current snap is 347 2026-02-13T18:20:00.573 INFO:tasks.rados.rados.0.trial187.stdout:3131: seq_num 1053 ranges {497771=493911,1619186=554020,2950529=430606} 2026-02-13T18:20:00.575 INFO:tasks.rados.rados.0.trial187.stdout:3131: writing trial18717860-12 from 497771 to 991682 tid 1 2026-02-13T18:20:00.583 INFO:tasks.rados.rados.0.trial187.stdout:3131: writing trial18717860-12 from 1619186 to 2173206 tid 2 2026-02-13T18:20:00.592 INFO:tasks.rados.rados.0.trial187.stdout:3131: writing trial18717860-12 from 2950529 to 3381135 tid 3 2026-02-13T18:20:00.592 INFO:tasks.rados.rados.0.trial187.stdout:3132: read oid 29 snap -1 2026-02-13T18:20:00.592 INFO:tasks.rados.rados.0.trial187.stdout:3132: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:20:00.593 INFO:tasks.rados.rados.0.trial187.stdout:3133: write (excl) oid 13 current snap is 347 2026-02-13T18:20:00.593 INFO:tasks.rados.rados.0.trial187.stdout:3133: seq_num 1054 ranges {514578=569160,1677668=414031,2577952=641878} 2026-02-13T18:20:00.597 INFO:tasks.rados.rados.0.trial187.stdout:3133: writing trial18717860-13 from 514578 to 1083738 tid 1 2026-02-13T18:20:00.601 INFO:tasks.rados.rados.0.trial187.stdout:3133: writing trial18717860-13 from 1677668 to 2091699 tid 2 2026-02-13T18:20:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3133: writing trial18717860-13 from 2577952 to 3219830 tid 3 2026-02-13T18:20:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3134: copy_from oid 3 from oid 49 current snap is 347 2026-02-13T18:20:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3129: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:20:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3129: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:20:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3130: expect (ObjNum 1005 snap 326 seq_num 1005) 2026-02-13T18:20:00.609 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 516893 2026-02-13T18:20:00.671 INFO:tasks.rados.rados.0.trial187.stdout:3129: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:20:00.672 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1638 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:20:00.672 INFO:tasks.rados.rados.0.trial187.stdout:3131: finishing write tid 1 to trial18717860-12 2026-02-13T18:20:00.672 INFO:tasks.rados.rados.0.trial187.stdout:3131: finishing write tid 2 to trial18717860-12 2026-02-13T18:20:00.672 INFO:tasks.rados.rados.0.trial187.stdout:3132: expect (ObjNum 971 snap 313 seq_num 971) 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: finishing write tid 3 to trial18717860-12 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: finishing write tid 4 to trial18717860-12 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: finishing write tid 5 to trial18717860-12 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: oid 12 updating version 0 to 1062 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: oid 12 updating version 1062 to 1064 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: oid 12 version 1064 is already newer than 1061 2026-02-13T18:20:00.719 INFO:tasks.rados.rados.0.trial187.stdout:3131: oid 12 version 1064 is already newer than 1063 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1064 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3131: left oid 12 (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: finishing write tid 1 to trial18717860-13 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: finishing write tid 2 to trial18717860-13 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3134: finishing copy_from to trial18717860-3 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3134: got expected ENOENT (src dne) 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3134: finishing copy_from racing read to trial18717860-3 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: finishing write tid 3 to trial18717860-13 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: finishing write tid 4 to trial18717860-13 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: finishing write tid 5 to trial18717860-13 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: oid 13 updating version 0 to 1213 2026-02-13T18:20:00.720 INFO:tasks.rados.rados.0.trial187.stdout:3133: oid 13 updating version 1213 to 1214 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3133: oid 13 version 1214 is already newer than 1212 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3133: oid 13 version 1214 is already newer than 1211 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1214 (ObjNum 1054 snap 347 seq_num 1054) dirty exists 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3133: left oid 13 (ObjNum 1054 snap 347 seq_num 1054) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3129: done (5 left) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3130: done (4 left) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3131: done (3 left) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3132: done (2 left) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3133: done (1 left) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3134: done (0 left) 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3135: read oid 23 snap -1 2026-02-13T18:20:00.721 INFO:tasks.rados.rados.0.trial187.stdout:3135: expect (ObjNum 1006 snap 326 seq_num 1006) 2026-02-13T18:20:00.722 INFO:tasks.rados.rados.0.trial187.stdout:3136: rollback oid 35 current snap is 347 2026-02-13T18:20:00.722 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 35 to 345 2026-02-13T18:20:00.722 INFO:tasks.rados.rados.0.trial187.stdout:3137: snap_create 2026-02-13T18:20:00.724 INFO:tasks.rados.rados.0.trial187.stdout:3135: expect (ObjNum 1006 snap 326 seq_num 1006) 2026-02-13T18:20:00.725 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 283745 2026-02-13T18:20:00.841 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:00.890 INFO:tasks.rados.rados.0.trial187.stdout:3136: finishing rollback tid 0 to trial18717860-35 2026-02-13T18:20:00.890 INFO:tasks.rados.rados.0.trial187.stdout:3136: finishing rollback tid 1 to trial18717860-35 2026-02-13T18:20:00.891 INFO:tasks.rados.rados.0.trial187.stdout:3136: finishing rollback tid 2 to trial18717860-35 2026-02-13T18:20:00.891 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1814 (ObjNum 1032 snap 335 seq_num 1032) dirty exists 2026-02-13T18:20:01.554 INFO:tasks.rados.rados.0.trial187.stdout:3135: done (2 left) 2026-02-13T18:20:01.554 INFO:tasks.rados.rados.0.trial187.stdout:3136: done (1 left) 2026-02-13T18:20:01.554 INFO:tasks.rados.rados.0.trial187.stdout:3137: done (0 left) 2026-02-13T18:20:01.554 INFO:tasks.rados.rados.0.trial187.stdout:3138: rollback oid 11 current snap is 348 2026-02-13T18:20:01.555 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 324 2026-02-13T18:20:01.555 INFO:tasks.rados.rados.0.trial187.stdout:3139: snap_create 2026-02-13T18:20:01.557 INFO:tasks.rados.rados.0.trial187.stdout:3138: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:20:01.557 INFO:tasks.rados.rados.0.trial187.stdout:3138: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:20:01.558 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1441 (ObjNum 870 snap 287 seq_num 870) dirty exists 2026-02-13T18:20:02.554 INFO:tasks.rados.rados.0.trial187.stdout:3138: done (1 left) 2026-02-13T18:20:02.554 INFO:tasks.rados.rados.0.trial187.stdout:3139: done (0 left) 2026-02-13T18:20:02.554 INFO:tasks.rados.rados.0.trial187.stdout:3140: read oid 28 snap -1 2026-02-13T18:20:02.554 INFO:tasks.rados.rados.0.trial187.stdout:3140: expect deleted 2026-02-13T18:20:02.554 INFO:tasks.rados.rados.0.trial187.stdout:3141: snap_remove snap 339 2026-02-13T18:20:03.555 INFO:tasks.rados.rados.0.trial187.stdout:3141: done (1 left) 2026-02-13T18:20:03.555 INFO:tasks.rados.rados.0.trial187.stdout:3142: write (excl) oid 21 current snap is 349 2026-02-13T18:20:03.556 INFO:tasks.rados.rados.0.trial187.stdout:3142: seq_num 1055 ranges {531385=644409,1736150=557689,3005375=569503} 2026-02-13T18:20:03.563 INFO:tasks.rados.rados.0.trial187.stdout:3142: writing trial18717860-21 from 531385 to 1175794 tid 1 2026-02-13T18:20:03.571 INFO:tasks.rados.rados.0.trial187.stdout:3142: writing trial18717860-21 from 1736150 to 2293839 tid 2 2026-02-13T18:20:03.580 INFO:tasks.rados.rados.0.trial187.stdout:3142: writing trial18717860-21 from 3005375 to 3574878 tid 3 2026-02-13T18:20:03.580 INFO:tasks.rados.rados.0.trial187.stdout:3143: write oid 37 current snap is 349 2026-02-13T18:20:03.580 INFO:tasks.rados.rados.0.trial187.stdout:3143: seq_num 1056 ranges {548192=719658,1678279=417700,2516445=780775} 2026-02-13T18:20:03.589 INFO:tasks.rados.rados.0.trial187.stdout:3143: writing trial18717860-37 from 548192 to 1267850 tid 1 2026-02-13T18:20:03.595 INFO:tasks.rados.rados.0.trial187.stdout:3143: writing trial18717860-37 from 1678279 to 2095979 tid 2 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3143: writing trial18717860-37 from 2516445 to 3297220 tid 3 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3144: delete oid 19 current snap is 349 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3142: finishing write tid 1 to trial18717860-21 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3142: finishing write tid 2 to trial18717860-21 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3142: finishing write tid 3 to trial18717860-21 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3142: finishing write tid 4 to trial18717860-21 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3142: finishing write tid 5 to trial18717860-21 2026-02-13T18:20:03.602 INFO:tasks.rados.rados.0.trial187.stdout:3142: oid 21 updating version 0 to 1184 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:3142: oid 21 updating version 1184 to 1186 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:3142: oid 21 version 1186 is already newer than 1185 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:3142: oid 21 version 1186 is already newer than 1183 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1186 (ObjNum 1055 snap 349 seq_num 1055) dirty exists 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:3142: left oid 21 (ObjNum 1055 snap 349 seq_num 1055) 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:3143: finishing write tid 1 to trial18717860-37 2026-02-13T18:20:03.603 INFO:tasks.rados.rados.0.trial187.stdout:3143: finishing write tid 2 to trial18717860-37 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3140: done (3 left) 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3142: done (2 left) 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3144: done (1 left) 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3145: rollback oid 44 current snap is 349 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 340 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3146: read oid 7 snap -1 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3146: expect (ObjNum 1046 snap 342 seq_num 1046) 2026-02-13T18:20:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3147: snap_create 2026-02-13T18:20:03.609 INFO:tasks.rados.rados.0.trial187.stdout:3146: expect (ObjNum 1046 snap 342 seq_num 1046) 2026-02-13T18:20:03.692 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2251264 2026-02-13T18:20:03.748 INFO:tasks.rados.rados.0.trial187.stdout:3143: finishing write tid 3 to trial18717860-37 2026-02-13T18:20:03.748 INFO:tasks.rados.rados.0.trial187.stdout:3143: finishing write tid 4 to trial18717860-37 2026-02-13T18:20:03.748 INFO:tasks.rados.rados.0.trial187.stdout:3143: finishing write tid 5 to trial18717860-37 2026-02-13T18:20:03.748 INFO:tasks.rados.rados.0.trial187.stdout:3143: oid 37 updating version 0 to 2033 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3143: oid 37 updating version 2033 to 2034 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3143: oid 37 version 2034 is already newer than 2031 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3143: oid 37 version 2034 is already newer than 2032 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 2034 (ObjNum 1056 snap 349 seq_num 1056) dirty exists 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3143: left oid 37 (ObjNum 1056 snap 349 seq_num 1056) 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3145: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3145: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:3145: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:20:03.749 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2038 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:20:04.564 INFO:tasks.rados.rados.0.trial187.stdout:3143: done (3 left) 2026-02-13T18:20:04.564 INFO:tasks.rados.rados.0.trial187.stdout:3145: done (2 left) 2026-02-13T18:20:04.564 INFO:tasks.rados.rados.0.trial187.stdout:3146: done (1 left) 2026-02-13T18:20:04.564 INFO:tasks.rados.rados.0.trial187.stdout:3147: done (0 left) 2026-02-13T18:20:04.564 INFO:tasks.rados.rados.0.trial187.stdout:3148: write oid 24 current snap is 350 2026-02-13T18:20:04.564 INFO:tasks.rados.rados.0.trial187.stdout:3148: seq_num 1058 ranges {581806=586509,1911596=421369,3087644=403319} 2026-02-13T18:20:04.571 INFO:tasks.rados.rados.0.trial187.stdout:3148: writing trial18717860-24 from 581806 to 1168315 tid 1 2026-02-13T18:20:04.579 INFO:tasks.rados.rados.0.trial187.stdout:3148: writing trial18717860-24 from 1911596 to 2332965 tid 2 2026-02-13T18:20:04.587 INFO:tasks.rados.rados.0.trial187.stdout:3148: writing trial18717860-24 from 3087644 to 3490963 tid 3 2026-02-13T18:20:04.587 INFO:tasks.rados.rados.0.trial187.stdout:3149: copy_from oid 17 from oid 38 current snap is 350 2026-02-13T18:20:04.588 INFO:tasks.rados.rados.0.trial187.stdout:3148: finishing write tid 1 to trial18717860-24 2026-02-13T18:20:04.588 INFO:tasks.rados.rados.0.trial187.stdout:3148: finishing write tid 2 to trial18717860-24 2026-02-13T18:20:04.588 INFO:tasks.rados.rados.0.trial187.stdout:3150: write oid 11 current snap is 350 2026-02-13T18:20:04.588 INFO:tasks.rados.rados.0.trial187.stdout:3150: seq_num 1059 ranges {598613=661758,1970078=565027,3115067=614591} 2026-02-13T18:20:04.596 INFO:tasks.rados.rados.0.trial187.stdout:3150: writing trial18717860-11 from 598613 to 1260371 tid 1 2026-02-13T18:20:04.604 INFO:tasks.rados.rados.0.trial187.stdout:3150: writing trial18717860-11 from 1970078 to 2535105 tid 2 2026-02-13T18:20:04.613 INFO:tasks.rados.rados.0.trial187.stdout:3150: writing trial18717860-11 from 3115067 to 3729658 tid 3 2026-02-13T18:20:04.613 INFO:tasks.rados.rados.0.trial187.stdout:3151: write (excl) oid 49 current snap is 350 2026-02-13T18:20:04.613 INFO:tasks.rados.rados.0.trial187.stdout:3148: finishing write tid 3 to trial18717860-24 2026-02-13T18:20:04.613 INFO:tasks.rados.rados.0.trial187.stdout:3148: finishing write tid 4 to trial18717860-24 2026-02-13T18:20:04.613 INFO:tasks.rados.rados.0.trial187.stdout:3148: finishing write tid 5 to trial18717860-24 2026-02-13T18:20:04.613 INFO:tasks.rados.rados.0.trial187.stdout:3148: oid 24 updating version 0 to 1624 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3148: oid 24 updating version 1624 to 1625 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3148: oid 24 version 1625 is already newer than 1623 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3148: oid 24 version 1625 is already newer than 1622 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1625 (ObjNum 1058 snap 350 seq_num 1058) dirty exists 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3148: left oid 24 (ObjNum 1058 snap 350 seq_num 1058) 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3149: finishing copy_from racing read to trial18717860-17 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3149: finishing copy_from to trial18717860-17 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1807 (ObjNum 1005 snap 326 seq_num 1005) dirty exists 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3150: finishing write tid 1 to trial18717860-11 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3150: finishing write tid 2 to trial18717860-11 2026-02-13T18:20:04.614 INFO:tasks.rados.rados.0.trial187.stdout:3151: seq_num 1060 ranges {615420=737007,1912207=425038,3026137=542216} 2026-02-13T18:20:04.620 INFO:tasks.rados.rados.0.trial187.stdout:3151: writing trial18717860-49 from 615420 to 1352427 tid 1 2026-02-13T18:20:04.625 INFO:tasks.rados.rados.0.trial187.stdout:3151: writing trial18717860-49 from 1912207 to 2337245 tid 2 2026-02-13T18:20:04.630 INFO:tasks.rados.rados.0.trial187.stdout:3151: writing trial18717860-49 from 3026137 to 3568353 tid 3 2026-02-13T18:20:04.630 INFO:tasks.rados.rados.0.trial187.stdout:3148: done (3 left) 2026-02-13T18:20:04.630 INFO:tasks.rados.rados.0.trial187.stdout:3149: done (2 left) 2026-02-13T18:20:04.630 INFO:tasks.rados.rados.0.trial187.stdout:3152: write (excl) oid 28 current snap is 350 2026-02-13T18:20:04.630 INFO:tasks.rados.rados.0.trial187.stdout:3152: seq_num 1061 ranges {632227=412256,1570689=568696,2653560=753488} 2026-02-13T18:20:04.634 INFO:tasks.rados.rados.0.trial187.stdout:3152: writing trial18717860-28 from 632227 to 1044483 tid 1 2026-02-13T18:20:04.638 INFO:tasks.rados.rados.0.trial187.stdout:3152: writing trial18717860-28 from 1570689 to 2139385 tid 2 2026-02-13T18:20:04.643 INFO:tasks.rados.rados.0.trial187.stdout:3152: writing trial18717860-28 from 2653560 to 3407048 tid 3 2026-02-13T18:20:04.643 INFO:tasks.rados.rados.0.trial187.stdout:3153: write (excl) oid 32 current snap is 350 2026-02-13T18:20:04.643 INFO:tasks.rados.rados.0.trial187.stdout:3153: seq_num 1062 ranges {649034=487505,1629171=428707,2680983=564760,3798768=50266} 2026-02-13T18:20:04.647 INFO:tasks.rados.rados.0.trial187.stdout:3153: writing trial18717860-32 from 649034 to 1136539 tid 1 2026-02-13T18:20:04.651 INFO:tasks.rados.rados.0.trial187.stdout:3153: writing trial18717860-32 from 1629171 to 2057878 tid 2 2026-02-13T18:20:04.655 INFO:tasks.rados.rados.0.trial187.stdout:3153: writing trial18717860-32 from 2680983 to 3245743 tid 3 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3153: writing trial18717860-32 from 3798768 to 3849034 tid 4 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3154: read oid 45 snap -1 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3154: expect deleted 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3155: snap_create 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3150: finishing write tid 3 to trial18717860-11 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3150: finishing write tid 4 to trial18717860-11 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3150: finishing write tid 5 to trial18717860-11 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3150: oid 11 updating version 0 to 1445 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3150: oid 11 version 1445 is already newer than 1443 2026-02-13T18:20:04.659 INFO:tasks.rados.rados.0.trial187.stdout:3150: oid 11 version 1445 is already newer than 1442 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3150: oid 11 version 1445 is already newer than 1444 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1445 (ObjNum 1059 snap 350 seq_num 1059) dirty exists 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3150: left oid 11 (ObjNum 1059 snap 350 seq_num 1059) 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: finishing write tid 1 to trial18717860-49 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: finishing write tid 2 to trial18717860-49 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: finishing write tid 3 to trial18717860-49 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: finishing write tid 4 to trial18717860-49 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: finishing write tid 5 to trial18717860-49 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: oid 49 updating version 0 to 1449 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: oid 49 version 1449 is already newer than 1447 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: oid 49 version 1449 is already newer than 1446 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:3151: oid 49 version 1449 is already newer than 1448 2026-02-13T18:20:04.660 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1449 (ObjNum 1060 snap 350 seq_num 1060) dirty exists 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3151: left oid 49 (ObjNum 1060 snap 350 seq_num 1060) 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: finishing write tid 1 to trial18717860-28 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: finishing write tid 2 to trial18717860-28 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: finishing write tid 3 to trial18717860-28 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: finishing write tid 4 to trial18717860-28 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: finishing write tid 5 to trial18717860-28 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: oid 28 updating version 0 to 1627 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: oid 28 updating version 1627 to 1628 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: oid 28 version 1628 is already newer than 1626 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3152: oid 28 updating version 1628 to 1629 2026-02-13T18:20:04.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1629 (ObjNum 1061 snap 350 seq_num 1061) dirty exists 2026-02-13T18:20:04.662 INFO:tasks.rados.rados.0.trial187.stdout:3152: left oid 28 (ObjNum 1061 snap 350 seq_num 1061) 2026-02-13T18:20:04.662 INFO:tasks.rados.rados.0.trial187.stdout:3153: finishing write tid 1 to trial18717860-32 2026-02-13T18:20:04.662 INFO:tasks.rados.rados.0.trial187.stdout:3153: finishing write tid 2 to trial18717860-32 2026-02-13T18:20:04.662 INFO:tasks.rados.rados.0.trial187.stdout:3153: finishing write tid 3 to trial18717860-32 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: finishing write tid 4 to trial18717860-32 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: finishing write tid 5 to trial18717860-32 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: finishing write tid 6 to trial18717860-32 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: oid 32 updating version 0 to 1082 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: oid 32 version 1082 is already newer than 1079 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: oid 32 version 1082 is already newer than 1081 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: oid 32 version 1082 is already newer than 1078 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: oid 32 version 1082 is already newer than 1080 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1082 (ObjNum 1062 snap 350 seq_num 1062) dirty exists 2026-02-13T18:20:04.663 INFO:tasks.rados.rados.0.trial187.stdout:3153: left oid 32 (ObjNum 1062 snap 350 seq_num 1062) 2026-02-13T18:20:05.566 INFO:tasks.rados.rados.0.trial187.stdout:3150: done (5 left) 2026-02-13T18:20:05.566 INFO:tasks.rados.rados.0.trial187.stdout:3151: done (4 left) 2026-02-13T18:20:05.566 INFO:tasks.rados.rados.0.trial187.stdout:3152: done (3 left) 2026-02-13T18:20:05.566 INFO:tasks.rados.rados.0.trial187.stdout:3153: done (2 left) 2026-02-13T18:20:05.566 INFO:tasks.rados.rados.0.trial187.stdout:3154: done (1 left) 2026-02-13T18:20:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3155: done (0 left) 2026-02-13T18:20:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3156: read oid 39 snap -1 2026-02-13T18:20:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3156: expect deleted 2026-02-13T18:20:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3157: write (excl) oid 17 current snap is 351 2026-02-13T18:20:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3157: seq_num 1063 ranges {665841=562754,1687653=572365,2708406=776032} 2026-02-13T18:20:05.571 INFO:tasks.rados.rados.0.trial187.stdout:3157: writing trial18717860-17 from 665841 to 1228595 tid 1 2026-02-13T18:20:05.575 INFO:tasks.rados.rados.0.trial187.stdout:3157: writing trial18717860-17 from 1687653 to 2260018 tid 2 2026-02-13T18:20:05.580 INFO:tasks.rados.rados.0.trial187.stdout:3157: writing trial18717860-17 from 2708406 to 3484438 tid 3 2026-02-13T18:20:05.580 INFO:tasks.rados.rados.0.trial187.stdout:3158: copy_from oid 11 from oid 42 current snap is 351 2026-02-13T18:20:05.580 INFO:tasks.rados.rados.0.trial187.stdout:3157: finishing write tid 1 to trial18717860-17 2026-02-13T18:20:05.580 INFO:tasks.rados.rados.0.trial187.stdout:3157: finishing write tid 2 to trial18717860-17 2026-02-13T18:20:05.580 INFO:tasks.rados.rados.0.trial187.stdout:3156: done (2 left) 2026-02-13T18:20:05.580 INFO:tasks.rados.rados.0.trial187.stdout:3159: snap_remove snap 343 2026-02-13T18:20:06.570 INFO:tasks.rados.rados.0.trial187.stdout:3159: done (2 left) 2026-02-13T18:20:06.570 INFO:tasks.rados.rados.0.trial187.stdout:3160: snap_remove snap 319 2026-02-13T18:20:07.572 INFO:tasks.rados.rados.0.trial187.stdout:3160: done (2 left) 2026-02-13T18:20:07.572 INFO:tasks.rados.rados.0.trial187.stdout:3161: read oid 48 snap -1 2026-02-13T18:20:07.572 INFO:tasks.rados.rados.0.trial187.stdout:3161: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:20:07.573 INFO:tasks.rados.rados.0.trial187.stdout:3162: read oid 20 snap 326 2026-02-13T18:20:07.573 INFO:tasks.rados.rados.0.trial187.stdout:3162: expect (ObjNum 871 snap 287 seq_num 871) 2026-02-13T18:20:07.573 INFO:tasks.rados.rados.0.trial187.stdout:3163: snap_remove snap 347 2026-02-13T18:20:08.572 INFO:tasks.rados.rados.0.trial187.stdout:3163: done (4 left) 2026-02-13T18:20:08.573 INFO:tasks.rados.rados.0.trial187.stdout:3164: snap_remove snap 328 2026-02-13T18:20:09.573 INFO:tasks.rados.rados.0.trial187.stdout:3164: done (4 left) 2026-02-13T18:20:09.574 INFO:tasks.rados.rados.0.trial187.stdout:3165: snap_remove snap 342 2026-02-13T18:20:10.547 INFO:tasks.rados.rados.0.trial187.stdout:3165: done (4 left) 2026-02-13T18:20:10.547 INFO:tasks.rados.rados.0.trial187.stdout:3166: read oid 41 snap -1 2026-02-13T18:20:10.547 INFO:tasks.rados.rados.0.trial187.stdout:3166: expect deleted 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3167: rollback oid 16 current snap is 351 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 345 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3158: finishing copy_from racing read to trial18717860-11 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3168: read oid 43 snap -1 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3168: expect deleted 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3169: rollback oid 30 current snap is 351 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 324 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3157: finishing write tid 3 to trial18717860-17 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3158: finishing copy_from to trial18717860-11 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1437 (ObjNum 870 snap 287 seq_num 870) dirty exists 2026-02-13T18:20:10.548 INFO:tasks.rados.rados.0.trial187.stdout:3157: finishing write tid 4 to trial18717860-17 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3157: finishing write tid 5 to trial18717860-17 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3157: oid 17 updating version 0 to 1809 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3157: oid 17 updating version 1809 to 1811 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3157: oid 17 version 1811 is already newer than 1810 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3157: oid 17 version 1811 is already newer than 1808 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1811 (ObjNum 1063 snap 351 seq_num 1063) dirty exists 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3157: left oid 17 (ObjNum 1063 snap 351 seq_num 1063) 2026-02-13T18:20:10.549 INFO:tasks.rados.rados.0.trial187.stdout:3162: expect (ObjNum 871 snap 287 seq_num 871) 2026-02-13T18:20:10.613 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:10.661 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 573292 2026-02-13T18:20:10.703 INFO:tasks.rados.rados.0.trial187.stdout:3161: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:20:10.703 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:10.754 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:10.851 INFO:tasks.rados.rados.0.trial187.stdout:3167: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3169: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3169: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1084 (ObjNum 129 snap 0 seq_num 3012834624) dirty dne 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3157: done (7 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3158: done (6 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3161: done (5 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3162: done (4 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3166: done (3 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3167: done (2 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3168: done (1 left) 2026-02-13T18:20:10.852 INFO:tasks.rados.rados.0.trial187.stdout:3169: done (0 left) 2026-02-13T18:20:10.853 INFO:tasks.rados.rados.0.trial187.stdout:3170: rollback oid 44 current snap is 351 2026-02-13T18:20:10.853 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 348 2026-02-13T18:20:10.853 INFO:tasks.rados.rados.0.trial187.stdout:3171: snap_remove snap 326 2026-02-13T18:20:11.581 INFO:tasks.rados.rados.0.trial187.stdout:3171: done (1 left) 2026-02-13T18:20:11.581 INFO:tasks.rados.rados.0.trial187.stdout:3172: delete oid 22 current snap is 351 2026-02-13T18:20:11.581 INFO:tasks.rados.rados.0.trial187.stdout:3170: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:20:11.581 INFO:tasks.rados.rados.0.trial187.stdout:3170: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:20:11.581 INFO:tasks.rados.rados.0.trial187.stdout:3170: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:20:11.581 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2062 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:20:11.587 INFO:tasks.rados.rados.0.trial187.stdout:3170: done (1 left) 2026-02-13T18:20:11.587 INFO:tasks.rados.rados.0.trial187.stdout:3172: done (0 left) 2026-02-13T18:20:11.587 INFO:tasks.rados.rados.0.trial187.stdout:3173: copy_from oid 10 from oid 1 current snap is 351 2026-02-13T18:20:11.587 INFO:tasks.rados.rados.0.trial187.stdout:3174: snap_create 2026-02-13T18:20:11.590 INFO:tasks.rados.rados.0.trial187.stdout:3173: finishing copy_from to trial18717860-10 2026-02-13T18:20:11.590 INFO:tasks.rados.rados.0.trial187.stdout:3173: got expected ENOENT (src dne) 2026-02-13T18:20:11.590 INFO:tasks.rados.rados.0.trial187.stdout:3173: finishing copy_from racing read to trial18717860-10 2026-02-13T18:20:13.155 INFO:tasks.rados.rados.0.trial187.stdout:3173: done (1 left) 2026-02-13T18:20:13.155 INFO:tasks.rados.rados.0.trial187.stdout:3174: done (0 left) 2026-02-13T18:20:13.156 INFO:tasks.rados.rados.0.trial187.stdout:3175: snap_remove snap 324 2026-02-13T18:20:14.158 INFO:tasks.rados.rados.0.trial187.stdout:3175: done (0 left) 2026-02-13T18:20:14.158 INFO:tasks.rados.rados.0.trial187.stdout:3176: write (excl) oid 25 current snap is 352 2026-02-13T18:20:14.158 INFO:tasks.rados.rados.0.trial187.stdout:3176: seq_num 1065 ranges {699455=429605,1804617=576034,3163252=514929} 2026-02-13T18:20:14.166 INFO:tasks.rados.rados.0.trial187.stdout:3176: writing trial18717860-25 from 699455 to 1129060 tid 1 2026-02-13T18:20:14.174 INFO:tasks.rados.rados.0.trial187.stdout:3176: writing trial18717860-25 from 1804617 to 2380651 tid 2 2026-02-13T18:20:14.183 INFO:tasks.rados.rados.0.trial187.stdout:3176: writing trial18717860-25 from 3163252 to 3678181 tid 3 2026-02-13T18:20:14.183 INFO:tasks.rados.rados.0.trial187.stdout:3177: read oid 19 snap -1 2026-02-13T18:20:14.183 INFO:tasks.rados.rados.0.trial187.stdout:3177: expect deleted 2026-02-13T18:20:14.184 INFO:tasks.rados.rados.0.trial187.stdout:3178: write (excl) oid 18 current snap is 352 2026-02-13T18:20:14.184 INFO:tasks.rados.rados.0.trial187.stdout:3178: seq_num 1066 ranges {716262=504854,1863099=719692,3074322=726201} 2026-02-13T18:20:14.191 INFO:tasks.rados.rados.0.trial187.stdout:3178: writing trial18717860-18 from 716262 to 1221116 tid 1 2026-02-13T18:20:14.200 INFO:tasks.rados.rados.0.trial187.stdout:3178: writing trial18717860-18 from 1863099 to 2582791 tid 2 2026-02-13T18:20:14.206 INFO:tasks.rados.rados.0.trial187.stdout:3178: writing trial18717860-18 from 3074322 to 3800523 tid 3 2026-02-13T18:20:14.207 INFO:tasks.rados.rados.0.trial187.stdout:3179: write (excl) oid 42 current snap is 352 2026-02-13T18:20:14.207 INFO:tasks.rados.rados.0.trial187.stdout:3179: seq_num 1067 ranges {733069=580103,1921581=579703,3218098=537473} 2026-02-13T18:20:14.211 INFO:tasks.rados.rados.0.trial187.stdout:3179: writing trial18717860-42 from 733069 to 1313172 tid 1 2026-02-13T18:20:14.216 INFO:tasks.rados.rados.0.trial187.stdout:3179: writing trial18717860-42 from 1921581 to 2501284 tid 2 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3179: writing trial18717860-42 from 3218098 to 3755571 tid 3 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3180: rollback oid 20 current snap is 352 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 346 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: finishing write tid 1 to trial18717860-25 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: finishing write tid 2 to trial18717860-25 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: finishing write tid 3 to trial18717860-25 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: finishing write tid 4 to trial18717860-25 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: finishing write tid 5 to trial18717860-25 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: oid 25 updating version 0 to 1031 2026-02-13T18:20:14.222 INFO:tasks.rados.rados.0.trial187.stdout:3176: oid 25 version 1031 is already newer than 1028 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3176: oid 25 version 1031 is already newer than 1030 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3176: oid 25 version 1031 is already newer than 1029 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1031 (ObjNum 1065 snap 352 seq_num 1065) dirty exists 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3176: left oid 25 (ObjNum 1065 snap 352 seq_num 1065) 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: finishing write tid 1 to trial18717860-18 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: finishing write tid 2 to trial18717860-18 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: finishing write tid 3 to trial18717860-18 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: finishing write tid 4 to trial18717860-18 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: finishing write tid 5 to trial18717860-18 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: oid 18 updating version 0 to 1218 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: oid 18 version 1218 is already newer than 1216 2026-02-13T18:20:14.223 INFO:tasks.rados.rados.0.trial187.stdout:3178: oid 18 version 1218 is already newer than 1217 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3178: oid 18 version 1218 is already newer than 1215 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1218 (ObjNum 1066 snap 352 seq_num 1066) dirty exists 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3178: left oid 18 (ObjNum 1066 snap 352 seq_num 1066) 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3179: finishing write tid 1 to trial18717860-42 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3179: finishing write tid 2 to trial18717860-42 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3176: done (4 left) 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3177: done (3 left) 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3178: done (2 left) 2026-02-13T18:20:14.224 INFO:tasks.rados.rados.0.trial187.stdout:3181: snap_remove snap 351 2026-02-13T18:20:15.163 INFO:tasks.rados.rados.0.trial187.stdout:3181: done (2 left) 2026-02-13T18:20:15.164 INFO:tasks.rados.rados.0.trial187.stdout:3182: read oid 31 snap -1 2026-02-13T18:20:15.164 INFO:tasks.rados.rados.0.trial187.stdout:3182: expect deleted 2026-02-13T18:20:15.164 INFO:tasks.rados.rados.0.trial187.stdout:3183: write (excl) oid 21 current snap is 352 2026-02-13T18:20:15.164 INFO:tasks.rados.rados.0.trial187.stdout:3179: finishing write tid 3 to trial18717860-42 2026-02-13T18:20:15.164 INFO:tasks.rados.rados.0.trial187.stdout:3179: finishing write tid 4 to trial18717860-42 2026-02-13T18:20:15.164 INFO:tasks.rados.rados.0.trial187.stdout:3183: seq_num 1068 ranges {749876=655352,1863710=723361,3012815=748745} 2026-02-13T18:20:15.169 INFO:tasks.rados.rados.0.trial187.stdout:3183: writing trial18717860-21 from 749876 to 1405228 tid 1 2026-02-13T18:20:15.173 INFO:tasks.rados.rados.0.trial187.stdout:3183: writing trial18717860-21 from 1863710 to 2587071 tid 2 2026-02-13T18:20:15.178 INFO:tasks.rados.rados.0.trial187.stdout:3183: writing trial18717860-21 from 3012815 to 3761560 tid 3 2026-02-13T18:20:15.178 INFO:tasks.rados.rados.0.trial187.stdout:3184: copy_from oid 48 from oid 5 current snap is 352 2026-02-13T18:20:15.178 INFO:tasks.rados.rados.0.trial187.stdout:3179: finishing write tid 5 to trial18717860-42 2026-02-13T18:20:15.178 INFO:tasks.rados.rados.0.trial187.stdout:3179: oid 42 updating version 0 to 1439 2026-02-13T18:20:15.178 INFO:tasks.rados.rados.0.trial187.stdout:3179: oid 42 updating version 1439 to 1441 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3179: oid 42 updating version 1441 to 1442 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3179: oid 42 version 1442 is already newer than 1440 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1442 (ObjNum 1067 snap 352 seq_num 1067) dirty exists 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3179: left oid 42 (ObjNum 1067 snap 352 seq_num 1067) 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3180: finishing rollback tid 0 to trial18717860-20 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3180: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3180: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1625 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3183: finishing write tid 1 to trial18717860-21 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3183: finishing write tid 2 to trial18717860-21 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3179: done (4 left) 2026-02-13T18:20:15.179 INFO:tasks.rados.rados.0.trial187.stdout:3180: done (3 left) 2026-02-13T18:20:15.180 INFO:tasks.rados.rados.0.trial187.stdout:3182: done (2 left) 2026-02-13T18:20:15.180 INFO:tasks.rados.rados.0.trial187.stdout:3185: delete oid 18 current snap is 352 2026-02-13T18:20:15.181 INFO:tasks.rados.rados.0.trial187.stdout:3183: finishing write tid 3 to trial18717860-21 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: finishing write tid 4 to trial18717860-21 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: finishing write tid 5 to trial18717860-21 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: oid 21 updating version 0 to 1220 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: oid 21 updating version 1220 to 1221 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: oid 21 version 1221 is already newer than 1219 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: oid 21 version 1221 is already newer than 1218 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1221 (ObjNum 1068 snap 352 seq_num 1068) dirty exists 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: left oid 21 (ObjNum 1068 snap 352 seq_num 1068) 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3183: done (2 left) 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3185: done (1 left) 2026-02-13T18:20:15.182 INFO:tasks.rados.rados.0.trial187.stdout:3186: write oid 25 current snap is 352 2026-02-13T18:20:15.183 INFO:tasks.rados.rados.0.trial187.stdout:3186: seq_num 1070 ranges {783490=405850,1980674=727030,3184014=487642} 2026-02-13T18:20:15.186 INFO:tasks.rados.rados.0.trial187.stdout:3186: writing trial18717860-25 from 783490 to 1189340 tid 1 2026-02-13T18:20:15.192 INFO:tasks.rados.rados.0.trial187.stdout:3186: writing trial18717860-25 from 1980674 to 2707704 tid 2 2026-02-13T18:20:15.196 INFO:tasks.rados.rados.0.trial187.stdout:3186: writing trial18717860-25 from 3184014 to 3671656 tid 3 2026-02-13T18:20:15.196 INFO:tasks.rados.rados.0.trial187.stdout:3187: copy_from oid 39 from oid 50 current snap is 352 2026-02-13T18:20:15.196 INFO:tasks.rados.rados.0.trial187.stdout:3184: finishing copy_from racing read to trial18717860-48 2026-02-13T18:20:15.196 INFO:tasks.rados.rados.0.trial187.stdout:3186: finishing write tid 1 to trial18717860-25 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:3184: finishing copy_from to trial18717860-48 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 1440 (ObjNum 1016 snap 330 seq_num 1016) dirty exists 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:3186: finishing write tid 2 to trial18717860-25 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:3184: done (2 left) 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:3188: snap_create 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:3187: finishing copy_from to trial18717860-39 2026-02-13T18:20:15.197 INFO:tasks.rados.rados.0.trial187.stdout:3187: got expected ENOENT (src dne) 2026-02-13T18:20:15.198 INFO:tasks.rados.rados.0.trial187.stdout:3187: finishing copy_from racing read to trial18717860-39 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: finishing write tid 3 to trial18717860-25 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: finishing write tid 4 to trial18717860-25 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: finishing write tid 5 to trial18717860-25 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: oid 25 updating version 0 to 1035 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: oid 25 version 1035 is already newer than 1034 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: oid 25 version 1035 is already newer than 1033 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: oid 25 version 1035 is already newer than 1032 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1035 (ObjNum 1070 snap 352 seq_num 1070) dirty exists 2026-02-13T18:20:15.199 INFO:tasks.rados.rados.0.trial187.stdout:3186: left oid 25 (ObjNum 1070 snap 352 seq_num 1070) 2026-02-13T18:20:15.548 INFO:tasks.rados.rados.0.trial187.stdout:3186: done (2 left) 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3187: done (1 left) 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3188: done (0 left) 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3189: read oid 14 snap -1 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3189: expect deleted 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3190: read oid 22 snap -1 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3190: expect deleted 2026-02-13T18:20:15.549 INFO:tasks.rados.rados.0.trial187.stdout:3191: delete oid 38 current snap is 353 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3189: done (2 left) 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3190: done (1 left) 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3191: done (0 left) 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3192: read oid 48 snap 346 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3192: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3193: write (excl) oid 5 current snap is 353 2026-02-13T18:20:15.553 INFO:tasks.rados.rados.0.trial187.stdout:3193: seq_num 1072 ranges {417104=672701,1813991=203113} 2026-02-13T18:20:15.560 INFO:tasks.rados.rados.0.trial187.stdout:3193: writing trial18717860-5 from 417104 to 1089805 tid 1 2026-02-13T18:20:15.567 INFO:tasks.rados.rados.0.trial187.stdout:3193: writing trial18717860-5 from 1813991 to 2017104 tid 2 2026-02-13T18:20:15.567 INFO:tasks.rados.rados.0.trial187.stdout:3194: read oid 19 snap 344 2026-02-13T18:20:15.567 INFO:tasks.rados.rados.0.trial187.stdout:3194: expect deleted 2026-02-13T18:20:15.567 INFO:tasks.rados.rados.0.trial187.stdout:3195: snap_create 2026-02-13T18:20:15.567 INFO:tasks.rados.rados.0.trial187.stdout:3192: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: finishing write tid 1 to trial18717860-5 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: finishing write tid 2 to trial18717860-5 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: finishing write tid 3 to trial18717860-5 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: finishing write tid 4 to trial18717860-5 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: oid 5 updating version 0 to 1457 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: oid 5 updating version 1457 to 1458 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: oid 5 version 1458 is already newer than 1456 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1458 (ObjNum 1072 snap 353 seq_num 1072) dirty exists 2026-02-13T18:20:15.744 INFO:tasks.rados.rados.0.trial187.stdout:3193: left oid 5 (ObjNum 1072 snap 353 seq_num 1072) 2026-02-13T18:20:16.554 INFO:tasks.rados.rados.0.trial187.stdout:3192: done (3 left) 2026-02-13T18:20:16.554 INFO:tasks.rados.rados.0.trial187.stdout:3193: done (2 left) 2026-02-13T18:20:16.554 INFO:tasks.rados.rados.0.trial187.stdout:3194: done (1 left) 2026-02-13T18:20:16.555 INFO:tasks.rados.rados.0.trial187.stdout:3195: done (0 left) 2026-02-13T18:20:16.555 INFO:tasks.rados.rados.0.trial187.stdout:3196: rollback oid 6 current snap is 354 2026-02-13T18:20:16.555 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 353 2026-02-13T18:20:16.555 INFO:tasks.rados.rados.0.trial187.stdout:3197: write oid 40 current snap is 354 2026-02-13T18:20:16.555 INFO:tasks.rados.rados.0.trial187.stdout:3197: seq_num 1073 ranges {433911=747950,1756120=277791} 2026-02-13T18:20:16.562 INFO:tasks.rados.rados.0.trial187.stdout:3197: writing trial18717860-40 from 433911 to 1181861 tid 1 2026-02-13T18:20:16.568 INFO:tasks.rados.rados.0.trial187.stdout:3197: writing trial18717860-40 from 1756120 to 2033911 tid 2 2026-02-13T18:20:16.568 INFO:tasks.rados.rados.0.trial187.stdout:3198: snap_remove snap 346 2026-02-13T18:20:17.555 INFO:tasks.rados.rados.0.trial187.stdout:3198: done (2 left) 2026-02-13T18:20:17.555 INFO:tasks.rados.rados.0.trial187.stdout:3199: snap_remove snap 338 2026-02-13T18:20:18.556 INFO:tasks.rados.rados.0.trial187.stdout:3199: done (2 left) 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3200: delete oid 48 current snap is 354 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3196: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3196: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3196: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1632 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3197: finishing write tid 1 to trial18717860-40 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3197: finishing write tid 2 to trial18717860-40 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3197: finishing write tid 3 to trial18717860-40 2026-02-13T18:20:18.557 INFO:tasks.rados.rados.0.trial187.stdout:3197: finishing write tid 4 to trial18717860-40 2026-02-13T18:20:18.558 INFO:tasks.rados.rados.0.trial187.stdout:3197: oid 40 updating version 0 to 1461 2026-02-13T18:20:18.558 INFO:tasks.rados.rados.0.trial187.stdout:3197: oid 40 version 1461 is already newer than 1459 2026-02-13T18:20:18.558 INFO:tasks.rados.rados.0.trial187.stdout:3197: oid 40 version 1461 is already newer than 1460 2026-02-13T18:20:18.558 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1461 (ObjNum 1073 snap 354 seq_num 1073) dirty exists 2026-02-13T18:20:18.558 INFO:tasks.rados.rados.0.trial187.stdout:3197: left oid 40 (ObjNum 1073 snap 354 seq_num 1073) 2026-02-13T18:20:18.564 INFO:tasks.rados.rados.0.trial187.stdout:3196: done (2 left) 2026-02-13T18:20:18.565 INFO:tasks.rados.rados.0.trial187.stdout:3197: done (1 left) 2026-02-13T18:20:18.565 INFO:tasks.rados.rados.0.trial187.stdout:3200: done (0 left) 2026-02-13T18:20:18.565 INFO:tasks.rados.rados.0.trial187.stdout:3201: rollback oid 43 current snap is 354 2026-02-13T18:20:18.565 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 43 to 350 2026-02-13T18:20:18.565 INFO:tasks.rados.rados.0.trial187.stdout:3202: write (excl) oid 30 current snap is 354 2026-02-13T18:20:18.565 INFO:tasks.rados.rados.0.trial187.stdout:3202: seq_num 1075 ranges {467525=498448,1473084=594379} 2026-02-13T18:20:18.568 INFO:tasks.rados.rados.0.trial187.stdout:3202: writing trial18717860-30 from 467525 to 965973 tid 1 2026-02-13T18:20:18.576 INFO:tasks.rados.rados.0.trial187.stdout:3202: writing trial18717860-30 from 1473084 to 2067463 tid 2 2026-02-13T18:20:18.576 INFO:tasks.rados.rados.0.trial187.stdout:3203: snap_remove snap 348 2026-02-13T18:20:18.576 INFO:tasks.rados.rados.0.trial187.stdout:3201: finishing rollback tid 1 to trial18717860-43 2026-02-13T18:20:18.576 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T18:20:18.576 INFO:tasks.rados.rados.0.trial187.stdout:3202: finishing write tid 1 to trial18717860-30 2026-02-13T18:20:20.128 INFO:tasks.rados.rados.0.trial187.stdout:3201: done (2 left) 2026-02-13T18:20:20.128 INFO:tasks.rados.rados.0.trial187.stdout:3203: done (1 left) 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3204: rollback oid 10 current snap is 354 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 10 to 350 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: finishing write tid 2 to trial18717860-30 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: finishing write tid 3 to trial18717860-30 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: finishing write tid 4 to trial18717860-30 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: oid 30 updating version 0 to 1085 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: oid 30 updating version 1085 to 1086 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: oid 30 updating version 1086 to 1087 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1087 (ObjNum 1075 snap 354 seq_num 1075) dirty exists 2026-02-13T18:20:20.129 INFO:tasks.rados.rados.0.trial187.stdout:3202: left oid 30 (ObjNum 1075 snap 354 seq_num 1075) 2026-02-13T18:20:20.130 INFO:tasks.rados.rados.0.trial187.stdout:3202: done (1 left) 2026-02-13T18:20:20.130 INFO:tasks.rados.rados.0.trial187.stdout:3205: rollback oid 20 current snap is 354 2026-02-13T18:20:20.130 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 341 2026-02-13T18:20:20.130 INFO:tasks.rados.rados.0.trial187.stdout:3206: rollback oid 11 current snap is 354 2026-02-13T18:20:20.130 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 329 2026-02-13T18:20:20.130 INFO:tasks.rados.rados.0.trial187.stdout:3207: delete oid 29 current snap is 354 2026-02-13T18:20:20.131 INFO:tasks.rados.rados.0.trial187.stdout:3204: finishing rollback tid 1 to trial18717860-10 2026-02-13T18:20:20.131 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1060 (ObjNum 81 snap 0 seq_num 0) dirty dne 2026-02-13T18:20:20.131 INFO:tasks.rados.rados.0.trial187.stdout:3204: done (3 left) 2026-02-13T18:20:20.131 INFO:tasks.rados.rados.0.trial187.stdout:3207: done (2 left) 2026-02-13T18:20:20.131 INFO:tasks.rados.rados.0.trial187.stdout:3208: snap_create 2026-02-13T18:20:20.131 INFO:tasks.rados.rados.0.trial187.stdout:3205: finishing rollback tid 0 to trial18717860-20 2026-02-13T18:20:20.132 INFO:tasks.rados.rados.0.trial187.stdout:3205: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:20:20.132 INFO:tasks.rados.rados.0.trial187.stdout:3205: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:20:20.132 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1628 (ObjNum 871 snap 287 seq_num 871) dirty exists 2026-02-13T18:20:20.133 INFO:tasks.rados.rados.0.trial187.stdout:3206: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:20:20.133 INFO:tasks.rados.rados.0.trial187.stdout:3206: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:20:20.133 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1451 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T18:20:20.548 INFO:tasks.rados.rados.0.trial187.stdout:3205: done (2 left) 2026-02-13T18:20:20.548 INFO:tasks.rados.rados.0.trial187.stdout:3206: done (1 left) 2026-02-13T18:20:20.549 INFO:tasks.rados.rados.0.trial187.stdout:3208: done (0 left) 2026-02-13T18:20:20.549 INFO:tasks.rados.rados.0.trial187.stdout:3209: delete oid 14 current snap is 355 2026-02-13T18:20:20.551 INFO:tasks.rados.rados.0.trial187.stdout:3209: done (0 left) 2026-02-13T18:20:20.552 INFO:tasks.rados.rados.0.trial187.stdout:3210: delete oid 39 current snap is 355 2026-02-13T18:20:20.553 INFO:tasks.rados.rados.0.trial187.stdout:3210: done (0 left) 2026-02-13T18:20:20.554 INFO:tasks.rados.rados.0.trial187.stdout:3211: write (excl) oid 2 current snap is 355 2026-02-13T18:20:20.554 INFO:tasks.rados.rados.0.trial187.stdout:3211: seq_num 1079 ranges {534753=799444,1990659=144094} 2026-02-13T18:20:20.562 INFO:tasks.rados.rados.0.trial187.stdout:3211: writing trial18717860-2 from 534753 to 1334197 tid 1 2026-02-13T18:20:20.568 INFO:tasks.rados.rados.0.trial187.stdout:3211: writing trial18717860-2 from 1990659 to 2134753 tid 2 2026-02-13T18:20:20.568 INFO:tasks.rados.rados.0.trial187.stdout:3212: write oid 24 current snap is 355 2026-02-13T18:20:20.568 INFO:tasks.rados.rados.0.trial187.stdout:3212: seq_num 1080 ranges {551560=591046,1765494=386066} 2026-02-13T18:20:20.575 INFO:tasks.rados.rados.0.trial187.stdout:3212: writing trial18717860-24 from 551560 to 1142606 tid 1 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:3212: writing trial18717860-24 from 1765494 to 2151560 tid 2 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:3213: rollback oid 44 current snap is 355 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 349 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:3211: finishing write tid 1 to trial18717860-2 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:3211: finishing write tid 2 to trial18717860-2 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:3211: finishing write tid 3 to trial18717860-2 2026-02-13T18:20:20.583 INFO:tasks.rados.rados.0.trial187.stdout:3211: finishing write tid 4 to trial18717860-2 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3211: oid 2 updating version 0 to 1222 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3211: oid 2 version 1222 is already newer than 1221 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3211: oid 2 version 1222 is already newer than 1220 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1222 (ObjNum 1079 snap 355 seq_num 1079) dirty exists 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3211: left oid 2 (ObjNum 1079 snap 355 seq_num 1079) 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3212: finishing write tid 1 to trial18717860-24 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3211: done (2 left) 2026-02-13T18:20:20.584 INFO:tasks.rados.rados.0.trial187.stdout:3214: delete oid 9 current snap is 355 2026-02-13T18:20:20.585 INFO:tasks.rados.rados.0.trial187.stdout:3214: done (2 left) 2026-02-13T18:20:20.585 INFO:tasks.rados.rados.0.trial187.stdout:3215: read oid 47 snap -1 2026-02-13T18:20:20.585 INFO:tasks.rados.rados.0.trial187.stdout:3215: expect (ObjNum 1027 snap 331 seq_num 1027) 2026-02-13T18:20:20.585 INFO:tasks.rados.rados.0.trial187.stdout:3216: copy_from oid 32 from oid 12 current snap is 355 2026-02-13T18:20:20.585 INFO:tasks.rados.rados.0.trial187.stdout:3217: snap_create 2026-02-13T18:20:20.586 INFO:tasks.rados.rados.0.trial187.stdout:3212: finishing write tid 2 to trial18717860-24 2026-02-13T18:20:20.588 INFO:tasks.rados.rados.0.trial187.stdout:3212: finishing write tid 3 to trial18717860-24 2026-02-13T18:20:20.588 INFO:tasks.rados.rados.0.trial187.stdout:3212: finishing write tid 4 to trial18717860-24 2026-02-13T18:20:20.588 INFO:tasks.rados.rados.0.trial187.stdout:3212: oid 24 updating version 0 to 1635 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:3212: oid 24 version 1635 is already newer than 1634 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:3212: oid 24 version 1635 is already newer than 1633 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1635 (ObjNum 1080 snap 355 seq_num 1080) dirty exists 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:3212: left oid 24 (ObjNum 1080 snap 355 seq_num 1080) 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:3213: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:3213: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:3213: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:20:20.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2104 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:20:20.590 INFO:tasks.rados.rados.0.trial187.stdout:3215: expect (ObjNum 1027 snap 331 seq_num 1027) 2026-02-13T18:20:20.672 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2682960 2026-02-13T18:20:20.680 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:20.725 INFO:tasks.rados.rados.0.trial187.stdout:3216: finishing copy_from racing read to trial18717860-32 2026-02-13T18:20:20.726 INFO:tasks.rados.rados.0.trial187.stdout:3216: finishing copy_from to trial18717860-32 2026-02-13T18:20:20.726 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1064 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2026-02-13T18:20:21.570 INFO:tasks.rados.rados.0.trial187.stdout:3212: done (4 left) 2026-02-13T18:20:21.570 INFO:tasks.rados.rados.0.trial187.stdout:3213: done (3 left) 2026-02-13T18:20:21.570 INFO:tasks.rados.rados.0.trial187.stdout:3215: done (2 left) 2026-02-13T18:20:21.570 INFO:tasks.rados.rados.0.trial187.stdout:3216: done (1 left) 2026-02-13T18:20:21.571 INFO:tasks.rados.rados.0.trial187.stdout:3217: done (0 left) 2026-02-13T18:20:21.571 INFO:tasks.rados.rados.0.trial187.stdout:3218: snap_create 2026-02-13T18:20:22.572 INFO:tasks.rados.rados.0.trial187.stdout:3218: done (0 left) 2026-02-13T18:20:22.572 INFO:tasks.rados.rados.0.trial187.stdout:3219: write (excl) oid 42 current snap is 357 2026-02-13T18:20:22.572 INFO:tasks.rados.rados.0.trial187.stdout:3219: seq_num 1082 ranges {585174=741544,1766105=419069} 2026-02-13T18:20:22.581 INFO:tasks.rados.rados.0.trial187.stdout:3219: writing trial18717860-42 from 585174 to 1326718 tid 1 2026-02-13T18:20:22.587 INFO:tasks.rados.rados.0.trial187.stdout:3219: writing trial18717860-42 from 1766105 to 2185174 tid 2 2026-02-13T18:20:22.587 INFO:tasks.rados.rados.0.trial187.stdout:3220: rollback oid 39 current snap is 357 2026-02-13T18:20:22.587 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 344 2026-02-13T18:20:22.587 INFO:tasks.rados.rados.0.trial187.stdout:3219: finishing write tid 1 to trial18717860-42 2026-02-13T18:20:22.588 INFO:tasks.rados.rados.0.trial187.stdout:3221: snap_remove snap 355 2026-02-13T18:20:23.577 INFO:tasks.rados.rados.0.trial187.stdout:3221: done (2 left) 2026-02-13T18:20:23.577 INFO:tasks.rados.rados.0.trial187.stdout:3222: snap_remove snap 354 2026-02-13T18:20:24.581 INFO:tasks.rados.rados.0.trial187.stdout:3222: done (2 left) 2026-02-13T18:20:24.581 INFO:tasks.rados.rados.0.trial187.stdout:3223: snap_create 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: finishing write tid 2 to trial18717860-42 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: finishing write tid 3 to trial18717860-42 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: finishing write tid 4 to trial18717860-42 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: oid 42 updating version 0 to 1444 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: oid 42 updating version 1444 to 1445 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: oid 42 version 1445 is already newer than 1443 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1445 (ObjNum 1082 snap 357 seq_num 1082) dirty exists 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3219: left oid 42 (ObjNum 1082 snap 357 seq_num 1082) 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:3220: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:20:24.582 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 0 (ObjNum 113 snap 0 seq_num 3012839088) dirty dne 2026-02-13T18:20:25.549 INFO:tasks.rados.rados.0.trial187.stdout:3219: done (2 left) 2026-02-13T18:20:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3220: done (1 left) 2026-02-13T18:20:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3223: done (0 left) 2026-02-13T18:20:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3224: copy_from oid 30 from oid 2 current snap is 358 2026-02-13T18:20:25.550 INFO:tasks.rados.rados.0.trial187.stdout:3225: snap_create 2026-02-13T18:20:25.561 INFO:tasks.rados.rados.0.trial187.stdout:3224: finishing copy_from racing read to trial18717860-30 2026-02-13T18:20:25.562 INFO:tasks.rados.rados.0.trial187.stdout:3224: finishing copy_from to trial18717860-30 2026-02-13T18:20:25.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1222 (ObjNum 1079 snap 355 seq_num 1079) dirty exists 2026-02-13T18:20:26.550 INFO:tasks.rados.rados.0.trial187.stdout:3224: done (1 left) 2026-02-13T18:20:26.550 INFO:tasks.rados.rados.0.trial187.stdout:3225: done (0 left) 2026-02-13T18:20:26.551 INFO:tasks.rados.rados.0.trial187.stdout:3226: delete oid 9 current snap is 359 2026-02-13T18:20:26.871 INFO:tasks.rados.rados.0.trial187.stdout:3226: done (0 left) 2026-02-13T18:20:26.871 INFO:tasks.rados.rados.0.trial187.stdout:3227: rollback oid 49 current snap is 359 2026-02-13T18:20:26.871 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 49 to 321 2026-02-13T18:20:26.871 INFO:tasks.rados.rados.0.trial187.stdout:3228: snap_remove snap 344 2026-02-13T18:20:27.583 INFO:tasks.rados.rados.0.trial187.stdout:3228: done (1 left) 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3229: rollback oid 7 current snap is 359 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 357 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3227: finishing rollback tid 0 to trial18717860-49 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3227: finishing rollback tid 1 to trial18717860-49 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3227: finishing rollback tid 2 to trial18717860-49 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1454 (ObjNum 796 snap 269 seq_num 796) dirty exists 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3227: done (1 left) 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3230: write (excl) oid 46 current snap is 359 2026-02-13T18:20:27.584 INFO:tasks.rados.rados.0.trial187.stdout:3230: seq_num 1084 ranges {618788=492042,1883069=335719} 2026-02-13T18:20:27.590 INFO:tasks.rados.rados.0.trial187.stdout:3230: writing trial18717860-46 from 618788 to 1110830 tid 1 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3230: writing trial18717860-46 from 1883069 to 2218788 tid 2 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3231: copy_from oid 16 from oid 2 current snap is 359 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3229: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3229: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3229: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1235 (ObjNum 1046 snap 342 seq_num 1046) dirty exists 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3230: finishing write tid 1 to trial18717860-46 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3229: done (2 left) 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3232: copy_from oid 27 from oid 31 current snap is 359 2026-02-13T18:20:27.599 INFO:tasks.rados.rados.0.trial187.stdout:3233: rollback oid 25 current snap is 359 2026-02-13T18:20:27.600 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 353 2026-02-13T18:20:27.600 INFO:tasks.rados.rados.0.trial187.stdout:3234: copy_from oid 17 from oid 37 current snap is 359 2026-02-13T18:20:27.600 INFO:tasks.rados.rados.0.trial187.stdout:3235: read oid 4 snap -1 2026-02-13T18:20:27.600 INFO:tasks.rados.rados.0.trial187.stdout:3235: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:20:27.600 INFO:tasks.rados.rados.0.trial187.stdout:3236: snap_remove snap 327 2026-02-13T18:20:28.588 INFO:tasks.rados.rados.0.trial187.stdout:3236: done (6 left) 2026-02-13T18:20:28.588 INFO:tasks.rados.rados.0.trial187.stdout:3237: snap_remove snap 356 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:3237: done (6 left) 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:3238: rollback oid 14 current snap is 359 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 353 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:3232: finishing copy_from to trial18717860-27 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:3232: got expected ENOENT (src dne) 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:3232: finishing copy_from racing read to trial18717860-27 2026-02-13T18:20:29.589 INFO:tasks.rados.rados.0.trial187.stdout:3235: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:20:29.599 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2485760 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3233: finishing rollback tid 0 to trial18717860-25 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: finishing write tid 2 to trial18717860-46 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3233: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: finishing write tid 3 to trial18717860-46 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3233: finishing rollback tid 2 to trial18717860-25 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1038 (ObjNum 1070 snap 352 seq_num 1070) dirty exists 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: finishing write tid 4 to trial18717860-46 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: oid 46 updating version 0 to 1239 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: oid 46 version 1239 is already newer than 1238 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: oid 46 updating version 1239 to 1240 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1240 (ObjNum 1084 snap 359 seq_num 1084) dirty exists 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: left oid 46 (ObjNum 1084 snap 359 seq_num 1084) 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3231: finishing copy_from racing read to trial18717860-16 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3231: finishing copy_from to trial18717860-16 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1222 (ObjNum 1079 snap 355 seq_num 1079) dirty exists 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3234: finishing copy_from racing read to trial18717860-17 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3234: finishing copy_from to trial18717860-17 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2034 (ObjNum 1056 snap 349 seq_num 1056) dirty exists 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3238: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1078 (ObjNum 129 snap 0 seq_num 4017040252) dirty dne 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3230: done (6 left) 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3231: done (5 left) 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3232: done (4 left) 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3233: done (3 left) 2026-02-13T18:20:29.661 INFO:tasks.rados.rados.0.trial187.stdout:3234: done (2 left) 2026-02-13T18:20:29.662 INFO:tasks.rados.rados.0.trial187.stdout:3235: done (1 left) 2026-02-13T18:20:29.662 INFO:tasks.rados.rados.0.trial187.stdout:3238: done (0 left) 2026-02-13T18:20:29.662 INFO:tasks.rados.rados.0.trial187.stdout:3239: delete oid 31 current snap is 359 2026-02-13T18:20:29.662 INFO:tasks.rados.rados.0.trial187.stdout:3239: done (0 left) 2026-02-13T18:20:29.662 INFO:tasks.rados.rados.0.trial187.stdout:3240: write oid 35 current snap is 359 2026-02-13T18:20:29.662 INFO:tasks.rados.rados.0.trial187.stdout:3240: seq_num 1086 ranges {652402=642540,1883680=368722} 2026-02-13T18:20:29.671 INFO:tasks.rados.rados.0.trial187.stdout:3240: writing trial18717860-35 from 652402 to 1294942 tid 1 2026-02-13T18:20:29.678 INFO:tasks.rados.rados.0.trial187.stdout:3240: writing trial18717860-35 from 1883680 to 2252402 tid 2 2026-02-13T18:20:29.678 INFO:tasks.rados.rados.0.trial187.stdout:3241: copy_from oid 19 from oid 26 current snap is 359 2026-02-13T18:20:29.678 INFO:tasks.rados.rados.0.trial187.stdout:3240: finishing write tid 1 to trial18717860-35 2026-02-13T18:20:29.678 INFO:tasks.rados.rados.0.trial187.stdout:3242: rollback oid 17 current snap is 359 2026-02-13T18:20:29.678 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 357 2026-02-13T18:20:29.678 INFO:tasks.rados.rados.0.trial187.stdout:3243: delete oid 1 current snap is 359 2026-02-13T18:20:29.680 INFO:tasks.rados.rados.0.trial187.stdout:3240: finishing write tid 2 to trial18717860-35 2026-02-13T18:20:29.681 INFO:tasks.rados.rados.0.trial187.stdout:3240: finishing write tid 3 to trial18717860-35 2026-02-13T18:20:29.681 INFO:tasks.rados.rados.0.trial187.stdout:3240: finishing write tid 4 to trial18717860-35 2026-02-13T18:20:29.681 INFO:tasks.rados.rados.0.trial187.stdout:3240: oid 35 updating version 0 to 1817 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3240: oid 35 updating version 1817 to 1818 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3240: oid 35 version 1818 is already newer than 1816 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1818 (ObjNum 1086 snap 359 seq_num 1086) dirty exists 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3240: left oid 35 (ObjNum 1086 snap 359 seq_num 1086) 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3242: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3242: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3241: finishing copy_from to trial18717860-19 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3241: got expected ENOENT (src dne) 2026-02-13T18:20:29.682 INFO:tasks.rados.rados.0.trial187.stdout:3242: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2037 (ObjNum 1063 snap 351 seq_num 1063) dirty exists 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3241: finishing copy_from racing read to trial18717860-19 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3240: done (3 left) 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3241: done (2 left) 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3242: done (1 left) 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3243: done (0 left) 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3244: write (excl) oid 46 current snap is 359 2026-02-13T18:20:29.683 INFO:tasks.rados.rados.0.trial187.stdout:3244: seq_num 1088 ranges {686016=509391,1716997=569019} 2026-02-13T18:20:29.692 INFO:tasks.rados.rados.0.trial187.stdout:3244: writing trial18717860-46 from 686016 to 1195407 tid 1 2026-02-13T18:20:29.699 INFO:tasks.rados.rados.0.trial187.stdout:3244: writing trial18717860-46 from 1716997 to 2286016 tid 2 2026-02-13T18:20:29.700 INFO:tasks.rados.rados.0.trial187.stdout:3245: read oid 43 snap -1 2026-02-13T18:20:29.700 INFO:tasks.rados.rados.0.trial187.stdout:3245: expect deleted 2026-02-13T18:20:29.700 INFO:tasks.rados.rados.0.trial187.stdout:3246: copy_from oid 42 from oid 9 current snap is 359 2026-02-13T18:20:29.700 INFO:tasks.rados.rados.0.trial187.stdout:3244: finishing write tid 1 to trial18717860-46 2026-02-13T18:20:29.700 INFO:tasks.rados.rados.0.trial187.stdout:3247: write oid 35 current snap is 359 2026-02-13T18:20:29.700 INFO:tasks.rados.rados.0.trial187.stdout:3247: seq_num 1089 ranges {702823=584640,2059126=243697} 2026-02-13T18:20:29.708 INFO:tasks.rados.rados.0.trial187.stdout:3247: writing trial18717860-35 from 702823 to 1287463 tid 1 2026-02-13T18:20:29.715 INFO:tasks.rados.rados.0.trial187.stdout:3247: writing trial18717860-35 from 2059126 to 2302823 tid 2 2026-02-13T18:20:29.715 INFO:tasks.rados.rados.0.trial187.stdout:3248: write (excl) oid 17 current snap is 359 2026-02-13T18:20:29.715 INFO:tasks.rados.rados.0.trial187.stdout:3248: seq_num 1090 ranges {719630=659889,2117608=202022} 2026-02-13T18:20:29.722 INFO:tasks.rados.rados.0.trial187.stdout:3248: writing trial18717860-17 from 719630 to 1379519 tid 1 2026-02-13T18:20:29.726 INFO:tasks.rados.rados.0.trial187.stdout:3248: writing trial18717860-17 from 2117608 to 2319630 tid 2 2026-02-13T18:20:29.726 INFO:tasks.rados.rados.0.trial187.stdout:3249: snap_create 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3246: finishing copy_from to trial18717860-42 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3246: got expected ENOENT (src dne) 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3246: finishing copy_from racing read to trial18717860-42 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: finishing write tid 2 to trial18717860-46 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: finishing write tid 3 to trial18717860-46 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: finishing write tid 4 to trial18717860-46 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: oid 46 updating version 0 to 1250 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: oid 46 updating version 1250 to 1251 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: oid 46 version 1251 is already newer than 1249 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1251 (ObjNum 1088 snap 359 seq_num 1088) dirty exists 2026-02-13T18:20:29.727 INFO:tasks.rados.rados.0.trial187.stdout:3244: left oid 46 (ObjNum 1088 snap 359 seq_num 1088) 2026-02-13T18:20:29.728 INFO:tasks.rados.rados.0.trial187.stdout:3247: finishing write tid 1 to trial18717860-35 2026-02-13T18:20:29.728 INFO:tasks.rados.rados.0.trial187.stdout:3247: finishing write tid 2 to trial18717860-35 2026-02-13T18:20:29.728 INFO:tasks.rados.rados.0.trial187.stdout:3247: finishing write tid 3 to trial18717860-35 2026-02-13T18:20:29.730 INFO:tasks.rados.rados.0.trial187.stdout:3247: finishing write tid 4 to trial18717860-35 2026-02-13T18:20:29.731 INFO:tasks.rados.rados.0.trial187.stdout:3247: oid 35 updating version 0 to 1820 2026-02-13T18:20:29.731 INFO:tasks.rados.rados.0.trial187.stdout:3247: oid 35 updating version 1820 to 1821 2026-02-13T18:20:29.731 INFO:tasks.rados.rados.0.trial187.stdout:3247: oid 35 version 1821 is already newer than 1819 2026-02-13T18:20:29.731 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1821 (ObjNum 1089 snap 359 seq_num 1089) dirty exists 2026-02-13T18:20:29.731 INFO:tasks.rados.rados.0.trial187.stdout:3247: left oid 35 (ObjNum 1089 snap 359 seq_num 1089) 2026-02-13T18:20:29.731 INFO:tasks.rados.rados.0.trial187.stdout:3248: finishing write tid 1 to trial18717860-17 2026-02-13T18:20:29.732 INFO:tasks.rados.rados.0.trial187.stdout:3248: finishing write tid 2 to trial18717860-17 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:3248: finishing write tid 3 to trial18717860-17 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:3248: finishing write tid 4 to trial18717860-17 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:3248: oid 17 updating version 0 to 2040 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:3248: oid 17 version 2040 is already newer than 2038 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:3248: oid 17 version 2040 is already newer than 2039 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2040 (ObjNum 1090 snap 359 seq_num 1090) dirty exists 2026-02-13T18:20:29.733 INFO:tasks.rados.rados.0.trial187.stdout:3248: left oid 17 (ObjNum 1090 snap 359 seq_num 1090) 2026-02-13T18:20:30.550 INFO:tasks.rados.rados.0.trial187.stdout:3244: done (5 left) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3245: done (4 left) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3246: done (3 left) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3247: done (2 left) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3248: done (1 left) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3249: done (0 left) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3250: read oid 7 snap -1 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3250: expect (ObjNum 1046 snap 342 seq_num 1046) 2026-02-13T18:20:30.551 INFO:tasks.rados.rados.0.trial187.stdout:3251: read oid 12 snap -1 2026-02-13T18:20:30.552 INFO:tasks.rados.rados.0.trial187.stdout:3251: expect (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:20:30.552 INFO:tasks.rados.rados.0.trial187.stdout:3252: read oid 50 snap -1 2026-02-13T18:20:30.552 INFO:tasks.rados.rados.0.trial187.stdout:3252: expect deleted 2026-02-13T18:20:30.552 INFO:tasks.rados.rados.0.trial187.stdout:3253: snap_create 2026-02-13T18:20:30.556 INFO:tasks.rados.rados.0.trial187.stdout:3250: expect (ObjNum 1046 snap 342 seq_num 1046) 2026-02-13T18:20:30.683 INFO:tasks.rados.rados.0.trial187.stdout:3251: expect (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:20:30.687 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 570914 2026-02-13T18:20:30.761 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:31.551 INFO:tasks.rados.rados.0.trial187.stdout:3250: done (3 left) 2026-02-13T18:20:31.551 INFO:tasks.rados.rados.0.trial187.stdout:3251: done (2 left) 2026-02-13T18:20:31.551 INFO:tasks.rados.rados.0.trial187.stdout:3252: done (1 left) 2026-02-13T18:20:31.551 INFO:tasks.rados.rados.0.trial187.stdout:3253: done (0 left) 2026-02-13T18:20:31.551 INFO:tasks.rados.rados.0.trial187.stdout:3254: write oid 18 current snap is 361 2026-02-13T18:20:31.551 INFO:tasks.rados.rados.0.trial187.stdout:3254: seq_num 1091 ranges {736437=735138,2176090=160347} 2026-02-13T18:20:31.561 INFO:tasks.rados.rados.0.trial187.stdout:3254: writing trial18717860-18 from 736437 to 1471575 tid 1 2026-02-13T18:20:31.567 INFO:tasks.rados.rados.0.trial187.stdout:3254: writing trial18717860-18 from 2176090 to 2336437 tid 2 2026-02-13T18:20:31.567 INFO:tasks.rados.rados.0.trial187.stdout:3255: copy_from oid 44 from oid 21 current snap is 361 2026-02-13T18:20:31.567 INFO:tasks.rados.rados.0.trial187.stdout:3256: snap_create 2026-02-13T18:20:31.567 INFO:tasks.rados.rados.0.trial187.stdout:3254: finishing write tid 1 to trial18717860-18 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: finishing write tid 2 to trial18717860-18 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: finishing write tid 3 to trial18717860-18 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: finishing write tid 4 to trial18717860-18 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: oid 18 updating version 0 to 1223 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: oid 18 updating version 1223 to 1224 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: oid 18 updating version 1224 to 1225 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1225 (ObjNum 1091 snap 361 seq_num 1091) dirty exists 2026-02-13T18:20:31.569 INFO:tasks.rados.rados.0.trial187.stdout:3254: left oid 18 (ObjNum 1091 snap 361 seq_num 1091) 2026-02-13T18:20:31.582 INFO:tasks.rados.rados.0.trial187.stdout:3255: finishing copy_from racing read to trial18717860-44 2026-02-13T18:20:31.583 INFO:tasks.rados.rados.0.trial187.stdout:3255: finishing copy_from to trial18717860-44 2026-02-13T18:20:31.583 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 1221 (ObjNum 1068 snap 352 seq_num 1068) dirty exists 2026-02-13T18:20:32.553 INFO:tasks.rados.rados.0.trial187.stdout:3254: done (2 left) 2026-02-13T18:20:32.553 INFO:tasks.rados.rados.0.trial187.stdout:3255: done (1 left) 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3256: done (0 left) 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3257: read oid 9 snap -1 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3257: expect deleted 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3258: read oid 24 snap 341 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3258: expect deleted 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3259: rollback oid 16 current snap is 362 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 359 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3260: read oid 44 snap 340 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3260: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3261: copy_from oid 22 from oid 4 current snap is 362 2026-02-13T18:20:32.554 INFO:tasks.rados.rados.0.trial187.stdout:3262: delete oid 20 current snap is 362 2026-02-13T18:20:32.558 INFO:tasks.rados.rados.0.trial187.stdout:3259: finishing rollback tid 0 to trial18717860-16 2026-02-13T18:20:32.558 INFO:tasks.rados.rados.0.trial187.stdout:3259: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:20:32.558 INFO:tasks.rados.rados.0.trial187.stdout:3259: finishing rollback tid 2 to trial18717860-16 2026-02-13T18:20:32.558 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1631 (ObjNum 1079 snap 355 seq_num 1079) dirty exists 2026-02-13T18:20:32.559 INFO:tasks.rados.rados.0.trial187.stdout:3257: done (5 left) 2026-02-13T18:20:32.559 INFO:tasks.rados.rados.0.trial187.stdout:3258: done (4 left) 2026-02-13T18:20:32.559 INFO:tasks.rados.rados.0.trial187.stdout:3259: done (3 left) 2026-02-13T18:20:32.559 INFO:tasks.rados.rados.0.trial187.stdout:3262: done (2 left) 2026-02-13T18:20:32.559 INFO:tasks.rados.rados.0.trial187.stdout:3263: read oid 15 snap 345 2026-02-13T18:20:32.559 INFO:tasks.rados.rados.0.trial187.stdout:3263: expect (ObjNum 1047 snap 342 seq_num 1047) 2026-02-13T18:20:32.560 INFO:tasks.rados.rados.0.trial187.stdout:3264: copy_from oid 28 from oid 40 current snap is 362 2026-02-13T18:20:32.560 INFO:tasks.rados.rados.0.trial187.stdout:3265: rollback oid 41 current snap is 362 2026-02-13T18:20:32.560 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 359 2026-02-13T18:20:32.560 INFO:tasks.rados.rados.0.trial187.stdout:3266: copy_from oid 9 from oid 50 current snap is 362 2026-02-13T18:20:32.560 INFO:tasks.rados.rados.0.trial187.stdout:3267: snap_create 2026-02-13T18:20:32.562 INFO:tasks.rados.rados.0.trial187.stdout:3263: expect (ObjNum 1047 snap 342 seq_num 1047) 2026-02-13T18:20:32.708 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3067562 2026-02-13T18:20:32.779 INFO:tasks.rados.rados.0.trial187.stdout:3266: finishing copy_from to trial18717860-9 2026-02-13T18:20:32.779 INFO:tasks.rados.rados.0.trial187.stdout:3266: got expected ENOENT (src dne) 2026-02-13T18:20:32.779 INFO:tasks.rados.rados.0.trial187.stdout:3266: finishing copy_from racing read to trial18717860-9 2026-02-13T18:20:32.779 INFO:tasks.rados.rados.0.trial187.stdout:3260: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:20:32.803 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2321356 2026-02-13T18:20:32.821 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:32.872 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:32.922 INFO:tasks.rados.rados.0.trial187.stdout:3265: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:3264: finishing copy_from racing read to trial18717860-28 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:3261: finishing copy_from racing read to trial18717860-22 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:3261: finishing copy_from to trial18717860-22 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1032 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:3264: finishing copy_from to trial18717860-28 2026-02-13T18:20:32.923 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1461 (ObjNum 1073 snap 354 seq_num 1073) dirty exists 2026-02-13T18:20:33.554 INFO:tasks.rados.rados.0.trial187.stdout:3260: done (6 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3261: done (5 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3263: done (4 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3264: done (3 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3265: done (2 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3266: done (1 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3267: done (0 left) 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3268: write (excl) oid 35 current snap is 363 2026-02-13T18:20:33.555 INFO:tasks.rados.rados.0.trial187.stdout:3268: seq_num 1093 ranges {770051=485636,1776701=511047} 2026-02-13T18:20:33.562 INFO:tasks.rados.rados.0.trial187.stdout:3268: writing trial18717860-35 from 770051 to 1255687 tid 1 2026-02-13T18:20:33.570 INFO:tasks.rados.rados.0.trial187.stdout:3268: writing trial18717860-35 from 1776701 to 2287748 tid 2 2026-02-13T18:20:33.570 INFO:tasks.rados.rados.0.trial187.stdout:3269: read oid 27 snap 349 2026-02-13T18:20:33.570 INFO:tasks.rados.rados.0.trial187.stdout:3269: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:20:33.570 INFO:tasks.rados.rados.0.trial187.stdout:3270: snap_create 2026-02-13T18:20:33.570 INFO:tasks.rados.rados.0.trial187.stdout:3268: finishing write tid 1 to trial18717860-35 2026-02-13T18:20:33.572 INFO:tasks.rados.rados.0.trial187.stdout:3268: finishing write tid 2 to trial18717860-35 2026-02-13T18:20:33.572 INFO:tasks.rados.rados.0.trial187.stdout:3268: finishing write tid 3 to trial18717860-35 2026-02-13T18:20:33.572 INFO:tasks.rados.rados.0.trial187.stdout:3268: finishing write tid 4 to trial18717860-35 2026-02-13T18:20:33.572 INFO:tasks.rados.rados.0.trial187.stdout:3268: oid 35 updating version 0 to 1824 2026-02-13T18:20:33.573 INFO:tasks.rados.rados.0.trial187.stdout:3268: oid 35 version 1824 is already newer than 1823 2026-02-13T18:20:33.573 INFO:tasks.rados.rados.0.trial187.stdout:3268: oid 35 version 1824 is already newer than 1822 2026-02-13T18:20:33.573 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1824 (ObjNum 1093 snap 363 seq_num 1093) dirty exists 2026-02-13T18:20:33.573 INFO:tasks.rados.rados.0.trial187.stdout:3268: left oid 35 (ObjNum 1093 snap 363 seq_num 1093) 2026-02-13T18:20:33.575 INFO:tasks.rados.rados.0.trial187.stdout:3269: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:20:33.575 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:34.557 INFO:tasks.rados.rados.0.trial187.stdout:3268: done (2 left) 2026-02-13T18:20:34.558 INFO:tasks.rados.rados.0.trial187.stdout:3269: done (1 left) 2026-02-13T18:20:34.558 INFO:tasks.rados.rados.0.trial187.stdout:3270: done (0 left) 2026-02-13T18:20:34.558 INFO:tasks.rados.rados.0.trial187.stdout:3271: snap_create 2026-02-13T18:20:35.551 INFO:tasks.rados.rados.0.trial187.stdout:3271: done (0 left) 2026-02-13T18:20:35.552 INFO:tasks.rados.rados.0.trial187.stdout:3272: copy_from oid 47 from oid 6 current snap is 365 2026-02-13T18:20:35.552 INFO:tasks.rados.rados.0.trial187.stdout:3273: write oid 46 current snap is 365 2026-02-13T18:20:35.552 INFO:tasks.rados.rados.0.trial187.stdout:3273: seq_num 1094 ranges {786858=560885,1835183=551675} 2026-02-13T18:20:35.560 INFO:tasks.rados.rados.0.trial187.stdout:3273: writing trial18717860-46 from 786858 to 1347743 tid 1 2026-02-13T18:20:35.568 INFO:tasks.rados.rados.0.trial187.stdout:3273: writing trial18717860-46 from 1835183 to 2386858 tid 2 2026-02-13T18:20:35.568 INFO:tasks.rados.rados.0.trial187.stdout:3274: rollback oid 15 current snap is 365 2026-02-13T18:20:35.568 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 321 2026-02-13T18:20:35.568 INFO:tasks.rados.rados.0.trial187.stdout:3272: finishing copy_from racing read to trial18717860-47 2026-02-13T18:20:35.568 INFO:tasks.rados.rados.0.trial187.stdout:3272: finishing copy_from to trial18717860-47 2026-02-13T18:20:35.568 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1632 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3273: finishing write tid 1 to trial18717860-46 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3272: done (2 left) 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3275: read oid 31 snap -1 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3275: expect deleted 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3276: copy_from oid 49 from oid 9 current snap is 365 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3277: copy_from oid 16 from oid 36 current snap is 365 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3278: write (excl) oid 30 current snap is 365 2026-02-13T18:20:35.569 INFO:tasks.rados.rados.0.trial187.stdout:3278: seq_num 1095 ranges {403665=752487,1610018=514716} 2026-02-13T18:20:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3278: writing trial18717860-30 from 403665 to 1156152 tid 1 2026-02-13T18:20:35.582 INFO:tasks.rados.rados.0.trial187.stdout:3278: writing trial18717860-30 from 1610018 to 2124734 tid 2 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3279: delete oid 10 current snap is 365 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: finishing write tid 2 to trial18717860-46 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: finishing write tid 3 to trial18717860-46 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: finishing write tid 4 to trial18717860-46 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: oid 46 updating version 0 to 1254 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: oid 46 updating version 1254 to 1255 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: oid 46 version 1255 is already newer than 1253 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1255 (ObjNum 1094 snap 365 seq_num 1094) dirty exists 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3273: left oid 46 (ObjNum 1094 snap 365 seq_num 1094) 2026-02-13T18:20:35.583 INFO:tasks.rados.rados.0.trial187.stdout:3274: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3276: finishing copy_from to trial18717860-49 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3276: got expected ENOENT (src dne) 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3276: finishing copy_from racing read to trial18717860-49 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3274: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3274: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1426 (ObjNum 954 snap 311 seq_num 954) dirty exists 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3277: finishing copy_from racing read to trial18717860-16 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3277: finishing copy_from to trial18717860-16 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1445 (ObjNum 1038 snap 338 seq_num 1038) dirty exists 2026-02-13T18:20:35.584 INFO:tasks.rados.rados.0.trial187.stdout:3278: finishing write tid 1 to trial18717860-30 2026-02-13T18:20:35.585 INFO:tasks.rados.rados.0.trial187.stdout:3273: done (6 left) 2026-02-13T18:20:35.585 INFO:tasks.rados.rados.0.trial187.stdout:3274: done (5 left) 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3275: done (4 left) 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3276: done (3 left) 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3277: done (2 left) 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3279: done (1 left) 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3280: snap_create 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3278: finishing write tid 2 to trial18717860-30 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3278: finishing write tid 3 to trial18717860-30 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3278: finishing write tid 4 to trial18717860-30 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3278: oid 30 updating version 0 to 1225 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3278: oid 30 version 1225 is already newer than 1223 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:3278: oid 30 version 1225 is already newer than 1224 2026-02-13T18:20:35.586 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1225 (ObjNum 1095 snap 365 seq_num 1095) dirty exists 2026-02-13T18:20:35.587 INFO:tasks.rados.rados.0.trial187.stdout:3278: left oid 30 (ObjNum 1095 snap 365 seq_num 1095) 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3278: done (1 left) 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3280: done (0 left) 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3281: rollback oid 15 current snap is 366 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 359 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3282: copy_from oid 36 from oid 7 current snap is 366 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3283: read oid 43 snap -1 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3283: expect deleted 2026-02-13T18:20:36.565 INFO:tasks.rados.rados.0.trial187.stdout:3284: copy_from oid 42 from oid 12 current snap is 366 2026-02-13T18:20:36.566 INFO:tasks.rados.rados.0.trial187.stdout:3285: read oid 21 snap -1 2026-02-13T18:20:36.566 INFO:tasks.rados.rados.0.trial187.stdout:3285: expect (ObjNum 1068 snap 352 seq_num 1068) 2026-02-13T18:20:36.566 INFO:tasks.rados.rados.0.trial187.stdout:3286: snap_create 2026-02-13T18:20:36.569 INFO:tasks.rados.rados.0.trial187.stdout:3281: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:20:36.570 INFO:tasks.rados.rados.0.trial187.stdout:3281: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:20:36.570 INFO:tasks.rados.rados.0.trial187.stdout:3281: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:20:36.570 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1429 (ObjNum 1047 snap 342 seq_num 1047) dirty exists 2026-02-13T18:20:36.576 INFO:tasks.rados.rados.0.trial187.stdout:3284: finishing copy_from racing read to trial18717860-42 2026-02-13T18:20:36.578 INFO:tasks.rados.rados.0.trial187.stdout:3285: expect (ObjNum 1068 snap 352 seq_num 1068) 2026-02-13T18:20:36.578 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:36.667 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 143722 2026-02-13T18:20:36.798 INFO:tasks.rados.rados.0.trial187.stdout:3284: finishing copy_from to trial18717860-42 2026-02-13T18:20:36.798 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1064 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2026-02-13T18:20:36.798 INFO:tasks.rados.rados.0.trial187.stdout:3282: finishing copy_from racing read to trial18717860-36 2026-02-13T18:20:36.799 INFO:tasks.rados.rados.0.trial187.stdout:3282: finishing copy_from to trial18717860-36 2026-02-13T18:20:36.799 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1235 (ObjNum 1046 snap 342 seq_num 1046) dirty exists 2026-02-13T18:20:37.569 INFO:tasks.rados.rados.0.trial187.stdout:3281: done (5 left) 2026-02-13T18:20:37.570 INFO:tasks.rados.rados.0.trial187.stdout:3282: done (4 left) 2026-02-13T18:20:37.570 INFO:tasks.rados.rados.0.trial187.stdout:3283: done (3 left) 2026-02-13T18:20:37.570 INFO:tasks.rados.rados.0.trial187.stdout:3284: done (2 left) 2026-02-13T18:20:37.570 INFO:tasks.rados.rados.0.trial187.stdout:3285: done (1 left) 2026-02-13T18:20:37.570 INFO:tasks.rados.rados.0.trial187.stdout:3286: done (0 left) 2026-02-13T18:20:37.570 INFO:tasks.rados.rados.0.trial187.stdout:3287: snap_create 2026-02-13T18:20:38.571 INFO:tasks.rados.rados.0.trial187.stdout:3287: done (0 left) 2026-02-13T18:20:38.571 INFO:tasks.rados.rados.0.trial187.stdout:3288: write (excl) oid 30 current snap is 368 2026-02-13T18:20:38.571 INFO:tasks.rados.rados.0.trial187.stdout:3288: seq_num 1097 ranges {437279=502985,1610629=518385} 2026-02-13T18:20:38.577 INFO:tasks.rados.rados.0.trial187.stdout:3288: writing trial18717860-30 from 437279 to 940264 tid 1 2026-02-13T18:20:38.585 INFO:tasks.rados.rados.0.trial187.stdout:3288: writing trial18717860-30 from 1610629 to 2129014 tid 2 2026-02-13T18:20:38.585 INFO:tasks.rados.rados.0.trial187.stdout:3289: read oid 43 snap -1 2026-02-13T18:20:38.586 INFO:tasks.rados.rados.0.trial187.stdout:3289: expect deleted 2026-02-13T18:20:38.586 INFO:tasks.rados.rados.0.trial187.stdout:3290: delete oid 36 current snap is 368 2026-02-13T18:20:38.586 INFO:tasks.rados.rados.0.trial187.stdout:3288: finishing write tid 1 to trial18717860-30 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: finishing write tid 2 to trial18717860-30 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: finishing write tid 3 to trial18717860-30 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: finishing write tid 4 to trial18717860-30 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: oid 30 updating version 0 to 1228 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: oid 30 version 1228 is already newer than 1227 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: oid 30 version 1228 is already newer than 1226 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 1228 (ObjNum 1097 snap 368 seq_num 1097) dirty exists 2026-02-13T18:20:38.588 INFO:tasks.rados.rados.0.trial187.stdout:3288: left oid 30 (ObjNum 1097 snap 368 seq_num 1097) 2026-02-13T18:20:38.589 INFO:tasks.rados.rados.0.trial187.stdout:3288: done (2 left) 2026-02-13T18:20:38.589 INFO:tasks.rados.rados.0.trial187.stdout:3289: done (1 left) 2026-02-13T18:20:38.589 INFO:tasks.rados.rados.0.trial187.stdout:3290: done (0 left) 2026-02-13T18:20:38.589 INFO:tasks.rados.rados.0.trial187.stdout:3291: delete oid 48 current snap is 368 2026-02-13T18:20:38.591 INFO:tasks.rados.rados.0.trial187.stdout:3291: done (0 left) 2026-02-13T18:20:38.592 INFO:tasks.rados.rados.0.trial187.stdout:3292: write (excl) oid 14 current snap is 368 2026-02-13T18:20:38.592 INFO:tasks.rados.rados.0.trial187.stdout:3292: seq_num 1100 ranges {487700=728732,1786075=665712} 2026-02-13T18:20:38.600 INFO:tasks.rados.rados.0.trial187.stdout:3292: writing trial18717860-14 from 487700 to 1216432 tid 1 2026-02-13T18:20:38.608 INFO:tasks.rados.rados.0.trial187.stdout:3292: writing trial18717860-14 from 1786075 to 2451787 tid 2 2026-02-13T18:20:38.608 INFO:tasks.rados.rados.0.trial187.stdout:3293: snap_remove snap 357 2026-02-13T18:20:39.576 INFO:tasks.rados.rados.0.trial187.stdout:3293: done (1 left) 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3294: snap_create 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: finishing write tid 1 to trial18717860-14 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: finishing write tid 2 to trial18717860-14 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: finishing write tid 3 to trial18717860-14 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: finishing write tid 4 to trial18717860-14 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: oid 14 updating version 0 to 1452 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: oid 14 version 1452 is already newer than 1450 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:3292: oid 14 version 1452 is already newer than 1451 2026-02-13T18:20:39.577 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1452 (ObjNum 1100 snap 368 seq_num 1100) dirty exists 2026-02-13T18:20:39.578 INFO:tasks.rados.rados.0.trial187.stdout:3292: left oid 14 (ObjNum 1100 snap 368 seq_num 1100) 2026-02-13T18:20:40.552 INFO:tasks.rados.rados.0.trial187.stdout:3292: done (1 left) 2026-02-13T18:20:40.553 INFO:tasks.rados.rados.0.trial187.stdout:3294: done (0 left) 2026-02-13T18:20:40.553 INFO:tasks.rados.rados.0.trial187.stdout:3295: write oid 5 current snap is 369 2026-02-13T18:20:40.553 INFO:tasks.rados.rados.0.trial187.stdout:3295: seq_num 1101 ranges {504507=403981,1328204=409370,2252362=252145} 2026-02-13T18:20:40.558 INFO:tasks.rados.rados.0.trial187.stdout:3295: writing trial18717860-5 from 504507 to 908488 tid 1 2026-02-13T18:20:40.564 INFO:tasks.rados.rados.0.trial187.stdout:3295: writing trial18717860-5 from 1328204 to 1737574 tid 2 2026-02-13T18:20:40.569 INFO:tasks.rados.rados.0.trial187.stdout:3295: writing trial18717860-5 from 2252362 to 2504507 tid 3 2026-02-13T18:20:40.569 INFO:tasks.rados.rados.0.trial187.stdout:3296: rollback oid 25 current snap is 369 2026-02-13T18:20:40.569 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 345 2026-02-13T18:20:40.569 INFO:tasks.rados.rados.0.trial187.stdout:3295: finishing write tid 1 to trial18717860-5 2026-02-13T18:20:40.569 INFO:tasks.rados.rados.0.trial187.stdout:3295: finishing write tid 2 to trial18717860-5 2026-02-13T18:20:40.570 INFO:tasks.rados.rados.0.trial187.stdout:3297: snap_create 2026-02-13T18:20:40.572 INFO:tasks.rados.rados.0.trial187.stdout:3296: finishing rollback tid 0 to trial18717860-25 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3296: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3296: finishing rollback tid 2 to trial18717860-25 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1041 (ObjNum 781 snap 267 seq_num 781) dirty exists 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: finishing write tid 3 to trial18717860-5 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: finishing write tid 4 to trial18717860-5 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: finishing write tid 5 to trial18717860-5 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: oid 5 updating version 0 to 1465 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: oid 5 version 1465 is already newer than 1463 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: oid 5 version 1465 is already newer than 1462 2026-02-13T18:20:40.573 INFO:tasks.rados.rados.0.trial187.stdout:3295: oid 5 version 1465 is already newer than 1464 2026-02-13T18:20:40.574 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1465 (ObjNum 1101 snap 369 seq_num 1101) dirty exists 2026-02-13T18:20:40.574 INFO:tasks.rados.rados.0.trial187.stdout:3295: left oid 5 (ObjNum 1101 snap 369 seq_num 1101) 2026-02-13T18:20:41.553 INFO:tasks.rados.rados.0.trial187.stdout:3295: done (2 left) 2026-02-13T18:20:41.553 INFO:tasks.rados.rados.0.trial187.stdout:3296: done (1 left) 2026-02-13T18:20:41.553 INFO:tasks.rados.rados.0.trial187.stdout:3297: done (0 left) 2026-02-13T18:20:41.554 INFO:tasks.rados.rados.0.trial187.stdout:3298: delete oid 2 current snap is 370 2026-02-13T18:20:41.557 INFO:tasks.rados.rados.0.trial187.stdout:3298: done (0 left) 2026-02-13T18:20:41.557 INFO:tasks.rados.rados.0.trial187.stdout:3299: copy_from oid 38 from oid 46 current snap is 370 2026-02-13T18:20:41.557 INFO:tasks.rados.rados.0.trial187.stdout:3300: read oid 45 snap -1 2026-02-13T18:20:41.557 INFO:tasks.rados.rados.0.trial187.stdout:3300: expect deleted 2026-02-13T18:20:41.557 INFO:tasks.rados.rados.0.trial187.stdout:3301: write (excl) oid 6 current snap is 370 2026-02-13T18:20:41.557 INFO:tasks.rados.rados.0.trial187.stdout:3301: seq_num 1103 ranges {538121=670832,1961521=413039} 2026-02-13T18:20:41.565 INFO:tasks.rados.rados.0.trial187.stdout:3301: writing trial18717860-6 from 538121 to 1208953 tid 1 2026-02-13T18:20:41.573 INFO:tasks.rados.rados.0.trial187.stdout:3301: writing trial18717860-6 from 1961521 to 2374560 tid 2 2026-02-13T18:20:41.573 INFO:tasks.rados.rados.0.trial187.stdout:3302: copy_from oid 8 from oid 33 current snap is 370 2026-02-13T18:20:41.573 INFO:tasks.rados.rados.0.trial187.stdout:3299: finishing copy_from racing read to trial18717860-38 2026-02-13T18:20:41.573 INFO:tasks.rados.rados.0.trial187.stdout:3299: finishing copy_from to trial18717860-38 2026-02-13T18:20:41.573 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1255 (ObjNum 1094 snap 365 seq_num 1094) dirty exists 2026-02-13T18:20:41.573 INFO:tasks.rados.rados.0.trial187.stdout:3301: finishing write tid 1 to trial18717860-6 2026-02-13T18:20:41.574 INFO:tasks.rados.rados.0.trial187.stdout:3299: done (3 left) 2026-02-13T18:20:41.574 INFO:tasks.rados.rados.0.trial187.stdout:3300: done (2 left) 2026-02-13T18:20:41.574 INFO:tasks.rados.rados.0.trial187.stdout:3303: delete oid 13 current snap is 370 2026-02-13T18:20:41.575 INFO:tasks.rados.rados.0.trial187.stdout:3301: finishing write tid 2 to trial18717860-6 2026-02-13T18:20:41.575 INFO:tasks.rados.rados.0.trial187.stdout:3303: done (2 left) 2026-02-13T18:20:41.576 INFO:tasks.rados.rados.0.trial187.stdout:3304: copy_from oid 19 from oid 47 current snap is 370 2026-02-13T18:20:41.576 INFO:tasks.rados.rados.0.trial187.stdout:3305: copy_from oid 28 from oid 41 current snap is 370 2026-02-13T18:20:41.576 INFO:tasks.rados.rados.0.trial187.stdout:3306: snap_remove snap 369 2026-02-13T18:20:42.557 INFO:tasks.rados.rados.0.trial187.stdout:3306: done (4 left) 2026-02-13T18:20:42.557 INFO:tasks.rados.rados.0.trial187.stdout:3307: read oid 48 snap 350 2026-02-13T18:20:42.558 INFO:tasks.rados.rados.0.trial187.stdout:3307: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:20:42.558 INFO:tasks.rados.rados.0.trial187.stdout:3308: snap_remove snap 363 2026-02-13T18:20:43.558 INFO:tasks.rados.rados.0.trial187.stdout:3308: done (5 left) 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3309: delete oid 26 current snap is 370 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3301: finishing write tid 3 to trial18717860-6 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3301: finishing write tid 4 to trial18717860-6 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3301: oid 6 updating version 0 to 1636 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3301: oid 6 updating version 1636 to 1638 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3301: oid 6 version 1638 is already newer than 1637 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1638 (ObjNum 1103 snap 370 seq_num 1103) dirty exists 2026-02-13T18:20:43.559 INFO:tasks.rados.rados.0.trial187.stdout:3301: left oid 6 (ObjNum 1103 snap 370 seq_num 1103) 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3305: finishing copy_from to trial18717860-28 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3305: got expected ENOENT (src dne) 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3305: finishing copy_from racing read to trial18717860-28 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3304: finishing copy_from racing read to trial18717860-19 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3304: finishing copy_from to trial18717860-19 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1632 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3302: finishing copy_from racing read to trial18717860-8 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3302: finishing copy_from to trial18717860-8 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 2028 (ObjNum 1051 snap 347 seq_num 1051) dirty exists 2026-02-13T18:20:43.560 INFO:tasks.rados.rados.0.trial187.stdout:3307: expect (ObjNum 1018 snap 331 seq_num 1018) 2026-02-13T18:20:43.584 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1506280 2026-02-13T18:20:43.631 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1043830 2026-02-13T18:20:43.672 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:43.724 INFO:tasks.rados.rados.0.trial187.stdout:3301: done (5 left) 2026-02-13T18:20:43.724 INFO:tasks.rados.rados.0.trial187.stdout:3302: done (4 left) 2026-02-13T18:20:43.724 INFO:tasks.rados.rados.0.trial187.stdout:3304: done (3 left) 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:3305: done (2 left) 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:3307: done (1 left) 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:3309: done (0 left) 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:3310: rollback oid 29 current snap is 370 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 365 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:3311: write oid 47 current snap is 370 2026-02-13T18:20:43.725 INFO:tasks.rados.rados.0.trial187.stdout:3311: seq_num 1106 ranges {588542=496579,1620614=676719} 2026-02-13T18:20:43.731 INFO:tasks.rados.rados.0.trial187.stdout:3311: writing trial18717860-47 from 588542 to 1085121 tid 1 2026-02-13T18:20:43.740 INFO:tasks.rados.rados.0.trial187.stdout:3311: writing trial18717860-47 from 1620614 to 2297333 tid 2 2026-02-13T18:20:43.740 INFO:tasks.rados.rados.0.trial187.stdout:3312: write oid 25 current snap is 370 2026-02-13T18:20:43.740 INFO:tasks.rados.rados.0.trial187.stdout:3312: seq_num 1107 ranges {605349=571828,1679096=420377} 2026-02-13T18:20:43.748 INFO:tasks.rados.rados.0.trial187.stdout:3312: writing trial18717860-25 from 605349 to 1177177 tid 1 2026-02-13T18:20:43.755 INFO:tasks.rados.rados.0.trial187.stdout:3312: writing trial18717860-25 from 1679096 to 2099473 tid 2 2026-02-13T18:20:43.755 INFO:tasks.rados.rados.0.trial187.stdout:3313: read oid 49 snap 368 2026-02-13T18:20:43.755 INFO:tasks.rados.rados.0.trial187.stdout:3313: expect (ObjNum 796 snap 269 seq_num 796) 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3314: copy_from oid 10 from oid 28 current snap is 370 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3310: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1423 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: finishing write tid 1 to trial18717860-47 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: finishing write tid 2 to trial18717860-47 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3310: done (4 left) 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3315: copy_from oid 24 from oid 19 current snap is 370 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: finishing write tid 3 to trial18717860-47 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: finishing write tid 4 to trial18717860-47 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: oid 47 updating version 0 to 1635 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: oid 47 version 1635 is already newer than 1633 2026-02-13T18:20:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3311: oid 47 version 1635 is already newer than 1634 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1635 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:3311: left oid 47 (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:3311: done (4 left) 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:3316: copy_from oid 6 from oid 48 current snap is 370 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:3312: finishing write tid 1 to trial18717860-25 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:3317: write (excl) oid 33 current snap is 370 2026-02-13T18:20:43.757 INFO:tasks.rados.rados.0.trial187.stdout:3317: seq_num 1108 ranges {622156=647077,1737578=680388} 2026-02-13T18:20:43.763 INFO:tasks.rados.rados.0.trial187.stdout:3317: writing trial18717860-33 from 622156 to 1269233 tid 1 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:3317: writing trial18717860-33 from 1737578 to 2417966 tid 2 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:3318: rollback oid 45 current snap is 370 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 358 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:3312: finishing write tid 2 to trial18717860-25 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:3319: read oid 43 snap -1 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:3319: expect deleted 2026-02-13T18:20:43.772 INFO:tasks.rados.rados.0.trial187.stdout:3320: copy_from oid 29 from oid 39 current snap is 370 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: finishing write tid 3 to trial18717860-25 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: finishing write tid 4 to trial18717860-25 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: oid 25 updating version 0 to 1042 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: oid 25 updating version 1042 to 1044 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: oid 25 version 1044 is already newer than 1043 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1044 (ObjNum 1107 snap 370 seq_num 1107) dirty exists 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: left oid 25 (ObjNum 1107 snap 370 seq_num 1107) 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3312: done (8 left) 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3321: rollback oid 44 current snap is 370 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 350 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3316: finishing copy_from to trial18717860-6 2026-02-13T18:20:43.773 INFO:tasks.rados.rados.0.trial187.stdout:3316: got expected ENOENT (src dne) 2026-02-13T18:20:43.774 INFO:tasks.rados.rados.0.trial187.stdout:3316: finishing copy_from racing read to trial18717860-6 2026-02-13T18:20:43.774 INFO:tasks.rados.rados.0.trial187.stdout:3313: expect (ObjNum 796 snap 269 seq_num 796) 2026-02-13T18:20:43.775 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1008004 2026-02-13T18:20:43.818 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:43.844 INFO:tasks.rados.rados.0.trial187.stdout:3314: finishing copy_from racing read to trial18717860-10 2026-02-13T18:20:43.844 INFO:tasks.rados.rados.0.trial187.stdout:3314: finishing copy_from to trial18717860-10 2026-02-13T18:20:43.844 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1461 (ObjNum 1073 snap 354 seq_num 1073) dirty exists 2026-02-13T18:20:43.844 INFO:tasks.rados.rados.0.trial187.stdout:3315: finishing copy_from racing read to trial18717860-24 2026-02-13T18:20:43.844 INFO:tasks.rados.rados.0.trial187.stdout:3315: finishing copy_from to trial18717860-24 2026-02-13T18:20:43.844 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1632 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: finishing write tid 1 to trial18717860-33 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: finishing write tid 2 to trial18717860-33 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: finishing write tid 3 to trial18717860-33 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: finishing write tid 4 to trial18717860-33 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: oid 33 updating version 0 to 2128 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: oid 33 updating version 2128 to 2129 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: oid 33 updating version 2129 to 2130 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2130 (ObjNum 1108 snap 370 seq_num 1108) dirty exists 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3317: left oid 33 (ObjNum 1108 snap 370 seq_num 1108) 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3320: finishing copy_from to trial18717860-29 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3320: got expected ENOENT (src dne) 2026-02-13T18:20:43.845 INFO:tasks.rados.rados.0.trial187.stdout:3320: finishing copy_from racing read to trial18717860-29 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3318: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1455 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3321: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3321: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3321: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2134 (ObjNum 945 snap 307 seq_num 945) dirty exists 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3313: done (8 left) 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3314: done (7 left) 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3315: done (6 left) 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3316: done (5 left) 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3317: done (4 left) 2026-02-13T18:20:43.846 INFO:tasks.rados.rados.0.trial187.stdout:3318: done (3 left) 2026-02-13T18:20:43.847 INFO:tasks.rados.rados.0.trial187.stdout:3319: done (2 left) 2026-02-13T18:20:43.847 INFO:tasks.rados.rados.0.trial187.stdout:3320: done (1 left) 2026-02-13T18:20:43.847 INFO:tasks.rados.rados.0.trial187.stdout:3321: done (0 left) 2026-02-13T18:20:43.847 INFO:tasks.rados.rados.0.trial187.stdout:3322: snap_create 2026-02-13T18:20:44.569 INFO:tasks.rados.rados.0.trial187.stdout:3322: done (0 left) 2026-02-13T18:20:44.569 INFO:tasks.rados.rados.0.trial187.stdout:3323: snap_remove snap 368 2026-02-13T18:20:45.553 INFO:tasks.rados.rados.0.trial187.stdout:3323: done (0 left) 2026-02-13T18:20:45.554 INFO:tasks.rados.rados.0.trial187.stdout:3324: snap_remove snap 358 2026-02-13T18:20:46.558 INFO:tasks.rados.rados.0.trial187.stdout:3324: done (0 left) 2026-02-13T18:20:46.558 INFO:tasks.rados.rados.0.trial187.stdout:3325: snap_remove snap 367 2026-02-13T18:20:47.561 INFO:tasks.rados.rados.0.trial187.stdout:3325: done (0 left) 2026-02-13T18:20:47.561 INFO:tasks.rados.rados.0.trial187.stdout:3326: read oid 41 snap -1 2026-02-13T18:20:47.561 INFO:tasks.rados.rados.0.trial187.stdout:3326: expect deleted 2026-02-13T18:20:47.561 INFO:tasks.rados.rados.0.trial187.stdout:3327: delete oid 43 current snap is 371 2026-02-13T18:20:47.565 INFO:tasks.rados.rados.0.trial187.stdout:3326: done (1 left) 2026-02-13T18:20:47.565 INFO:tasks.rados.rados.0.trial187.stdout:3327: done (0 left) 2026-02-13T18:20:47.565 INFO:tasks.rados.rados.0.trial187.stdout:3328: copy_from oid 26 from oid 1 current snap is 371 2026-02-13T18:20:47.565 INFO:tasks.rados.rados.0.trial187.stdout:3329: snap_create 2026-02-13T18:20:47.566 INFO:tasks.rados.rados.0.trial187.stdout:3328: finishing copy_from to trial18717860-26 2026-02-13T18:20:47.566 INFO:tasks.rados.rados.0.trial187.stdout:3328: got expected ENOENT (src dne) 2026-02-13T18:20:47.566 INFO:tasks.rados.rados.0.trial187.stdout:3328: finishing copy_from racing read to trial18717860-26 2026-02-13T18:20:48.573 INFO:tasks.rados.rados.0.trial187.stdout:3328: done (1 left) 2026-02-13T18:20:48.573 INFO:tasks.rados.rados.0.trial187.stdout:3329: done (0 left) 2026-02-13T18:20:48.573 INFO:tasks.rados.rados.0.trial187.stdout:3330: write (excl) oid 10 current snap is 372 2026-02-13T18:20:48.573 INFO:tasks.rados.rados.0.trial187.stdout:3330: seq_num 1110 ranges {655770=513928,1854542=684057} 2026-02-13T18:20:48.580 INFO:tasks.rados.rados.0.trial187.stdout:3330: writing trial18717860-10 from 655770 to 1169698 tid 1 2026-02-13T18:20:48.590 INFO:tasks.rados.rados.0.trial187.stdout:3330: writing trial18717860-10 from 1854542 to 2538599 tid 2 2026-02-13T18:20:48.590 INFO:tasks.rados.rados.0.trial187.stdout:3331: copy_from oid 49 from oid 1 current snap is 372 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3330: finishing write tid 1 to trial18717860-10 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3332: read oid 6 snap -1 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3332: expect (ObjNum 1103 snap 370 seq_num 1103) 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3333: read oid 29 snap -1 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3333: expect deleted 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3334: read oid 14 snap -1 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3334: expect (ObjNum 1100 snap 368 seq_num 1100) 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3335: rollback oid 24 current snap is 372 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 345 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3336: read oid 34 snap 371 2026-02-13T18:20:48.591 INFO:tasks.rados.rados.0.trial187.stdout:3336: expect deleted 2026-02-13T18:20:48.592 INFO:tasks.rados.rados.0.trial187.stdout:3337: write oid 26 current snap is 372 2026-02-13T18:20:48.592 INFO:tasks.rados.rados.0.trial187.stdout:3337: seq_num 1111 ranges {672577=589177,1913024=427715} 2026-02-13T18:20:48.600 INFO:tasks.rados.rados.0.trial187.stdout:3337: writing trial18717860-26 from 672577 to 1261754 tid 1 2026-02-13T18:20:48.607 INFO:tasks.rados.rados.0.trial187.stdout:3337: writing trial18717860-26 from 1913024 to 2340739 tid 2 2026-02-13T18:20:48.608 INFO:tasks.rados.rados.0.trial187.stdout:3338: snap_create 2026-02-13T18:20:48.608 INFO:tasks.rados.rados.0.trial187.stdout:3334: expect (ObjNum 1100 snap 368 seq_num 1100) 2026-02-13T18:20:48.671 INFO:tasks.rados.rados.0.trial187.stdout:3330: finishing write tid 2 to trial18717860-10 2026-02-13T18:20:48.671 INFO:tasks.rados.rados.0.trial187.stdout:3330: finishing write tid 3 to trial18717860-10 2026-02-13T18:20:48.671 INFO:tasks.rados.rados.0.trial187.stdout:3332: expect (ObjNum 1103 snap 370 seq_num 1103) 2026-02-13T18:20:48.675 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1123454 2026-02-13T18:20:48.695 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 345690 2026-02-13T18:20:48.750 INFO:tasks.rados.rados.0.trial187.stdout:3330: finishing write tid 4 to trial18717860-10 2026-02-13T18:20:48.750 INFO:tasks.rados.rados.0.trial187.stdout:3330: oid 10 updating version 0 to 1463 2026-02-13T18:20:48.750 INFO:tasks.rados.rados.0.trial187.stdout:3330: oid 10 version 1463 is already newer than 1462 2026-02-13T18:20:48.750 INFO:tasks.rados.rados.0.trial187.stdout:3330: oid 10 updating version 1463 to 1464 2026-02-13T18:20:48.750 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1464 (ObjNum 1110 snap 372 seq_num 1110) dirty exists 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3330: left oid 10 (ObjNum 1110 snap 372 seq_num 1110) 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3335: finishing rollback tid 0 to trial18717860-24 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3335: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1640 (ObjNum 81 snap 0 seq_num 486115264) dirty dne 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3331: finishing copy_from to trial18717860-49 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3331: got expected ENOENT (src dne) 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3331: finishing copy_from racing read to trial18717860-49 2026-02-13T18:20:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3337: finishing write tid 1 to trial18717860-26 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: finishing write tid 2 to trial18717860-26 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: finishing write tid 3 to trial18717860-26 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: finishing write tid 4 to trial18717860-26 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: oid 26 updating version 0 to 2042 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: oid 26 version 2042 is already newer than 2041 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: oid 26 updating version 2042 to 2043 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 2043 (ObjNum 1111 snap 372 seq_num 1111) dirty exists 2026-02-13T18:20:48.752 INFO:tasks.rados.rados.0.trial187.stdout:3337: left oid 26 (ObjNum 1111 snap 372 seq_num 1111) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3330: done (8 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3331: done (7 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3332: done (6 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3333: done (5 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3334: done (4 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3335: done (3 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3336: done (2 left) 2026-02-13T18:20:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3337: done (1 left) 2026-02-13T18:20:49.587 INFO:tasks.rados.rados.0.trial187.stdout:3338: done (0 left) 2026-02-13T18:20:49.587 INFO:tasks.rados.rados.0.trial187.stdout:3339: write oid 5 current snap is 373 2026-02-13T18:20:49.587 INFO:tasks.rados.rados.0.trial187.stdout:3339: seq_num 1112 ranges {689384=664426,1971506=687726} 2026-02-13T18:20:49.594 INFO:tasks.rados.rados.0.trial187.stdout:3339: writing trial18717860-5 from 689384 to 1353810 tid 1 2026-02-13T18:20:49.604 INFO:tasks.rados.rados.0.trial187.stdout:3339: writing trial18717860-5 from 1971506 to 2659232 tid 2 2026-02-13T18:20:49.604 INFO:tasks.rados.rados.0.trial187.stdout:3340: rollback oid 38 current snap is 373 2026-02-13T18:20:49.604 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 349 2026-02-13T18:20:49.604 INFO:tasks.rados.rados.0.trial187.stdout:3339: finishing write tid 1 to trial18717860-5 2026-02-13T18:20:49.604 INFO:tasks.rados.rados.0.trial187.stdout:3341: delete oid 44 current snap is 373 2026-02-13T18:20:49.607 INFO:tasks.rados.rados.0.trial187.stdout:3339: finishing write tid 2 to trial18717860-5 2026-02-13T18:20:49.607 INFO:tasks.rados.rados.0.trial187.stdout:3339: finishing write tid 3 to trial18717860-5 2026-02-13T18:20:49.608 INFO:tasks.rados.rados.0.trial187.stdout:3341: done (2 left) 2026-02-13T18:20:49.608 INFO:tasks.rados.rados.0.trial187.stdout:3342: read oid 19 snap 360 2026-02-13T18:20:49.608 INFO:tasks.rados.rados.0.trial187.stdout:3342: expect deleted 2026-02-13T18:20:49.608 INFO:tasks.rados.rados.0.trial187.stdout:3343: write (excl) oid 6 current snap is 373 2026-02-13T18:20:49.608 INFO:tasks.rados.rados.0.trial187.stdout:3343: seq_num 1114 ranges {722998=414924,1572117=575042} 2026-02-13T18:20:49.615 INFO:tasks.rados.rados.0.trial187.stdout:3343: writing trial18717860-6 from 722998 to 1137922 tid 1 2026-02-13T18:20:49.622 INFO:tasks.rados.rados.0.trial187.stdout:3343: writing trial18717860-6 from 1572117 to 2147159 tid 2 2026-02-13T18:20:49.622 INFO:tasks.rados.rados.0.trial187.stdout:3344: snap_remove snap 362 2026-02-13T18:20:50.555 INFO:tasks.rados.rados.0.trial187.stdout:3344: done (4 left) 2026-02-13T18:20:50.555 INFO:tasks.rados.rados.0.trial187.stdout:3345: read oid 41 snap -1 2026-02-13T18:20:50.555 INFO:tasks.rados.rados.0.trial187.stdout:3345: expect deleted 2026-02-13T18:20:50.555 INFO:tasks.rados.rados.0.trial187.stdout:3346: delete oid 31 current snap is 373 2026-02-13T18:20:50.555 INFO:tasks.rados.rados.0.trial187.stdout:3339: finishing write tid 4 to trial18717860-5 2026-02-13T18:20:50.555 INFO:tasks.rados.rados.0.trial187.stdout:3339: oid 5 updating version 0 to 1466 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3339: oid 5 updating version 1466 to 1468 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3339: oid 5 version 1468 is already newer than 1467 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1468 (ObjNum 1112 snap 373 seq_num 1112) dirty exists 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3339: left oid 5 (ObjNum 1112 snap 373 seq_num 1112) 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3340: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3340: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3340: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1827 (ObjNum 1005 snap 326 seq_num 1005) dirty exists 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3343: finishing write tid 1 to trial18717860-6 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3343: finishing write tid 2 to trial18717860-6 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3343: finishing write tid 3 to trial18717860-6 2026-02-13T18:20:50.556 INFO:tasks.rados.rados.0.trial187.stdout:3343: finishing write tid 4 to trial18717860-6 2026-02-13T18:20:50.557 INFO:tasks.rados.rados.0.trial187.stdout:3343: oid 6 updating version 0 to 1642 2026-02-13T18:20:50.557 INFO:tasks.rados.rados.0.trial187.stdout:3343: oid 6 updating version 1642 to 1643 2026-02-13T18:20:50.557 INFO:tasks.rados.rados.0.trial187.stdout:3343: oid 6 version 1643 is already newer than 1641 2026-02-13T18:20:50.557 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1643 (ObjNum 1114 snap 373 seq_num 1114) dirty exists 2026-02-13T18:20:50.557 INFO:tasks.rados.rados.0.trial187.stdout:3343: left oid 6 (ObjNum 1114 snap 373 seq_num 1114) 2026-02-13T18:20:50.559 INFO:tasks.rados.rados.0.trial187.stdout:3339: done (5 left) 2026-02-13T18:20:50.559 INFO:tasks.rados.rados.0.trial187.stdout:3340: done (4 left) 2026-02-13T18:20:50.560 INFO:tasks.rados.rados.0.trial187.stdout:3342: done (3 left) 2026-02-13T18:20:50.560 INFO:tasks.rados.rados.0.trial187.stdout:3343: done (2 left) 2026-02-13T18:20:50.560 INFO:tasks.rados.rados.0.trial187.stdout:3345: done (1 left) 2026-02-13T18:20:50.560 INFO:tasks.rados.rados.0.trial187.stdout:3346: done (0 left) 2026-02-13T18:20:50.560 INFO:tasks.rados.rados.0.trial187.stdout:3347: snap_create 2026-02-13T18:20:51.555 INFO:tasks.rados.rados.0.trial187.stdout:3347: done (0 left) 2026-02-13T18:20:51.556 INFO:tasks.rados.rados.0.trial187.stdout:3348: read oid 37 snap -1 2026-02-13T18:20:51.556 INFO:tasks.rados.rados.0.trial187.stdout:3348: expect (ObjNum 1056 snap 349 seq_num 1056) 2026-02-13T18:20:51.556 INFO:tasks.rados.rados.0.trial187.stdout:3349: write (excl) oid 26 current snap is 374 2026-02-13T18:20:51.556 INFO:tasks.rados.rados.0.trial187.stdout:3349: seq_num 1116 ranges {756612=565422,2089081=578711} 2026-02-13T18:20:51.564 INFO:tasks.rados.rados.0.trial187.stdout:3349: writing trial18717860-26 from 756612 to 1322034 tid 1 2026-02-13T18:20:51.573 INFO:tasks.rados.rados.0.trial187.stdout:3349: writing trial18717860-26 from 2089081 to 2667792 tid 2 2026-02-13T18:20:51.573 INFO:tasks.rados.rados.0.trial187.stdout:3350: rollback oid 24 current snap is 374 2026-02-13T18:20:51.574 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 372 2026-02-13T18:20:51.574 INFO:tasks.rados.rados.0.trial187.stdout:3348: expect (ObjNum 1056 snap 349 seq_num 1056) 2026-02-13T18:20:51.587 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2068981 2026-02-13T18:20:51.637 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: finishing write tid 1 to trial18717860-26 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3350: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1640 (ObjNum 945 snap 0 seq_num 4015609805) dirty dne 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: finishing write tid 2 to trial18717860-26 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: finishing write tid 3 to trial18717860-26 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: finishing write tid 4 to trial18717860-26 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: oid 26 updating version 0 to 2045 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: oid 26 updating version 2045 to 2046 2026-02-13T18:20:51.665 INFO:tasks.rados.rados.0.trial187.stdout:3349: oid 26 version 2046 is already newer than 2044 2026-02-13T18:20:51.666 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 2046 (ObjNum 1116 snap 374 seq_num 1116) dirty exists 2026-02-13T18:20:51.666 INFO:tasks.rados.rados.0.trial187.stdout:3349: left oid 26 (ObjNum 1116 snap 374 seq_num 1116) 2026-02-13T18:20:51.666 INFO:tasks.rados.rados.0.trial187.stdout:3348: done (2 left) 2026-02-13T18:20:51.666 INFO:tasks.rados.rados.0.trial187.stdout:3349: done (1 left) 2026-02-13T18:20:51.666 INFO:tasks.rados.rados.0.trial187.stdout:3350: done (0 left) 2026-02-13T18:20:51.666 INFO:tasks.rados.rados.0.trial187.stdout:3351: snap_create 2026-02-13T18:20:52.592 INFO:tasks.rados.rados.0.trial187.stdout:3351: done (0 left) 2026-02-13T18:20:52.593 INFO:tasks.rados.rados.0.trial187.stdout:3352: write (excl) oid 45 current snap is 375 2026-02-13T18:20:52.593 INFO:tasks.rados.rados.0.trial187.stdout:3352: seq_num 1117 ranges {773419=640671,2147563=438722} 2026-02-13T18:20:52.601 INFO:tasks.rados.rados.0.trial187.stdout:3352: writing trial18717860-45 from 773419 to 1414090 tid 1 2026-02-13T18:20:52.610 INFO:tasks.rados.rados.0.trial187.stdout:3352: writing trial18717860-45 from 2147563 to 2586285 tid 2 2026-02-13T18:20:52.610 INFO:tasks.rados.rados.0.trial187.stdout:3353: snap_create 2026-02-13T18:20:52.610 INFO:tasks.rados.rados.0.trial187.stdout:3352: finishing write tid 1 to trial18717860-45 2026-02-13T18:20:52.611 INFO:tasks.rados.rados.0.trial187.stdout:3352: finishing write tid 2 to trial18717860-45 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:3352: finishing write tid 3 to trial18717860-45 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:3352: finishing write tid 4 to trial18717860-45 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:3352: oid 45 updating version 0 to 1470 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:3352: oid 45 updating version 1470 to 1471 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:3352: oid 45 version 1471 is already newer than 1469 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1471 (ObjNum 1117 snap 375 seq_num 1117) dirty exists 2026-02-13T18:20:52.612 INFO:tasks.rados.rados.0.trial187.stdout:3352: left oid 45 (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:20:53.593 INFO:tasks.rados.rados.0.trial187.stdout:3352: done (1 left) 2026-02-13T18:20:53.594 INFO:tasks.rados.rados.0.trial187.stdout:3353: done (0 left) 2026-02-13T18:20:53.594 INFO:tasks.rados.rados.0.trial187.stdout:3354: write (excl) oid 21 current snap is 376 2026-02-13T18:20:53.594 INFO:tasks.rados.rados.0.trial187.stdout:3354: seq_num 1118 ranges {790226=432273,1806045=582380} 2026-02-13T18:20:53.601 INFO:tasks.rados.rados.0.trial187.stdout:3354: writing trial18717860-21 from 790226 to 1222499 tid 1 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:3354: writing trial18717860-21 from 1806045 to 2388425 tid 2 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:3355: read oid 4 snap 372 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:3355: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:3356: rollback oid 37 current snap is 376 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 341 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:3354: finishing write tid 1 to trial18717860-21 2026-02-13T18:20:53.610 INFO:tasks.rados.rados.0.trial187.stdout:3357: rollback oid 24 current snap is 376 2026-02-13T18:20:53.611 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 24 to 372 2026-02-13T18:20:53.611 INFO:tasks.rados.rados.0.trial187.stdout:3358: rollback oid 29 current snap is 376 2026-02-13T18:20:53.611 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 364 2026-02-13T18:20:53.611 INFO:tasks.rados.rados.0.trial187.stdout:3359: delete oid 28 current snap is 376 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:3354: finishing write tid 2 to trial18717860-21 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:3354: finishing write tid 3 to trial18717860-21 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:3357: finishing rollback tid 1 to trial18717860-24 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1640 (ObjNum 33 snap 0 seq_num 3014706320) dirty dne 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:3354: finishing write tid 4 to trial18717860-21 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:3354: oid 21 updating version 0 to 1265 2026-02-13T18:20:53.614 INFO:tasks.rados.rados.0.trial187.stdout:3354: oid 21 updating version 1265 to 1266 2026-02-13T18:20:53.615 INFO:tasks.rados.rados.0.trial187.stdout:3354: oid 21 updating version 1266 to 1267 2026-02-13T18:20:53.615 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1267 (ObjNum 1118 snap 376 seq_num 1118) dirty exists 2026-02-13T18:20:53.615 INFO:tasks.rados.rados.0.trial187.stdout:3354: left oid 21 (ObjNum 1118 snap 376 seq_num 1118) 2026-02-13T18:20:53.615 INFO:tasks.rados.rados.0.trial187.stdout:3358: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:20:53.615 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1423 (ObjNum 273 snap 0 seq_num 1559968356) dirty dne 2026-02-13T18:20:53.616 INFO:tasks.rados.rados.0.trial187.stdout:3356: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:20:53.616 INFO:tasks.rados.rados.0.trial187.stdout:3354: done (5 left) 2026-02-13T18:20:53.616 INFO:tasks.rados.rados.0.trial187.stdout:3357: done (4 left) 2026-02-13T18:20:53.616 INFO:tasks.rados.rados.0.trial187.stdout:3358: done (3 left) 2026-02-13T18:20:53.616 INFO:tasks.rados.rados.0.trial187.stdout:3359: done (2 left) 2026-02-13T18:20:53.616 INFO:tasks.rados.rados.0.trial187.stdout:3360: snap_remove snap 373 2026-02-13T18:20:54.601 INFO:tasks.rados.rados.0.trial187.stdout:3360: done (2 left) 2026-02-13T18:20:54.601 INFO:tasks.rados.rados.0.trial187.stdout:3361: rollback oid 14 current snap is 376 2026-02-13T18:20:54.601 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 14 to 365 2026-02-13T18:20:54.601 INFO:tasks.rados.rados.0.trial187.stdout:3356: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:20:54.601 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 2156 (ObjNum 65 snap 0 seq_num 3012949152) dirty dne 2026-02-13T18:20:54.601 INFO:tasks.rados.rados.0.trial187.stdout:3355: expect (ObjNum 929 snap 304 seq_num 929) 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3361: finishing rollback tid 0 to trial18717860-14 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3361: finishing rollback tid 1 to trial18717860-14 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1454 (ObjNum 65 snap 0 seq_num 1634300532) dirty dne 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3355: done (2 left) 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3356: done (1 left) 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3361: done (0 left) 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3362: read oid 17 snap -1 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3362: expect (ObjNum 1090 snap 359 seq_num 1090) 2026-02-13T18:20:54.679 INFO:tasks.rados.rados.0.trial187.stdout:3363: write (excl) oid 40 current snap is 376 2026-02-13T18:20:54.680 INFO:tasks.rados.rados.0.trial187.stdout:3363: seq_num 1120 ranges {423840=582771,1523009=586049,2657046=166794} 2026-02-13T18:20:54.685 INFO:tasks.rados.rados.0.trial187.stdout:3363: writing trial18717860-40 from 423840 to 1006611 tid 1 2026-02-13T18:20:54.693 INFO:tasks.rados.rados.0.trial187.stdout:3363: writing trial18717860-40 from 1523009 to 2109058 tid 2 2026-02-13T18:20:54.698 INFO:tasks.rados.rados.0.trial187.stdout:3363: writing trial18717860-40 from 2657046 to 2823840 tid 3 2026-02-13T18:20:54.698 INFO:tasks.rados.rados.0.trial187.stdout:3364: snap_create 2026-02-13T18:20:54.698 INFO:tasks.rados.rados.0.trial187.stdout:3362: expect (ObjNum 1090 snap 359 seq_num 1090) 2026-02-13T18:20:54.807 INFO:tasks.rados.rados.0.trial187.stdout:3363: finishing write tid 1 to trial18717860-40 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: finishing write tid 2 to trial18717860-40 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: finishing write tid 3 to trial18717860-40 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: finishing write tid 4 to trial18717860-40 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: finishing write tid 5 to trial18717860-40 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: oid 40 updating version 0 to 1473 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: oid 40 updating version 1473 to 1474 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: oid 40 version 1474 is already newer than 1472 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: oid 40 updating version 1474 to 1475 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1475 (ObjNum 1120 snap 376 seq_num 1120) dirty exists 2026-02-13T18:20:54.808 INFO:tasks.rados.rados.0.trial187.stdout:3363: left oid 40 (ObjNum 1120 snap 376 seq_num 1120) 2026-02-13T18:20:55.555 INFO:tasks.rados.rados.0.trial187.stdout:3362: done (2 left) 2026-02-13T18:20:55.556 INFO:tasks.rados.rados.0.trial187.stdout:3363: done (1 left) 2026-02-13T18:20:55.556 INFO:tasks.rados.rados.0.trial187.stdout:3364: done (0 left) 2026-02-13T18:20:55.556 INFO:tasks.rados.rados.0.trial187.stdout:3365: write oid 41 current snap is 377 2026-02-13T18:20:55.556 INFO:tasks.rados.rados.0.trial187.stdout:3365: seq_num 1121 ranges {440647=658020,1581491=446060,2800822=39825} 2026-02-13T18:20:55.563 INFO:tasks.rados.rados.0.trial187.stdout:3365: writing trial18717860-41 from 440647 to 1098667 tid 1 2026-02-13T18:20:55.569 INFO:tasks.rados.rados.0.trial187.stdout:3365: writing trial18717860-41 from 1581491 to 2027551 tid 2 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:3365: writing trial18717860-41 from 2800822 to 2840647 tid 3 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:3366: rollback oid 11 current snap is 377 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 364 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:3365: finishing write tid 1 to trial18717860-41 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:3365: finishing write tid 2 to trial18717860-41 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:3367: write (excl) oid 23 current snap is 377 2026-02-13T18:20:55.575 INFO:tasks.rados.rados.0.trial187.stdout:3367: seq_num 1122 ranges {457454=733269,1923620=589718} 2026-02-13T18:20:55.582 INFO:tasks.rados.rados.0.trial187.stdout:3367: writing trial18717860-23 from 457454 to 1190723 tid 1 2026-02-13T18:20:55.591 INFO:tasks.rados.rados.0.trial187.stdout:3367: writing trial18717860-23 from 1923620 to 2513338 tid 2 2026-02-13T18:20:55.591 INFO:tasks.rados.rados.0.trial187.stdout:3368: snap_remove snap 374 2026-02-13T18:20:56.561 INFO:tasks.rados.rados.0.trial187.stdout:3368: done (3 left) 2026-02-13T18:20:56.561 INFO:tasks.rados.rados.0.trial187.stdout:3369: delete oid 43 current snap is 377 2026-02-13T18:20:56.561 INFO:tasks.rados.rados.0.trial187.stdout:3365: finishing write tid 3 to trial18717860-41 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: finishing write tid 4 to trial18717860-41 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: finishing write tid 5 to trial18717860-41 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: oid 41 updating version 0 to 1447 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: oid 41 updating version 1447 to 1449 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: oid 41 version 1449 is already newer than 1446 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: oid 41 version 1449 is already newer than 1448 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1449 (ObjNum 1121 snap 377 seq_num 1121) dirty exists 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3365: left oid 41 (ObjNum 1121 snap 377 seq_num 1121) 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3366: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1451 (ObjNum 129 snap 0 seq_num 3012730400) dirty dne 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3367: finishing write tid 1 to trial18717860-23 2026-02-13T18:20:56.562 INFO:tasks.rados.rados.0.trial187.stdout:3367: finishing write tid 2 to trial18717860-23 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:3367: finishing write tid 3 to trial18717860-23 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:3367: finishing write tid 4 to trial18717860-23 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:3367: oid 23 updating version 0 to 1455 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:3367: oid 23 updating version 1455 to 1456 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:3367: oid 23 updating version 1456 to 1457 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1457 (ObjNum 1122 snap 377 seq_num 1122) dirty exists 2026-02-13T18:20:56.563 INFO:tasks.rados.rados.0.trial187.stdout:3367: left oid 23 (ObjNum 1122 snap 377 seq_num 1122) 2026-02-13T18:20:56.565 INFO:tasks.rados.rados.0.trial187.stdout:3365: done (3 left) 2026-02-13T18:20:56.565 INFO:tasks.rados.rados.0.trial187.stdout:3366: done (2 left) 2026-02-13T18:20:56.565 INFO:tasks.rados.rados.0.trial187.stdout:3367: done (1 left) 2026-02-13T18:20:56.566 INFO:tasks.rados.rados.0.trial187.stdout:3369: done (0 left) 2026-02-13T18:20:56.566 INFO:tasks.rados.rados.0.trial187.stdout:3370: write oid 33 current snap is 377 2026-02-13T18:20:56.566 INFO:tasks.rados.rados.0.trial187.stdout:3370: seq_num 1124 ranges {491068=483767,1640584=593387,2650385=240683} 2026-02-13T18:20:56.572 INFO:tasks.rados.rados.0.trial187.stdout:3370: writing trial18717860-33 from 491068 to 974835 tid 1 2026-02-13T18:20:56.581 INFO:tasks.rados.rados.0.trial187.stdout:3370: writing trial18717860-33 from 1640584 to 2233971 tid 2 2026-02-13T18:20:56.585 INFO:tasks.rados.rados.0.trial187.stdout:3370: writing trial18717860-33 from 2650385 to 2891068 tid 3 2026-02-13T18:20:56.586 INFO:tasks.rados.rados.0.trial187.stdout:3371: snap_create 2026-02-13T18:20:56.586 INFO:tasks.rados.rados.0.trial187.stdout:3370: finishing write tid 1 to trial18717860-33 2026-02-13T18:20:56.586 INFO:tasks.rados.rados.0.trial187.stdout:3370: finishing write tid 2 to trial18717860-33 2026-02-13T18:20:56.588 INFO:tasks.rados.rados.0.trial187.stdout:3370: finishing write tid 3 to trial18717860-33 2026-02-13T18:20:56.588 INFO:tasks.rados.rados.0.trial187.stdout:3370: finishing write tid 4 to trial18717860-33 2026-02-13T18:20:56.588 INFO:tasks.rados.rados.0.trial187.stdout:3370: finishing write tid 5 to trial18717860-33 2026-02-13T18:20:56.588 INFO:tasks.rados.rados.0.trial187.stdout:3370: oid 33 updating version 0 to 2165 2026-02-13T18:20:56.589 INFO:tasks.rados.rados.0.trial187.stdout:3370: oid 33 version 2165 is already newer than 2163 2026-02-13T18:20:56.589 INFO:tasks.rados.rados.0.trial187.stdout:3370: oid 33 updating version 2165 to 2166 2026-02-13T18:20:56.589 INFO:tasks.rados.rados.0.trial187.stdout:3370: oid 33 version 2166 is already newer than 2164 2026-02-13T18:20:56.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2166 (ObjNum 1124 snap 377 seq_num 1124) dirty exists 2026-02-13T18:20:56.589 INFO:tasks.rados.rados.0.trial187.stdout:3370: left oid 33 (ObjNum 1124 snap 377 seq_num 1124) 2026-02-13T18:20:57.564 INFO:tasks.rados.rados.0.trial187.stdout:3370: done (1 left) 2026-02-13T18:20:57.564 INFO:tasks.rados.rados.0.trial187.stdout:3371: done (0 left) 2026-02-13T18:20:57.564 INFO:tasks.rados.rados.0.trial187.stdout:3372: snap_remove snap 353 2026-02-13T18:20:58.567 INFO:tasks.rados.rados.0.trial187.stdout:3372: done (0 left) 2026-02-13T18:20:58.567 INFO:tasks.rados.rados.0.trial187.stdout:3373: rollback oid 12 current snap is 378 2026-02-13T18:20:58.567 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 371 2026-02-13T18:20:58.567 INFO:tasks.rados.rados.0.trial187.stdout:3374: snap_remove snap 360 2026-02-13T18:20:59.568 INFO:tasks.rados.rados.0.trial187.stdout:3374: done (1 left) 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:3375: copy_from oid 26 from oid 18 current snap is 378 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:3373: finishing rollback tid 0 to trial18717860-12 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:3373: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:3373: finishing rollback tid 2 to trial18717860-12 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1467 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:3373: done (1 left) 2026-02-13T18:20:59.569 INFO:tasks.rados.rados.0.trial187.stdout:3376: snap_remove snap 341 2026-02-13T18:21:00.556 INFO:tasks.rados.rados.0.trial187.stdout:3376: done (1 left) 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3377: copy_from oid 1 from oid 45 current snap is 378 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3375: finishing copy_from racing read to trial18717860-26 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3375: finishing copy_from to trial18717860-26 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 1225 (ObjNum 1091 snap 361 seq_num 1091) dirty exists 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3375: done (1 left) 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3378: copy_from oid 8 from oid 42 current snap is 378 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3379: write (excl) oid 10 current snap is 378 2026-02-13T18:21:00.557 INFO:tasks.rados.rados.0.trial187.stdout:3379: seq_num 1125 ranges {507875=559016,1699066=737045} 2026-02-13T18:21:00.563 INFO:tasks.rados.rados.0.trial187.stdout:3379: writing trial18717860-10 from 507875 to 1066891 tid 1 2026-02-13T18:21:00.573 INFO:tasks.rados.rados.0.trial187.stdout:3379: writing trial18717860-10 from 1699066 to 2436111 tid 2 2026-02-13T18:21:00.573 INFO:tasks.rados.rados.0.trial187.stdout:3380: write (excl) oid 7 current snap is 378 2026-02-13T18:21:00.573 INFO:tasks.rados.rados.0.trial187.stdout:3380: seq_num 1126 ranges {524682=750618,1757548=597056} 2026-02-13T18:21:00.582 INFO:tasks.rados.rados.0.trial187.stdout:3380: writing trial18717860-7 from 524682 to 1275300 tid 1 2026-02-13T18:21:00.590 INFO:tasks.rados.rados.0.trial187.stdout:3380: writing trial18717860-7 from 1757548 to 2354604 tid 2 2026-02-13T18:21:00.590 INFO:tasks.rados.rados.0.trial187.stdout:3381: snap_remove snap 376 2026-02-13T18:21:00.590 INFO:tasks.rados.rados.0.trial187.stdout:3377: finishing copy_from racing read to trial18717860-1 2026-02-13T18:21:00.590 INFO:tasks.rados.rados.0.trial187.stdout:3379: finishing write tid 1 to trial18717860-10 2026-02-13T18:21:01.563 INFO:tasks.rados.rados.0.trial187.stdout:3381: done (4 left) 2026-02-13T18:21:01.563 INFO:tasks.rados.rados.0.trial187.stdout:3382: read oid 32 snap 371 2026-02-13T18:21:01.563 INFO:tasks.rados.rados.0.trial187.stdout:3382: expect (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:21:01.564 INFO:tasks.rados.rados.0.trial187.stdout:3383: write (excl) oid 30 current snap is 378 2026-02-13T18:21:01.564 INFO:tasks.rados.rados.0.trial187.stdout:3383: seq_num 1127 ranges {541489=425867,1416030=740714,2732654=208835} 2026-02-13T18:21:01.569 INFO:tasks.rados.rados.0.trial187.stdout:3383: writing trial18717860-30 from 541489 to 967356 tid 1 2026-02-13T18:21:01.577 INFO:tasks.rados.rados.0.trial187.stdout:3383: writing trial18717860-30 from 1416030 to 2156744 tid 2 2026-02-13T18:21:01.583 INFO:tasks.rados.rados.0.trial187.stdout:3383: writing trial18717860-30 from 2732654 to 2941489 tid 3 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3384: rollback oid 26 current snap is 378 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 26 to 366 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3377: finishing copy_from to trial18717860-1 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 1471 (ObjNum 1117 snap 375 seq_num 1117) dirty exists 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3378: finishing copy_from racing read to trial18717860-8 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3378: finishing copy_from to trial18717860-8 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 1064 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3379: finishing write tid 2 to trial18717860-10 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3379: finishing write tid 3 to trial18717860-10 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3379: finishing write tid 4 to trial18717860-10 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3379: oid 10 updating version 0 to 1469 2026-02-13T18:21:01.584 INFO:tasks.rados.rados.0.trial187.stdout:3379: oid 10 updating version 1469 to 1470 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3379: oid 10 version 1470 is already newer than 1468 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1470 (ObjNum 1125 snap 378 seq_num 1125) dirty exists 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3379: left oid 10 (ObjNum 1125 snap 378 seq_num 1125) 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3380: finishing write tid 1 to trial18717860-7 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3380: finishing write tid 2 to trial18717860-7 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3380: finishing write tid 3 to trial18717860-7 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3377: done (6 left) 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3378: done (5 left) 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3379: done (4 left) 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3385: copy_from oid 36 from oid 25 current snap is 378 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3380: finishing write tid 4 to trial18717860-7 2026-02-13T18:21:01.585 INFO:tasks.rados.rados.0.trial187.stdout:3380: oid 7 updating version 0 to 1285 2026-02-13T18:21:01.586 INFO:tasks.rados.rados.0.trial187.stdout:3380: oid 7 updating version 1285 to 1287 2026-02-13T18:21:01.586 INFO:tasks.rados.rados.0.trial187.stdout:3380: oid 7 version 1287 is already newer than 1286 2026-02-13T18:21:01.586 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1287 (ObjNum 1126 snap 378 seq_num 1126) dirty exists 2026-02-13T18:21:01.586 INFO:tasks.rados.rados.0.trial187.stdout:3380: left oid 7 (ObjNum 1126 snap 378 seq_num 1126) 2026-02-13T18:21:01.586 INFO:tasks.rados.rados.0.trial187.stdout:3382: expect (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:21:01.586 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:01.675 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 696608 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3383: finishing write tid 1 to trial18717860-30 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3383: finishing write tid 2 to trial18717860-30 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3383: finishing write tid 3 to trial18717860-30 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3380: done (4 left) 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3382: done (3 left) 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3386: copy_from oid 10 from oid 14 current snap is 378 2026-02-13T18:21:01.708 INFO:tasks.rados.rados.0.trial187.stdout:3383: finishing write tid 4 to trial18717860-30 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3383: finishing write tid 5 to trial18717860-30 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3383: oid 30 updating version 0 to 2030 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3383: oid 30 updating version 2030 to 2031 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3383: oid 30 updating version 2031 to 2032 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3383: oid 30 version 2032 is already newer than 2029 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 2032 (ObjNum 1127 snap 378 seq_num 1127) dirty exists 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3383: left oid 30 (ObjNum 1127 snap 378 seq_num 1127) 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3384: finishing rollback tid 0 to trial18717860-26 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3384: finishing rollback tid 1 to trial18717860-26 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 26 v 2048 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3385: finishing copy_from racing read to trial18717860-36 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:3385: finishing copy_from to trial18717860-36 2026-02-13T18:21:01.709 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1044 (ObjNum 1107 snap 370 seq_num 1107) dirty exists 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3383: done (3 left) 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3384: done (2 left) 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3385: done (1 left) 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3387: read oid 16 snap -1 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3387: expect (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3388: snap_create 2026-02-13T18:21:01.710 INFO:tasks.rados.rados.0.trial187.stdout:3387: expect (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:21:01.803 INFO:tasks.rados.rados.0.trial187.stdout:3386: finishing copy_from to trial18717860-10 2026-02-13T18:21:01.803 INFO:tasks.rados.rados.0.trial187.stdout:3386: got expected ENOENT (src dne) 2026-02-13T18:21:01.803 INFO:tasks.rados.rados.0.trial187.stdout:3386: finishing copy_from racing read to trial18717860-10 2026-02-13T18:21:02.566 INFO:tasks.rados.rados.0.trial187.stdout:3386: done (2 left) 2026-02-13T18:21:02.566 INFO:tasks.rados.rados.0.trial187.stdout:3387: done (1 left) 2026-02-13T18:21:02.567 INFO:tasks.rados.rados.0.trial187.stdout:3388: done (0 left) 2026-02-13T18:21:02.567 INFO:tasks.rados.rados.0.trial187.stdout:3389: write (excl) oid 17 current snap is 379 2026-02-13T18:21:02.567 INFO:tasks.rados.rados.0.trial187.stdout:3389: seq_num 1128 ranges {558296=501116,1474512=600725,2760077=198219} 2026-02-13T18:21:02.573 INFO:tasks.rados.rados.0.trial187.stdout:3389: writing trial18717860-17 from 558296 to 1059412 tid 1 2026-02-13T18:21:02.579 INFO:tasks.rados.rados.0.trial187.stdout:3389: writing trial18717860-17 from 1474512 to 2075237 tid 2 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3389: writing trial18717860-17 from 2760077 to 2958296 tid 3 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3390: rollback oid 21 current snap is 379 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 350 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3389: finishing write tid 1 to trial18717860-17 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3389: finishing write tid 2 to trial18717860-17 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3391: read oid 27 snap -1 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3391: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:21:02.586 INFO:tasks.rados.rados.0.trial187.stdout:3392: snap_remove snap 364 2026-02-13T18:21:03.567 INFO:tasks.rados.rados.0.trial187.stdout:3392: done (3 left) 2026-02-13T18:21:03.567 INFO:tasks.rados.rados.0.trial187.stdout:3393: snap_remove snap 372 2026-02-13T18:21:04.569 INFO:tasks.rados.rados.0.trial187.stdout:3393: done (3 left) 2026-02-13T18:21:04.569 INFO:tasks.rados.rados.0.trial187.stdout:3394: delete oid 25 current snap is 379 2026-02-13T18:21:04.569 INFO:tasks.rados.rados.0.trial187.stdout:3389: finishing write tid 3 to trial18717860-17 2026-02-13T18:21:04.569 INFO:tasks.rados.rados.0.trial187.stdout:3389: finishing write tid 4 to trial18717860-17 2026-02-13T18:21:04.569 INFO:tasks.rados.rados.0.trial187.stdout:3389: finishing write tid 5 to trial18717860-17 2026-02-13T18:21:04.569 INFO:tasks.rados.rados.0.trial187.stdout:3389: oid 17 updating version 0 to 2052 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3389: oid 17 version 2052 is already newer than 2051 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3389: oid 17 version 2052 is already newer than 2050 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3389: oid 17 version 2052 is already newer than 2049 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2052 (ObjNum 1128 snap 379 seq_num 1128) dirty exists 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3389: left oid 17 (ObjNum 1128 snap 379 seq_num 1128) 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3390: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3390: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3390: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1293 (ObjNum 1055 snap 349 seq_num 1055) dirty exists 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:3391: expect (ObjNum 662 snap 221 seq_num 662) 2026-02-13T18:21:04.570 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:04.634 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 455647 2026-02-13T18:21:04.656 INFO:tasks.rados.rados.0.trial187.stdout:3389: done (3 left) 2026-02-13T18:21:04.656 INFO:tasks.rados.rados.0.trial187.stdout:3390: done (2 left) 2026-02-13T18:21:04.656 INFO:tasks.rados.rados.0.trial187.stdout:3391: done (1 left) 2026-02-13T18:21:04.656 INFO:tasks.rados.rados.0.trial187.stdout:3394: done (0 left) 2026-02-13T18:21:04.656 INFO:tasks.rados.rados.0.trial187.stdout:3395: read oid 12 snap -1 2026-02-13T18:21:04.657 INFO:tasks.rados.rados.0.trial187.stdout:3395: expect (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:21:04.657 INFO:tasks.rados.rados.0.trial187.stdout:3396: rollback oid 7 current snap is 379 2026-02-13T18:21:04.657 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 370 2026-02-13T18:21:04.657 INFO:tasks.rados.rados.0.trial187.stdout:3397: write (excl) oid 29 current snap is 379 2026-02-13T18:21:04.657 INFO:tasks.rados.rados.0.trial187.stdout:3397: seq_num 1130 ranges {591910=651614,1875123=604394} 2026-02-13T18:21:04.664 INFO:tasks.rados.rados.0.trial187.stdout:3397: writing trial18717860-29 from 591910 to 1243524 tid 1 2026-02-13T18:21:04.673 INFO:tasks.rados.rados.0.trial187.stdout:3397: writing trial18717860-29 from 1875123 to 2479517 tid 2 2026-02-13T18:21:04.673 INFO:tasks.rados.rados.0.trial187.stdout:3398: snap_remove snap 378 2026-02-13T18:21:05.557 INFO:tasks.rados.rados.0.trial187.stdout:3398: done (3 left) 2026-02-13T18:21:05.557 INFO:tasks.rados.rados.0.trial187.stdout:3399: rollback oid 27 current snap is 379 2026-02-13T18:21:05.557 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 350 2026-02-13T18:21:05.558 INFO:tasks.rados.rados.0.trial187.stdout:3395: expect (ObjNum 1053 snap 347 seq_num 1053) 2026-02-13T18:21:05.614 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:05.683 INFO:tasks.rados.rados.0.trial187.stdout:3396: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:21:05.683 INFO:tasks.rados.rados.0.trial187.stdout:3396: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3396: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1307 (ObjNum 1046 snap 342 seq_num 1046) dirty exists 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: finishing write tid 1 to trial18717860-29 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: finishing write tid 2 to trial18717860-29 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: finishing write tid 3 to trial18717860-29 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: finishing write tid 4 to trial18717860-29 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: oid 29 updating version 0 to 1633 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: oid 29 updating version 1633 to 1634 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: oid 29 updating version 1634 to 1635 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1635 (ObjNum 1130 snap 379 seq_num 1130) dirty exists 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3397: left oid 29 (ObjNum 1130 snap 379 seq_num 1130) 2026-02-13T18:21:05.684 INFO:tasks.rados.rados.0.trial187.stdout:3399: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3399: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3399: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1048 (ObjNum 662 snap 221 seq_num 662) dirty exists 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3395: done (3 left) 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3396: done (2 left) 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3397: done (1 left) 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3399: done (0 left) 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3400: read oid 9 snap -1 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3400: expect deleted 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3401: read oid 24 snap 329 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3401: expect deleted 2026-02-13T18:21:05.685 INFO:tasks.rados.rados.0.trial187.stdout:3402: snap_create 2026-02-13T18:21:06.850 INFO:tasks.rados.rados.0.trial187.stdout:3400: done (2 left) 2026-02-13T18:21:06.850 INFO:tasks.rados.rados.0.trial187.stdout:3401: done (1 left) 2026-02-13T18:21:06.850 INFO:tasks.rados.rados.0.trial187.stdout:3402: done (0 left) 2026-02-13T18:21:06.851 INFO:tasks.rados.rados.0.trial187.stdout:3403: rollback oid 30 current snap is 380 2026-02-13T18:21:06.851 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 345 2026-02-13T18:21:06.851 INFO:tasks.rados.rados.0.trial187.stdout:3404: write oid 41 current snap is 380 2026-02-13T18:21:06.851 INFO:tasks.rados.rados.0.trial187.stdout:3404: seq_num 1131 ranges {608717=726863,1933605=748052} 2026-02-13T18:21:06.859 INFO:tasks.rados.rados.0.trial187.stdout:3404: writing trial18717860-41 from 608717 to 1335580 tid 1 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:3404: writing trial18717860-41 from 1933605 to 2681657 tid 2 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:3405: delete oid 9 current snap is 380 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:3403: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:3403: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:3403: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 2035 (ObjNum 1049 snap 344 seq_num 1049) dirty exists 2026-02-13T18:21:06.869 INFO:tasks.rados.rados.0.trial187.stdout:3404: finishing write tid 1 to trial18717860-41 2026-02-13T18:21:06.870 INFO:tasks.rados.rados.0.trial187.stdout:3403: done (2 left) 2026-02-13T18:21:06.870 INFO:tasks.rados.rados.0.trial187.stdout:3405: done (1 left) 2026-02-13T18:21:06.870 INFO:tasks.rados.rados.0.trial187.stdout:3406: write oid 29 current snap is 380 2026-02-13T18:21:06.870 INFO:tasks.rados.rados.0.trial187.stdout:3406: seq_num 1133 ranges {642331=593714,1766922=751721} 2026-02-13T18:21:06.878 INFO:tasks.rados.rados.0.trial187.stdout:3406: writing trial18717860-29 from 642331 to 1236045 tid 1 2026-02-13T18:21:06.887 INFO:tasks.rados.rados.0.trial187.stdout:3406: writing trial18717860-29 from 1766922 to 2518643 tid 2 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3407: read oid 40 snap -1 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3407: expect (ObjNum 1120 snap 376 seq_num 1120) 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3408: snap_create 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: finishing write tid 2 to trial18717860-41 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: finishing write tid 3 to trial18717860-41 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: finishing write tid 4 to trial18717860-41 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: oid 41 updating version 0 to 1450 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: oid 41 updating version 1450 to 1451 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: oid 41 updating version 1451 to 1452 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1452 (ObjNum 1131 snap 380 seq_num 1131) dirty exists 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3404: left oid 41 (ObjNum 1131 snap 380 seq_num 1131) 2026-02-13T18:21:06.888 INFO:tasks.rados.rados.0.trial187.stdout:3406: finishing write tid 1 to trial18717860-29 2026-02-13T18:21:06.893 INFO:tasks.rados.rados.0.trial187.stdout:3406: finishing write tid 2 to trial18717860-29 2026-02-13T18:21:06.893 INFO:tasks.rados.rados.0.trial187.stdout:3406: finishing write tid 3 to trial18717860-29 2026-02-13T18:21:06.893 INFO:tasks.rados.rados.0.trial187.stdout:3407: expect (ObjNum 1120 snap 376 seq_num 1120) 2026-02-13T18:21:06.950 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 962046 2026-02-13T18:21:07.000 INFO:tasks.rados.rados.0.trial187.stdout:3406: finishing write tid 4 to trial18717860-29 2026-02-13T18:21:07.000 INFO:tasks.rados.rados.0.trial187.stdout:3406: oid 29 updating version 0 to 1638 2026-02-13T18:21:07.000 INFO:tasks.rados.rados.0.trial187.stdout:3406: oid 29 version 1638 is already newer than 1637 2026-02-13T18:21:07.000 INFO:tasks.rados.rados.0.trial187.stdout:3406: oid 29 version 1638 is already newer than 1636 2026-02-13T18:21:07.000 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1638 (ObjNum 1133 snap 380 seq_num 1133) dirty exists 2026-02-13T18:21:07.000 INFO:tasks.rados.rados.0.trial187.stdout:3406: left oid 29 (ObjNum 1133 snap 380 seq_num 1133) 2026-02-13T18:21:07.859 INFO:tasks.rados.rados.0.trial187.stdout:3404: done (3 left) 2026-02-13T18:21:07.859 INFO:tasks.rados.rados.0.trial187.stdout:3406: done (2 left) 2026-02-13T18:21:07.859 INFO:tasks.rados.rados.0.trial187.stdout:3407: done (1 left) 2026-02-13T18:21:07.859 INFO:tasks.rados.rados.0.trial187.stdout:3408: done (0 left) 2026-02-13T18:21:07.859 INFO:tasks.rados.rados.0.trial187.stdout:3409: read oid 5 snap -1 2026-02-13T18:21:07.860 INFO:tasks.rados.rados.0.trial187.stdout:3409: expect (ObjNum 1112 snap 373 seq_num 1112) 2026-02-13T18:21:07.860 INFO:tasks.rados.rados.0.trial187.stdout:3410: delete oid 31 current snap is 381 2026-02-13T18:21:07.862 INFO:tasks.rados.rados.0.trial187.stdout:3410: done (1 left) 2026-02-13T18:21:07.862 INFO:tasks.rados.rados.0.trial187.stdout:3411: rollback oid 15 current snap is 381 2026-02-13T18:21:07.862 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 377 2026-02-13T18:21:07.862 INFO:tasks.rados.rados.0.trial187.stdout:3412: write oid 31 current snap is 381 2026-02-13T18:21:07.862 INFO:tasks.rados.rados.0.trial187.stdout:3412: seq_num 1135 ranges {675945=744212,2167533=755390} 2026-02-13T18:21:07.871 INFO:tasks.rados.rados.0.trial187.stdout:3412: writing trial18717860-31 from 675945 to 1420157 tid 1 2026-02-13T18:21:07.882 INFO:tasks.rados.rados.0.trial187.stdout:3412: writing trial18717860-31 from 2167533 to 2922923 tid 2 2026-02-13T18:21:07.882 INFO:tasks.rados.rados.0.trial187.stdout:3413: write oid 44 current snap is 381 2026-02-13T18:21:07.882 INFO:tasks.rados.rados.0.trial187.stdout:3413: seq_num 1136 ranges {692752=419461,1826015=615401,2979461=113291} 2026-02-13T18:21:07.889 INFO:tasks.rados.rados.0.trial187.stdout:3413: writing trial18717860-44 from 692752 to 1112213 tid 1 2026-02-13T18:21:07.898 INFO:tasks.rados.rados.0.trial187.stdout:3413: writing trial18717860-44 from 1826015 to 2441416 tid 2 2026-02-13T18:21:07.903 INFO:tasks.rados.rados.0.trial187.stdout:3413: writing trial18717860-44 from 2979461 to 3092752 tid 3 2026-02-13T18:21:07.903 INFO:tasks.rados.rados.0.trial187.stdout:3414: copy_from oid 12 from oid 41 current snap is 381 2026-02-13T18:21:07.903 INFO:tasks.rados.rados.0.trial187.stdout:3409: expect (ObjNum 1112 snap 373 seq_num 1112) 2026-02-13T18:21:07.903 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:08.043 INFO:tasks.rados.rados.0.trial187.stdout:3411: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:21:08.043 INFO:tasks.rados.rados.0.trial187.stdout:3411: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3411: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1641 (ObjNum 1047 snap 342 seq_num 1047) dirty exists 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: finishing write tid 1 to trial18717860-31 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: finishing write tid 2 to trial18717860-31 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: finishing write tid 3 to trial18717860-31 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: finishing write tid 4 to trial18717860-31 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: oid 31 updating version 0 to 1033 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: oid 31 updating version 1033 to 1035 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: oid 31 version 1035 is already newer than 1034 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1035 (ObjNum 1135 snap 381 seq_num 1135) dirty exists 2026-02-13T18:21:08.044 INFO:tasks.rados.rados.0.trial187.stdout:3412: left oid 31 (ObjNum 1135 snap 381 seq_num 1135) 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: finishing write tid 1 to trial18717860-44 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: finishing write tid 2 to trial18717860-44 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: finishing write tid 3 to trial18717860-44 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: finishing write tid 4 to trial18717860-44 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: finishing write tid 5 to trial18717860-44 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: oid 44 updating version 0 to 2202 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: oid 44 version 2202 is already newer than 2201 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: oid 44 updating version 2202 to 2203 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: oid 44 updating version 2203 to 2204 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2204 (ObjNum 1136 snap 381 seq_num 1136) dirty exists 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3413: left oid 44 (ObjNum 1136 snap 381 seq_num 1136) 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3414: finishing copy_from racing read to trial18717860-12 2026-02-13T18:21:08.045 INFO:tasks.rados.rados.0.trial187.stdout:3414: finishing copy_from to trial18717860-12 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1452 (ObjNum 1131 snap 380 seq_num 1131) dirty exists 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3409: done (4 left) 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3411: done (3 left) 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3412: done (2 left) 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3413: done (1 left) 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3414: done (0 left) 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3415: read oid 25 snap -1 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3415: expect deleted 2026-02-13T18:21:08.046 INFO:tasks.rados.rados.0.trial187.stdout:3416: snap_create 2026-02-13T18:21:08.860 INFO:tasks.rados.rados.0.trial187.stdout:3415: done (1 left) 2026-02-13T18:21:08.860 INFO:tasks.rados.rados.0.trial187.stdout:3416: done (0 left) 2026-02-13T18:21:08.860 INFO:tasks.rados.rados.0.trial187.stdout:3417: read oid 8 snap 377 2026-02-13T18:21:08.860 INFO:tasks.rados.rados.0.trial187.stdout:3417: expect (ObjNum 1051 snap 347 seq_num 1051) 2026-02-13T18:21:08.860 INFO:tasks.rados.rados.0.trial187.stdout:3418: write oid 48 current snap is 382 2026-02-13T18:21:08.860 INFO:tasks.rados.rados.0.trial187.stdout:3418: seq_num 1137 ranges {709559=494710,1884497=759059} 2026-02-13T18:21:08.867 INFO:tasks.rados.rados.0.trial187.stdout:3418: writing trial18717860-48 from 709559 to 1204269 tid 1 2026-02-13T18:21:08.877 INFO:tasks.rados.rados.0.trial187.stdout:3418: writing trial18717860-48 from 1884497 to 2643556 tid 2 2026-02-13T18:21:08.878 INFO:tasks.rados.rados.0.trial187.stdout:3419: write oid 20 current snap is 382 2026-02-13T18:21:08.878 INFO:tasks.rados.rados.0.trial187.stdout:3419: seq_num 1138 ranges {726366=569959,1826626=502717,2801601=324765} 2026-02-13T18:21:08.886 INFO:tasks.rados.rados.0.trial187.stdout:3419: writing trial18717860-20 from 726366 to 1296325 tid 1 2026-02-13T18:21:08.893 INFO:tasks.rados.rados.0.trial187.stdout:3419: writing trial18717860-20 from 1826626 to 2329343 tid 2 2026-02-13T18:21:08.898 INFO:tasks.rados.rados.0.trial187.stdout:3419: writing trial18717860-20 from 2801601 to 3126366 tid 3 2026-02-13T18:21:08.898 INFO:tasks.rados.rados.0.trial187.stdout:3420: write (excl) oid 2 current snap is 382 2026-02-13T18:21:08.898 INFO:tasks.rados.rados.0.trial187.stdout:3420: seq_num 1139 ranges {743173=645208,1885108=762728} 2026-02-13T18:21:08.906 INFO:tasks.rados.rados.0.trial187.stdout:3420: writing trial18717860-2 from 743173 to 1388381 tid 1 2026-02-13T18:21:08.911 INFO:tasks.rados.rados.0.trial187.stdout:3420: writing trial18717860-2 from 1885108 to 2647836 tid 2 2026-02-13T18:21:08.911 INFO:tasks.rados.rados.0.trial187.stdout:3421: write (excl) oid 28 current snap is 382 2026-02-13T18:21:08.911 INFO:tasks.rados.rados.0.trial187.stdout:3421: seq_num 1140 ranges {759980=720457,1943590=506386,2856447=303533} 2026-02-13T18:21:08.916 INFO:tasks.rados.rados.0.trial187.stdout:3421: writing trial18717860-28 from 759980 to 1480437 tid 1 2026-02-13T18:21:08.920 INFO:tasks.rados.rados.0.trial187.stdout:3421: writing trial18717860-28 from 1943590 to 2449976 tid 2 2026-02-13T18:21:08.923 INFO:tasks.rados.rados.0.trial187.stdout:3421: writing trial18717860-28 from 2856447 to 3159980 tid 3 2026-02-13T18:21:08.923 INFO:tasks.rados.rados.0.trial187.stdout:3422: copy_from oid 27 from oid 42 current snap is 382 2026-02-13T18:21:08.923 INFO:tasks.rados.rados.0.trial187.stdout:3417: expect (ObjNum 1051 snap 347 seq_num 1051) 2026-02-13T18:21:09.000 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2726796 2026-02-13T18:21:09.012 INFO:tasks.rados.rados.0.trial187.stdout:3418: finishing write tid 1 to trial18717860-48 2026-02-13T18:21:09.012 INFO:tasks.rados.rados.0.trial187.stdout:3418: finishing write tid 2 to trial18717860-48 2026-02-13T18:21:09.012 INFO:tasks.rados.rados.0.trial187.stdout:3418: finishing write tid 3 to trial18717860-48 2026-02-13T18:21:09.012 INFO:tasks.rados.rados.0.trial187.stdout:3418: finishing write tid 4 to trial18717860-48 2026-02-13T18:21:09.012 INFO:tasks.rados.rados.0.trial187.stdout:3418: oid 48 updating version 0 to 2205 2026-02-13T18:21:09.012 INFO:tasks.rados.rados.0.trial187.stdout:3418: oid 48 updating version 2205 to 2206 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3418: oid 48 updating version 2206 to 2207 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 2207 (ObjNum 1137 snap 382 seq_num 1137) dirty exists 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3418: left oid 48 (ObjNum 1137 snap 382 seq_num 1137) 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: finishing write tid 1 to trial18717860-20 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: finishing write tid 2 to trial18717860-20 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: finishing write tid 3 to trial18717860-20 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: finishing write tid 4 to trial18717860-20 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: finishing write tid 5 to trial18717860-20 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: oid 20 updating version 0 to 1637 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: oid 20 version 1637 is already newer than 1636 2026-02-13T18:21:09.013 INFO:tasks.rados.rados.0.trial187.stdout:3419: oid 20 updating version 1637 to 1638 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3419: oid 20 updating version 1638 to 1639 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1639 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3419: left oid 20 (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: finishing write tid 1 to trial18717860-2 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: finishing write tid 2 to trial18717860-2 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: finishing write tid 3 to trial18717860-2 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: finishing write tid 4 to trial18717860-2 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: oid 2 updating version 0 to 1228 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: oid 2 updating version 1228 to 1230 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: oid 2 version 1230 is already newer than 1229 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1230 (ObjNum 1139 snap 382 seq_num 1139) dirty exists 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3420: left oid 2 (ObjNum 1139 snap 382 seq_num 1139) 2026-02-13T18:21:09.014 INFO:tasks.rados.rados.0.trial187.stdout:3421: finishing write tid 1 to trial18717860-28 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: finishing write tid 2 to trial18717860-28 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: finishing write tid 3 to trial18717860-28 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: finishing write tid 4 to trial18717860-28 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: finishing write tid 5 to trial18717860-28 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: oid 28 updating version 0 to 1647 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: oid 28 version 1647 is already newer than 1645 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: oid 28 version 1647 is already newer than 1646 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: oid 28 updating version 1647 to 1648 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1648 (ObjNum 1140 snap 382 seq_num 1140) dirty exists 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3421: left oid 28 (ObjNum 1140 snap 382 seq_num 1140) 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3422: finishing copy_from racing read to trial18717860-27 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:3422: finishing copy_from to trial18717860-27 2026-02-13T18:21:09.015 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1064 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3417: done (5 left) 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3418: done (4 left) 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3419: done (3 left) 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3420: done (2 left) 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3421: done (1 left) 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3422: done (0 left) 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3423: write oid 11 current snap is 382 2026-02-13T18:21:09.016 INFO:tasks.rados.rados.0.trial187.stdout:3423: seq_num 1141 ranges {776787=512059,1718425=766397,3000223=176564} 2026-02-13T18:21:09.017 INFO:tasks.rados.rados.0.trial187.stdout:3423: writing trial18717860-11 from 776787 to 1288846 tid 1 2026-02-13T18:21:09.021 INFO:tasks.rados.rados.0.trial187.stdout:3423: writing trial18717860-11 from 1718425 to 2484822 tid 2 2026-02-13T18:21:09.024 INFO:tasks.rados.rados.0.trial187.stdout:3423: writing trial18717860-11 from 3000223 to 3176787 tid 3 2026-02-13T18:21:09.024 INFO:tasks.rados.rados.0.trial187.stdout:3424: read oid 14 snap 350 2026-02-13T18:21:09.024 INFO:tasks.rados.rados.0.trial187.stdout:3424: expect deleted 2026-02-13T18:21:09.024 INFO:tasks.rados.rados.0.trial187.stdout:3425: write (excl) oid 27 current snap is 382 2026-02-13T18:21:09.024 INFO:tasks.rados.rados.0.trial187.stdout:3425: seq_num 1142 ranges {793594=587308,2060554=510055} 2026-02-13T18:21:09.029 INFO:tasks.rados.rados.0.trial187.stdout:3425: writing trial18717860-27 from 793594 to 1380902 tid 1 2026-02-13T18:21:09.034 INFO:tasks.rados.rados.0.trial187.stdout:3425: writing trial18717860-27 from 2060554 to 2570609 tid 2 2026-02-13T18:21:09.034 INFO:tasks.rados.rados.0.trial187.stdout:3426: snap_remove snap 371 2026-02-13T18:21:09.861 INFO:tasks.rados.rados.0.trial187.stdout:3426: done (3 left) 2026-02-13T18:21:09.861 INFO:tasks.rados.rados.0.trial187.stdout:3427: write (excl) oid 34 current snap is 382 2026-02-13T18:21:09.861 INFO:tasks.rados.rados.0.trial187.stdout:3423: finishing write tid 1 to trial18717860-11 2026-02-13T18:21:09.861 INFO:tasks.rados.rados.0.trial187.stdout:3427: seq_num 1143 ranges {410401=662557,1719036=770066,2938716=271685} 2026-02-13T18:21:09.865 INFO:tasks.rados.rados.0.trial187.stdout:3427: writing trial18717860-34 from 410401 to 1072958 tid 1 2026-02-13T18:21:09.870 INFO:tasks.rados.rados.0.trial187.stdout:3427: writing trial18717860-34 from 1719036 to 2489102 tid 2 2026-02-13T18:21:09.873 INFO:tasks.rados.rados.0.trial187.stdout:3427: writing trial18717860-34 from 2938716 to 3210401 tid 3 2026-02-13T18:21:09.873 INFO:tasks.rados.rados.0.trial187.stdout:3428: write oid 40 current snap is 382 2026-02-13T18:21:09.873 INFO:tasks.rados.rados.0.trial187.stdout:3428: seq_num 1144 ranges {427208=737806,1777518=513724,2966139=261069} 2026-02-13T18:21:09.877 INFO:tasks.rados.rados.0.trial187.stdout:3428: writing trial18717860-40 from 427208 to 1165014 tid 1 2026-02-13T18:21:09.882 INFO:tasks.rados.rados.0.trial187.stdout:3428: writing trial18717860-40 from 1777518 to 2291242 tid 2 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3428: writing trial18717860-40 from 2966139 to 3227208 tid 3 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3429: read oid 44 snap 345 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3429: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3430: read oid 1 snap -1 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3430: expect (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3431: delete oid 16 current snap is 382 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3423: finishing write tid 2 to trial18717860-11 2026-02-13T18:21:09.887 INFO:tasks.rados.rados.0.trial187.stdout:3423: finishing write tid 3 to trial18717860-11 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: finishing write tid 4 to trial18717860-11 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: finishing write tid 5 to trial18717860-11 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: oid 11 updating version 0 to 1458 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: oid 11 version 1458 is already newer than 1457 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: oid 11 version 1458 is already newer than 1455 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: oid 11 version 1458 is already newer than 1456 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1458 (ObjNum 1141 snap 382 seq_num 1141) dirty exists 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3423: left oid 11 (ObjNum 1141 snap 382 seq_num 1141) 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3425: finishing write tid 1 to trial18717860-27 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3425: finishing write tid 2 to trial18717860-27 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3425: finishing write tid 3 to trial18717860-27 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3425: finishing write tid 4 to trial18717860-27 2026-02-13T18:21:09.888 INFO:tasks.rados.rados.0.trial187.stdout:3425: oid 27 updating version 0 to 1067 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3425: oid 27 version 1067 is already newer than 1065 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3425: oid 27 version 1067 is already newer than 1066 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1067 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3425: left oid 27 (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: finishing write tid 1 to trial18717860-34 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: finishing write tid 2 to trial18717860-34 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: finishing write tid 3 to trial18717860-34 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: finishing write tid 4 to trial18717860-34 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: finishing write tid 5 to trial18717860-34 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: oid 34 updating version 0 to 1460 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: oid 34 updating version 1460 to 1462 2026-02-13T18:21:09.889 INFO:tasks.rados.rados.0.trial187.stdout:3427: oid 34 version 1462 is already newer than 1459 2026-02-13T18:21:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3427: oid 34 version 1462 is already newer than 1461 2026-02-13T18:21:09.890 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1462 (ObjNum 1143 snap 382 seq_num 1143) dirty exists 2026-02-13T18:21:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3427: left oid 34 (ObjNum 1143 snap 382 seq_num 1143) 2026-02-13T18:21:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3428: finishing write tid 1 to trial18717860-40 2026-02-13T18:21:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3428: finishing write tid 2 to trial18717860-40 2026-02-13T18:21:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3423: done (7 left) 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3424: done (6 left) 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3425: done (5 left) 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3427: done (4 left) 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3431: done (3 left) 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3432: read oid 45 snap -1 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3432: expect (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3433: write (excl) oid 33 current snap is 382 2026-02-13T18:21:09.891 INFO:tasks.rados.rados.0.trial187.stdout:3433: seq_num 1146 ranges {460822=488304,1378129=517393,2504632=405962} 2026-02-13T18:21:09.892 INFO:tasks.rados.rados.0.trial187.stdout:3433: writing trial18717860-33 from 460822 to 949126 tid 1 2026-02-13T18:21:09.895 INFO:tasks.rados.rados.0.trial187.stdout:3433: writing trial18717860-33 from 1378129 to 1895522 tid 2 2026-02-13T18:21:09.899 INFO:tasks.rados.rados.0.trial187.stdout:3433: writing trial18717860-33 from 2504632 to 2910594 tid 3 2026-02-13T18:21:09.899 INFO:tasks.rados.rados.0.trial187.stdout:3434: write oid 24 current snap is 382 2026-02-13T18:21:09.899 INFO:tasks.rados.rados.0.trial187.stdout:3434: seq_num 1147 ranges {477629=563553,1836611=777404,3048408=229221} 2026-02-13T18:21:09.903 INFO:tasks.rados.rados.0.trial187.stdout:3434: writing trial18717860-24 from 477629 to 1041182 tid 1 2026-02-13T18:21:09.909 INFO:tasks.rados.rados.0.trial187.stdout:3434: writing trial18717860-24 from 1836611 to 2614015 tid 2 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3434: writing trial18717860-24 from 3048408 to 3277629 tid 3 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3435: delete oid 50 current snap is 382 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3428: finishing write tid 3 to trial18717860-40 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3428: finishing write tid 4 to trial18717860-40 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3428: finishing write tid 5 to trial18717860-40 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3428: oid 40 updating version 0 to 1477 2026-02-13T18:21:09.912 INFO:tasks.rados.rados.0.trial187.stdout:3428: oid 40 updating version 1477 to 1478 2026-02-13T18:21:09.913 INFO:tasks.rados.rados.0.trial187.stdout:3428: oid 40 updating version 1478 to 1479 2026-02-13T18:21:09.913 INFO:tasks.rados.rados.0.trial187.stdout:3428: oid 40 version 1479 is already newer than 1476 2026-02-13T18:21:09.913 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1479 (ObjNum 1144 snap 382 seq_num 1144) dirty exists 2026-02-13T18:21:09.913 INFO:tasks.rados.rados.0.trial187.stdout:3428: left oid 40 (ObjNum 1144 snap 382 seq_num 1144) 2026-02-13T18:21:09.913 INFO:tasks.rados.rados.0.trial187.stdout:3430: expect (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:21:09.964 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 537969 2026-02-13T18:21:09.983 INFO:tasks.rados.rados.0.trial187.stdout:3432: expect (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:21:09.986 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1837571 2026-02-13T18:21:09.997 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:10.040 INFO:tasks.rados.rados.0.trial187.stdout:3429: expect (ObjNum 945 snap 307 seq_num 945) 2026-02-13T18:21:10.041 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:10.193 INFO:tasks.rados.rados.0.trial187.stdout:3433: finishing write tid 1 to trial18717860-33 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: finishing write tid 2 to trial18717860-33 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: finishing write tid 3 to trial18717860-33 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: finishing write tid 4 to trial18717860-33 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: finishing write tid 5 to trial18717860-33 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: oid 33 updating version 0 to 2217 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: oid 33 version 2217 is already newer than 2216 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: oid 33 version 2217 is already newer than 2215 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:3433: oid 33 updating version 2217 to 2218 2026-02-13T18:21:10.194 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2218 (ObjNum 1146 snap 382 seq_num 1146) dirty exists 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3433: left oid 33 (ObjNum 1146 snap 382 seq_num 1146) 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: finishing write tid 1 to trial18717860-24 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: finishing write tid 2 to trial18717860-24 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: finishing write tid 3 to trial18717860-24 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: finishing write tid 4 to trial18717860-24 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: finishing write tid 5 to trial18717860-24 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: oid 24 updating version 0 to 1650 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: oid 24 updating version 1650 to 1652 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: oid 24 version 1652 is already newer than 1651 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: oid 24 version 1652 is already newer than 1649 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 1652 (ObjNum 1147 snap 382 seq_num 1147) dirty exists 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3434: left oid 24 (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:21:10.195 INFO:tasks.rados.rados.0.trial187.stdout:3428: done (6 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3429: done (5 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3430: done (4 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3432: done (3 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3433: done (2 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3434: done (1 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3435: done (0 left) 2026-02-13T18:21:10.196 INFO:tasks.rados.rados.0.trial187.stdout:3436: snap_create 2026-02-13T18:21:10.559 INFO:tasks.rados.rados.0.trial187.stdout:3436: done (0 left) 2026-02-13T18:21:10.559 INFO:tasks.rados.rados.0.trial187.stdout:3437: read oid 27 snap -1 2026-02-13T18:21:10.559 INFO:tasks.rados.rados.0.trial187.stdout:3437: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:21:10.559 INFO:tasks.rados.rados.0.trial187.stdout:3438: write (excl) oid 31 current snap is 383 2026-02-13T18:21:10.559 INFO:tasks.rados.rados.0.trial187.stdout:3438: seq_num 1149 ranges {511243=430404,1669928=664720,3103254=207989} 2026-02-13T18:21:10.565 INFO:tasks.rados.rados.0.trial187.stdout:3438: writing trial18717860-31 from 511243 to 941647 tid 1 2026-02-13T18:21:10.574 INFO:tasks.rados.rados.0.trial187.stdout:3438: writing trial18717860-31 from 1669928 to 2334648 tid 2 2026-02-13T18:21:10.581 INFO:tasks.rados.rados.0.trial187.stdout:3438: writing trial18717860-31 from 3103254 to 3311243 tid 3 2026-02-13T18:21:10.581 INFO:tasks.rados.rados.0.trial187.stdout:3439: snap_remove snap 382 2026-02-13T18:21:11.429 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:21:11.429 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T18:21:11.429 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T18:21:11.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T18:21:11.432 INFO:tasks.ceph.mon.a:Started 2026-02-13T18:21:11.432 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:21:11.432 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:21:11.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.481+0000 7f0ec0435640 10 monclient: get_monmap_and_config 2026-02-13T18:21:11.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.481+0000 7f0ec0435640 10 monclient: build_initial_monmap 2026-02-13T18:21:11.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.481+0000 7f0ec0435640 10 monclient: monmap: 2026-02-13T18:21:11.494 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:11.485153+0000 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:11.485153+0000 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.481+0000 7f0ec0435640 1 Processor -- start 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.481+0000 7f0ec0435640 1 -- start start 2026-02-13T18:21:11.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.481+0000 7f0ec0435640 10 monclient: init 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient(hunting): picked mon.noname-a con 0x7f0eb808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient(hunting): picked mon.noname-c con 0x7f0eb808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient(hunting): picked mon.noname-b con 0x7f0eb808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb8089e80 con 0x7f0eb808c2f0 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb8088c20 con 0x7f0eb808dc80 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb8089ba0 con 0x7f0eb808cdd0 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient(hunting): authenticate will time out at 1502.540264s 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebe1aa640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0eb808c2f0 0x7f0eb808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59188/0 (socket says 10.20.193.78:59188) 2026-02-13T18:21:11.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebe1aa640 1 -- 10.20.193.78:0/1019267699 learned_addr learned my addr 10.20.193.78:0/1019267699 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:11.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebe1aa640 1 -- 10.20.193.78:0/1019267699 >> v1:10.20.193.78:6789/0 conn(0x7f0eb808c2f0 legacy=0x7f0eb808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebe9ab640 1 -- 10.20.193.78:0/1019267699 >> v1:10.20.193.78:6790/0 conn(0x7f0eb808cdd0 legacy=0x7f0eb81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189838573 0 0) 0x7f0eb8089ba0 con 0x7f0eb808cdd0 2026-02-13T18:21:11.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): _negotiate 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): my global_id is 104294 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd9a9640 1 -- 10.20.193.78:0/1019267699 >> v1:10.20.193.187:6789/0 conn(0x7f0eb808dc80 legacy=0x7f0eb8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea0003620 con 0x7f0eb808cdd0 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022344215 0 0) 0x7f0eb8088c20 con 0x7f0eb808dc80 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): _negotiate 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient(hunting): my global_id is 114154 2026-02-13T18:21:11.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0eb8089ba0 con 0x7f0eb808dc80 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4090262990 0 0) 0x7f0ea0003620 con 0x7f0eb808cdd0 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 >> v1:10.20.193.187:6789/0 conn(0x7f0eb808dc80 legacy=0x7f0eb8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 >> v1:10.20.193.78:6789/0 conn(0x7f0eb808c2f0 legacy=0x7f0eb808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: _finish_hunting 0 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 monclient: found mon.noname-b 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb808d370 con 0x7f0eb808cdd0 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: _finish_auth 0 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: _check_auth_tickets 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:11.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 5 monclient: authenticate success, global_id 104294 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0eb4004620 con 0x7f0eb808cdd0 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: dump: 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.505 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0eb40048b0 con 0x7f0eb808cdd0 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 1 -- 10.20.193.78:0/1019267699 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0eb4004dd0 con 0x7f0eb808cdd0 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ebd1a8640 10 monclient: dump: 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.506 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 4 set_mon_vals no callback set 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: shutdown 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:11.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- 10.20.193.78:0/1019267699 >> v1:10.20.193.78:6790/0 conn(0x7f0eb808cdd0 legacy=0x7f0eb81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- 10.20.193.78:0/1019267699 shutdown_connections 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- 10.20.193.78:0/1019267699 >> 10.20.193.78:0/1019267699 conn(0x7f0eb8091720 msgr2=0x7f0eb8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- 10.20.193.78:0/1019267699 shutdown_connections 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- 10.20.193.78:0/1019267699 wait complete. 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: build_initial_monmap 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: monmap: 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:11.508 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 Processor -- start 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 1 -- start start 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.485+0000 7f0ec0435640 10 monclient: init 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient(hunting): picked mon.noname-c con 0x7f0eb808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient(hunting): picked mon.noname-b con 0x7f0eb808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient(hunting): picked mon.noname-a con 0x7f0eb808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:11.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb8081ac0 con 0x7f0eb808dc80 2026-02-13T18:21:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb8085af0 con 0x7f0eb808cdd0 2026-02-13T18:21:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb8088910 con 0x7f0eb808c2f0 2026-02-13T18:21:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient(hunting): authenticate will time out at 1502.544221s 2026-02-13T18:21:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ebe1aa640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0eb808c2f0 0x7f0eb8083890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39404/0 (socket says 10.20.193.78:39404) 2026-02-13T18:21:11.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ebe1aa640 1 -- 10.20.193.78:0/1657439305 learned_addr learned my addr 10.20.193.78:0/1657439305 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ebe1aa640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.78:6790/0 conn(0x7f0eb808c2f0 legacy=0x7f0eb8083890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ebe9ab640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.78:6789/0 conn(0x7f0eb808dc80 legacy=0x7f0eb8195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881535416 0 0) 0x7f0eb8088910 con 0x7f0eb808c2f0 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): my global_id is 104297 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e88003620 con 0x7f0eb808c2f0 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ebd9a9640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.187:6789/0 conn(0x7f0eb808cdd0 legacy=0x7f0eb8194330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4125353683 0 0) 0x7f0e88003620 con 0x7f0eb808c2f0 2026-02-13T18:21:11.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0eb8088910 con 0x7f0eb808c2f0 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0ea8003330 con 0x7f0eb808c2f0 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): dump: 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.512 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 971685077 0 0) 0x7f0eb8088910 con 0x7f0eb808c2f0 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.187:6789/0 conn(0x7f0eb808cdd0 legacy=0x7f0eb8194330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.78:6789/0 conn(0x7f0eb808dc80 legacy=0x7f0eb8195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: _finish_hunting 0 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 monclient: found mon.c 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb8080000 con 0x7f0eb808c2f0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: _finish_auth 0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: _check_auth_tickets 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 5 monclient: authenticate success, global_id 104297 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _renew_subs 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb8082360 con 0x7f0eb808c2f0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _renew_subs 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0eb8083fa0 con 0x7f0eb808c2f0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ea8003550 con 0x7f0eb808c2f0 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:11.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0ea8004db0 con 0x7f0eb808c2f0 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 10 monclient: dump: 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.515 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ebc9a7640 4 set_mon_vals no callback set 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb808f620 con 0x7f0eb808c2f0 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0ea8005080 con 0x7f0eb808c2f0 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.489+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(777..777 src has 621..777) ==== 3991+0+0 (unknown 3366792250 0 0) 0x7f0ea804c7d0 con 0x7f0eb808c2f0 2026-02-13T18:21:11.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.493+0000 7f0ebd9a9640 10 monclient: get_auth_request con 0x7f0e8803d450 auth_method 0 2026-02-13T18:21:11.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.497+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f0eb808f620 con 0x7f0eb808c2f0 2026-02-13T18:21:11.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.497+0000 7f0e9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:11.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.497+0000 7f0e9effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0eb8090810 con 0x7f0eb808c2f0 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0e9effd640 1 -- 10.20.193.78:0/1657439305 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1575143772) 0x7f0ea8017730 con 0x7f0eb808c2f0 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0e9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:21:11.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0e9effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:11.629 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.187:6812/2668687789 conn(0x7f0e8803d450 legacy=0x7f0e8805d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 10 monclient: shutdown 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 >> v1:10.20.193.78:6790/0 conn(0x7f0eb808c2f0 legacy=0x7f0eb8083890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 shutdown_connections 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 >> 10.20.193.78:0/1657439305 conn(0x7f0eb8091720 msgr2=0x7f0eb805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 shutdown_connections 2026-02-13T18:21:11.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.617+0000 7f0ec0435640 1 -- 10.20.193.78:0/1657439305 wait complete. 2026-02-13T18:21:11.640 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:21:11.640 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:21:11.640 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:21:11.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.689+0000 7f2fa1c5c640 10 monclient: get_monmap_and_config 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.689+0000 7f2fa1c5c640 10 monclient: build_initial_monmap 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.689+0000 7f2fa1c5c640 10 monclient: monmap: 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:11.693378+0000 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:11.693378+0000 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.704 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 1 Processor -- start 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 1 -- start start 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient: init 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient(hunting): picked mon.noname-b con 0x7f2f9c08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient(hunting): picked mon.noname-c con 0x7f2f9c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient(hunting): picked mon.noname-a con 0x7f2f9c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:11.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c089e80 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c088c20 con 0x7f2f9c08dc80 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c089ba0 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient(hunting): authenticate will time out at 1502.748525s 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f2f9c08c2f0 0x7f2f9c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39416/0 (socket says 10.20.193.78:39416) 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9b7fe640 1 -- 10.20.193.78:0/2231171752 learned_addr learned my addr 10.20.193.78:0/2231171752 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:11.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9bfff640 1 --1- 10.20.193.78:0/2231171752 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c08cdd0 0x7f2f9c1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59208/0 (socket says 10.20.193.78:59208) 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9b7fe640 1 -- 10.20.193.78:0/2231171752 >> v1:10.20.193.78:6790/0 conn(0x7f2f9c08c2f0 legacy=0x7f2f9c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9bfff640 1 -- 10.20.193.78:0/2231171752 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c08cdd0 legacy=0x7f2f9c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801635134 0 0) 0x7f2f9c089ba0 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient(hunting): my global_id is 104300 2026-02-13T18:21:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9affd640 1 -- 10.20.193.78:0/2231171752 >> v1:10.20.193.187:6789/0 conn(0x7f2f9c08dc80 legacy=0x7f2f9c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f80003620 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3514181981 0 0) 0x7f2f80003620 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 >> v1:10.20.193.187:6789/0 conn(0x7f2f9c08dc80 legacy=0x7f2f9c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c08cdd0 legacy=0x7f2f9c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 monclient: found mon.noname-b 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c08d370 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:21:11.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f88003110 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 5 monclient: authenticate success, global_id 104300 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: dump: 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.716 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f880033e0 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 1 -- 10.20.193.78:0/2231171752 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f88004b50 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2fa1c5c640 4 set_mon_vals no callback set 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.693+0000 7f2f9a7fc640 10 monclient: dump: 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.718 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: shutdown 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/2231171752 >> v1:10.20.193.78:6790/0 conn(0x7f2f9c08c2f0 legacy=0x7f2f9c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/2231171752 shutdown_connections 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/2231171752 >> 10.20.193.78:0/2231171752 conn(0x7f2f9c091720 msgr2=0x7f2f9c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/2231171752 shutdown_connections 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/2231171752 wait complete. 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: build_initial_monmap 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: monmap: 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:11.719 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 Processor -- start 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- start start 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: init 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:11.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient(hunting): picked mon.noname-b con 0x7f2f9c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient(hunting): picked mon.noname-c con 0x7f2f9c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient(hunting): picked mon.noname-a con 0x7f2f9c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c0816d0 con 0x7f2f9c08dc80 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c082410 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9c07f7f0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient(hunting): authenticate will time out at 1502.752966s 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f9bfff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f2f9c08dc80 0x7f2f9c195e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59224/0 (socket says 10.20.193.78:59224) 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f9bfff640 1 -- 10.20.193.78:0/447400177 learned_addr learned my addr 10.20.193.78:0/447400177 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f9bfff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c08dc80 legacy=0x7f2f9c195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f9affd640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6790/0 conn(0x7f2f9c08cdd0 legacy=0x7f2f9c07f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f9b7fe640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.187:6789/0 conn(0x7f2f9c08c2f0 legacy=0x7f2f9c07e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142585772 0 0) 0x7f2f9c07f7f0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): my global_id is 104303 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f6c003620 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f9b7fe640 1 --1- 10.20.193.78:0/447400177 >> v1:10.20.193.187:6789/0 conn(0x7f2f9c08c2f0 0x7f2f9c07e9d0 :-1 s=OPENED pgs=602 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f2f9c082410 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3086816302 0 0) 0x7f2f6c003620 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f9c07f7f0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f8c003380 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): dump: 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.723 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3224285335 0 0) 0x7f2f9c07f7f0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.187:6789/0 conn(0x7f2f9c08c2f0 legacy=0x7f2f9c07e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c08dc80 legacy=0x7f2f9c195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient: _finish_hunting 0 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 monclient: found mon.c 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c0826f0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient: _finish_auth 0 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient: _check_auth_tickets 2026-02-13T18:21:11.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648634428 0 0) 0x7f2f9c082410 con 0x7f2f9c08c2f0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 5 monclient: authenticate success, global_id 104303 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: _renew_subs 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c082130 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: _renew_subs 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f9c083de0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.697+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f8c0039c0 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f8c003d60 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f99ffb640 4 set_mon_vals no callback set 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 10 monclient: dump: 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.726 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2fa1c5c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f2f8c004030 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f9c08f600 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(777..777 src has 621..777) ==== 3991+0+0 (unknown 3366792250 0 0) 0x7f2f8c04c700 con 0x7f2f9c08cdd0 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f9bfff640 10 monclient: get_auth_request con 0x7f2f6c03d3c0 auth_method 0 2026-02-13T18:21:11.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.701+0000 7f2f9b7fe640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c07a3d0 legacy=0x7f2f9c07a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572310824 0 0) 0x7f2f9c08f600 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient(hunting): my global_id is 124098 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f9c082410 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4157536142 0 0) 0x7f2f9c082410 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f9c08f600 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f88004a90 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient: dump: 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:11.862 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2413200784 0 0) 0x7f2f9c08f600 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f9c085af0 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2f88002d90 con 0x7f2f9c07a3d0 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c07a3d0 legacy=0x7f2f9c07a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:11.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.849+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c07a3d0 legacy=0x7f2f9c07a7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:11.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.853+0000 7f2fa1c5c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:11.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.853+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f9c08cb00 con 0x7f2f9c07aeb0 2026-02-13T18:21:11.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:11.857+0000 7f2f9b7fe640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c07aeb0 legacy=0x7f2f9c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913062324 0 0) 0x7f2f9c08cb00 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient(hunting): my global_id is 124101 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f9c08f600 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1739830914 0 0) 0x7f2f9c08f600 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f9c08cb00 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2f880051b0 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 10 monclient: dump: 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.264 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.265 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.266 INFO:tasks.rados.rados.0.trial187.stdout:3439: done (2 left) 2026-02-13T18:21:12.266 INFO:tasks.rados.rados.0.trial187.stdout:3440: write (excl) oid 36 current snap is 383 2026-02-13T18:21:12.266 INFO:tasks.rados.rados.0.trial187.stdout:3440: seq_num 1150 ranges {528050=505653,1612057=524731,2614324=567403} 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 559311233 0 0) 0x7f2f9c08cb00 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.253+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f9c090810 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4338 (unknown 0 0 1581336944) 0x7f2f88007430 con 0x7f2f9c07aeb0 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f77fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f77fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c07aeb0 legacy=0x7f2f9c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f77fff640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6789/0 conn(0x7f2f9c07aeb0 legacy=0x7f2f9c198550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 56, 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 791, 2026-02-13T18:21:12.268 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.269 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.270 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.271 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:12.272 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.273 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:12.274 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.275 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:12.276 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.277 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.278 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.279 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.280 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:12.281 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.281 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.281 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.281 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:12.281 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:12.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.187:6812/2668687789 conn(0x7f2f6c03d3c0 legacy=0x7f2f6c05d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 10 monclient: shutdown 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 >> v1:10.20.193.78:6790/0 conn(0x7f2f9c08cdd0 legacy=0x7f2f9c07f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f9bfff640 1 -- 10.20.193.78:0/447400177 reap_dead start 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2f9bfff640 1 -- 10.20.193.78:0/447400177 reap_dead start 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 shutdown_connections 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 >> 10.20.193.78:0/447400177 conn(0x7f2f9c091720 msgr2=0x7f2f9c086470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 shutdown_connections 2026-02-13T18:21:12.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.257+0000 7f2fa1c5c640 1 -- 10.20.193.78:0/447400177 wait complete. 2026-02-13T18:21:12.284 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:21:12.284 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:21:12.284 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:21:12.285 INFO:tasks.rados.rados.0.trial187.stdout:3440: writing trial18717860-36 from 528050 to 1033703 tid 1 2026-02-13T18:21:12.286 INFO:tasks.rados.rados.0.trial187.stdout:3440: writing trial18717860-36 from 1612057 to 2136788 tid 2 2026-02-13T18:21:12.287 INFO:tasks.rados.rados.0.trial187.stdout:3440: writing trial18717860-36 from 2614324 to 3181727 tid 3 2026-02-13T18:21:12.287 INFO:tasks.rados.rados.0.trial187.stdout:3441: write (excl) oid 49 current snap is 383 2026-02-13T18:21:12.287 INFO:tasks.rados.rados.0.trial187.stdout:3441: seq_num 1151 ranges {544857=580902,1670539=668389,3041747=303110} 2026-02-13T18:21:12.294 INFO:tasks.rados.rados.0.trial187.stdout:3441: writing trial18717860-49 from 544857 to 1125759 tid 1 2026-02-13T18:21:12.302 INFO:tasks.rados.rados.0.trial187.stdout:3441: writing trial18717860-49 from 1670539 to 2338928 tid 2 2026-02-13T18:21:12.309 INFO:tasks.rados.rados.0.trial187.stdout:3441: writing trial18717860-49 from 3041747 to 3344857 tid 3 2026-02-13T18:21:12.309 INFO:tasks.rados.rados.0.trial187.stdout:3442: delete oid 39 current snap is 383 2026-02-13T18:21:12.310 INFO:tasks.rados.rados.0.trial187.stdout:3437: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:21:12.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.333+0000 7fd6714ea640 10 monclient: get_monmap_and_config 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.333+0000 7fd6714ea640 10 monclient: build_initial_monmap 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.333+0000 7fd6714ea640 10 monclient: monmap: 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:12.337521+0000 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:12.337521+0000 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.347 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 Processor -- start 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 -- start start 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient: init 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient(hunting): picked mon.noname-c con 0x7fd66c08cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient(hunting): picked mon.noname-b con 0x7fd66c08d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient(hunting): picked mon.noname-a con 0x7fd66c08d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c085ad0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c085ee0 con 0x7fd66c08cdc0 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c08e000 con 0x7fd66c08d190 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient(hunting): authenticate will time out at 1503.392660s 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd66a7fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd66c08d190 0x7fd66c183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39426/0 (socket says 10.20.193.78:39426) 2026-02-13T18:21:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd66a7fc640 1 -- 10.20.193.78:0/2119601094 learned_addr learned my addr 10.20.193.78:0/2119601094 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:12.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd66a7fc640 1 -- 10.20.193.78:0/2119601094 >> v1:10.20.193.78:6790/0 conn(0x7fd66c08d190 legacy=0x7fd66c183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd66b7fe640 1 -- 10.20.193.78:0/2119601094 >> v1:10.20.193.78:6789/0 conn(0x7fd66c08d5d0 legacy=0x7fd66c1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719959359 0 0) 0x7fd66c08e000 con 0x7fd66c08d190 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): my global_id is 104306 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd658003620 con 0x7fd66c08d190 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509411262 0 0) 0x7fd66c085ad0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient(hunting): my global_id is 124104 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c08e000 con 0x7fd66c08d5d0 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd66affd640 1 -- 10.20.193.78:0/2119601094 >> v1:10.20.193.187:6789/0 conn(0x7fd66c08cdc0 legacy=0x7fd66c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 738642693 0 0) 0x7fd658003620 con 0x7fd66c08d190 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 >> v1:10.20.193.187:6789/0 conn(0x7fd66c08cdc0 legacy=0x7fd66c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 >> v1:10.20.193.78:6789/0 conn(0x7fd66c08d5d0 legacy=0x7fd66c1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 monclient: found mon.noname-b 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:12.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c086f80 con 0x7fd66c08d190 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: _finish_auth 0 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd654003110 con 0x7fd66c08d190 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: dump: 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.356 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 5 monclient: authenticate success, global_id 104306 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6540033e0 con 0x7fd66c08d190 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 1 -- 10.20.193.78:0/2119601094 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd654004b50 con 0x7fd66c08d190 2026-02-13T18:21:12.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd669ffb640 10 monclient: dump: 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.358 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 4 set_mon_vals no callback set 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 10 monclient: shutdown 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 -- 10.20.193.78:0/2119601094 >> v1:10.20.193.78:6790/0 conn(0x7fd66c08d190 legacy=0x7fd66c183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.337+0000 7fd6714ea640 1 -- 10.20.193.78:0/2119601094 shutdown_connections 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- 10.20.193.78:0/2119601094 >> 10.20.193.78:0/2119601094 conn(0x7fd66c091720 msgr2=0x7fd66c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- 10.20.193.78:0/2119601094 shutdown_connections 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- 10.20.193.78:0/2119601094 wait complete. 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient: build_initial_monmap 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient: monmap: 2026-02-13T18:21:12.359 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 Processor -- start 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- start start 2026-02-13T18:21:12.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient: init 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient(hunting): picked mon.noname-a con 0x7fd66c08cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient(hunting): picked mon.noname-b con 0x7fd66c08d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient(hunting): picked mon.noname-c con 0x7fd66c08d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c0831f0 con 0x7fd66c08cdc0 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c081cd0 con 0x7fd66c08d190 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c0834d0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd6714ea640 10 monclient(hunting): authenticate will time out at 1503.396834s 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd66affd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd66c08cdc0 0x7fd66c152de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59262/0 (socket says 10.20.193.78:59262) 2026-02-13T18:21:12.361 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd66affd640 1 -- 10.20.193.78:0/97934424 learned_addr learned my addr 10.20.193.78:0/97934424 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd66b7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd66c08d5d0 0x7fd66c195150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39434/0 (socket says 10.20.193.78:39434) 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd66b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c08d5d0 legacy=0x7fd66c195150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd66affd640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6789/0 conn(0x7fd66c08cdc0 legacy=0x7fd66c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609195138 0 0) 0x7fd66c0834d0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 10 monclient(hunting): my global_id is 104309 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd66a7fc640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.187:6789/0 conn(0x7fd66c08d190 legacy=0x7fd66c084a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd638003620 con 0x7fd66c08d5d0 2026-02-13T18:21:12.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.341+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:21:12.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313177096 0 0) 0x7fd66c0831f0 con 0x7fd66c08cdc0 2026-02-13T18:21:12.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): my global_id is 124107 2026-02-13T18:21:12.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c0834d0 con 0x7fd66c08cdc0 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884264709 0 0) 0x7fd66c081cd0 con 0x7fd66c08d190 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): my global_id is 114169 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c0831f0 con 0x7fd66c08d190 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 216498639 0 0) 0x7fd638003620 con 0x7fd66c08d5d0 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c081cd0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd65c004930 con 0x7fd66c08d5d0 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:12.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): dump: 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:12.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1770009747 0 0) 0x7fd66c081cd0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.187:6789/0 conn(0x7fd66c08d190 legacy=0x7fd66c084a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6789/0 conn(0x7fd66c08cdc0 legacy=0x7fd66c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 monclient: found mon.c 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c082340 con 0x7fd66c08d5d0 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: _finish_auth 0 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 5 monclient: authenticate success, global_id 104309 2026-02-13T18:21:12.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 10 monclient: _renew_subs 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c081170 con 0x7fd66c08d5d0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 10 monclient: _renew_subs 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd66c0852e0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd65c004ed0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd65c005260 con 0x7fd66c08d5d0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 10 monclient: dump: 2026-02-13T18:21:12.371 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6697fa640 4 set_mon_vals no callback set 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd66c082db0 con 0x7fd66c07b550 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd65c005440 con 0x7fd66c08d5d0 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(778..778 src has 621..778) ==== 3959+0+0 (unknown 3353606430 0 0) 0x7fd65c04dae0 con 0x7fd66c08d5d0 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.345+0000 7fd66a7fc640 10 monclient: get_auth_request con 0x7fd63803d6a0 auth_method 0 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd66affd640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c07b550 legacy=0x7fd66c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421312667 0 0) 0x7fd66c082db0 con 0x7fd66c07b550 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient(hunting): my global_id is 104312 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c081cd0 con 0x7fd66c07b550 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 357892529 0 0) 0x7fd66c081cd0 con 0x7fd66c07b550 2026-02-13T18:21:12.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c082db0 con 0x7fd66c07b550 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd660003350 con 0x7fd66c07b550 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient: dump: 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.374 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1837954484 0 0) 0x7fd66c082db0 con 0x7fd66c07b550 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd66c08f620 con 0x7fd66c07b550 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd6600068f0 con 0x7fd66c07b550 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c07b550 legacy=0x7fd66c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.349+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c07b550 legacy=0x7fd66c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd66c0510e0 con 0x7fd66c07b920 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd66affd640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c07b920 legacy=0x7fd66c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947783370 0 0) 0x7fd66c0510e0 con 0x7fd66c07b920 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient(hunting): my global_id is 104315 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c082db0 con 0x7fd66c07b920 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 42365925 0 0) 0x7fd66c082db0 con 0x7fd66c07b920 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c0510e0 con 0x7fd66c07b920 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd660003bb0 con 0x7fd66c07b920 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient: dump: 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.376 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1370669104 0 0) 0x7fd66c0510e0 con 0x7fd66c07b920 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd66c04d910 con 0x7fd66c07b920 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4510 (unknown 0 0 3423462364) 0x7fd660006b20 con 0x7fd66c07b920 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c07b920 legacy=0x7fd66c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd64b7fe640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c07b920 legacy=0x7fd66c197880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 56, 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 216854, 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:12.378 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.379 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.380 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:12.381 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.382 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.383 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.384 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:12.385 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.386 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:12.387 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:12.388 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd63803d6a0 legacy=0x7fd63805db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 10 monclient: shutdown 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 >> v1:10.20.193.78:6790/0 conn(0x7fd66c08d5d0 legacy=0x7fd66c195150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd66b7fe640 1 -- 10.20.193.78:0/97934424 reap_dead start 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd66b7fe640 1 -- 10.20.193.78:0/97934424 reap_dead start 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 shutdown_connections 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 >> 10.20.193.78:0/97934424 conn(0x7fd66c091720 msgr2=0x7fd66c089b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 shutdown_connections 2026-02-13T18:21:12.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.353+0000 7fd6714ea640 1 -- 10.20.193.78:0/97934424 wait complete. 2026-02-13T18:21:12.390 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1187731 2026-02-13T18:21:12.390 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:21:12.390 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:21:12.390 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: finishing write tid 1 to trial18717860-31 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: finishing write tid 2 to trial18717860-31 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: finishing write tid 3 to trial18717860-31 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: finishing write tid 4 to trial18717860-31 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: finishing write tid 5 to trial18717860-31 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: oid 31 updating version 0 to 1037 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: oid 31 version 1037 is already newer than 1036 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: oid 31 updating version 1037 to 1038 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: oid 31 updating version 1038 to 1039 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1039 (ObjNum 1149 snap 383 seq_num 1149) dirty exists 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3438: left oid 31 (ObjNum 1149 snap 383 seq_num 1149) 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3440: finishing write tid 1 to trial18717860-36 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3440: finishing write tid 2 to trial18717860-36 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3440: finishing write tid 3 to trial18717860-36 2026-02-13T18:21:12.424 INFO:tasks.rados.rados.0.trial187.stdout:3440: finishing write tid 4 to trial18717860-36 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: finishing write tid 5 to trial18717860-36 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: oid 36 updating version 0 to 1458 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: oid 36 updating version 1458 to 1459 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: oid 36 updating version 1459 to 1461 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: oid 36 version 1461 is already newer than 1460 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1461 (ObjNum 1150 snap 383 seq_num 1150) dirty exists 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: left oid 36 (ObjNum 1150 snap 383 seq_num 1150) 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3441: finishing write tid 1 to trial18717860-49 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3441: finishing write tid 2 to trial18717860-49 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3441: finishing write tid 3 to trial18717860-49 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3441: finishing write tid 4 to trial18717860-49 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3437: done (4 left) 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3438: done (3 left) 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3440: done (2 left) 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3442: done (1 left) 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3443: write oid 12 current snap is 383 2026-02-13T18:21:12.425 INFO:tasks.rados.rados.0.trial187.stdout:3443: seq_num 1153 ranges {578471=731400,1787503=672058,3096593=281878} 2026-02-13T18:21:12.432 INFO:tasks.rados.rados.0.trial187.stdout:3443: writing trial18717860-12 from 578471 to 1309871 tid 1 2026-02-13T18:21:12.440 INFO:tasks.rados.rados.0.trial187.stdout:3443: writing trial18717860-12 from 1787503 to 2459561 tid 2 2026-02-13T18:21:12.447 INFO:tasks.rados.rados.0.trial187.stdout:3443: writing trial18717860-12 from 3096593 to 3378471 tid 3 2026-02-13T18:21:12.447 INFO:tasks.rados.rados.0.trial187.stdout:3444: rollback oid 19 current snap is 383 2026-02-13T18:21:12.447 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 329 2026-02-13T18:21:12.447 INFO:tasks.rados.rados.0.trial187.stdout:3441: finishing write tid 5 to trial18717860-49 2026-02-13T18:21:12.447 INFO:tasks.rados.rados.0.trial187.stdout:3441: oid 49 updating version 0 to 1464 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3441: oid 49 updating version 1464 to 1465 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3441: oid 49 updating version 1465 to 1466 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3441: oid 49 version 1466 is already newer than 1463 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 49 v 1466 (ObjNum 1151 snap 383 seq_num 1151) dirty exists 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3441: left oid 49 (ObjNum 1151 snap 383 seq_num 1151) 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3443: finishing write tid 1 to trial18717860-12 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3443: finishing write tid 2 to trial18717860-12 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3441: done (2 left) 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3445: copy_from oid 22 from oid 44 current snap is 383 2026-02-13T18:21:12.448 INFO:tasks.rados.rados.0.trial187.stdout:3446: snap_remove snap 381 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient: get_monmap_and_config 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient: build_initial_monmap 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient: monmap: 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:12.451792+0000 2026-02-13T18:21:12.460 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:12.451792+0000 2026-02-13T18:21:12.461 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:12.461 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.461 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:12.461 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:12.461 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:12.461 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 1 Processor -- start 2026-02-13T18:21:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 1 -- start start 2026-02-13T18:21:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient: init 2026-02-13T18:21:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient(hunting): picked mon.noname-b con 0x7fb52808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient(hunting): picked mon.noname-a con 0x7fb52808d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient(hunting): picked mon.noname-c con 0x7fb52808d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528085ad0 con 0x7fb52808d190 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528085ee0 con 0x7fb52808d5d0 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52808e000 con 0x7fb52808cdc0 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb52df66640 10 monclient(hunting): authenticate will time out at 1503.506976s 2026-02-13T18:21:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb5277fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb52808cdc0 0x7fb52808c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39458/0 (socket says 10.20.193.78:39458) 2026-02-13T18:21:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.449+0000 7fb5277fe640 1 -- 10.20.193.78:0/2488528521 learned_addr learned my addr 10.20.193.78:0/2488528521 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5277fe640 1 -- 10.20.193.78:0/2488528521 >> v1:10.20.193.78:6790/0 conn(0x7fb52808cdc0 legacy=0x7fb52808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb526ffd640 1 -- 10.20.193.78:0/2488528521 >> v1:10.20.193.78:6789/0 conn(0x7fb52808d190 legacy=0x7fb528183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103878632 0 0) 0x7fb52808e000 con 0x7fb52808cdc0 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): my global_id is 104318 2026-02-13T18:21:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50c003620 con 0x7fb52808cdc0 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809227098 0 0) 0x7fb528085ad0 con 0x7fb52808d190 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient(hunting): my global_id is 124110 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52808e000 con 0x7fb52808d190 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb527fff640 1 -- 10.20.193.78:0/2488528521 >> v1:10.20.193.187:6789/0 conn(0x7fb52808d5d0 legacy=0x7fb5281a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3270996133 0 0) 0x7fb50c003620 con 0x7fb52808cdc0 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 >> v1:10.20.193.187:6789/0 conn(0x7fb52808d5d0 legacy=0x7fb5281a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 >> v1:10.20.193.78:6789/0 conn(0x7fb52808d190 legacy=0x7fb528183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: _finish_hunting 0 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 monclient: found mon.noname-b 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528086f80 con 0x7fb52808cdc0 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: _finish_auth 0 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: _check_auth_tickets 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 5 monclient: authenticate success, global_id 104318 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb514003110 con 0x7fb52808cdc0 2026-02-13T18:21:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: dump: 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.471 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5140033e0 con 0x7fb52808cdc0 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 1 -- 10.20.193.78:0/2488528521 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb514004b50 con 0x7fb52808cdc0 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5267fc640 10 monclient: dump: 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.472 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 4 set_mon_vals no callback set 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: shutdown 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- 10.20.193.78:0/2488528521 >> v1:10.20.193.78:6790/0 conn(0x7fb52808cdc0 legacy=0x7fb52808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- 10.20.193.78:0/2488528521 shutdown_connections 2026-02-13T18:21:12.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- 10.20.193.78:0/2488528521 >> 10.20.193.78:0/2488528521 conn(0x7fb528091720 msgr2=0x7fb528091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- 10.20.193.78:0/2488528521 shutdown_connections 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- 10.20.193.78:0/2488528521 wait complete. 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: build_initial_monmap 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: monmap: 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:12.474 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 Processor -- start 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- start start 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: init 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient(hunting): picked mon.noname-c con 0x7fb52808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient(hunting): picked mon.noname-b con 0x7fb52808d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient(hunting): picked mon.noname-a con 0x7fb52808d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5280810e0 con 0x7fb52808d5d0 2026-02-13T18:21:12.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528083160 con 0x7fb52808d190 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528083440 con 0x7fb52808cdc0 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb52df66640 10 monclient(hunting): authenticate will time out at 1503.510953s 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5277fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb52808cdc0 0x7fb528084970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39470/0 (socket says 10.20.193.78:39470) 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.453+0000 7fb5277fe640 1 -- 10.20.193.78:0/2927133554 learned_addr learned my addr 10.20.193.78:0/2927133554 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb5277fe640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.78:6790/0 conn(0x7fb52808cdc0 legacy=0x7fb528084970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb527fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.78:6789/0 conn(0x7fb52808d5d0 legacy=0x7fb5281957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534979774 0 0) 0x7fb528083440 con 0x7fb52808cdc0 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): my global_id is 104321 2026-02-13T18:21:12.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f8003620 con 0x7fb52808cdc0 2026-02-13T18:21:12.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:21:12.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb526ffd640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52808d190 legacy=0x7fb5281940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3801583788 0 0) 0x7fb4f8003620 con 0x7fb52808cdc0 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb528083440 con 0x7fb52808cdc0 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762665474 0 0) 0x7fb528083160 con 0x7fb52808d190 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): my global_id is 114175 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f8003620 con 0x7fb52808d190 2026-02-13T18:21:12.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526961778 0 0) 0x7fb5280810e0 con 0x7fb52808d5d0 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): my global_id is 124113 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb528083160 con 0x7fb52808d5d0 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb5140048e0 con 0x7fb52808cdc0 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): dump: 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.483 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1607513547 0 0) 0x7fb528083440 con 0x7fb52808cdc0 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52808d190 legacy=0x7fb5281940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.78:6789/0 conn(0x7fb52808d5d0 legacy=0x7fb5281957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: _finish_hunting 0 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 monclient: found mon.c 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528081c40 con 0x7fb52808cdc0 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: _finish_auth 0 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: _check_auth_tickets 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 5 monclient: authenticate success, global_id 104321 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 10 monclient: _renew_subs 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb528085080 con 0x7fb52808cdc0 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 10 monclient: _renew_subs 2026-02-13T18:21:12.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb528152f20 con 0x7fb52808cdc0 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb514004c20 con 0x7fb52808cdc0 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb514005130 con 0x7fb52808cdc0 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb525ffb640 4 set_mon_vals no callback set 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb503fff640 10 monclient: dump: 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.486 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.457+0000 7fb52df66640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb52808f620 con 0x7fb52807b550 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb5140117c0 con 0x7fb52808cdc0 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(778..778 src has 621..778) ==== 3959+0+0 (unknown 3353606430 0 0) 0x7fb51404c790 con 0x7fb52808cdc0 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb527fff640 10 monclient: get_auth_request con 0x7fb4f803d6f0 auth_method 0 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb526ffd640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52807b550 legacy=0x7fb52804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584350442 0 0) 0x7fb4f8003620 con 0x7fb52807b550 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient(hunting): my global_id is 114178 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb528083440 con 0x7fb52807b550 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1426029346 0 0) 0x7fb528083440 con 0x7fb52807b550 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4f8003620 con 0x7fb52807b550 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb518002f90 con 0x7fb52807b550 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient: dump: 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.488 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4021720724 0 0) 0x7fb4f8003620 con 0x7fb52807b550 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb528085460 con 0x7fb52807b550 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb5180058c0 con 0x7fb52807b550 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52807b550 legacy=0x7fb52804d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.461+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52807b550 legacy=0x7fb52804d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.465+0000 7fb52df66640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.465+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb528088910 con 0x7fb52807b920 2026-02-13T18:21:12.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb526ffd640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52807b920 legacy=0x7fb528197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227136426 0 0) 0x7fb528088910 con 0x7fb52807b920 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient(hunting): my global_id is 114181 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f8003620 con 0x7fb52807b920 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2695450273 0 0) 0x7fb4f8003620 con 0x7fb52807b920 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb528088910 con 0x7fb52807b920 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb518003b80 con 0x7fb52807b920 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient: dump: 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.490 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2023104462 0 0) 0x7fb528088910 con 0x7fb52807b920 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb52808b770 con 0x7fb52807b920 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 70343396) 0x7fb518005b10 con 0x7fb52807b920 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52807b920 legacy=0x7fb528197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb503fff640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6789/0 conn(0x7fb52807b920 legacy=0x7fb528197f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 56, 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 109162, 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.492 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.493 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.494 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:12.495 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:12.496 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.497 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.498 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:12.499 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:12.500 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:12.501 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb4f803d6f0 legacy=0x7fb4f805dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 10 monclient: shutdown 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 >> v1:10.20.193.78:6790/0 conn(0x7fb52808cdc0 legacy=0x7fb528084970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb527fff640 1 -- 10.20.193.78:0/2927133554 reap_dead start 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb527fff640 1 -- 10.20.193.78:0/2927133554 reap_dead start 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 shutdown_connections 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 >> 10.20.193.78:0/2927133554 conn(0x7fb528091720 msgr2=0x7fb52805ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 shutdown_connections 2026-02-13T18:21:12.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.469+0000 7fb52df66640 1 -- 10.20.193.78:0/2927133554 wait complete. 2026-02-13T18:21:12.503 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:21:12.503 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:21:12.503 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:21:12.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient: get_monmap_and_config 2026-02-13T18:21:12.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient: build_initial_monmap 2026-02-13T18:21:12.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient: monmap: 2026-02-13T18:21:12.572 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:12.564367+0000 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:12.564367+0000 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:12.573 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 1 Processor -- start 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 1 -- start start 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient: init 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient(hunting): picked mon.noname-c con 0x7fb45c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient(hunting): picked mon.noname-b con 0x7fb45c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient(hunting): picked mon.noname-a con 0x7fb45c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c089e80 con 0x7fb45c08cdd0 2026-02-13T18:21:12.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c088c20 con 0x7fb45c08c2f0 2026-02-13T18:21:12.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c089ba0 con 0x7fb45c08dc80 2026-02-13T18:21:12.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:12.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb464681640 10 monclient(hunting): authenticate will time out at 1503.619532s 2026-02-13T18:21:12.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb461bf5640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb45c08dc80 0x7fb45c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39486/0 (socket says 10.20.193.78:39486) 2026-02-13T18:21:12.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.561+0000 7fb461bf5640 1 -- 10.20.193.78:0/540615103 learned_addr learned my addr 10.20.193.78:0/540615103 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb461bf5640 1 -- 10.20.193.78:0/540615103 >> v1:10.20.193.78:6790/0 conn(0x7fb45c08dc80 legacy=0x7fb45c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb462bf7640 1 -- 10.20.193.78:0/540615103 >> v1:10.20.193.78:6789/0 conn(0x7fb45c08cdd0 legacy=0x7fb45c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562397182 0 0) 0x7fb45c089ba0 con 0x7fb45c08dc80 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): my global_id is 104324 2026-02-13T18:21:12.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb444003620 con 0x7fb45c08dc80 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4623f6640 1 -- 10.20.193.78:0/540615103 >> v1:10.20.193.187:6789/0 conn(0x7fb45c08c2f0 legacy=0x7fb45c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715336991 0 0) 0x7fb45c089e80 con 0x7fb45c08cdd0 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient(hunting): my global_id is 124116 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb45c089ba0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2004672225 0 0) 0x7fb444003620 con 0x7fb45c08dc80 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 >> v1:10.20.193.187:6789/0 conn(0x7fb45c08c2f0 legacy=0x7fb45c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 >> v1:10.20.193.78:6789/0 conn(0x7fb45c08cdd0 legacy=0x7fb45c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: _finish_hunting 0 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 monclient: found mon.noname-b 2026-02-13T18:21:12.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c08d370 con 0x7fb45c08dc80 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: _finish_auth 0 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: _check_auth_tickets 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb450003110 con 0x7fb45c08dc80 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 5 monclient: authenticate success, global_id 104324 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: dump: 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.584 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4500033e0 con 0x7fb45c08dc80 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 1 -- 10.20.193.78:0/540615103 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb450004b50 con 0x7fb45c08dc80 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb4613f4640 10 monclient: dump: 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:12.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 4 set_mon_vals no callback set 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: shutdown 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- 10.20.193.78:0/540615103 >> v1:10.20.193.78:6790/0 conn(0x7fb45c08dc80 legacy=0x7fb45c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- 10.20.193.78:0/540615103 shutdown_connections 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- 10.20.193.78:0/540615103 >> 10.20.193.78:0/540615103 conn(0x7fb45c091720 msgr2=0x7fb45c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- 10.20.193.78:0/540615103 shutdown_connections 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- 10.20.193.78:0/540615103 wait complete. 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: build_initial_monmap 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: monmap: 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:12.587 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 Processor -- start 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- start start 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: init 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient(hunting): picked mon.noname-b con 0x7fb45c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient(hunting): picked mon.noname-c con 0x7fb45c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient(hunting): picked mon.noname-a con 0x7fb45c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c084300 con 0x7fb45c08dc80 2026-02-13T18:21:12.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c080360 con 0x7fb45c08c2f0 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c0826c0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb464681640 10 monclient(hunting): authenticate will time out at 1503.623765s 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb461bf5640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb45c08cdd0 0x7fb45c1946f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39494/0 (socket says 10.20.193.78:39494) 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb461bf5640 1 -- 10.20.193.78:0/3333290063 learned_addr learned my addr 10.20.193.78:0/3333290063 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.565+0000 7fb462bf7640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb45c08dc80 0x7fb45c195e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59296/0 (socket says 10.20.193.78:59296) 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb462bf7640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.78:6789/0 conn(0x7fb45c08dc80 legacy=0x7fb45c195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb461bf5640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.78:6790/0 conn(0x7fb45c08cdd0 legacy=0x7fb45c1946f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866809949 0 0) 0x7fb45c089ba0 con 0x7fb45c08dc80 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): my global_id is 124119 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb42c003620 con 0x7fb45c08dc80 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1815767380 0 0) 0x7fb45c0826c0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): my global_id is 104327 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb45c089ba0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb4623f6640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.187:6789/0 conn(0x7fb45c08c2f0 legacy=0x7fb45c083bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2621831461 0 0) 0x7fb45c089ba0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb45c0826c0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb4500048e0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:12.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): dump: 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1774599469 0 0) 0x7fb42c003620 con 0x7fb45c08dc80 2026-02-13T18:21:12.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb45c089ba0 con 0x7fb45c08dc80 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb458004900 con 0x7fb45c08dc80 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): dump: 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008528928 0 0) 0x7fb45c080360 con 0x7fb45c08c2f0 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient(hunting): my global_id is 114187 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb42c003620 con 0x7fb45c08c2f0 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1751851645 0 0) 0x7fb45c0826c0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.187:6789/0 conn(0x7fb45c08c2f0 legacy=0x7fb45c083bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.78:6789/0 conn(0x7fb45c08dc80 legacy=0x7fb45c195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 monclient: found mon.c 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c081e20 con 0x7fb45c08cdd0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: _finish_auth 0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 5 monclient: authenticate success, global_id 104327 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 monclient: _renew_subs 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1535f0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 monclient: _renew_subs 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb45c081090 con 0x7fb45c08cdd0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4500033c0 con 0x7fb45c08cdd0 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:12.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb450004b50 con 0x7fb45c08cdd0 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 10 monclient: dump: 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb460bf3640 4 set_mon_vals no callback set 2026-02-13T18:21:12.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb450011810 con 0x7fb45c08cdd0 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c08f600 con 0x7fb45c08cdd0 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(778..778 src has 621..778) ==== 3959+0+0 (unknown 3353606430 0 0) 0x7fb45004c710 con 0x7fb45c08cdd0 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.569+0000 7fb4623f6640 10 monclient: get_auth_request con 0x7fb42c03d830 auth_method 0 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.573+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fb450017690 con 0x7fb45c08cdd0 2026-02-13T18:21:12.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.573+0000 7fb442ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:12.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.573+0000 7fb442ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:12.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.693+0000 7fb464681640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:21:12.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.693+0000 7fb464681640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:21:12.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.693+0000 7fb464681640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:12.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.693+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb45c08cb60 con 0x7fb45c08cdd0 2026-02-13T18:21:12.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb442ffd640 1 -- 10.20.193.78:0/3333290063 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fb45001c950 con 0x7fb45c08cdd0 2026-02-13T18:21:12.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb442ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:21:12.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb442ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:12.708 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.708 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=12,kv=9,logm=56} crc {auth=1633990412,config=1618278320,health=861837567,kv=751936864,logm=3115872925}) 2026-02-13T18:21:12.708 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=20,config=2,health=11,kv=10,logm=57} crc {auth=3148827644,config=1618278320,health=3847813451,kv=1077773571,logm=3817399166}) 2026-02-13T18:21:12.708 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.708 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=12,kv=9,logm=56} crc {auth=1633990412,config=1618278320,health=861837567,kv=751936864,logm=3115872925}) 2026-02-13T18:21:12.708 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=12,kv=11,logm=55} crc {auth=3166177760,config=1618278320,health=1927041440,kv=2081102228,logm=3446512629}) 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb42c03d830 legacy=0x7fb42c05dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 10 monclient: shutdown 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 >> v1:10.20.193.78:6790/0 conn(0x7fb45c08cdd0 legacy=0x7fb45c1946f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 shutdown_connections 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 >> 10.20.193.78:0/3333290063 conn(0x7fb45c091720 msgr2=0x7fb45c057a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 shutdown_connections 2026-02-13T18:21:12.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:12.697+0000 7fb464681640 1 -- 10.20.193.78:0/3333290063 wait complete. 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1111647729}) 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1978160374}) 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1111647729}) 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=473957632}) 2026-02-13T18:21:12.712 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2202541487}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1425809570}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2202541487}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=89075384}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=735276878}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=821053412}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=735276878}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.697+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2068116959}) 2026-02-13T18:21:12.713 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1387250392}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1276259449}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1387250392}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2471748933}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4086467428}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3869262849}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4086467428}) 2026-02-13T18:21:12.714 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2622519071}) 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3591596450}) 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612428351}) 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3591596450}) 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1971287974}) 2026-02-13T18:21:12.717 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1304154362}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3528876970}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1304154362}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.701+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2170995399}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1869769760}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=246418251}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1869769760}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1595303335}) 2026-02-13T18:21:12.718 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2280823871}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1232859881}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2280823871}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=485630197}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2447096210}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127974484}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2447096210}) 2026-02-13T18:21:12.719 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1415760685}) 2026-02-13T18:21:12.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:21:12.726 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.726 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=110238774}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1605871223}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=110238774}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1228771415}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3314997104}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1356103889}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3314997104}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.705+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4123120151}) 2026-02-13T18:21:12.727 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=773289392}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3161083898}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=773289392}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=286305911}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1283460146}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131442035}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1283460146}) 2026-02-13T18:21:12.728 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=594976652}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1882709294}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2347327589}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1882709294}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2732751986}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4077876677}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=696666271}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4077876677}) 2026-02-13T18:21:12.729 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1968751817}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1999865263}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1568139253}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1999865263}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.709+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2235414040}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1369020704}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2402948924}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1369020704}) 2026-02-13T18:21:12.730 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2523664619}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1512939561}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055739273}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1512939561}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1547957173}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1944447198}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4044129015}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1944447198}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1111812813}) 2026-02-13T18:21:12.731 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=722260744}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128149789}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=722260744}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1197368803}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2203143927}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398645821}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2203143927}) 2026-02-13T18:21:12.732 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.713+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2578839529}) 2026-02-13T18:21:12.733 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.733 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2351775507}) 2026-02-13T18:21:12.733 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1975332286}) 2026-02-13T18:21:12.733 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.733 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2351775507}) 2026-02-13T18:21:12.733 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1691757081}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2035799148}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4055783720}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2035799148}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4059932935}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=13298120}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=324205485}) 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.740 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=13298120}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4132953875}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3499620025}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=938885015}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3499620025}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2833503214}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1867905007}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507346911}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1867905007}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.717+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2362031337}) 2026-02-13T18:21:12.741 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4218537054}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=868660040}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4218537054}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1442436835}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2427287287}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2094677873}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2427287287}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2927628925}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3504348617}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=202031794}) 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.742 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3504348617}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3499319779}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2877299832}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=787771632}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2877299832}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=717835637}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=492607278}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=623100986}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=492607278}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.721+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1756969626}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=45,mdsmap=2,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=12} crc {logm=2792682129,mdsmap=3140514009,mgr=903296875,mgr_command_descs=2141687499,mgrstat=1772640981,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=417129019,osd_pg_creating=128661328,osd_snap=3806206326}) 2026-02-13T18:21:12.743 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=8} crc {logm=2548367776,mdsmap=685858242,mgr=3121433233,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2200992710,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=128661328,osd_snap=2582167927}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=45,mdsmap=2,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=12} crc {logm=2792682129,mdsmap=3140514009,mgr=903296875,mgr_command_descs=2141687499,mgrstat=1772640981,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=417129019,osd_pg_creating=128661328,osd_snap=3806206326}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=46,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=2,osd_metadata=6,osd_snap=10} crc {logm=2640250833,mdsmap=685858242,mgr=12400356,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=2200992710,mon_config_key=3256534467,monmap=1180532494,nvmeofgw=3140514009,osd_metadata=1252444728,osd_snap=2236634839}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=647021663}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=4233443031}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=647021663}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=2249846633}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=36,osdmap=64} crc {osd_snap=2358172051,osdmap=3725751657}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=36,osdmap=64} crc {osd_snap=2746882632,osdmap=3258577600}) 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.744 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=36,osdmap=64} crc {osd_snap=2358172051,osdmap=3725751657}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=37,osdmap=63} crc {osd_snap=3376825816,osdmap=315247680}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=144337057}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1417563434}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=144337057}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.725+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=806672798}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.729+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.729+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=76} crc {osdmap=520436354}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.729+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=976437161}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.729+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.729+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=76} crc {osdmap=520436354}) 2026-02-13T18:21:12.745 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:21:12.729+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=75} crc {osdmap=2880890529}) 2026-02-13T18:21:13.277 INFO:tasks.rados.rados.0.trial187.stdout:3446: done (3 left) 2026-02-13T18:21:13.277 INFO:tasks.rados.rados.0.trial187.stdout:3447: snap_remove snap 379 2026-02-13T18:21:13.721 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:21:13.722 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:21:13.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.781+0000 7ff4343bf640 10 monclient: get_monmap_and_config 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.781+0000 7ff4343bf640 10 monclient: build_initial_monmap 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.781+0000 7ff4343bf640 10 monclient: monmap: 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:13.784885+0000 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:13.784885+0000 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:13.794 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:13.795 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:13.795 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.781+0000 7ff4343bf640 1 Processor -- start 2026-02-13T18:21:13.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.781+0000 7ff4343bf640 1 -- start start 2026-02-13T18:21:13.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.781+0000 7ff4343bf640 10 monclient: init 2026-02-13T18:21:13.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:13.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:13.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient(hunting): picked mon.noname-b con 0x7ff42c085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:13.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient(hunting): picked mon.noname-c con 0x7ff42c085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:13.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient(hunting): picked mon.noname-a con 0x7ff42c181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c088400 con 0x7ff42c181d50 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c088120 con 0x7ff42c085b60 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c08c550 con 0x7ff42c085790 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient(hunting): authenticate will time out at 1504.840224s 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff432134640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff42c085790 0x7ff42c089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39498/0 (socket says 10.20.193.78:39498) 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff432134640 1 -- 10.20.193.78:0/753718194 learned_addr learned my addr 10.20.193.78:0/753718194 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff432134640 1 -- 10.20.193.78:0/753718194 >> v1:10.20.193.78:6790/0 conn(0x7ff42c085790 legacy=0x7ff42c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:13.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff432935640 1 -- 10.20.193.78:0/753718194 >> v1:10.20.193.78:6789/0 conn(0x7ff42c181d50 legacy=0x7ff42c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291243 0 0) 0x7ff4280041c0 con 0x7ff42c181d50 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): _negotiate 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): my global_id is 124122 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4140058b0 con 0x7ff42c181d50 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849306843 0 0) 0x7ff42c08c550 con 0x7ff42c085790 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): _negotiate 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:13.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient(hunting): my global_id is 104330 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4280041c0 con 0x7ff42c085790 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431933640 1 -- 10.20.193.78:0/753718194 >> v1:10.20.193.187:6789/0 conn(0x7ff42c085b60 legacy=0x7ff42c085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 721316006 0 0) 0x7ff4140058b0 con 0x7ff42c181d50 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 >> v1:10.20.193.78:6790/0 conn(0x7ff42c085790 legacy=0x7ff42c089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 >> v1:10.20.193.187:6789/0 conn(0x7ff42c085b60 legacy=0x7ff42c085fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: _finish_hunting 0 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 monclient: found mon.noname-a 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:21:13.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c087540 con 0x7ff42c181d50 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: _finish_auth 0 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: _check_auth_tickets 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 5 monclient: authenticate success, global_id 124122 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff428004840 con 0x7ff42c181d50 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:13.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:13.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:13.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: dump: 2026-02-13T18:21:13.805 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff428004c20 con 0x7ff42c181d50 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 1 -- 10.20.193.78:0/753718194 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff428004fb0 con 0x7ff42c181d50 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff431132640 10 monclient: dump: 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:13.807 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 4 set_mon_vals no callback set 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 10 monclient: shutdown 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- 10.20.193.78:0/753718194 >> v1:10.20.193.78:6789/0 conn(0x7ff42c181d50 legacy=0x7ff42c1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- 10.20.193.78:0/753718194 shutdown_connections 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- 10.20.193.78:0/753718194 >> 10.20.193.78:0/753718194 conn(0x7ff42c091720 msgr2=0x7ff42c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:13.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- 10.20.193.78:0/753718194 shutdown_connections 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.785+0000 7ff4343bf640 1 -- 10.20.193.78:0/753718194 wait complete. 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: build_initial_monmap 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: monmap: 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:13.809 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 Processor -- start 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 -- start start 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: init 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient(hunting): picked mon.noname-a con 0x7ff42c085790 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient(hunting): picked mon.noname-b con 0x7ff42c085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient(hunting): picked mon.noname-c con 0x7ff42c181d50 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c13f670 con 0x7ff42c085790 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c153f00 con 0x7ff42c085b60 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c13f950 con 0x7ff42c181d50 2026-02-13T18:21:13.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:13.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient(hunting): authenticate will time out at 1504.844837s 2026-02-13T18:21:13.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff432134640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff42c085790 0x7ff42c1530e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59314/0 (socket says 10.20.193.78:59314) 2026-02-13T18:21:13.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff432134640 1 -- 10.20.193.78:0/2765951703 learned_addr learned my addr 10.20.193.78:0/2765951703 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:13.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff432134640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.78:6789/0 conn(0x7ff42c085790 legacy=0x7ff42c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:13.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff432935640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.78:6790/0 conn(0x7ff42c181d50 legacy=0x7ff42c175690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:13.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540279542 0 0) 0x7ff42c13f670 con 0x7ff42c085790 2026-02-13T18:21:13.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:13.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:13.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): my global_id is 124125 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3fc003620 con 0x7ff42c085790 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113893318 0 0) 0x7ff42c13f950 con 0x7ff42c181d50 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): my global_id is 104333 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c13f670 con 0x7ff42c181d50 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff431933640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.187:6789/0 conn(0x7ff42c085b60 legacy=0x7ff42c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3180200506 0 0) 0x7ff3fc003620 con 0x7ff42c085790 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff42c13f950 con 0x7ff42c085790 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff41c0033a0 con 0x7ff42c085790 2026-02-13T18:21:13.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): dump: 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3862726059 0 0) 0x7ff42c13f670 con 0x7ff42c181d50 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3fc003620 con 0x7ff42c181d50 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff428004620 con 0x7ff42c181d50 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): dump: 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:13.818 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974368897 0 0) 0x7ff42c153f00 con 0x7ff42c085b60 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient(hunting): my global_id is 114193 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c13f670 con 0x7ff42c085b60 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3158119727 0 0) 0x7ff42c13f950 con 0x7ff42c085790 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.78:6790/0 conn(0x7ff42c181d50 legacy=0x7ff42c175690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.187:6789/0 conn(0x7ff42c085b60 legacy=0x7ff42c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:21:13.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 monclient: found mon.a 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c089fc0 con 0x7ff42c085790 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: _finish_auth 0 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 5 monclient: authenticate success, global_id 124125 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: _renew_subs 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c088910 con 0x7ff42c085790 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: _renew_subs 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff42c1400b0 con 0x7ff42c085790 2026-02-13T18:21:13.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff41c004c00 con 0x7ff42c085790 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff41c004f60 con 0x7ff42c085790 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff430931640 4 set_mon_vals no callback set 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.789+0000 7ff412ffd640 10 monclient: dump: 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:13.821 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff4343bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7ff41c005140 con 0x7ff42c085790 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff4343bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff4343bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c0389c0 con 0x7ff42c085790 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7ff41c04c7c0 con 0x7ff42c085790 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff431933640 10 monclient: get_auth_request con 0x7ff3fc03d850 auth_method 0 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7ff41c0177a0 con 0x7ff42c085790 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff412ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.793+0000 7ff412ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff42c090810 con 0x7ff42c085790 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff412ffd640 1 -- 10.20.193.78:0/2765951703 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2242284484) 0x7ff41c017080 con 0x7ff42c085790 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff412ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:21:13.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff412ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:13.925 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.187:6812/2668687789 conn(0x7ff3fc03d850 legacy=0x7ff3fc05dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 10 monclient: shutdown 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 >> v1:10.20.193.78:6789/0 conn(0x7ff42c085790 legacy=0x7ff42c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 shutdown_connections 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 >> 10.20.193.78:0/2765951703 conn(0x7ff42c091720 msgr2=0x7ff42c05cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 shutdown_connections 2026-02-13T18:21:13.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.913+0000 7ff4343bf640 1 -- 10.20.193.78:0/2765951703 wait complete. 2026-02-13T18:21:13.933 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:21:13.934 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:21:13.934 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:21:13.934 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient: get_monmap_and_config 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient: build_initial_monmap 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient: monmap: 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:13.996283+0000 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:13.996283+0000 2026-02-13T18:21:14.005 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 1 Processor -- start 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 1 -- start start 2026-02-13T18:21:14.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient: init 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient(hunting): picked mon.noname-b con 0x7fe2d008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient(hunting): picked mon.noname-c con 0x7fe2d008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient(hunting): picked mon.noname-a con 0x7fe2d008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d0089e80 con 0x7fe2d008cdd0 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d0088c20 con 0x7fe2d008dc80 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d0089ba0 con 0x7fe2d008c2f0 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:14.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d7987640 10 monclient(hunting): authenticate will time out at 1505.051623s 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d56fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe2d008c2f0 0x7fe2d008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39516/0 (socket says 10.20.193.78:39516) 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.993+0000 7fe2d56fc640 1 -- 10.20.193.78:0/665403949 learned_addr learned my addr 10.20.193.78:0/665403949 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d56fc640 1 -- 10.20.193.78:0/665403949 >> v1:10.20.193.78:6790/0 conn(0x7fe2d008c2f0 legacy=0x7fe2d008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d5efd640 1 -- 10.20.193.78:0/665403949 >> v1:10.20.193.78:6789/0 conn(0x7fe2d008cdd0 legacy=0x7fe2d01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d4efb640 1 -- 10.20.193.78:0/665403949 >> v1:10.20.193.187:6789/0 conn(0x7fe2d008dc80 legacy=0x7fe2d0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616916190 0 0) 0x7fe2d0089e80 con 0x7fe2d008cdd0 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient(hunting): my global_id is 124128 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b8003620 con 0x7fe2d008cdd0 2026-02-13T18:21:14.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183392934 0 0) 0x7fe2b8003620 con 0x7fe2d008cdd0 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 >> v1:10.20.193.78:6790/0 conn(0x7fe2d008c2f0 legacy=0x7fe2d008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 >> v1:10.20.193.187:6789/0 conn(0x7fe2d008dc80 legacy=0x7fe2d0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: _finish_hunting 0 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 monclient: found mon.noname-a 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d008d370 con 0x7fe2d008cdd0 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: _finish_auth 0 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: _check_auth_tickets 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2cc004670 con 0x7fe2d008cdd0 2026-02-13T18:21:14.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: dump: 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.014 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 5 monclient: authenticate success, global_id 124128 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2cc004940 con 0x7fe2d008cdd0 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 1 -- 10.20.193.78:0/665403949 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2cc004dd0 con 0x7fe2d008cdd0 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2bffff640 10 monclient: dump: 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.015 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 4 set_mon_vals no callback set 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 10 monclient: shutdown 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 -- 10.20.193.78:0/665403949 >> v1:10.20.193.78:6789/0 conn(0x7fe2d008cdd0 legacy=0x7fe2d01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 -- 10.20.193.78:0/665403949 shutdown_connections 2026-02-13T18:21:14.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 -- 10.20.193.78:0/665403949 >> 10.20.193.78:0/665403949 conn(0x7fe2d0091720 msgr2=0x7fe2d0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 -- 10.20.193.78:0/665403949 shutdown_connections 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 -- 10.20.193.78:0/665403949 wait complete. 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 10 monclient: build_initial_monmap 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 10 monclient: monmap: 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:14.017 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 Processor -- start 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 1 -- start start 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:13.997+0000 7fe2d7987640 10 monclient: init 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient(hunting): picked mon.noname-b con 0x7fe2d008c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient(hunting): picked mon.noname-a con 0x7fe2d008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient(hunting): picked mon.noname-c con 0x7fe2d008dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d0087180 con 0x7fe2d008cdd0 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d007e210 con 0x7fe2d008c2f0 2026-02-13T18:21:14.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d007e4f0 con 0x7fe2d008dc80 2026-02-13T18:21:14.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:14.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient(hunting): authenticate will time out at 1505.056261s 2026-02-13T18:21:14.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d4efb640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe2d008cdd0 0x7fe2d0083a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59346/0 (socket says 10.20.193.78:59346) 2026-02-13T18:21:14.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d4efb640 1 -- 10.20.193.78:0/3689246418 learned_addr learned my addr 10.20.193.78:0/3689246418 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:14.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d4efb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d008cdd0 legacy=0x7fe2d0083a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d5efd640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6790/0 conn(0x7fe2d008dc80 legacy=0x7fe2d02380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d56fc640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.187:6789/0 conn(0x7fe2d008c2f0 legacy=0x7fe2d01d5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986568238 0 0) 0x7fe2d0087180 con 0x7fe2d008cdd0 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): my global_id is 124131 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2a0003620 con 0x7fe2d008cdd0 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138865059 0 0) 0x7fe2d007e4f0 con 0x7fe2d008dc80 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): my global_id is 104336 2026-02-13T18:21:14.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d0087180 con 0x7fe2d008dc80 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 671554199 0 0) 0x7fe2a0003620 con 0x7fe2d008cdd0 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2d007e4f0 con 0x7fe2d008cdd0 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2c4003420 con 0x7fe2d008cdd0 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): dump: 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.026 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 72736495 0 0) 0x7fe2d0087180 con 0x7fe2d008dc80 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2a0003620 con 0x7fe2d008dc80 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186909841 0 0) 0x7fe2d007e210 con 0x7fe2d008c2f0 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.027 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): my global_id is 114199 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d0087180 con 0x7fe2d008c2f0 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2cc004c20 con 0x7fe2d008dc80 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient(hunting): dump: 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.028 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2645828304 0 0) 0x7fe2d007e4f0 con 0x7fe2d008cdd0 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6790/0 conn(0x7fe2d008dc80 legacy=0x7fe2d02380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.187:6789/0 conn(0x7fe2d008c2f0 legacy=0x7fe2d01d5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: _finish_hunting 0 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 monclient: found mon.a 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d005de10 con 0x7fe2d008cdd0 2026-02-13T18:21:14.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: _finish_auth 0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: _check_auth_tickets 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 5 monclient: authenticate success, global_id 124131 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient: _renew_subs 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d007df30 con 0x7fe2d008cdd0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient: _renew_subs 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2d0239800 con 0x7fe2d008cdd0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2c40039c0 con 0x7fe2d008cdd0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2c4003d20 con 0x7fe2d008cdd0 2026-02-13T18:21:14.030 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 10 monclient: dump: 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.031 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bf7fe640 4 set_mon_vals no callback set 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe2c4003fb0 con 0x7fe2d008cdd0 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe2d008f5e0 con 0x7fe2d00598c0 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7fe2c404c760 con 0x7fe2d008cdd0 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.001+0000 7fe2d5efd640 10 monclient: get_auth_request con 0x7fe2a003d900 auth_method 0 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2d56fc640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d00598c0 legacy=0x7fe2d004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288233675 0 0) 0x7fe2d008f5e0 con 0x7fe2d00598c0 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient(hunting): my global_id is 124134 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d007e4f0 con 0x7fe2d00598c0 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4011278024 0 0) 0x7fe2d007e4f0 con 0x7fe2d00598c0 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2d008f5e0 con 0x7fe2d00598c0 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2c0003250 con 0x7fe2d00598c0 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient: dump: 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.033 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 239581152 0 0) 0x7fe2d008f5e0 con 0x7fe2d00598c0 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2d007d2b0 con 0x7fe2d00598c0 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe2c0003530 con 0x7fe2d00598c0 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d00598c0 legacy=0x7fe2d004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.005+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d00598c0 legacy=0x7fe2d004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.009+0000 7fe2d7987640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.009+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe2d0090810 con 0x7fe2d0059c90 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d56fc640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d0059c90 legacy=0x7fe2d025a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580739545 0 0) 0x7fe2d0090810 con 0x7fe2d0059c90 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient(hunting): my global_id is 124137 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d008f5e0 con 0x7fe2d0059c90 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3253843530 0 0) 0x7fe2d008f5e0 con 0x7fe2d0059c90 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2d0090810 con 0x7fe2d0059c90 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe2c0004cf0 con 0x7fe2d0059c90 2026-02-13T18:21:14.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient: dump: 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.036 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 768911181 0 0) 0x7fe2d0090810 con 0x7fe2d0059c90 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe2d0086290 con 0x7fe2d0059c90 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4339 (unknown 0 0 316099511) 0x7fe2c0005a50 con 0x7fe2d0059c90 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d0059c90 legacy=0x7fe2d025a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2bdffb640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d0059c90 legacy=0x7fe2d025a9f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:14.037 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 56, 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 2551, 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.038 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.039 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.040 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:14.041 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.042 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:14.043 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.044 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:14.045 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.046 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.047 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:14.048 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:14.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe2a003d900 legacy=0x7fe2a005ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 10 monclient: shutdown 2026-02-13T18:21:14.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:14.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 >> v1:10.20.193.78:6789/0 conn(0x7fe2d008cdd0 legacy=0x7fe2d0083a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d5efd640 1 -- 10.20.193.78:0/3689246418 reap_dead start 2026-02-13T18:21:14.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d5efd640 1 -- 10.20.193.78:0/3689246418 reap_dead start 2026-02-13T18:21:14.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 shutdown_connections 2026-02-13T18:21:14.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 >> 10.20.193.78:0/3689246418 conn(0x7fe2d0091720 msgr2=0x7fe2d0057020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:14.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 shutdown_connections 2026-02-13T18:21:14.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.013+0000 7fe2d7987640 1 -- 10.20.193.78:0/3689246418 wait complete. 2026-02-13T18:21:14.050 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:21:14.050 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:21:14.050 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:21:14.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient: get_monmap_and_config 2026-02-13T18:21:14.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient: build_initial_monmap 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient: monmap: 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:14.111322+0000 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:14.111322+0000 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:14.120 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 1 Processor -- start 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 1 -- start start 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient: init 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient(hunting): picked mon.noname-a con 0x7f7a9c0561f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient(hunting): picked mon.noname-b con 0x7f7a9c057f90 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient(hunting): picked mon.noname-c con 0x7f7a9c056cd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c089dc0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c089800 con 0x7f7a9c056cd0 2026-02-13T18:21:14.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c089ae0 con 0x7f7a9c057f90 2026-02-13T18:21:14.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:14.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa3d9c640 10 monclient(hunting): authenticate will time out at 1505.166603s 2026-02-13T18:21:14.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa1b11640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7a9c0561f0 0x7f7a9c0565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59364/0 (socket says 10.20.193.78:59364) 2026-02-13T18:21:14.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa1b11640 1 -- 10.20.193.78:0/1761137564 learned_addr learned my addr 10.20.193.78:0/1761137564 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:14.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.109+0000 7f7aa1310640 1 --1- 10.20.193.78:0/1761137564 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c057f90 0x7f7a9c183e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39522/0 (socket says 10.20.193.78:39522) 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa1310640 1 -- 10.20.193.78:0/1761137564 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c057f90 legacy=0x7f7a9c183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa1b11640 1 -- 10.20.193.78:0/1761137564 >> v1:10.20.193.78:6789/0 conn(0x7f7a9c0561f0 legacy=0x7f7a9c0565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa2312640 1 -- 10.20.193.78:0/1761137564 >> v1:10.20.193.187:6789/0 conn(0x7f7a9c056cd0 legacy=0x7f7a9c1a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235490615 0 0) 0x7f7a9c089ae0 con 0x7f7a9c057f90 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): my global_id is 104339 2026-02-13T18:21:14.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a84003620 con 0x7f7a9c057f90 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475589609 0 0) 0x7f7a9c089dc0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient(hunting): my global_id is 124140 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c089ae0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 518844725 0 0) 0x7f7a9c089ae0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c057f90 legacy=0x7f7a9c183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 >> v1:10.20.193.187:6789/0 conn(0x7f7a9c056cd0 legacy=0x7f7a9c1a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: _finish_hunting 0 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 monclient: found mon.noname-a 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:14.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c05dab0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: _finish_auth 0 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: _check_auth_tickets 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a8c003040 con 0x7f7a9c0561f0 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: dump: 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.128 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 5 monclient: authenticate success, global_id 124140 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a8c003310 con 0x7f7a9c0561f0 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 1 -- 10.20.193.78:0/1761137564 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a8c0049a0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa0b0f640 10 monclient: dump: 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.129 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 4 set_mon_vals no callback set 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: shutdown 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:14.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/1761137564 >> v1:10.20.193.78:6789/0 conn(0x7f7a9c0561f0 legacy=0x7f7a9c0565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/1761137564 shutdown_connections 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/1761137564 >> 10.20.193.78:0/1761137564 conn(0x7f7a9c054e70 msgr2=0x7f7a9c093b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/1761137564 shutdown_connections 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/1761137564 wait complete. 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: build_initial_monmap 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: monmap: 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:14.131 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 Processor -- start 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- start start 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: init 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient(hunting): picked mon.noname-c con 0x7f7a9c0561f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient(hunting): picked mon.noname-b con 0x7f7a9c056cd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient(hunting): picked mon.noname-a con 0x7f7a9c057f90 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c08e820 con 0x7f7a9c057f90 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c12ee80 con 0x7f7a9c056cd0 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c131e40 con 0x7f7a9c0561f0 2026-02-13T18:21:14.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:14.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa3d9c640 10 monclient(hunting): authenticate will time out at 1505.171048s 2026-02-13T18:21:14.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa1b11640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f7a9c0561f0 0x7f7a9c12e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39532/0 (socket says 10.20.193.78:39532) 2026-02-13T18:21:14.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.113+0000 7f7aa1b11640 1 -- 10.20.193.78:0/3550062695 learned_addr learned my addr 10.20.193.78:0/3550062695 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:14.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa1b11640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c0561f0 legacy=0x7f7a9c12e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa2312640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6789/0 conn(0x7f7a9c057f90 legacy=0x7f7a9c195190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123973875 0 0) 0x7f7a98004310 con 0x7f7a9c057f90 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): my global_id is 124143 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a6c003620 con 0x7f7a9c057f90 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984447873 0 0) 0x7f7a9c131e40 con 0x7f7a9c0561f0 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): my global_id is 104342 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a98004310 con 0x7f7a9c0561f0 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa1310640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.187:6789/0 conn(0x7f7a9c056cd0 legacy=0x7f7a9c12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3295042745 0 0) 0x7f7a6c003620 con 0x7f7a9c057f90 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c131e40 con 0x7f7a9c057f90 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a98004c20 con 0x7f7a9c057f90 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): dump: 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.138 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4206004797 0 0) 0x7f7a98004310 con 0x7f7a9c0561f0 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a6c003620 con 0x7f7a9c0561f0 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a8c0048e0 con 0x7f7a9c0561f0 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient(hunting): dump: 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.139 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 51556570 0 0) 0x7f7a9c131e40 con 0x7f7a9c057f90 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c0561f0 legacy=0x7f7a9c12e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.187:6789/0 conn(0x7f7a9c056cd0 legacy=0x7f7a9c12e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 monclient: found mon.a 2026-02-13T18:21:14.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c141ec0 con 0x7f7a9c057f90 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 5 monclient: authenticate success, global_id 124143 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 10 monclient: _renew_subs 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c130fd0 con 0x7f7a9c057f90 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 10 monclient: _renew_subs 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a9c131b60 con 0x7f7a9c057f90 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a980050f0 con 0x7f7a9c057f90 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:14.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a98005480 con 0x7f7a9c057f90 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 10 monclient: dump: 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8bfff640 4 set_mon_vals no callback set 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f7a980056d0 con 0x7f7a9c057f90 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a9c0919f0 con 0x7f7a9c12a170 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7f7a9804dcb0 con 0x7f7a9c057f90 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.117+0000 7f7aa1310640 10 monclient: get_auth_request con 0x7f7a6c03d650 auth_method 0 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7aa1b11640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c12a170 legacy=0x7f7a9c12a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025085331 0 0) 0x7f7a9c0919f0 con 0x7f7a9c12a170 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient(hunting): my global_id is 104345 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c131e40 con 0x7f7a9c12a170 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1658203018 0 0) 0x7f7a9c131e40 con 0x7f7a9c12a170 2026-02-13T18:21:14.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c0919f0 con 0x7f7a9c12a170 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a8c004c30 con 0x7f7a9c12a170 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient: dump: 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.144 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4031034997 0 0) 0x7f7a9c0919f0 con 0x7f7a9c12a170 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a9c0008e0 con 0x7f7a9c12a170 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7a8c007a20 con 0x7f7a9c12a170 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c12a170 legacy=0x7f7a9c12a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.121+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c12a170 legacy=0x7f7a9c12a540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7aa3d9c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:14.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a9c12b020 con 0x7f7a9c12ac50 2026-02-13T18:21:14.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7aa1b11640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c12ac50 legacy=0x7f7a9c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425703955 0 0) 0x7f7a9c12b020 con 0x7f7a9c12ac50 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient(hunting): my global_id is 104348 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c0919f0 con 0x7f7a9c12ac50 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4192533768 0 0) 0x7f7a9c0919f0 con 0x7f7a9c12ac50 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c12b020 con 0x7f7a9c12ac50 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7a8c0053d0 con 0x7f7a9c12ac50 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 10 monclient: dump: 2026-02-13T18:21:14.147 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 64338256 0 0) 0x7f7a9c12b020 con 0x7f7a9c12ac50 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.125+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a9c1308a0 con 0x7f7a9c12ac50 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4510 (unknown 0 0 3008214200) 0x7f7a8c0077e0 con 0x7f7a9c12ac50 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7a8a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:14.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7a8a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c12ac50 legacy=0x7f7a9c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7a8a7fc640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6790/0 conn(0x7f7a9c12ac50 legacy=0x7f7a9c1978c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 56, 2026-02-13T18:21:14.149 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 218630, 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.150 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.151 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:14.152 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:14.153 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.154 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.155 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.156 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:14.157 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.158 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:14.159 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:14.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.187:6812/2668687789 conn(0x7f7a6c03d650 legacy=0x7f7a6c05db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 10 monclient: shutdown 2026-02-13T18:21:14.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:14.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 >> v1:10.20.193.78:6789/0 conn(0x7f7a9c057f90 legacy=0x7f7a9c195190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa2312640 1 -- 10.20.193.78:0/3550062695 reap_dead start 2026-02-13T18:21:14.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa2312640 1 -- 10.20.193.78:0/3550062695 reap_dead start 2026-02-13T18:21:14.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 shutdown_connections 2026-02-13T18:21:14.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 >> 10.20.193.78:0/3550062695 conn(0x7f7a9c054e70 msgr2=0x7f7a9c08b550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:14.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 shutdown_connections 2026-02-13T18:21:14.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.129+0000 7f7aa3d9c640 1 -- 10.20.193.78:0/3550062695 wait complete. 2026-02-13T18:21:14.161 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:21:14.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:21:14.161 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:21:14.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient: get_monmap_and_config 2026-02-13T18:21:14.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient: build_initial_monmap 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient: monmap: 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:14.215438+0000 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:14.215438+0000 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:14.224 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 1 Processor -- start 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 1 -- start start 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient: init 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient(hunting): picked mon.noname-c con 0x7f34b008b0f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient(hunting): picked mon.noname-a con 0x7f34b0086cd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient(hunting): picked mon.noname-b con 0x7f34b0182b50 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0086560 con 0x7f34b0086cd0 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0086840 con 0x7f34b008b0f0 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b008d1f0 con 0x7f34b0182b50 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b672e640 10 monclient(hunting): authenticate will time out at 1505.270629s 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b4f2b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f34b0086cd0 0x7f34b008cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59378/0 (socket says 10.20.193.78:59378) 2026-02-13T18:21:14.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.213+0000 7f34b4f2b640 1 -- 10.20.193.78:0/1370286056 learned_addr learned my addr 10.20.193.78:0/1370286056 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:14.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b4f2b640 1 -- 10.20.193.78:0/1370286056 >> v1:10.20.193.78:6789/0 conn(0x7f34b0086cd0 legacy=0x7f34b008cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b5f2d640 1 -- 10.20.193.78:0/1370286056 >> v1:10.20.193.78:6790/0 conn(0x7f34b0182b50 legacy=0x7f34b01a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258195633 0 0) 0x7f34b0086560 con 0x7f34b0086cd0 2026-02-13T18:21:14.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): my global_id is 124146 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3498003620 con 0x7f34b0086cd0 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220991241 0 0) 0x7f34b008d1f0 con 0x7f34b0182b50 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient(hunting): my global_id is 104351 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b0086560 con 0x7f34b0182b50 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b572c640 1 -- 10.20.193.78:0/1370286056 >> v1:10.20.193.187:6789/0 conn(0x7f34b008b0f0 legacy=0x7f34b008c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2110673759 0 0) 0x7f3498003620 con 0x7f34b0086cd0 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 >> v1:10.20.193.78:6790/0 conn(0x7f34b0182b50 legacy=0x7f34b01a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 >> v1:10.20.193.187:6789/0 conn(0x7f34b008b0f0 legacy=0x7f34b008c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 monclient: found mon.noname-a 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b008de50 con 0x7f34b0086cd0 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: _finish_auth 0 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 5 monclient: authenticate success, global_id 124146 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a4003110 con 0x7f34b0086cd0 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: dump: 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.231 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34ac004670 con 0x7f34b0182b50 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34a4003450 con 0x7f34b0086cd0 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 1 -- 10.20.193.78:0/1370286056 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a4004b50 con 0x7f34b0086cd0 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f349ffff640 10 monclient: dump: 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 4 set_mon_vals no callback set 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: shutdown 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:14.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- 10.20.193.78:0/1370286056 >> v1:10.20.193.78:6789/0 conn(0x7f34b0086cd0 legacy=0x7f34b008cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- 10.20.193.78:0/1370286056 shutdown_connections 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- 10.20.193.78:0/1370286056 >> 10.20.193.78:0/1370286056 conn(0x7f34b00545d0 msgr2=0x7f34b00549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- 10.20.193.78:0/1370286056 shutdown_connections 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- 10.20.193.78:0/1370286056 wait complete. 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: build_initial_monmap 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: monmap: 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:14.234 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 Processor -- start 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- start start 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: init 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient(hunting): picked mon.noname-b con 0x7f34b0086cd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient(hunting): picked mon.noname-c con 0x7f34b008b0f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient(hunting): picked mon.noname-a con 0x7f34b0182b50 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0058330 con 0x7f34b0182b50 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0089ae0 con 0x7f34b0086cd0 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b013c330 con 0x7f34b008b0f0 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b672e640 10 monclient(hunting): authenticate will time out at 1505.275098s 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b4f2b640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f34b008b0f0 0x7f34b00893d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39574/0 (socket says 10.20.193.78:39574) 2026-02-13T18:21:14.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.217+0000 7f34b4f2b640 1 -- 10.20.193.78:0/2860514148 learned_addr learned my addr 10.20.193.78:0/2860514148 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:14.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b4f2b640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.78:6790/0 conn(0x7f34b008b0f0 legacy=0x7f34b00893d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b5f2d640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.78:6789/0 conn(0x7f34b0182b50 legacy=0x7f34b0195220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b572c640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b0086cd0 legacy=0x7f34b0088cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97221998 0 0) 0x7f34b013c330 con 0x7f34b008b0f0 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): my global_id is 104354 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3480003620 con 0x7f34b008b0f0 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509192551 0 0) 0x7f34ac004960 con 0x7f34b0182b50 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): my global_id is 124149 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b013c330 con 0x7f34b0182b50 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719584666 0 0) 0x7f34b0089ae0 con 0x7f34b0086cd0 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): my global_id is 114211 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ac004960 con 0x7f34b0086cd0 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 10850490 0 0) 0x7f3480003620 con 0x7f34b008b0f0 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b0089ae0 con 0x7f34b008b0f0 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a40048e0 con 0x7f34b008b0f0 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): dump: 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 380433297 0 0) 0x7f34b013c330 con 0x7f34b0182b50 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3480003620 con 0x7f34b0182b50 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34ac004dd0 con 0x7f34b0182b50 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): dump: 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.242 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3725623749 0 0) 0x7f34ac004960 con 0x7f34b0086cd0 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b013c330 con 0x7f34b0086cd0 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a0003340 con 0x7f34b0086cd0 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient(hunting): dump: 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.243 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4202596052 0 0) 0x7f34b0089ae0 con 0x7f34b008b0f0 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b0086cd0 legacy=0x7f34b0088cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.78:6789/0 conn(0x7f34b0182b50 legacy=0x7f34b0195220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: _finish_hunting 0 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 monclient: found mon.c 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b013d570 con 0x7f34b008b0f0 2026-02-13T18:21:14.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: _finish_auth 0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: _check_auth_tickets 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 5 monclient: authenticate success, global_id 104354 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 10 monclient: _renew_subs 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34b013d850 con 0x7f34b008b0f0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 10 monclient: _renew_subs 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f34b0141510 con 0x7f34b008b0f0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34a4003350 con 0x7f34b008b0f0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a4005320 con 0x7f34b008b0f0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:14.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 10 monclient: dump: 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349f7fe640 4 set_mon_vals no callback set 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34b013c7a0 con 0x7f34b005a9f0 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f34a40119b0 con 0x7f34b008b0f0 2026-02-13T18:21:14.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7f34a404c5a0 con 0x7f34b008b0f0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.221+0000 7f34b5f2d640 10 monclient: get_auth_request con 0x7f348003d9a0 auth_method 0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f34b572c640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b005a9f0 legacy=0x7f34b005adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150742765 0 0) 0x7f34b013c7a0 con 0x7f34b005a9f0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient(hunting): my global_id is 114214 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b0089ae0 con 0x7f34b005a9f0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1877450414 0 0) 0x7f34b0089ae0 con 0x7f34b005a9f0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b013c7a0 con 0x7f34b005a9f0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a0003af0 con 0x7f34b005a9f0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient: dump: 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.247 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3942022492 0 0) 0x7f34b013c7a0 con 0x7f34b005a9f0 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34b00008e0 con 0x7f34b005a9f0 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f34a00058c0 con 0x7f34b005a9f0 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b005a9f0 legacy=0x7f34b005adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.225+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b005a9f0 legacy=0x7f34b005adc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:14.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.229+0000 7f34b672e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:14.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.229+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34b0090810 con 0x7f34b005b4d0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.229+0000 7f34b572c640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b005b4d0 legacy=0x7f34b0197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499497485 0 0) 0x7f34b0090810 con 0x7f34b005b4d0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient(hunting): my global_id is 114217 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b013c7a0 con 0x7f34b005b4d0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2360337025 0 0) 0x7f34b013c7a0 con 0x7f34b005b4d0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b0090810 con 0x7f34b005b4d0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f34a0004200 con 0x7f34b005b4d0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient: dump: 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 16842310 0 0) 0x7f34b0090810 con 0x7f34b005b4d0 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f34b005b8a0 con 0x7f34b005b4d0 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 2187619339) 0x7f34a0004510 con 0x7f34b005b4d0 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b005b4d0 legacy=0x7f34b0197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f349dffb640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6789/0 conn(0x7f34b005b4d0 legacy=0x7f34b0197950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 56, 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 110922, 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:14.252 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.253 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.254 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:14.255 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:14.256 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.257 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.258 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:14.259 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:14.260 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:14.261 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:14.262 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:14.262 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:14.262 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:14.262 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.187:6812/2668687789 conn(0x7f348003d9a0 legacy=0x7f348005de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 10 monclient: shutdown 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 >> v1:10.20.193.78:6790/0 conn(0x7f34b008b0f0 legacy=0x7f34b00893d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b5f2d640 1 -- 10.20.193.78:0/2860514148 reap_dead start 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b5f2d640 1 -- 10.20.193.78:0/2860514148 reap_dead start 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 shutdown_connections 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 >> 10.20.193.78:0/2860514148 conn(0x7f34b00545d0 msgr2=0x7f34b0191070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 shutdown_connections 2026-02-13T18:21:14.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:14.233+0000 7f34b672e640 1 -- 10.20.193.78:0/2860514148 wait complete. 2026-02-13T18:21:14.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:21:14.264 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T18:21:14.264 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-13T18:21:14.264 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T18:21:14.264 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T18:21:14.264 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T18:21:14.264 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:21:14.275 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T18:21:14.275 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-13T18:21:14.275 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-13T18:21:14.275 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-13T18:21:14.275 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T18:21:29.276 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-13T18:21:29.276 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-13T18:21:29.277 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-13T18:21:29.277 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:21:29.277 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:21:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient: get_monmap_and_config 2026-02-13T18:21:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient: build_initial_monmap 2026-02-13T18:21:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient: monmap: 2026-02-13T18:21:29.346 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:29.346 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:29.346 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:29.336187+0000 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:29.336187+0000 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 1 Processor -- start 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 1 -- start start 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient: init 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient(hunting): picked mon.noname-a con 0x7faf4c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient(hunting): picked mon.noname-c con 0x7faf4c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient(hunting): picked mon.noname-b con 0x7faf4c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c089e80 con 0x7faf4c08c2f0 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c088c20 con 0x7faf4c08dc80 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c089ba0 con 0x7faf4c08cdd0 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf510d9640 10 monclient(hunting): authenticate will time out at 1520.391425s 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf4a575640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf4ad76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 0x7faf4c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:43436/0 (socket says 10.20.193.78:43436) 2026-02-13T18:21:29.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.333+0000 7faf4ad76640 1 -- 10.20.193.78:0/4134569624 learned_addr learned my addr 10.20.193.78:0/4134569624 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:29.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.337+0000 7faf4ad76640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 legacy=0x7faf4c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:29.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.337+0000 7faf4b577640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 legacy=0x7faf4c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:29.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.537+0000 7faf4a575640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:29.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:29.941+0000 7faf4a575640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:30.754 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:30.745+0000 7faf4a575640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:32.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): tick 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 monclient(hunting): continuing hunt 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 legacy=0x7faf4c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 legacy=0x7faf4c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): picked mon.noname-b con 0x7faf4c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): picked mon.noname-a con 0x7faf4c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:32.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): picked mon.noname-c con 0x7faf4c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:32.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 -- 10.20.193.78:0/4134569624 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c08d370 con 0x7faf4c08c2f0 2026-02-13T18:21:32.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 -- 10.20.193.78:0/4134569624 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c088c20 con 0x7faf4c08dc80 2026-02-13T18:21:32.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 1 -- 10.20.193.78:0/4134569624 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3006a180 con 0x7faf4c08cdd0 2026-02-13T18:21:32.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf48d72640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:32.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.333+0000 7faf4b577640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf300668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:32.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.337+0000 7faf4ad76640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 legacy=0x7faf300238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:32.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.337+0000 7faf4a575640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 legacy=0x7faf300450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:32.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.537+0000 7faf4b577640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf300668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:32.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:32.941+0000 7faf4b577640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf300668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:33.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:33.745+0000 7faf4b577640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf300668a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566875978 0 0) 0x7faf3006a180 con 0x7faf4c08cdd0 2026-02-13T18:21:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): my global_id is 104357 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf38003620 con 0x7faf4c08cdd0 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38326038 0 0) 0x7faf4c08d370 con 0x7faf4c08c2f0 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient(hunting): my global_id is 124152 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf3006a180 con 0x7faf4c08c2f0 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1921539473 0 0) 0x7faf3006a180 con 0x7faf4c08c2f0 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 legacy=0x7faf300238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf300668a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:21:34.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: _finish_hunting 0 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 monclient: found mon.noname-a 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3006b4e0 con 0x7faf4c08c2f0 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: _finish_auth 0 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: _check_auth_tickets 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf34004550 con 0x7faf4c08c2f0 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:34.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: dump: 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 5 monclient: authenticate success, global_id 124152 2026-02-13T18:21:34.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf34004890 con 0x7faf4c08c2f0 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 1 -- 10.20.193.78:0/4134569624 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf34004c20 con 0x7faf4c08c2f0 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf49d74640 10 monclient: dump: 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.335 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 4 set_mon_vals no callback set 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: shutdown 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- 10.20.193.78:0/4134569624 >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 legacy=0x7faf300450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- 10.20.193.78:0/4134569624 shutdown_connections 2026-02-13T18:21:34.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- 10.20.193.78:0/4134569624 >> 10.20.193.78:0/4134569624 conn(0x7faf4c091720 msgr2=0x7faf4c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- 10.20.193.78:0/4134569624 shutdown_connections 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- 10.20.193.78:0/4134569624 wait complete. 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: build_initial_monmap 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: monmap: 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:34.337 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 Processor -- start 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- start start 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: init 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient(hunting): picked mon.noname-a con 0x7faf4c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient(hunting): picked mon.noname-c con 0x7faf4c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient(hunting): picked mon.noname-b con 0x7faf4c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c081ba0 con 0x7faf4c08c2f0 2026-02-13T18:21:34.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c081e80 con 0x7faf4c08dc80 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c082160 con 0x7faf4c08cdd0 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf510d9640 10 monclient(hunting): authenticate will time out at 1525.375900s 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf4ad76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 0x7faf4c1d9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:58156/0 (socket says 10.20.193.78:58156) 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf4ad76640 1 -- 10.20.193.78:0/1173036219 learned_addr learned my addr 10.20.193.78:0/1173036219 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.317+0000 7faf4a575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 0x7faf4c083970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:53846/0 (socket says 10.20.193.78:53846) 2026-02-13T18:21:34.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf4b577640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c23c050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf4ad76640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 legacy=0x7faf4c1d9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf4a575640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 legacy=0x7faf4c083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481953343 0 0) 0x7faf4c081ba0 con 0x7faf4c08c2f0 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): my global_id is 124155 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf18003620 con 0x7faf4c08c2f0 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091566590 0 0) 0x7faf4c082160 con 0x7faf4c08cdd0 2026-02-13T18:21:34.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): my global_id is 104360 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf4c081ba0 con 0x7faf4c08cdd0 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2715832421 0 0) 0x7faf18003620 con 0x7faf4c08c2f0 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf4c082160 con 0x7faf4c08c2f0 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf40003300 con 0x7faf4c08c2f0 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): dump: 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.344 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2815290206 0 0) 0x7faf4c081ba0 con 0x7faf4c08cdd0 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf18003620 con 0x7faf4c08cdd0 2026-02-13T18:21:34.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf34004a40 con 0x7faf4c08cdd0 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient(hunting): dump: 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.346 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3711544190 0 0) 0x7faf18003620 con 0x7faf4c08cdd0 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.187:6789/0 conn(0x7faf4c08dc80 legacy=0x7faf4c23c050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.78:6789/0 conn(0x7faf4c08c2f0 legacy=0x7faf4c1d9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 monclient: found mon.c 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c080230 con 0x7faf4c08cdd0 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: _finish_auth 0 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:34.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 5 monclient: authenticate success, global_id 104360 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 monclient: _renew_subs 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf4c080c40 con 0x7faf4c08cdd0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 monclient: _renew_subs 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faf4c084250 con 0x7faf4c08cdd0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf34004820 con 0x7faf4c08cdd0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf34005040 con 0x7faf4c08cdd0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 10 monclient: dump: 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf49573640 4 set_mon_vals no callback set 2026-02-13T18:21:34.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7faf340051e0 con 0x7faf4c08cdd0 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4c08f620 con 0x7faf4c08cdd0 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7faf3404c5e0 con 0x7faf4c08cdd0 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.321+0000 7faf4ad76640 10 monclient: get_auth_request con 0x7faf1803d570 auth_method 0 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.325+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7faf4c08f620 con 0x7faf4c08cdd0 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.325+0000 7faf2b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.325+0000 7faf2b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:34.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faf4c090810 con 0x7faf4c08cdd0 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf2b7fe640 1 -- 10.20.193.78:0/1173036219 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 3278351930) 0x7faf34017620 con 0x7faf4c08cdd0 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf2b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf2b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:34.453 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:21:34.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.187:6812/2668687789 conn(0x7faf1803d570 legacy=0x7faf1805da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 10 monclient: shutdown 2026-02-13T18:21:34.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:34.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 >> v1:10.20.193.78:6790/0 conn(0x7faf4c08cdd0 legacy=0x7faf4c083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 shutdown_connections 2026-02-13T18:21:34.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 >> 10.20.193.78:0/1173036219 conn(0x7faf4c091720 msgr2=0x7faf4c057a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:34.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 shutdown_connections 2026-02-13T18:21:34.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.441+0000 7faf510d9640 1 -- 10.20.193.78:0/1173036219 wait complete. 2026-02-13T18:21:34.463 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:21:34.463 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T18:21:34.463 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:21:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient: get_monmap_and_config 2026-02-13T18:21:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient: build_initial_monmap 2026-02-13T18:21:34.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient: monmap: 2026-02-13T18:21:34.526 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:34.516864+0000 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:34.516864+0000 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 1 Processor -- start 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 1 -- start start 2026-02-13T18:21:34.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient: init 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient(hunting): picked mon.noname-c con 0x7f9ae808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient(hunting): picked mon.noname-a con 0x7f9ae808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient(hunting): picked mon.noname-b con 0x7f9ae808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae8089e80 con 0x7f9ae808dc80 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae8088c20 con 0x7f9ae808c2f0 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae8089ba0 con 0x7f9ae808cdd0 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.513+0000 7f9aed916640 10 monclient(hunting): authenticate will time out at 1525.571983s 2026-02-13T18:21:34.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae6ffd640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f9ae808c2f0 legacy=0x7f9ae808c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae77fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9ae808cdd0 0x7f9ae81a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:53862/0 (socket says 10.20.193.78:53862) 2026-02-13T18:21:34.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae77fe640 1 -- 10.20.193.78:0/1954263842 learned_addr learned my addr 10.20.193.78:0/1954263842 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae77fe640 1 -- 10.20.193.78:0/1954263842 >> v1:10.20.193.78:6790/0 conn(0x7f9ae808cdd0 legacy=0x7f9ae81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae67fc640 1 -- 10.20.193.78:0/1954263842 >> v1:10.20.193.78:6789/0 conn(0x7f9ae808dc80 legacy=0x7f9ae8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010477662 0 0) 0x7f9ae8089ba0 con 0x7f9ae808cdd0 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): my global_id is 104363 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad4003620 con 0x7f9ae808cdd0 2026-02-13T18:21:34.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804217343 0 0) 0x7f9ae8089e80 con 0x7f9ae808dc80 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient(hunting): my global_id is 124158 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae8089ba0 con 0x7f9ae808dc80 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3903926931 0 0) 0x7f9ad4003620 con 0x7f9ae808cdd0 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 >> v1:10.20.193.187:6789/0 conn(0x7f9ae808c2f0 legacy=0x7f9ae808c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 >> v1:10.20.193.78:6789/0 conn(0x7f9ae808dc80 legacy=0x7f9ae8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 monclient: found mon.noname-b 2026-02-13T18:21:34.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae808d370 con 0x7f9ae808cdd0 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: _finish_auth 0 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 5 monclient: authenticate success, global_id 104363 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ad8004620 con 0x7f9ae808cdd0 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: dump: 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.538 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ad80048f0 con 0x7f9ae808cdd0 2026-02-13T18:21:34.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 1 -- 10.20.193.78:0/1954263842 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ad8006060 con 0x7f9ae808cdd0 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9ae5ffb640 10 monclient: dump: 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.540 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 4 set_mon_vals no callback set 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 10 monclient: shutdown 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 1 -- 10.20.193.78:0/1954263842 >> v1:10.20.193.78:6790/0 conn(0x7f9ae808cdd0 legacy=0x7f9ae81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 1 -- 10.20.193.78:0/1954263842 shutdown_connections 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 1 -- 10.20.193.78:0/1954263842 >> 10.20.193.78:0/1954263842 conn(0x7f9ae8091720 msgr2=0x7f9ae8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 1 -- 10.20.193.78:0/1954263842 shutdown_connections 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 1 -- 10.20.193.78:0/1954263842 wait complete. 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 10 monclient: build_initial_monmap 2026-02-13T18:21:34.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.517+0000 7f9aed916640 10 monclient: monmap: 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 Processor -- start 2026-02-13T18:21:34.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- start start 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: init 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient(hunting): picked mon.noname-b con 0x7f9ae808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient(hunting): picked mon.noname-a con 0x7f9ae808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient(hunting): picked mon.noname-c con 0x7f9ae808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae8082240 con 0x7f9ae808cdd0 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae805d570 con 0x7f9ae808c2f0 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae8057910 con 0x7f9ae808dc80 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient(hunting): authenticate will time out at 1525.576531s 2026-02-13T18:21:34.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae6ffd640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7f9ae808c2f0 legacy=0x7f9ae8083770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae77fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9ae808dc80 0x7f9ae81959e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:53868/0 (socket says 10.20.193.78:53868) 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae77fe640 1 -- 10.20.193.78:0/3172483748 learned_addr learned my addr 10.20.193.78:0/3172483748 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae67fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9ae808cdd0 0x7f9ae81942c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:58170/0 (socket says 10.20.193.78:58170) 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae77fe640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6790/0 conn(0x7f9ae808dc80 legacy=0x7f9ae81959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae67fc640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae808cdd0 legacy=0x7f9ae81942c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1912427220 0 0) 0x7f9ae8057910 con 0x7f9ae808dc80 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): my global_id is 104366 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab8003620 con 0x7f9ae808dc80 2026-02-13T18:21:34.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611839913 0 0) 0x7f9ae8082240 con 0x7f9ae808cdd0 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): my global_id is 124161 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae8057910 con 0x7f9ae808cdd0 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1329154102 0 0) 0x7f9ab8003620 con 0x7f9ae808dc80 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ae8082240 con 0x7f9ae808dc80 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ad8004080 con 0x7f9ae808dc80 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): dump: 2026-02-13T18:21:34.545 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2344123144 0 0) 0x7f9ae8057910 con 0x7f9ae808cdd0 2026-02-13T18:21:34.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ab8003620 con 0x7f9ae808cdd0 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ad00033f0 con 0x7f9ae808cdd0 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient(hunting): dump: 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.547 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1681714148 0 0) 0x7f9ae8082240 con 0x7f9ae808dc80 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.187:6789/0 conn(0x7f9ae808c2f0 legacy=0x7f9ae8083770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae808cdd0 legacy=0x7f9ae81942c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: _finish_hunting 0 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 monclient: found mon.c 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae8088910 con 0x7f9ae808dc80 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: _finish_auth 0 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: _check_auth_tickets 2026-02-13T18:21:34.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 5 monclient: authenticate success, global_id 104366 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: _renew_subs 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae8081f60 con 0x7f9ae808dc80 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: _renew_subs 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ae8083e80 con 0x7f9ae808dc80 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ad8006020 con 0x7f9ae808dc80 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ad8006680 con 0x7f9ae808dc80 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 10 monclient: dump: 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9ae57fa640 4 set_mon_vals no callback set 2026-02-13T18:21:34.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9ad8012d10 con 0x7f9ae808dc80 2026-02-13T18:21:34.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.521+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9ae808f5e0 con 0x7f9ae8152f40 2026-02-13T18:21:34.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7f9ad804daf0 con 0x7f9ae808dc80 2026-02-13T18:21:34.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9ae67fc640 10 monclient: get_auth_request con 0x7f9ab803d610 auth_method 0 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9ae6ffd640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae8152f40 legacy=0x7f9ae805ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729022362 0 0) 0x7f9ae808f5e0 con 0x7f9ae8152f40 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient(hunting): my global_id is 124164 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae8082240 con 0x7f9ae8152f40 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2770429366 0 0) 0x7f9ae8082240 con 0x7f9ae8152f40 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ae808f5e0 con 0x7f9ae8152f40 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9adc004370 con 0x7f9ae8152f40 2026-02-13T18:21:34.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient: dump: 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.555 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1568904477 0 0) 0x7f9ae808f5e0 con 0x7f9ae8152f40 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ae8090810 con 0x7f9ae8152f40 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9adc0067a0 con 0x7f9ae8152f40 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae8152f40 legacy=0x7f9ae805ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.525+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae8152f40 legacy=0x7f9ae805ac70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.529+0000 7f9aed916640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.529+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9ae80510e0 con 0x7f9ae804d200 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9ae6ffd640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae804d200 legacy=0x7f9ae8198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072452807 0 0) 0x7f9ae80510e0 con 0x7f9ae804d200 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient(hunting): my global_id is 124167 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae808f5e0 con 0x7f9ae804d200 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3472580519 0 0) 0x7f9ae808f5e0 con 0x7f9ae804d200 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ae80510e0 con 0x7f9ae804d200 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9adc004b30 con 0x7f9ae804d200 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient: dump: 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.557 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1836832924 0 0) 0x7f9ae80510e0 con 0x7f9ae804d200 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9ae8153310 con 0x7f9ae804d200 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 197270771) 0x7f9adc006a20 con 0x7f9ae804d200 2026-02-13T18:21:34.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae804d200 legacy=0x7f9ae8198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9abffff640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6789/0 conn(0x7f9ae804d200 legacy=0x7f9ae8198110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:34.559 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 58, 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 23071, 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:34.560 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:34.561 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:34.562 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:34.563 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:34.564 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:34.565 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:34.566 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:34.567 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.568 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.569 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.570 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:34.571 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:34.572 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9ab803d610 legacy=0x7f9ab805dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 10 monclient: shutdown 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 >> v1:10.20.193.78:6790/0 conn(0x7f9ae808dc80 legacy=0x7f9ae81959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9ae77fe640 1 -- 10.20.193.78:0/3172483748 reap_dead start 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9ae77fe640 1 -- 10.20.193.78:0/3172483748 reap_dead start 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 shutdown_connections 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 >> 10.20.193.78:0/3172483748 conn(0x7f9ae8091720 msgr2=0x7f9ae805daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 shutdown_connections 2026-02-13T18:21:34.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.533+0000 7f9aed916640 1 -- 10.20.193.78:0/3172483748 wait complete. 2026-02-13T18:21:34.573 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:21:34.574 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T18:21:34.574 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient: get_monmap_and_config 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient: build_initial_monmap 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient: monmap: 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:21:34.635472+0000 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:21:34.635472+0000 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:34.644 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.645 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:34.645 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:21:34.645 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:21:34.645 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 1 Processor -- start 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 1 -- start start 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient: init 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient(hunting): picked mon.noname-b con 0x7efdbc085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient(hunting): picked mon.noname-c con 0x7efdbc085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient(hunting): picked mon.noname-a con 0x7efdbc181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:34.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc088400 con 0x7efdbc181d50 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc088120 con 0x7efdbc085b60 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc08c550 con 0x7efdbc085790 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdb3fff640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7efdbc085b60 legacy=0x7efdbc085fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc308a640 10 monclient(hunting): authenticate will time out at 1525.690872s 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc0dff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7efdbc085790 0x7efdbc089100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:53870/0 (socket says 10.20.193.78:53870) 2026-02-13T18:21:34.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.633+0000 7efdc0dff640 1 -- 10.20.193.78:0/1535044424 learned_addr learned my addr 10.20.193.78:0/1535044424 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:34.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc1600640 1 -- 10.20.193.78:0/1535044424 >> v1:10.20.193.78:6789/0 conn(0x7efdbc181d50 legacy=0x7efdbc1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc0dff640 1 -- 10.20.193.78:0/1535044424 >> v1:10.20.193.78:6790/0 conn(0x7efdbc085790 legacy=0x7efdbc089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721159106 0 0) 0x7efdbc08c550 con 0x7efdbc085790 2026-02-13T18:21:34.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): my global_id is 104369 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda80058b0 con 0x7efdbc085790 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888186007 0 0) 0x7efdb80041c0 con 0x7efdbc181d50 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient(hunting): my global_id is 124170 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc08c550 con 0x7efdbc181d50 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2072104110 0 0) 0x7efda80058b0 con 0x7efdbc085790 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 >> v1:10.20.193.187:6789/0 conn(0x7efdbc085b60 legacy=0x7efdbc085fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 >> v1:10.20.193.78:6789/0 conn(0x7efdbc181d50 legacy=0x7efdbc1a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 monclient: found mon.noname-b 2026-02-13T18:21:34.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc087540 con 0x7efdbc085790 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: _finish_auth 0 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdac003040 con 0x7efdbc085790 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: dump: 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.651 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 5 monclient: authenticate success, global_id 104369 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdac003380 con 0x7efdbc085790 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 1 -- 10.20.193.78:0/1535044424 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdac004b50 con 0x7efdbc085790 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb37fe640 10 monclient: dump: 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.652 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: get_monmap_and_config success 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 4 set_mon_vals no callback set 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: shutdown 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- 10.20.193.78:0/1535044424 >> v1:10.20.193.78:6790/0 conn(0x7efdbc085790 legacy=0x7efdbc089100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- 10.20.193.78:0/1535044424 shutdown_connections 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- 10.20.193.78:0/1535044424 >> 10.20.193.78:0/1535044424 conn(0x7efdbc091720 msgr2=0x7efdbc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- 10.20.193.78:0/1535044424 shutdown_connections 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- 10.20.193.78:0/1535044424 wait complete. 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: build_initial_monmap 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: monmap: 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:21:34.653 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 Processor -- start 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- start start 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: init 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: _reopen_session rank -1 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient(hunting): picked mon.noname-c con 0x7efdbc085790 addr v1:10.20.193.78:6790/0 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient(hunting): picked mon.noname-b con 0x7efdbc085b60 addr v1:10.20.193.187:6789/0 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient(hunting): picked mon.noname-a con 0x7efdbc181d50 addr v1:10.20.193.78:6789/0 2026-02-13T18:21:34.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc13f530 con 0x7efdbc181d50 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc089ee0 con 0x7efdbc085b60 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc13f810 con 0x7efdbc085790 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient(hunting): _renew_subs 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc308a640 10 monclient(hunting): authenticate will time out at 1525.695366s 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc0dff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7efdbc085790 0x7efdbc150160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:53872/0 (socket says 10.20.193.78:53872) 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdb3fff640 1 -- >> v1:10.20.193.187:6789/0 conn(0x7efdbc085b60 legacy=0x7efdbc174320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.187:6789/0 2026-02-13T18:21:34.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.637+0000 7efdc0dff640 1 -- 10.20.193.78:0/2151208866 learned_addr learned my addr 10.20.193.78:0/2151208866 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc0dff640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc085790 legacy=0x7efdbc150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc1600640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6789/0 conn(0x7efdbc181d50 legacy=0x7efdbc175a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431370824 0 0) 0x7efdbc13f530 con 0x7efdbc181d50 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): my global_id is 124173 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8c003620 con 0x7efdbc181d50 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676908779 0 0) 0x7efdbc13f810 con 0x7efdbc085790 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): my global_id is 104372 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc13f530 con 0x7efdbc085790 2026-02-13T18:21:34.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3951589769 0 0) 0x7efd8c003620 con 0x7efdbc181d50 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdbc13f810 con 0x7efdbc181d50 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdb8004160 con 0x7efdbc181d50 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): dump: 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:21:34.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 694477985 0 0) 0x7efdbc13f530 con 0x7efdbc085790 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd8c003620 con 0x7efdbc085790 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdac003530 con 0x7efdbc085790 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient(hunting): dump: 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 433516840 0 0) 0x7efdbc13f810 con 0x7efdbc181d50 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc085790 legacy=0x7efdbc150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.187:6789/0 conn(0x7efdbc085b60 legacy=0x7efdbc174320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: _finish_hunting 0 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 monclient: found mon.a 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc05d3d0 con 0x7efdbc181d50 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: _finish_auth 0 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: _check_auth_tickets 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 5 monclient: authenticate success, global_id 124173 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 10 monclient: _renew_subs 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc13f250 con 0x7efdbc181d50 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 10 monclient: _renew_subs 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:21:34.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efdbc13ff70 con 0x7efdbc181d50 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdb8004ed0 con 0x7efdbc181d50 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdb8005260 con 0x7efdbc181d50 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 10 monclient: dump: 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb2ffd640 4 set_mon_vals no callback set 2026-02-13T18:21:34.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7efdb8005440 con 0x7efdbc181d50 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efdbc08f620 con 0x7efdbc08cba0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(779..779 src has 621..779) ==== 3959+0+0 (unknown 2854034106 0 0) 0x7efdb804dac0 con 0x7efdbc181d50 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.641+0000 7efdb3fff640 10 monclient: get_auth_request con 0x7efd8c03d610 auth_method 0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdc0dff640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc08cba0 legacy=0x7efdbc137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597775043 0 0) 0x7efd8c003620 con 0x7efdbc08cba0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient(hunting): my global_id is 104375 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc13f810 con 0x7efdbc08cba0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1774393762 0 0) 0x7efdbc13f810 con 0x7efdbc08cba0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd8c003620 con 0x7efdbc08cba0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdac004b30 con 0x7efdbc08cba0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient: dump: 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 77657494 0 0) 0x7efd8c003620 con 0x7efdbc08cba0 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdbc090810 con 0x7efdbc08cba0 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efdac004fc0 con 0x7efdbc08cba0 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:21:34.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc08cba0 legacy=0x7efdbc137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.645+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc08cba0 legacy=0x7efdbc137800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdc308a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efdbc150c40 con 0x7efdbc150870 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdc0dff640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc150870 legacy=0x7efdbc137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420514035 0 0) 0x7efdbc087540 con 0x7efdbc150870 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:21:34.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 10 monclient(hunting): my global_id is 104378 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8c003620 con 0x7efdbc150870 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.649+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2660856059 0 0) 0x7efd8c003620 con 0x7efdbc150870 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdbc087540 con 0x7efdbc150870 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7efdac005740 con 0x7efdbc150870 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 10 monclient: dump: 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:21:34.667 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1195059122 0 0) 0x7efdbc087540 con 0x7efdbc150870 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdbc138620 con 0x7efdbc150870 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4499 (unknown 0 0 1934924353) 0x7efdac005a10 con 0x7efdbc150870 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc150870 legacy=0x7efdbc137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdb17fa640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6790/0 conn(0x7efdbc150870 legacy=0x7efdbc137f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:34.668 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 58, 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 239154, 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:34.669 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:34.670 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:21:34.671 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:21:34.672 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:34.673 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:34.674 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:21:34.675 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:21:34.676 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:21:34.677 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:21:34.678 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:21:34.678 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:21:34.678 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.187:6812/2668687789 conn(0x7efd8c03d610 legacy=0x7efd8c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 10 monclient: shutdown 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 >> v1:10.20.193.78:6789/0 conn(0x7efdbc181d50 legacy=0x7efdbc175a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc1600640 1 -- 10.20.193.78:0/2151208866 reap_dead start 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc1600640 1 -- 10.20.193.78:0/2151208866 reap_dead start 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 shutdown_connections 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 >> 10.20.193.78:0/2151208866 conn(0x7efdbc091720 msgr2=0x7efdbc05bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 shutdown_connections 2026-02-13T18:21:34.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:21:34.653+0000 7efdc308a640 1 -- 10.20.193.78:0/2151208866 wait complete. 2026-02-13T18:21:34.680 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:21:34.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:21:35.316 INFO:tasks.rados.rados.0.trial187.stdout:3447: done (3 left) 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3448: read oid 6 snap -1 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3448: expect (ObjNum 1114 snap 373 seq_num 1114) 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3449: copy_from oid 7 from oid 4 current snap is 383 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: finishing write tid 3 to trial18717860-12 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: finishing write tid 4 to trial18717860-12 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: finishing write tid 5 to trial18717860-12 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: oid 12 updating version 0 to 1474 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: oid 12 version 1474 is already newer than 1471 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: oid 12 version 1474 is already newer than 1473 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:3443: oid 12 version 1474 is already newer than 1472 2026-02-13T18:21:35.317 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1474 (ObjNum 1153 snap 383 seq_num 1153) dirty exists 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3443: left oid 12 (ObjNum 1153 snap 383 seq_num 1153) 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3444: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3444: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1643 (ObjNum 129 snap 0 seq_num 3013857552) dirty dne 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3445: finishing copy_from racing read to trial18717860-22 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3445: finishing copy_from to trial18717860-22 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 2204 (ObjNum 1136 snap 381 seq_num 1136) dirty exists 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3443: done (4 left) 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3444: done (3 left) 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3445: done (2 left) 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:3450: rollback oid 39 current snap is 383 2026-02-13T18:21:35.318 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 39 to 321 2026-02-13T18:21:35.319 INFO:tasks.rados.rados.0.trial187.stdout:3451: rollback oid 40 current snap is 383 2026-02-13T18:21:35.319 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 370 2026-02-13T18:21:35.319 INFO:tasks.rados.rados.0.trial187.stdout:3452: read oid 32 snap 321 2026-02-13T18:21:35.319 INFO:tasks.rados.rados.0.trial187.stdout:3452: expect deleted 2026-02-13T18:21:35.319 INFO:tasks.rados.rados.0.trial187.stdout:3453: delete oid 50 current snap is 383 2026-02-13T18:21:35.319 INFO:tasks.rados.rados.0.trial187.stdout:3452: done (5 left) 2026-02-13T18:21:35.320 INFO:tasks.rados.rados.0.trial187.stdout:3453: done (4 left) 2026-02-13T18:21:35.320 INFO:tasks.rados.rados.0.trial187.stdout:3454: write oid 50 current snap is 383 2026-02-13T18:21:35.320 INFO:tasks.rados.rados.0.trial187.stdout:3454: seq_num 1155 ranges {612085=481898,1788114=675727,3035086=376999} 2026-02-13T18:21:35.326 INFO:tasks.rados.rados.0.trial187.stdout:3454: writing trial18717860-50 from 612085 to 1093983 tid 1 2026-02-13T18:21:35.335 INFO:tasks.rados.rados.0.trial187.stdout:3454: writing trial18717860-50 from 1788114 to 2463841 tid 2 2026-02-13T18:21:35.341 INFO:tasks.rados.rados.0.trial187.stdout:3454: writing trial18717860-50 from 3035086 to 3412085 tid 3 2026-02-13T18:21:35.342 INFO:tasks.rados.rados.0.trial187.stdout:3455: write (excl) oid 31 current snap is 383 2026-02-13T18:21:35.342 INFO:tasks.rados.rados.0.trial187.stdout:3455: seq_num 1156 ranges {628892=673500,1962949=535738,3178862=250030} 2026-02-13T18:21:35.350 INFO:tasks.rados.rados.0.trial187.stdout:3455: writing trial18717860-31 from 628892 to 1302392 tid 1 2026-02-13T18:21:35.358 INFO:tasks.rados.rados.0.trial187.stdout:3455: writing trial18717860-31 from 1962949 to 2498687 tid 2 2026-02-13T18:21:35.365 INFO:tasks.rados.rados.0.trial187.stdout:3455: writing trial18717860-31 from 3178862 to 3428892 tid 3 2026-02-13T18:21:35.365 INFO:tasks.rados.rados.0.trial187.stdout:3456: delete oid 1 current snap is 383 2026-02-13T18:21:35.365 INFO:tasks.rados.rados.0.trial187.stdout:3450: finishing rollback tid 1 to trial18717860-39 2026-02-13T18:21:35.365 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 0 (ObjNum 81 snap 0 seq_num 4016893529) dirty dne 2026-02-13T18:21:35.365 INFO:tasks.rados.rados.0.trial187.stdout:3451: finishing rollback tid 0 to trial18717860-40 2026-02-13T18:21:35.365 INFO:tasks.rados.rados.0.trial187.stdout:3448: expect (ObjNum 1114 snap 373 seq_num 1114) 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3451: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3451: finishing rollback tid 2 to trial18717860-40 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 1482 (ObjNum 1073 snap 354 seq_num 1073) dirty exists 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3449: finishing copy_from racing read to trial18717860-7 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3449: finishing copy_from to trial18717860-7 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1032 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3454: finishing write tid 1 to trial18717860-50 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3454: finishing write tid 2 to trial18717860-50 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3454: finishing write tid 3 to trial18717860-50 2026-02-13T18:21:35.489 INFO:tasks.rados.rados.0.trial187.stdout:3454: finishing write tid 4 to trial18717860-50 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3448: done (6 left) 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3449: done (5 left) 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3450: done (4 left) 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3451: done (3 left) 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3456: done (2 left) 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3457: rollback oid 21 current snap is 383 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 352 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3454: finishing write tid 5 to trial18717860-50 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3454: oid 50 updating version 0 to 1454 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3454: oid 50 updating version 1454 to 1455 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3454: oid 50 updating version 1455 to 1456 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:3454: oid 50 version 1456 is already newer than 1453 2026-02-13T18:21:35.490 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1456 (ObjNum 1155 snap 383 seq_num 1155) dirty exists 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3454: left oid 50 (ObjNum 1155 snap 383 seq_num 1155) 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: finishing write tid 1 to trial18717860-31 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: finishing write tid 2 to trial18717860-31 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: finishing write tid 3 to trial18717860-31 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: finishing write tid 4 to trial18717860-31 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: finishing write tid 5 to trial18717860-31 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: oid 31 updating version 0 to 1040 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: oid 31 updating version 1040 to 1041 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: oid 31 updating version 1041 to 1042 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: oid 31 updating version 1042 to 1043 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1043 (ObjNum 1156 snap 383 seq_num 1156) dirty exists 2026-02-13T18:21:35.491 INFO:tasks.rados.rados.0.trial187.stdout:3455: left oid 31 (ObjNum 1156 snap 383 seq_num 1156) 2026-02-13T18:21:35.492 INFO:tasks.rados.rados.0.trial187.stdout:3454: done (2 left) 2026-02-13T18:21:35.492 INFO:tasks.rados.rados.0.trial187.stdout:3455: done (1 left) 2026-02-13T18:21:35.492 INFO:tasks.rados.rados.0.trial187.stdout:3458: snap_remove snap 350 2026-02-13T18:21:35.560 INFO:tasks.rados.rados.0.trial187.stdout:3458: done (1 left) 2026-02-13T18:21:35.560 INFO:tasks.rados.rados.0.trial187.stdout:3459: write (excl) oid 13 current snap is 383 2026-02-13T18:21:35.560 INFO:tasks.rados.rados.0.trial187.stdout:3459: seq_num 1158 ranges {662506=423998,1563560=539407,2717355=490285} 2026-02-13T18:21:35.566 INFO:tasks.rados.rados.0.trial187.stdout:3459: writing trial18717860-13 from 662506 to 1086504 tid 1 2026-02-13T18:21:35.570 INFO:tasks.rados.rados.0.trial187.stdout:3459: writing trial18717860-13 from 1563560 to 2102967 tid 2 2026-02-13T18:21:35.574 INFO:tasks.rados.rados.0.trial187.stdout:3459: writing trial18717860-13 from 2717355 to 3207640 tid 3 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3460: rollback oid 17 current snap is 383 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 366 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3457: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3457: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3457: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1321 (ObjNum 1068 snap 352 seq_num 1068) dirty exists 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3459: finishing write tid 1 to trial18717860-13 2026-02-13T18:21:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3457: done (2 left) 2026-02-13T18:21:35.576 INFO:tasks.rados.rados.0.trial187.stdout:3461: copy_from oid 2 from oid 1 current snap is 383 2026-02-13T18:21:35.576 INFO:tasks.rados.rados.0.trial187.stdout:3462: write oid 6 current snap is 383 2026-02-13T18:21:35.576 INFO:tasks.rados.rados.0.trial187.stdout:3462: seq_num 1159 ranges {679313=499247,1622042=683065,2744778=701557} 2026-02-13T18:21:35.581 INFO:tasks.rados.rados.0.trial187.stdout:3462: writing trial18717860-6 from 679313 to 1178560 tid 1 2026-02-13T18:21:35.589 INFO:tasks.rados.rados.0.trial187.stdout:3462: writing trial18717860-6 from 1622042 to 2305107 tid 2 2026-02-13T18:21:35.598 INFO:tasks.rados.rados.0.trial187.stdout:3462: writing trial18717860-6 from 2744778 to 3446335 tid 3 2026-02-13T18:21:35.598 INFO:tasks.rados.rados.0.trial187.stdout:3463: read oid 47 snap -1 2026-02-13T18:21:35.598 INFO:tasks.rados.rados.0.trial187.stdout:3463: expect (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3464: read oid 35 snap -1 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3464: expect (ObjNum 1093 snap 363 seq_num 1093) 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3465: read oid 48 snap -1 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3465: expect (ObjNum 1137 snap 382 seq_num 1137) 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3466: copy_from oid 37 from oid 20 current snap is 383 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3459: finishing write tid 2 to trial18717860-13 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3460: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3461: finishing copy_from to trial18717860-2 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3461: got expected ENOENT (src dne) 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3461: finishing copy_from racing read to trial18717860-2 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3459: finishing write tid 3 to trial18717860-13 2026-02-13T18:21:35.599 INFO:tasks.rados.rados.0.trial187.stdout:3459: finishing write tid 4 to trial18717860-13 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: finishing write tid 5 to trial18717860-13 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: oid 13 updating version 0 to 1234 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: oid 13 version 1234 is already newer than 1232 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: oid 13 version 1234 is already newer than 1233 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: oid 13 version 1234 is already newer than 1231 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1234 (ObjNum 1158 snap 383 seq_num 1158) dirty exists 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: left oid 13 (ObjNum 1158 snap 383 seq_num 1158) 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3460: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3460: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2055 (ObjNum 1090 snap 359 seq_num 1090) dirty exists 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3462: finishing write tid 1 to trial18717860-6 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3462: finishing write tid 2 to trial18717860-6 2026-02-13T18:21:35.600 INFO:tasks.rados.rados.0.trial187.stdout:3459: done (7 left) 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3460: done (6 left) 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3461: done (5 left) 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3467: read oid 18 snap -1 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3467: expect (ObjNum 1091 snap 361 seq_num 1091) 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3468: rollback oid 25 current snap is 383 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 25 to 329 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3469: write (excl) oid 33 current snap is 383 2026-02-13T18:21:35.601 INFO:tasks.rados.rados.0.trial187.stdout:3469: seq_num 1160 ranges {696120=574496,1680524=543076,2888554=512829} 2026-02-13T18:21:35.603 INFO:tasks.rados.rados.0.trial187.stdout:3469: writing trial18717860-33 from 696120 to 1270616 tid 1 2026-02-13T18:21:35.607 INFO:tasks.rados.rados.0.trial187.stdout:3469: writing trial18717860-33 from 1680524 to 2223600 tid 2 2026-02-13T18:21:35.612 INFO:tasks.rados.rados.0.trial187.stdout:3469: writing trial18717860-33 from 2888554 to 3401383 tid 3 2026-02-13T18:21:35.612 INFO:tasks.rados.rados.0.trial187.stdout:3470: copy_from oid 8 from oid 27 current snap is 383 2026-02-13T18:21:35.612 INFO:tasks.rados.rados.0.trial187.stdout:3467: expect (ObjNum 1091 snap 361 seq_num 1091) 2026-02-13T18:21:35.682 INFO:tasks.rados.rados.0.trial187.stdout:3462: finishing write tid 3 to trial18717860-6 2026-02-13T18:21:35.682 INFO:tasks.rados.rados.0.trial187.stdout:3468: finishing rollback tid 1 to trial18717860-25 2026-02-13T18:21:35.682 INFO:tasks.rados.rados.0.trial187.stdout:3462: finishing write tid 4 to trial18717860-6 2026-02-13T18:21:35.682 INFO:tasks.rados.rados.0.trial187.stdout:3462: finishing write tid 5 to trial18717860-6 2026-02-13T18:21:35.682 INFO:tasks.rados.rados.0.trial187.stdout:3462: oid 6 updating version 0 to 1653 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:3462: oid 6 updating version 1653 to 1656 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:3462: oid 6 version 1656 is already newer than 1655 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:3462: oid 6 version 1656 is already newer than 1654 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1656 (ObjNum 1159 snap 383 seq_num 1159) dirty exists 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:3462: left oid 6 (ObjNum 1159 snap 383 seq_num 1159) 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:3468: finishing rollback tid 2 to trial18717860-25 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1069 (ObjNum 781 snap 267 seq_num 781) dirty exists 2026-02-13T18:21:35.683 INFO:tasks.rados.rados.0.trial187.stdout:3463: expect (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:21:35.730 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:35.758 INFO:tasks.rados.rados.0.trial187.stdout:3464: expect (ObjNum 1093 snap 363 seq_num 1093) 2026-02-13T18:21:35.808 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:35.858 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:35.909 INFO:tasks.rados.rados.0.trial187.stdout:3465: expect (ObjNum 1137 snap 382 seq_num 1137) 2026-02-13T18:21:35.909 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:35.933 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 117323 2026-02-13T18:21:35.956 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:35.981 INFO:tasks.rados.rados.0.trial187.stdout:3469: finishing write tid 1 to trial18717860-33 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3466: finishing copy_from racing read to trial18717860-37 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: finishing write tid 2 to trial18717860-33 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3466: finishing copy_from to trial18717860-37 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 1639 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: finishing write tid 3 to trial18717860-33 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: finishing write tid 4 to trial18717860-33 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: finishing write tid 5 to trial18717860-33 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: oid 33 updating version 0 to 2243 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: oid 33 version 2243 is already newer than 2242 2026-02-13T18:21:35.982 INFO:tasks.rados.rados.0.trial187.stdout:3469: oid 33 version 2243 is already newer than 2240 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3469: oid 33 version 2243 is already newer than 2239 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2243 (ObjNum 1160 snap 383 seq_num 1160) dirty exists 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3469: left oid 33 (ObjNum 1160 snap 383 seq_num 1160) 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3470: finishing copy_from racing read to trial18717860-8 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3470: finishing copy_from to trial18717860-8 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 1067 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3462: done (8 left) 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3463: done (7 left) 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3464: done (6 left) 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3465: done (5 left) 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3466: done (4 left) 2026-02-13T18:21:35.983 INFO:tasks.rados.rados.0.trial187.stdout:3467: done (3 left) 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3468: done (2 left) 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3469: done (1 left) 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3470: done (0 left) 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3471: read oid 17 snap 321 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3471: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3472: delete oid 22 current snap is 383 2026-02-13T18:21:35.984 INFO:tasks.rados.rados.0.trial187.stdout:3472: done (1 left) 2026-02-13T18:21:35.985 INFO:tasks.rados.rados.0.trial187.stdout:3473: write oid 14 current snap is 383 2026-02-13T18:21:35.985 INFO:tasks.rados.rados.0.trial187.stdout:3473: seq_num 1162 ranges {729734=724994,2197488=430392,3227047=302687} 2026-02-13T18:21:35.993 INFO:tasks.rados.rados.0.trial187.stdout:3473: writing trial18717860-14 from 729734 to 1454728 tid 1 2026-02-13T18:21:36.001 INFO:tasks.rados.rados.0.trial187.stdout:3473: writing trial18717860-14 from 2197488 to 2627880 tid 2 2026-02-13T18:21:36.008 INFO:tasks.rados.rados.0.trial187.stdout:3473: writing trial18717860-14 from 3227047 to 3529734 tid 3 2026-02-13T18:21:36.008 INFO:tasks.rados.rados.0.trial187.stdout:3474: write (excl) oid 29 current snap is 383 2026-02-13T18:21:36.008 INFO:tasks.rados.rados.0.trial187.stdout:3474: seq_num 1163 ranges {746541=400243,1739617=690403,3138117=408424} 2026-02-13T18:21:36.015 INFO:tasks.rados.rados.0.trial187.stdout:3474: writing trial18717860-29 from 746541 to 1146784 tid 1 2026-02-13T18:21:36.024 INFO:tasks.rados.rados.0.trial187.stdout:3474: writing trial18717860-29 from 1739617 to 2430020 tid 2 2026-02-13T18:21:36.031 INFO:tasks.rados.rados.0.trial187.stdout:3474: writing trial18717860-29 from 3138117 to 3546541 tid 3 2026-02-13T18:21:36.031 INFO:tasks.rados.rados.0.trial187.stdout:3475: snap_create 2026-02-13T18:21:36.031 INFO:tasks.rados.rados.0.trial187.stdout:3471: expect (ObjNum 738 snap 257 seq_num 738) 2026-02-13T18:21:36.031 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:36.092 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1649799 2026-02-13T18:21:36.098 INFO:tasks.rados.rados.0.trial187.stdout:3473: finishing write tid 1 to trial18717860-14 2026-02-13T18:21:36.098 INFO:tasks.rados.rados.0.trial187.stdout:3473: finishing write tid 2 to trial18717860-14 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: finishing write tid 3 to trial18717860-14 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: finishing write tid 4 to trial18717860-14 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: finishing write tid 5 to trial18717860-14 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: oid 14 updating version 0 to 1463 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: oid 14 version 1463 is already newer than 1462 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: oid 14 updating version 1463 to 1465 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: oid 14 version 1465 is already newer than 1464 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1465 (ObjNum 1162 snap 383 seq_num 1162) dirty exists 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3473: left oid 14 (ObjNum 1162 snap 383 seq_num 1162) 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3474: finishing write tid 1 to trial18717860-29 2026-02-13T18:21:36.099 INFO:tasks.rados.rados.0.trial187.stdout:3474: finishing write tid 2 to trial18717860-29 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: finishing write tid 3 to trial18717860-29 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: finishing write tid 4 to trial18717860-29 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: finishing write tid 5 to trial18717860-29 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: oid 29 updating version 0 to 1647 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: oid 29 version 1647 is already newer than 1645 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: oid 29 version 1647 is already newer than 1646 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: oid 29 updating version 1647 to 1648 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1648 (ObjNum 1163 snap 383 seq_num 1163) dirty exists 2026-02-13T18:21:36.100 INFO:tasks.rados.rados.0.trial187.stdout:3474: left oid 29 (ObjNum 1163 snap 383 seq_num 1163) 2026-02-13T18:21:36.574 INFO:tasks.rados.rados.0.trial187.stdout:3471: done (3 left) 2026-02-13T18:21:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3473: done (2 left) 2026-02-13T18:21:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3474: done (1 left) 2026-02-13T18:21:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3475: done (0 left) 2026-02-13T18:21:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3476: copy_from oid 25 from oid 11 current snap is 384 2026-02-13T18:21:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3477: write (excl) oid 23 current snap is 384 2026-02-13T18:21:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3477: seq_num 1164 ranges {763348=591845,1914452=434061,2881893=674270} 2026-02-13T18:21:36.581 INFO:tasks.rados.rados.0.trial187.stdout:3477: writing trial18717860-23 from 763348 to 1355193 tid 1 2026-02-13T18:21:36.584 INFO:tasks.rados.rados.0.trial187.stdout:3477: writing trial18717860-23 from 1914452 to 2348513 tid 2 2026-02-13T18:21:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3477: writing trial18717860-23 from 2881893 to 3556163 tid 3 2026-02-13T18:21:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3478: rollback oid 17 current snap is 384 2026-02-13T18:21:36.590 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 345 2026-02-13T18:21:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3477: finishing write tid 1 to trial18717860-23 2026-02-13T18:21:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3477: finishing write tid 2 to trial18717860-23 2026-02-13T18:21:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3479: snap_create 2026-02-13T18:21:36.591 INFO:tasks.rados.rados.0.trial187.stdout:3476: finishing copy_from racing read to trial18717860-25 2026-02-13T18:21:36.592 INFO:tasks.rados.rados.0.trial187.stdout:3476: finishing copy_from to trial18717860-25 2026-02-13T18:21:36.592 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1458 (ObjNum 1141 snap 382 seq_num 1141) dirty exists 2026-02-13T18:21:36.592 INFO:tasks.rados.rados.0.trial187.stdout:3477: finishing write tid 3 to trial18717860-23 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: finishing write tid 4 to trial18717860-23 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: finishing write tid 5 to trial18717860-23 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: oid 23 updating version 0 to 1467 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: oid 23 updating version 1467 to 1468 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: oid 23 updating version 1468 to 1469 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: oid 23 version 1469 is already newer than 1466 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1469 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:21:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3477: left oid 23 (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:21:36.602 INFO:tasks.rados.rados.0.trial187.stdout:3478: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:21:36.602 INFO:tasks.rados.rados.0.trial187.stdout:3478: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:21:36.603 INFO:tasks.rados.rados.0.trial187.stdout:3478: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:21:36.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2058 (ObjNum 1040 snap 339 seq_num 1040) dirty exists 2026-02-13T18:21:37.578 INFO:tasks.rados.rados.0.trial187.stdout:3476: done (3 left) 2026-02-13T18:21:37.578 INFO:tasks.rados.rados.0.trial187.stdout:3477: done (2 left) 2026-02-13T18:21:37.578 INFO:tasks.rados.rados.0.trial187.stdout:3478: done (1 left) 2026-02-13T18:21:37.579 INFO:tasks.rados.rados.0.trial187.stdout:3479: done (0 left) 2026-02-13T18:21:37.579 INFO:tasks.rados.rados.0.trial187.stdout:3480: write oid 38 current snap is 385 2026-02-13T18:21:37.579 INFO:tasks.rados.rados.0.trial187.stdout:3480: seq_num 1165 ranges {780155=667094,1972934=694072,3309316=270839} 2026-02-13T18:21:37.588 INFO:tasks.rados.rados.0.trial187.stdout:3480: writing trial18717860-38 from 780155 to 1447249 tid 1 2026-02-13T18:21:37.596 INFO:tasks.rados.rados.0.trial187.stdout:3480: writing trial18717860-38 from 1972934 to 2667006 tid 2 2026-02-13T18:21:37.602 INFO:tasks.rados.rados.0.trial187.stdout:3480: writing trial18717860-38 from 3309316 to 3580155 tid 3 2026-02-13T18:21:37.602 INFO:tasks.rados.rados.0.trial187.stdout:3481: write oid 4 current snap is 385 2026-02-13T18:21:37.602 INFO:tasks.rados.rados.0.trial187.stdout:3481: seq_num 1166 ranges {796962=742343,2031416=437730,2936739=413167} 2026-02-13T18:21:37.612 INFO:tasks.rados.rados.0.trial187.stdout:3481: writing trial18717860-4 from 796962 to 1539305 tid 1 2026-02-13T18:21:37.618 INFO:tasks.rados.rados.0.trial187.stdout:3481: writing trial18717860-4 from 2031416 to 2469146 tid 2 2026-02-13T18:21:37.625 INFO:tasks.rados.rados.0.trial187.stdout:3481: writing trial18717860-4 from 2936739 to 3349906 tid 3 2026-02-13T18:21:37.625 INFO:tasks.rados.rados.0.trial187.stdout:3482: copy_from oid 46 from oid 28 current snap is 385 2026-02-13T18:21:37.625 INFO:tasks.rados.rados.0.trial187.stdout:3480: finishing write tid 1 to trial18717860-38 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: finishing write tid 2 to trial18717860-38 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: finishing write tid 3 to trial18717860-38 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: finishing write tid 4 to trial18717860-38 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: finishing write tid 5 to trial18717860-38 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: oid 38 updating version 0 to 1830 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: oid 38 version 1830 is already newer than 1829 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: oid 38 updating version 1830 to 1831 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: oid 38 version 1831 is already newer than 1828 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1831 (ObjNum 1165 snap 385 seq_num 1165) dirty exists 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3480: left oid 38 (ObjNum 1165 snap 385 seq_num 1165) 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3481: finishing write tid 1 to trial18717860-4 2026-02-13T18:21:37.626 INFO:tasks.rados.rados.0.trial187.stdout:3481: finishing write tid 2 to trial18717860-4 2026-02-13T18:21:37.627 INFO:tasks.rados.rados.0.trial187.stdout:3480: done (2 left) 2026-02-13T18:21:37.627 INFO:tasks.rados.rados.0.trial187.stdout:3483: copy_from oid 11 from oid 21 current snap is 385 2026-02-13T18:21:37.627 INFO:tasks.rados.rados.0.trial187.stdout:3484: snap_create 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: finishing write tid 3 to trial18717860-4 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: finishing write tid 4 to trial18717860-4 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: finishing write tid 5 to trial18717860-4 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: oid 4 updating version 0 to 1047 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: oid 4 version 1047 is already newer than 1045 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: oid 4 version 1047 is already newer than 1044 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: oid 4 version 1047 is already newer than 1046 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1047 (ObjNum 1166 snap 385 seq_num 1166) dirty exists 2026-02-13T18:21:37.631 INFO:tasks.rados.rados.0.trial187.stdout:3481: left oid 4 (ObjNum 1166 snap 385 seq_num 1166) 2026-02-13T18:21:37.643 INFO:tasks.rados.rados.0.trial187.stdout:3483: finishing copy_from racing read to trial18717860-11 2026-02-13T18:21:37.643 INFO:tasks.rados.rados.0.trial187.stdout:3482: finishing copy_from racing read to trial18717860-46 2026-02-13T18:21:37.644 INFO:tasks.rados.rados.0.trial187.stdout:3482: finishing copy_from to trial18717860-46 2026-02-13T18:21:37.644 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1648 (ObjNum 1140 snap 382 seq_num 1140) dirty exists 2026-02-13T18:21:37.644 INFO:tasks.rados.rados.0.trial187.stdout:3483: finishing copy_from to trial18717860-11 2026-02-13T18:21:37.644 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1321 (ObjNum 1068 snap 352 seq_num 1068) dirty exists 2026-02-13T18:21:38.583 INFO:tasks.rados.rados.0.trial187.stdout:3481: done (3 left) 2026-02-13T18:21:38.583 INFO:tasks.rados.rados.0.trial187.stdout:3482: done (2 left) 2026-02-13T18:21:38.584 INFO:tasks.rados.rados.0.trial187.stdout:3483: done (1 left) 2026-02-13T18:21:38.584 INFO:tasks.rados.rados.0.trial187.stdout:3484: done (0 left) 2026-02-13T18:21:38.584 INFO:tasks.rados.rados.0.trial187.stdout:3485: copy_from oid 10 from oid 29 current snap is 386 2026-02-13T18:21:38.584 INFO:tasks.rados.rados.0.trial187.stdout:3486: snap_create 2026-02-13T18:21:38.599 INFO:tasks.rados.rados.0.trial187.stdout:3485: finishing copy_from racing read to trial18717860-10 2026-02-13T18:21:38.599 INFO:tasks.rados.rados.0.trial187.stdout:3485: finishing copy_from to trial18717860-10 2026-02-13T18:21:38.599 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1648 (ObjNum 1163 snap 383 seq_num 1163) dirty exists 2026-02-13T18:21:39.585 INFO:tasks.rados.rados.0.trial187.stdout:3485: done (1 left) 2026-02-13T18:21:39.585 INFO:tasks.rados.rados.0.trial187.stdout:3486: done (0 left) 2026-02-13T18:21:39.585 INFO:tasks.rados.rados.0.trial187.stdout:3487: read oid 14 snap -1 2026-02-13T18:21:39.585 INFO:tasks.rados.rados.0.trial187.stdout:3487: expect (ObjNum 1162 snap 383 seq_num 1162) 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:3488: copy_from oid 46 from oid 47 current snap is 387 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:3489: read oid 45 snap -1 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:3489: expect (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:3490: rollback oid 4 current snap is 387 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 377 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:3491: copy_from oid 34 from oid 43 current snap is 387 2026-02-13T18:21:39.586 INFO:tasks.rados.rados.0.trial187.stdout:3492: snap_remove snap 375 2026-02-13T18:21:40.562 INFO:tasks.rados.rados.0.trial187.stdout:3492: done (5 left) 2026-02-13T18:21:40.562 INFO:tasks.rados.rados.0.trial187.stdout:3493: snap_remove snap 349 2026-02-13T18:21:41.562 INFO:tasks.rados.rados.0.trial187.stdout:3493: done (5 left) 2026-02-13T18:21:41.563 INFO:tasks.rados.rados.0.trial187.stdout:3494: write (excl) oid 19 current snap is 387 2026-02-13T18:21:41.563 INFO:tasks.rados.rados.0.trial187.stdout:3494: seq_num 1167 ranges {413769=417592,1573545=697741,2847809=624439} 2026-02-13T18:21:41.568 INFO:tasks.rados.rados.0.trial187.stdout:3494: writing trial18717860-19 from 413769 to 831361 tid 1 2026-02-13T18:21:41.578 INFO:tasks.rados.rados.0.trial187.stdout:3494: writing trial18717860-19 from 1573545 to 2271286 tid 2 2026-02-13T18:21:41.586 INFO:tasks.rados.rados.0.trial187.stdout:3494: writing trial18717860-19 from 2847809 to 3472248 tid 3 2026-02-13T18:21:41.586 INFO:tasks.rados.rados.0.trial187.stdout:3495: read oid 16 snap -1 2026-02-13T18:21:41.586 INFO:tasks.rados.rados.0.trial187.stdout:3495: expect deleted 2026-02-13T18:21:41.586 INFO:tasks.rados.rados.0.trial187.stdout:3496: snap_remove snap 385 2026-02-13T18:21:42.565 INFO:tasks.rados.rados.0.trial187.stdout:3496: done (7 left) 2026-02-13T18:21:42.566 INFO:tasks.rados.rados.0.trial187.stdout:3497: write oid 42 current snap is 387 2026-02-13T18:21:42.566 INFO:tasks.rados.rados.0.trial187.stdout:3497: seq_num 1168 ranges {430576=492841,1632027=441399,2475232=435711,3365397=265179} 2026-02-13T18:21:42.571 INFO:tasks.rados.rados.0.trial187.stdout:3497: writing trial18717860-42 from 430576 to 923417 tid 1 2026-02-13T18:21:42.579 INFO:tasks.rados.rados.0.trial187.stdout:3497: writing trial18717860-42 from 1632027 to 2073426 tid 2 2026-02-13T18:21:42.585 INFO:tasks.rados.rados.0.trial187.stdout:3497: writing trial18717860-42 from 2475232 to 2910943 tid 3 2026-02-13T18:21:42.590 INFO:tasks.rados.rados.0.trial187.stdout:3497: writing trial18717860-42 from 3365397 to 3630576 tid 4 2026-02-13T18:21:42.590 INFO:tasks.rados.rados.0.trial187.stdout:3498: snap_create 2026-02-13T18:21:42.591 INFO:tasks.rados.rados.0.trial187.stdout:3489: expect (ObjNum 1117 snap 375 seq_num 1117) 2026-02-13T18:21:42.624 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 73542 2026-02-13T18:21:42.651 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 389148 2026-02-13T18:21:42.670 INFO:tasks.rados.rados.0.trial187.stdout:3491: finishing copy_from to trial18717860-34 2026-02-13T18:21:42.670 INFO:tasks.rados.rados.0.trial187.stdout:3491: got expected ENOENT (src dne) 2026-02-13T18:21:42.670 INFO:tasks.rados.rados.0.trial187.stdout:3491: finishing copy_from racing read to trial18717860-34 2026-02-13T18:21:42.670 INFO:tasks.rados.rados.0.trial187.stdout:3487: expect (ObjNum 1162 snap 383 seq_num 1162) 2026-02-13T18:21:42.670 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:42.698 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1867259 2026-02-13T18:21:42.739 INFO:tasks.rados.rados.0.trial187.stdout:3490: finishing rollback tid 0 to trial18717860-4 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3490: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3490: finishing rollback tid 2 to trial18717860-4 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1050 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3488: finishing copy_from racing read to trial18717860-46 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3488: finishing copy_from to trial18717860-46 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1635 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3494: finishing write tid 1 to trial18717860-19 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3494: finishing write tid 2 to trial18717860-19 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3494: finishing write tid 3 to trial18717860-19 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3494: finishing write tid 4 to trial18717860-19 2026-02-13T18:21:42.740 INFO:tasks.rados.rados.0.trial187.stdout:3494: finishing write tid 5 to trial18717860-19 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3494: oid 19 updating version 0 to 1649 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3494: oid 19 updating version 1649 to 1652 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3494: oid 19 version 1652 is already newer than 1650 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3494: oid 19 version 1652 is already newer than 1651 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1652 (ObjNum 1167 snap 387 seq_num 1167) dirty exists 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3494: left oid 19 (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3497: finishing write tid 1 to trial18717860-42 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3497: finishing write tid 2 to trial18717860-42 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3497: finishing write tid 3 to trial18717860-42 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3497: finishing write tid 4 to trial18717860-42 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3497: finishing write tid 5 to trial18717860-42 2026-02-13T18:21:42.741 INFO:tasks.rados.rados.0.trial187.stdout:3497: finishing write tid 6 to trial18717860-42 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:3497: oid 42 updating version 0 to 1458 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:3497: oid 42 updating version 1458 to 1460 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:3497: oid 42 version 1460 is already newer than 1459 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:3497: oid 42 version 1460 is already newer than 1457 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:3497: oid 42 updating version 1460 to 1461 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1461 (ObjNum 1168 snap 387 seq_num 1168) dirty exists 2026-02-13T18:21:42.742 INFO:tasks.rados.rados.0.trial187.stdout:3497: left oid 42 (ObjNum 1168 snap 387 seq_num 1168) 2026-02-13T18:21:43.592 INFO:tasks.rados.rados.0.trial187.stdout:3487: done (8 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3488: done (7 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3489: done (6 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3490: done (5 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3491: done (4 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3494: done (3 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3495: done (2 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3497: done (1 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3498: done (0 left) 2026-02-13T18:21:43.593 INFO:tasks.rados.rados.0.trial187.stdout:3499: copy_from oid 25 from oid 10 current snap is 388 2026-02-13T18:21:43.594 INFO:tasks.rados.rados.0.trial187.stdout:3500: write (excl) oid 17 current snap is 388 2026-02-13T18:21:43.594 INFO:tasks.rados.rados.0.trial187.stdout:3500: seq_num 1169 ranges {447383=568090,1690509=701410,2902655=646983} 2026-02-13T18:21:43.599 INFO:tasks.rados.rados.0.trial187.stdout:3500: writing trial18717860-17 from 447383 to 1015473 tid 1 2026-02-13T18:21:43.608 INFO:tasks.rados.rados.0.trial187.stdout:3500: writing trial18717860-17 from 1690509 to 2391919 tid 2 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3500: writing trial18717860-17 from 2902655 to 3549638 tid 3 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3501: read oid 28 snap -1 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3501: expect (ObjNum 1140 snap 382 seq_num 1140) 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3502: copy_from oid 11 from oid 47 current snap is 388 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3500: finishing write tid 1 to trial18717860-17 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3499: finishing copy_from racing read to trial18717860-25 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3499: finishing copy_from to trial18717860-25 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1648 (ObjNum 1163 snap 383 seq_num 1163) dirty exists 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3500: finishing write tid 2 to trial18717860-17 2026-02-13T18:21:43.617 INFO:tasks.rados.rados.0.trial187.stdout:3499: done (3 left) 2026-02-13T18:21:43.618 INFO:tasks.rados.rados.0.trial187.stdout:3503: snap_create 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: finishing write tid 3 to trial18717860-17 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: finishing write tid 4 to trial18717860-17 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: finishing write tid 5 to trial18717860-17 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: oid 17 updating version 0 to 2061 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: oid 17 version 2061 is already newer than 2060 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: oid 17 updating version 2061 to 2062 2026-02-13T18:21:43.620 INFO:tasks.rados.rados.0.trial187.stdout:3500: oid 17 version 2062 is already newer than 2059 2026-02-13T18:21:43.621 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2062 (ObjNum 1169 snap 388 seq_num 1169) dirty exists 2026-02-13T18:21:43.621 INFO:tasks.rados.rados.0.trial187.stdout:3500: left oid 17 (ObjNum 1169 snap 388 seq_num 1169) 2026-02-13T18:21:43.622 INFO:tasks.rados.rados.0.trial187.stdout:3501: expect (ObjNum 1140 snap 382 seq_num 1140) 2026-02-13T18:21:43.640 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:43.662 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 592720 2026-02-13T18:21:43.682 INFO:tasks.rados.rados.0.trial187.stdout:3502: finishing copy_from racing read to trial18717860-11 2026-02-13T18:21:43.682 INFO:tasks.rados.rados.0.trial187.stdout:3502: finishing copy_from to trial18717860-11 2026-02-13T18:21:43.682 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1635 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2026-02-13T18:21:44.597 INFO:tasks.rados.rados.0.trial187.stdout:3500: done (3 left) 2026-02-13T18:21:44.597 INFO:tasks.rados.rados.0.trial187.stdout:3501: done (2 left) 2026-02-13T18:21:44.597 INFO:tasks.rados.rados.0.trial187.stdout:3502: done (1 left) 2026-02-13T18:21:44.597 INFO:tasks.rados.rados.0.trial187.stdout:3503: done (0 left) 2026-02-13T18:21:44.597 INFO:tasks.rados.rados.0.trial187.stdout:3504: read oid 43 snap 387 2026-02-13T18:21:44.598 INFO:tasks.rados.rados.0.trial187.stdout:3504: expect deleted 2026-02-13T18:21:44.598 INFO:tasks.rados.rados.0.trial187.stdout:3505: write oid 13 current snap is 389 2026-02-13T18:21:44.598 INFO:tasks.rados.rados.0.trial187.stdout:3505: seq_num 1170 ranges {464190=643339,1748991=445068,2930078=574608} 2026-02-13T18:21:44.604 INFO:tasks.rados.rados.0.trial187.stdout:3505: writing trial18717860-13 from 464190 to 1107529 tid 1 2026-02-13T18:21:44.611 INFO:tasks.rados.rados.0.trial187.stdout:3505: writing trial18717860-13 from 1748991 to 2194059 tid 2 2026-02-13T18:21:44.620 INFO:tasks.rados.rados.0.trial187.stdout:3505: writing trial18717860-13 from 2930078 to 3504686 tid 3 2026-02-13T18:21:44.620 INFO:tasks.rados.rados.0.trial187.stdout:3506: snap_remove snap 352 2026-02-13T18:21:45.562 INFO:tasks.rados.rados.0.trial187.stdout:3506: done (2 left) 2026-02-13T18:21:45.562 INFO:tasks.rados.rados.0.trial187.stdout:3507: read oid 39 snap -1 2026-02-13T18:21:45.562 INFO:tasks.rados.rados.0.trial187.stdout:3507: expect deleted 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3508: snap_create 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: finishing write tid 1 to trial18717860-13 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: finishing write tid 2 to trial18717860-13 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: finishing write tid 3 to trial18717860-13 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: finishing write tid 4 to trial18717860-13 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: finishing write tid 5 to trial18717860-13 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: oid 13 updating version 0 to 1235 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: oid 13 updating version 1235 to 1237 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: oid 13 version 1237 is already newer than 1236 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: oid 13 updating version 1237 to 1238 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1238 (ObjNum 1170 snap 389 seq_num 1170) dirty exists 2026-02-13T18:21:45.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: left oid 13 (ObjNum 1170 snap 389 seq_num 1170) 2026-02-13T18:21:46.563 INFO:tasks.rados.rados.0.trial187.stdout:3504: done (3 left) 2026-02-13T18:21:46.563 INFO:tasks.rados.rados.0.trial187.stdout:3505: done (2 left) 2026-02-13T18:21:46.563 INFO:tasks.rados.rados.0.trial187.stdout:3507: done (1 left) 2026-02-13T18:21:46.563 INFO:tasks.rados.rados.0.trial187.stdout:3508: done (0 left) 2026-02-13T18:21:46.563 INFO:tasks.rados.rados.0.trial187.stdout:3509: snap_remove snap 359 2026-02-13T18:21:47.566 INFO:tasks.rados.rados.0.trial187.stdout:3509: done (0 left) 2026-02-13T18:21:47.566 INFO:tasks.rados.rados.0.trial187.stdout:3510: snap_create 2026-02-13T18:21:48.935 INFO:tasks.rados.rados.0.trial187.stdout:3510: done (0 left) 2026-02-13T18:21:48.936 INFO:tasks.rados.rados.0.trial187.stdout:3511: read oid 2 snap -1 2026-02-13T18:21:48.936 INFO:tasks.rados.rados.0.trial187.stdout:3511: expect (ObjNum 1139 snap 382 seq_num 1139) 2026-02-13T18:21:48.936 INFO:tasks.rados.rados.0.trial187.stdout:3512: snap_remove snap 387 2026-02-13T18:21:49.573 INFO:tasks.rados.rados.0.trial187.stdout:3512: done (1 left) 2026-02-13T18:21:49.573 INFO:tasks.rados.rados.0.trial187.stdout:3513: read oid 1 snap -1 2026-02-13T18:21:49.573 INFO:tasks.rados.rados.0.trial187.stdout:3513: expect deleted 2026-02-13T18:21:49.573 INFO:tasks.rados.rados.0.trial187.stdout:3514: snap_create 2026-02-13T18:21:49.573 INFO:tasks.rados.rados.0.trial187.stdout:3511: expect (ObjNum 1139 snap 382 seq_num 1139) 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:3511: done (2 left) 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:3513: done (1 left) 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:3514: done (0 left) 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:3515: rollback oid 2 current snap is 392 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 2 to 340 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:3516: write (excl) oid 7 current snap is 392 2026-02-13T18:21:50.563 INFO:tasks.rados.rados.0.trial187.stdout:3516: seq_num 1171 ranges {480997=434941,1407473=705079,2557501=785880} 2026-02-13T18:21:50.569 INFO:tasks.rados.rados.0.trial187.stdout:3516: writing trial18717860-7 from 480997 to 915938 tid 1 2026-02-13T18:21:50.578 INFO:tasks.rados.rados.0.trial187.stdout:3516: writing trial18717860-7 from 1407473 to 2112552 tid 2 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:3516: writing trial18717860-7 from 2557501 to 3343381 tid 3 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:3517: rollback oid 18 current snap is 392 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 370 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:3515: finishing rollback tid 0 to trial18717860-2 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:3515: finishing rollback tid 1 to trial18717860-2 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:3515: finishing rollback tid 2 to trial18717860-2 2026-02-13T18:21:50.586 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1241 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:21:50.587 INFO:tasks.rados.rados.0.trial187.stdout:3516: finishing write tid 1 to trial18717860-7 2026-02-13T18:21:50.587 INFO:tasks.rados.rados.0.trial187.stdout:3515: done (2 left) 2026-02-13T18:21:50.587 INFO:tasks.rados.rados.0.trial187.stdout:3518: delete oid 17 current snap is 392 2026-02-13T18:21:50.587 INFO:tasks.rados.rados.0.trial187.stdout:3516: finishing write tid 2 to trial18717860-7 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:3518: done (2 left) 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:3519: read oid 47 snap 390 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:3519: expect (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:3520: rollback oid 12 current snap is 392 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 390 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:3521: rollback oid 30 current snap is 392 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 380 2026-02-13T18:21:50.589 INFO:tasks.rados.rados.0.trial187.stdout:3522: snap_remove snap 384 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3522: done (5 left) 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3523: read oid 44 snap -1 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3523: expect (ObjNum 1136 snap 381 seq_num 1136) 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3524: read oid 24 snap 390 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3524: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3525: write (excl) oid 14 current snap is 392 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3516: finishing write tid 3 to trial18717860-7 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3516: finishing write tid 4 to trial18717860-7 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3517: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:21:51.717 INFO:tasks.rados.rados.0.trial187.stdout:3525: seq_num 1173 ranges {514611=585439,1524437=592395,2895994=408424} 2026-02-13T18:21:51.724 INFO:tasks.rados.rados.0.trial187.stdout:3525: writing trial18717860-14 from 514611 to 1100050 tid 1 2026-02-13T18:21:51.731 INFO:tasks.rados.rados.0.trial187.stdout:3525: writing trial18717860-14 from 1524437 to 2116832 tid 2 2026-02-13T18:21:51.740 INFO:tasks.rados.rados.0.trial187.stdout:3525: writing trial18717860-14 from 2895994 to 3304418 tid 3 2026-02-13T18:21:51.740 INFO:tasks.rados.rados.0.trial187.stdout:3526: snap_remove snap 388 2026-02-13T18:21:52.723 INFO:tasks.rados.rados.0.trial187.stdout:3526: done (8 left) 2026-02-13T18:21:52.723 INFO:tasks.rados.rados.0.trial187.stdout:3527: delete oid 4 current snap is 392 2026-02-13T18:21:52.723 INFO:tasks.rados.rados.0.trial187.stdout:3521: finishing rollback tid 0 to trial18717860-30 2026-02-13T18:21:52.723 INFO:tasks.rados.rados.0.trial187.stdout:3517: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:21:52.723 INFO:tasks.rados.rados.0.trial187.stdout:3517: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:21:52.723 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1244 (ObjNum 1091 snap 361 seq_num 1091) dirty exists 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3516: finishing write tid 5 to trial18717860-7 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3516: oid 7 updating version 0 to 1652 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3516: oid 7 version 1652 is already newer than 1650 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3516: oid 7 version 1652 is already newer than 1651 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3516: oid 7 version 1652 is already newer than 1649 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1652 (ObjNum 1171 snap 392 seq_num 1171) dirty exists 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3516: left oid 7 (ObjNum 1171 snap 392 seq_num 1171) 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:3519: expect (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:21:52.724 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:52.783 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1992597 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3521: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3521: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 2038 (ObjNum 1049 snap 344 seq_num 1049) dirty exists 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3516: done (8 left) 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3517: done (7 left) 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3519: done (6 left) 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3521: done (5 left) 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3527: done (4 left) 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3528: snap_create 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3520: finishing rollback tid 0 to trial18717860-12 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3520: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3520: finishing rollback tid 2 to trial18717860-12 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1651 (ObjNum 1153 snap 383 seq_num 1153) dirty exists 2026-02-13T18:21:52.819 INFO:tasks.rados.rados.0.trial187.stdout:3523: expect (ObjNum 1136 snap 381 seq_num 1136) 2026-02-13T18:21:52.853 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:52.877 INFO:tasks.rados.rados.0.trial187.stdout:3524: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:21:52.884 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2704749 2026-02-13T18:21:52.914 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 476767 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: finishing write tid 1 to trial18717860-14 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: finishing write tid 2 to trial18717860-14 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: finishing write tid 3 to trial18717860-14 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: finishing write tid 4 to trial18717860-14 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: finishing write tid 5 to trial18717860-14 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: oid 14 updating version 0 to 1473 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: oid 14 version 1473 is already newer than 1470 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: oid 14 version 1473 is already newer than 1471 2026-02-13T18:21:52.936 INFO:tasks.rados.rados.0.trial187.stdout:3525: oid 14 version 1473 is already newer than 1472 2026-02-13T18:21:52.937 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1473 (ObjNum 1173 snap 392 seq_num 1173) dirty exists 2026-02-13T18:21:52.937 INFO:tasks.rados.rados.0.trial187.stdout:3525: left oid 14 (ObjNum 1173 snap 392 seq_num 1173) 2026-02-13T18:21:53.725 INFO:tasks.rados.rados.0.trial187.stdout:3520: done (4 left) 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3523: done (3 left) 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3524: done (2 left) 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3525: done (1 left) 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3528: done (0 left) 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3529: read oid 24 snap -1 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3529: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3530: read oid 41 snap -1 2026-02-13T18:21:53.726 INFO:tasks.rados.rados.0.trial187.stdout:3530: expect (ObjNum 1131 snap 380 seq_num 1131) 2026-02-13T18:21:53.727 INFO:tasks.rados.rados.0.trial187.stdout:3531: rollback oid 22 current snap is 393 2026-02-13T18:21:53.727 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 380 2026-02-13T18:21:53.727 INFO:tasks.rados.rados.0.trial187.stdout:3532: rollback oid 20 current snap is 393 2026-02-13T18:21:53.727 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 20 to 383 2026-02-13T18:21:53.727 INFO:tasks.rados.rados.0.trial187.stdout:3533: write oid 35 current snap is 393 2026-02-13T18:21:53.727 INFO:tasks.rados.rados.0.trial187.stdout:3533: seq_num 1175 ranges {548225=735937,1925048=596064,2950840=547321} 2026-02-13T18:21:53.734 INFO:tasks.rados.rados.0.trial187.stdout:3533: writing trial18717860-35 from 548225 to 1284162 tid 1 2026-02-13T18:21:53.742 INFO:tasks.rados.rados.0.trial187.stdout:3533: writing trial18717860-35 from 1925048 to 2521112 tid 2 2026-02-13T18:21:53.749 INFO:tasks.rados.rados.0.trial187.stdout:3533: writing trial18717860-35 from 2950840 to 3498161 tid 3 2026-02-13T18:21:53.749 INFO:tasks.rados.rados.0.trial187.stdout:3534: snap_remove snap 361 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3534: done (5 left) 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3535: read oid 13 snap 321 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3535: expect (ObjNum 926 snap 303 seq_num 926) 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3536: read oid 30 snap -1 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3536: expect (ObjNum 1049 snap 344 seq_num 1049) 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3537: copy_from oid 29 from oid 2 current snap is 393 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3532: finishing rollback tid 0 to trial18717860-20 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3532: finishing rollback tid 1 to trial18717860-20 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3532: finishing rollback tid 2 to trial18717860-20 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1643 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:21:54.949 INFO:tasks.rados.rados.0.trial187.stdout:3529: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:21:54.989 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:55.021 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2741383 2026-02-13T18:21:55.028 INFO:tasks.rados.rados.0.trial187.stdout:3530: expect (ObjNum 1131 snap 380 seq_num 1131) 2026-02-13T18:21:55.034 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1202942 2026-02-13T18:21:55.077 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3531: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: finishing write tid 1 to trial18717860-35 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3531: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 2276 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: finishing write tid 2 to trial18717860-35 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: finishing write tid 3 to trial18717860-35 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: finishing write tid 4 to trial18717860-35 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: finishing write tid 5 to trial18717860-35 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: oid 35 updating version 0 to 1833 2026-02-13T18:21:55.116 INFO:tasks.rados.rados.0.trial187.stdout:3533: oid 35 updating version 1833 to 1834 2026-02-13T18:21:55.117 INFO:tasks.rados.rados.0.trial187.stdout:3533: oid 35 version 1834 is already newer than 1832 2026-02-13T18:21:55.117 INFO:tasks.rados.rados.0.trial187.stdout:3533: oid 35 updating version 1834 to 1835 2026-02-13T18:21:55.117 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 35 v 1835 (ObjNum 1175 snap 393 seq_num 1175) dirty exists 2026-02-13T18:21:55.117 INFO:tasks.rados.rados.0.trial187.stdout:3533: left oid 35 (ObjNum 1175 snap 393 seq_num 1175) 2026-02-13T18:21:55.117 INFO:tasks.rados.rados.0.trial187.stdout:3536: expect (ObjNum 1049 snap 344 seq_num 1049) 2026-02-13T18:21:55.117 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:55.265 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3101255 2026-02-13T18:21:55.271 INFO:tasks.rados.rados.0.trial187.stdout:3535: expect (ObjNum 926 snap 303 seq_num 926) 2026-02-13T18:21:55.279 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2197899 2026-02-13T18:21:55.315 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:55.341 INFO:tasks.rados.rados.0.trial187.stdout:3537: finishing copy_from racing read to trial18717860-29 2026-02-13T18:21:55.341 INFO:tasks.rados.rados.0.trial187.stdout:3537: finishing copy_from to trial18717860-29 2026-02-13T18:21:55.341 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1241 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:21:55.341 INFO:tasks.rados.rados.0.trial187.stdout:3529: done (7 left) 2026-02-13T18:21:55.341 INFO:tasks.rados.rados.0.trial187.stdout:3530: done (6 left) 2026-02-13T18:21:55.341 INFO:tasks.rados.rados.0.trial187.stdout:3531: done (5 left) 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3532: done (4 left) 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3533: done (3 left) 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3535: done (2 left) 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3536: done (1 left) 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3537: done (0 left) 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3538: write oid 47 current snap is 393 2026-02-13T18:21:55.342 INFO:tasks.rados.rados.0.trial187.stdout:3538: seq_num 1176 ranges {565032=411186,1583530=456075,2578263=758593} 2026-02-13T18:21:55.347 INFO:tasks.rados.rados.0.trial187.stdout:3538: writing trial18717860-47 from 565032 to 976218 tid 1 2026-02-13T18:21:55.355 INFO:tasks.rados.rados.0.trial187.stdout:3538: writing trial18717860-47 from 1583530 to 2039605 tid 2 2026-02-13T18:21:55.364 INFO:tasks.rados.rados.0.trial187.stdout:3538: writing trial18717860-47 from 2578263 to 3336856 tid 3 2026-02-13T18:21:55.364 INFO:tasks.rados.rados.0.trial187.stdout:3539: delete oid 39 current snap is 393 2026-02-13T18:21:55.364 INFO:tasks.rados.rados.0.trial187.stdout:3538: finishing write tid 1 to trial18717860-47 2026-02-13T18:21:55.364 INFO:tasks.rados.rados.0.trial187.stdout:3538: finishing write tid 2 to trial18717860-47 2026-02-13T18:21:55.365 INFO:tasks.rados.rados.0.trial187.stdout:3539: done (1 left) 2026-02-13T18:21:55.366 INFO:tasks.rados.rados.0.trial187.stdout:3540: snap_create 2026-02-13T18:21:55.366 INFO:tasks.rados.rados.0.trial187.stdout:3538: finishing write tid 3 to trial18717860-47 2026-02-13T18:21:55.366 INFO:tasks.rados.rados.0.trial187.stdout:3538: finishing write tid 4 to trial18717860-47 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:3538: finishing write tid 5 to trial18717860-47 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:3538: oid 47 updating version 0 to 1647 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:3538: oid 47 version 1647 is already newer than 1646 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:3538: oid 47 version 1647 is already newer than 1645 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:3538: oid 47 version 1647 is already newer than 1644 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1647 (ObjNum 1176 snap 393 seq_num 1176) dirty exists 2026-02-13T18:21:55.367 INFO:tasks.rados.rados.0.trial187.stdout:3538: left oid 47 (ObjNum 1176 snap 393 seq_num 1176) 2026-02-13T18:21:55.565 INFO:tasks.rados.rados.0.trial187.stdout:3538: done (1 left) 2026-02-13T18:21:55.565 INFO:tasks.rados.rados.0.trial187.stdout:3540: done (0 left) 2026-02-13T18:21:55.565 INFO:tasks.rados.rados.0.trial187.stdout:3541: snap_remove snap 383 2026-02-13T18:21:56.565 INFO:tasks.rados.rados.0.trial187.stdout:3541: done (0 left) 2026-02-13T18:21:56.566 INFO:tasks.rados.rados.0.trial187.stdout:3542: snap_create 2026-02-13T18:21:57.566 INFO:tasks.rados.rados.0.trial187.stdout:3542: done (0 left) 2026-02-13T18:21:57.566 INFO:tasks.rados.rados.0.trial187.stdout:3543: copy_from oid 28 from oid 22 current snap is 395 2026-02-13T18:21:57.566 INFO:tasks.rados.rados.0.trial187.stdout:3544: read oid 34 snap -1 2026-02-13T18:21:57.566 INFO:tasks.rados.rados.0.trial187.stdout:3544: expect (ObjNum 1143 snap 382 seq_num 1143) 2026-02-13T18:21:57.566 INFO:tasks.rados.rados.0.trial187.stdout:3545: write oid 18 current snap is 395 2026-02-13T18:21:57.566 INFO:tasks.rados.rados.0.trial187.stdout:3545: seq_num 1178 ranges {598646=561684,1700494=459744,2633109=781137} 2026-02-13T18:21:57.574 INFO:tasks.rados.rados.0.trial187.stdout:3545: writing trial18717860-18 from 598646 to 1160330 tid 1 2026-02-13T18:21:57.581 INFO:tasks.rados.rados.0.trial187.stdout:3545: writing trial18717860-18 from 1700494 to 2160238 tid 2 2026-02-13T18:21:57.589 INFO:tasks.rados.rados.0.trial187.stdout:3545: writing trial18717860-18 from 2633109 to 3414246 tid 3 2026-02-13T18:21:57.590 INFO:tasks.rados.rados.0.trial187.stdout:3546: copy_from oid 16 from oid 37 current snap is 395 2026-02-13T18:21:57.590 INFO:tasks.rados.rados.0.trial187.stdout:3544: expect (ObjNum 1143 snap 382 seq_num 1143) 2026-02-13T18:21:57.630 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:21:57.661 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1965190 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: finishing write tid 1 to trial18717860-18 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3543: finishing copy_from racing read to trial18717860-28 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3543: finishing copy_from to trial18717860-28 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 2276 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: finishing write tid 2 to trial18717860-18 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: finishing write tid 3 to trial18717860-18 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: finishing write tid 4 to trial18717860-18 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: finishing write tid 5 to trial18717860-18 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: oid 18 updating version 0 to 1246 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: oid 18 updating version 1246 to 1248 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: oid 18 version 1248 is already newer than 1247 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: oid 18 version 1248 is already newer than 1245 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1248 (ObjNum 1178 snap 395 seq_num 1178) dirty exists 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3545: left oid 18 (ObjNum 1178 snap 395 seq_num 1178) 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3546: finishing copy_from racing read to trial18717860-16 2026-02-13T18:21:57.670 INFO:tasks.rados.rados.0.trial187.stdout:3546: finishing copy_from to trial18717860-16 2026-02-13T18:21:57.671 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1639 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:21:57.671 INFO:tasks.rados.rados.0.trial187.stdout:3543: done (3 left) 2026-02-13T18:21:57.671 INFO:tasks.rados.rados.0.trial187.stdout:3544: done (2 left) 2026-02-13T18:21:57.671 INFO:tasks.rados.rados.0.trial187.stdout:3545: done (1 left) 2026-02-13T18:21:57.671 INFO:tasks.rados.rados.0.trial187.stdout:3546: done (0 left) 2026-02-13T18:21:57.671 INFO:tasks.rados.rados.0.trial187.stdout:3547: snap_create 2026-02-13T18:21:58.573 INFO:tasks.rados.rados.0.trial187.stdout:3547: done (0 left) 2026-02-13T18:21:58.573 INFO:tasks.rados.rados.0.trial187.stdout:3548: copy_from oid 22 from oid 7 current snap is 396 2026-02-13T18:21:58.573 INFO:tasks.rados.rados.0.trial187.stdout:3549: write (excl) oid 25 current snap is 396 2026-02-13T18:21:58.574 INFO:tasks.rados.rados.0.trial187.stdout:3549: seq_num 1179 ranges {615453=753286,2158976=603402,3460532=354921} 2026-02-13T18:21:58.582 INFO:tasks.rados.rados.0.trial187.stdout:3549: writing trial18717860-25 from 615453 to 1368739 tid 1 2026-02-13T18:21:58.591 INFO:tasks.rados.rados.0.trial187.stdout:3549: writing trial18717860-25 from 2158976 to 2762378 tid 2 2026-02-13T18:21:58.599 INFO:tasks.rados.rados.0.trial187.stdout:3549: writing trial18717860-25 from 3460532 to 3815453 tid 3 2026-02-13T18:21:58.599 INFO:tasks.rados.rados.0.trial187.stdout:3550: write oid 42 current snap is 396 2026-02-13T18:21:58.599 INFO:tasks.rados.rados.0.trial187.stdout:3550: seq_num 1180 ranges {632260=428535,1817458=463413,2687955=520034,3709324=122936} 2026-02-13T18:21:58.606 INFO:tasks.rados.rados.0.trial187.stdout:3550: writing trial18717860-42 from 632260 to 1060795 tid 1 2026-02-13T18:21:58.614 INFO:tasks.rados.rados.0.trial187.stdout:3550: writing trial18717860-42 from 1817458 to 2280871 tid 2 2026-02-13T18:21:58.619 INFO:tasks.rados.rados.0.trial187.stdout:3550: writing trial18717860-42 from 2687955 to 3207989 tid 3 2026-02-13T18:21:58.621 INFO:tasks.rados.rados.0.trial187.stdout:3550: writing trial18717860-42 from 3709324 to 3832260 tid 4 2026-02-13T18:21:58.621 INFO:tasks.rados.rados.0.trial187.stdout:3551: write (excl) oid 3 current snap is 396 2026-02-13T18:21:58.622 INFO:tasks.rados.rados.0.trial187.stdout:3551: seq_num 1181 ranges {649067=503784,1875940=607071,3115378=731306} 2026-02-13T18:21:58.626 INFO:tasks.rados.rados.0.trial187.stdout:3551: writing trial18717860-3 from 649067 to 1152851 tid 1 2026-02-13T18:21:58.631 INFO:tasks.rados.rados.0.trial187.stdout:3551: writing trial18717860-3 from 1875940 to 2483011 tid 2 2026-02-13T18:21:58.636 INFO:tasks.rados.rados.0.trial187.stdout:3551: writing trial18717860-3 from 3115378 to 3846684 tid 3 2026-02-13T18:21:58.636 INFO:tasks.rados.rados.0.trial187.stdout:3552: write (excl) oid 48 current snap is 396 2026-02-13T18:21:58.636 INFO:tasks.rados.rados.0.trial187.stdout:3552: seq_num 1182 ranges {665874=579033,1934422=467082,3142801=542578} 2026-02-13T18:21:58.641 INFO:tasks.rados.rados.0.trial187.stdout:3552: writing trial18717860-48 from 665874 to 1244907 tid 1 2026-02-13T18:21:58.645 INFO:tasks.rados.rados.0.trial187.stdout:3552: writing trial18717860-48 from 1934422 to 2401504 tid 2 2026-02-13T18:21:58.651 INFO:tasks.rados.rados.0.trial187.stdout:3552: writing trial18717860-48 from 3142801 to 3685379 tid 3 2026-02-13T18:21:58.651 INFO:tasks.rados.rados.0.trial187.stdout:3553: delete oid 16 current snap is 396 2026-02-13T18:21:58.651 INFO:tasks.rados.rados.0.trial187.stdout:3549: finishing write tid 1 to trial18717860-25 2026-02-13T18:21:58.651 INFO:tasks.rados.rados.0.trial187.stdout:3548: finishing copy_from racing read to trial18717860-22 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3548: finishing copy_from to trial18717860-22 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 1652 (ObjNum 1171 snap 392 seq_num 1171) dirty exists 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: finishing write tid 2 to trial18717860-25 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: finishing write tid 3 to trial18717860-25 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: finishing write tid 4 to trial18717860-25 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: finishing write tid 5 to trial18717860-25 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: oid 25 updating version 0 to 1651 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: oid 25 updating version 1651 to 1652 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: oid 25 version 1652 is already newer than 1649 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: oid 25 version 1652 is already newer than 1650 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1652 (ObjNum 1179 snap 396 seq_num 1179) dirty exists 2026-02-13T18:21:58.652 INFO:tasks.rados.rados.0.trial187.stdout:3549: left oid 25 (ObjNum 1179 snap 396 seq_num 1179) 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: finishing write tid 1 to trial18717860-42 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: finishing write tid 2 to trial18717860-42 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: finishing write tid 3 to trial18717860-42 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: finishing write tid 4 to trial18717860-42 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: finishing write tid 5 to trial18717860-42 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: finishing write tid 6 to trial18717860-42 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: oid 42 updating version 0 to 1462 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: oid 42 updating version 1462 to 1463 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: oid 42 updating version 1463 to 1464 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: oid 42 updating version 1464 to 1465 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:3550: oid 42 updating version 1465 to 1466 2026-02-13T18:21:58.653 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1466 (ObjNum 1180 snap 396 seq_num 1180) dirty exists 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3550: left oid 42 (ObjNum 1180 snap 396 seq_num 1180) 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: finishing write tid 1 to trial18717860-3 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: finishing write tid 2 to trial18717860-3 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: finishing write tid 3 to trial18717860-3 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: finishing write tid 4 to trial18717860-3 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: finishing write tid 5 to trial18717860-3 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: oid 3 updating version 0 to 2066 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: oid 3 version 2066 is already newer than 2064 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: oid 3 updating version 2066 to 2067 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: oid 3 version 2067 is already newer than 2065 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 2067 (ObjNum 1181 snap 396 seq_num 1181) dirty exists 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3551: left oid 3 (ObjNum 1181 snap 396 seq_num 1181) 2026-02-13T18:21:58.654 INFO:tasks.rados.rados.0.trial187.stdout:3552: finishing write tid 1 to trial18717860-48 2026-02-13T18:21:58.655 INFO:tasks.rados.rados.0.trial187.stdout:3552: finishing write tid 2 to trial18717860-48 2026-02-13T18:21:58.655 INFO:tasks.rados.rados.0.trial187.stdout:3548: done (5 left) 2026-02-13T18:21:58.655 INFO:tasks.rados.rados.0.trial187.stdout:3549: done (4 left) 2026-02-13T18:21:58.655 INFO:tasks.rados.rados.0.trial187.stdout:3550: done (3 left) 2026-02-13T18:21:58.656 INFO:tasks.rados.rados.0.trial187.stdout:3551: done (2 left) 2026-02-13T18:21:58.656 INFO:tasks.rados.rados.0.trial187.stdout:3553: done (1 left) 2026-02-13T18:21:58.656 INFO:tasks.rados.rados.0.trial187.stdout:3554: copy_from oid 43 from oid 25 current snap is 396 2026-02-13T18:21:58.656 INFO:tasks.rados.rados.0.trial187.stdout:3555: snap_remove snap 394 2026-02-13T18:21:59.577 INFO:tasks.rados.rados.0.trial187.stdout:3555: done (2 left) 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3556: copy_from oid 35 from oid 39 current snap is 396 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: finishing write tid 3 to trial18717860-48 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: finishing write tid 4 to trial18717860-48 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: finishing write tid 5 to trial18717860-48 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: oid 48 updating version 0 to 2287 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: oid 48 updating version 2287 to 2288 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: oid 48 updating version 2288 to 2289 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: oid 48 version 2289 is already newer than 2286 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 48 v 2289 (ObjNum 1182 snap 396 seq_num 1182) dirty exists 2026-02-13T18:21:59.578 INFO:tasks.rados.rados.0.trial187.stdout:3552: left oid 48 (ObjNum 1182 snap 396 seq_num 1182) 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3554: finishing copy_from racing read to trial18717860-43 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3554: finishing copy_from to trial18717860-43 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1652 (ObjNum 1179 snap 396 seq_num 1179) dirty exists 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3552: done (2 left) 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3554: done (1 left) 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3557: rollback oid 22 current snap is 396 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 366 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3558: copy_from oid 34 from oid 6 current snap is 396 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3559: read oid 2 snap -1 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3559: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:21:59.579 INFO:tasks.rados.rados.0.trial187.stdout:3560: delete oid 16 current snap is 396 2026-02-13T18:21:59.580 INFO:tasks.rados.rados.0.trial187.stdout:3560: done (4 left) 2026-02-13T18:21:59.580 INFO:tasks.rados.rados.0.trial187.stdout:3561: snap_remove snap 391 2026-02-13T18:22:00.566 INFO:tasks.rados.rados.0.trial187.stdout:3561: done (4 left) 2026-02-13T18:22:00.566 INFO:tasks.rados.rados.0.trial187.stdout:3562: snap_create 2026-02-13T18:22:00.566 INFO:tasks.rados.rados.0.trial187.stdout:3556: finishing copy_from to trial18717860-35 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:3556: got expected ENOENT (src dne) 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:3556: finishing copy_from racing read to trial18717860-35 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:3557: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:3557: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:3557: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 2293 (ObjNum 929 snap 304 seq_num 929) dirty exists 2026-02-13T18:22:00.567 INFO:tasks.rados.rados.0.trial187.stdout:3559: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:00.627 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:00.707 INFO:tasks.rados.rados.0.trial187.stdout:3558: finishing copy_from racing read to trial18717860-34 2026-02-13T18:22:00.707 INFO:tasks.rados.rados.0.trial187.stdout:3558: finishing copy_from to trial18717860-34 2026-02-13T18:22:00.707 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1656 (ObjNum 1159 snap 383 seq_num 1159) dirty exists 2026-02-13T18:22:01.566 INFO:tasks.rados.rados.0.trial187.stdout:3556: done (4 left) 2026-02-13T18:22:01.567 INFO:tasks.rados.rados.0.trial187.stdout:3557: done (3 left) 2026-02-13T18:22:01.567 INFO:tasks.rados.rados.0.trial187.stdout:3558: done (2 left) 2026-02-13T18:22:01.567 INFO:tasks.rados.rados.0.trial187.stdout:3559: done (1 left) 2026-02-13T18:22:01.567 INFO:tasks.rados.rados.0.trial187.stdout:3562: done (0 left) 2026-02-13T18:22:01.567 INFO:tasks.rados.rados.0.trial187.stdout:3563: snap_remove snap 340 2026-02-13T18:22:02.567 INFO:tasks.rados.rados.0.trial187.stdout:3563: done (0 left) 2026-02-13T18:22:02.568 INFO:tasks.rados.rados.0.trial187.stdout:3564: write oid 14 current snap is 397 2026-02-13T18:22:02.568 INFO:tasks.rados.rados.0.trial187.stdout:3564: seq_num 1185 ranges {716295=404780,1593515=614409,2708717=492747,3640519=275776} 2026-02-13T18:22:02.575 INFO:tasks.rados.rados.0.trial187.stdout:3564: writing trial18717860-14 from 716295 to 1121075 tid 1 2026-02-13T18:22:02.582 INFO:tasks.rados.rados.0.trial187.stdout:3564: writing trial18717860-14 from 1593515 to 2207924 tid 2 2026-02-13T18:22:02.589 INFO:tasks.rados.rados.0.trial187.stdout:3564: writing trial18717860-14 from 2708717 to 3201464 tid 3 2026-02-13T18:22:02.594 INFO:tasks.rados.rados.0.trial187.stdout:3564: writing trial18717860-14 from 3640519 to 3916295 tid 4 2026-02-13T18:22:02.594 INFO:tasks.rados.rados.0.trial187.stdout:3565: snap_create 2026-02-13T18:22:02.594 INFO:tasks.rados.rados.0.trial187.stdout:3564: finishing write tid 1 to trial18717860-14 2026-02-13T18:22:02.594 INFO:tasks.rados.rados.0.trial187.stdout:3564: finishing write tid 2 to trial18717860-14 2026-02-13T18:22:02.594 INFO:tasks.rados.rados.0.trial187.stdout:3564: finishing write tid 3 to trial18717860-14 2026-02-13T18:22:02.595 INFO:tasks.rados.rados.0.trial187.stdout:3564: finishing write tid 4 to trial18717860-14 2026-02-13T18:22:02.596 INFO:tasks.rados.rados.0.trial187.stdout:3564: finishing write tid 5 to trial18717860-14 2026-02-13T18:22:02.596 INFO:tasks.rados.rados.0.trial187.stdout:3564: finishing write tid 6 to trial18717860-14 2026-02-13T18:22:02.596 INFO:tasks.rados.rados.0.trial187.stdout:3564: oid 14 updating version 0 to 1475 2026-02-13T18:22:02.597 INFO:tasks.rados.rados.0.trial187.stdout:3564: oid 14 updating version 1475 to 1478 2026-02-13T18:22:02.597 INFO:tasks.rados.rados.0.trial187.stdout:3564: oid 14 version 1478 is already newer than 1474 2026-02-13T18:22:02.597 INFO:tasks.rados.rados.0.trial187.stdout:3564: oid 14 version 1478 is already newer than 1477 2026-02-13T18:22:02.597 INFO:tasks.rados.rados.0.trial187.stdout:3564: oid 14 version 1478 is already newer than 1476 2026-02-13T18:22:02.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1478 (ObjNum 1185 snap 397 seq_num 1185) dirty exists 2026-02-13T18:22:02.597 INFO:tasks.rados.rados.0.trial187.stdout:3564: left oid 14 (ObjNum 1185 snap 397 seq_num 1185) 2026-02-13T18:22:03.582 INFO:tasks.rados.rados.0.trial187.stdout:3564: done (1 left) 2026-02-13T18:22:03.582 INFO:tasks.rados.rados.0.trial187.stdout:3565: done (0 left) 2026-02-13T18:22:03.582 INFO:tasks.rados.rados.0.trial187.stdout:3566: rollback oid 11 current snap is 398 2026-02-13T18:22:03.582 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 392 2026-02-13T18:22:03.582 INFO:tasks.rados.rados.0.trial187.stdout:3567: read oid 14 snap 392 2026-02-13T18:22:03.583 INFO:tasks.rados.rados.0.trial187.stdout:3567: expect (ObjNum 1173 snap 392 seq_num 1173) 2026-02-13T18:22:03.583 INFO:tasks.rados.rados.0.trial187.stdout:3568: snap_create 2026-02-13T18:22:03.586 INFO:tasks.rados.rados.0.trial187.stdout:3566: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:22:03.586 INFO:tasks.rados.rados.0.trial187.stdout:3566: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:22:03.586 INFO:tasks.rados.rados.0.trial187.stdout:3566: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:22:03.586 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 1659 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2026-02-13T18:22:03.590 INFO:tasks.rados.rados.0.trial187.stdout:3567: expect (ObjNum 1173 snap 392 seq_num 1173) 2026-02-13T18:22:03.590 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:03.705 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3673290 2026-02-13T18:22:04.583 INFO:tasks.rados.rados.0.trial187.stdout:3566: done (2 left) 2026-02-13T18:22:04.583 INFO:tasks.rados.rados.0.trial187.stdout:3567: done (1 left) 2026-02-13T18:22:04.583 INFO:tasks.rados.rados.0.trial187.stdout:3568: done (0 left) 2026-02-13T18:22:04.584 INFO:tasks.rados.rados.0.trial187.stdout:3569: snap_create 2026-02-13T18:22:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3569: done (0 left) 2026-02-13T18:22:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3570: write (excl) oid 16 current snap is 400 2026-02-13T18:22:05.567 INFO:tasks.rados.rados.0.trial187.stdout:3570: seq_num 1186 ranges {733102=596382,1768350=758067,3136140=704019} 2026-02-13T18:22:05.576 INFO:tasks.rados.rados.0.trial187.stdout:3570: writing trial18717860-16 from 733102 to 1329484 tid 1 2026-02-13T18:22:05.584 INFO:tasks.rados.rados.0.trial187.stdout:3570: writing trial18717860-16 from 1768350 to 2526417 tid 2 2026-02-13T18:22:05.593 INFO:tasks.rados.rados.0.trial187.stdout:3570: writing trial18717860-16 from 3136140 to 3840159 tid 3 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3571: rollback oid 37 current snap is 400 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 397 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3570: finishing write tid 1 to trial18717860-16 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3570: finishing write tid 2 to trial18717860-16 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3572: read oid 40 snap -1 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3572: expect (ObjNum 1073 snap 354 seq_num 1073) 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3573: read oid 48 snap -1 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3573: expect (ObjNum 1182 snap 396 seq_num 1182) 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3574: copy_from oid 6 from oid 46 current snap is 400 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3575: write oid 39 current snap is 400 2026-02-13T18:22:05.594 INFO:tasks.rados.rados.0.trial187.stdout:3575: seq_num 1187 ranges {749909=671631,2110479=618078,3163563=515291} 2026-02-13T18:22:05.602 INFO:tasks.rados.rados.0.trial187.stdout:3575: writing trial18717860-39 from 749909 to 1421540 tid 1 2026-02-13T18:22:05.611 INFO:tasks.rados.rados.0.trial187.stdout:3575: writing trial18717860-39 from 2110479 to 2728557 tid 2 2026-02-13T18:22:05.616 INFO:tasks.rados.rados.0.trial187.stdout:3575: writing trial18717860-39 from 3163563 to 3678854 tid 3 2026-02-13T18:22:05.616 INFO:tasks.rados.rados.0.trial187.stdout:3576: write oid 34 current snap is 400 2026-02-13T18:22:05.616 INFO:tasks.rados.rados.0.trial187.stdout:3576: seq_num 1188 ranges {766716=746880,2168961=761736,3474633=442916} 2026-02-13T18:22:05.622 INFO:tasks.rados.rados.0.trial187.stdout:3576: writing trial18717860-34 from 766716 to 1513596 tid 1 2026-02-13T18:22:05.627 INFO:tasks.rados.rados.0.trial187.stdout:3576: writing trial18717860-34 from 2168961 to 2930697 tid 2 2026-02-13T18:22:05.631 INFO:tasks.rados.rados.0.trial187.stdout:3576: writing trial18717860-34 from 3474633 to 3917549 tid 3 2026-02-13T18:22:05.631 INFO:tasks.rados.rados.0.trial187.stdout:3577: read oid 30 snap -1 2026-02-13T18:22:05.631 INFO:tasks.rados.rados.0.trial187.stdout:3577: expect (ObjNum 1049 snap 344 seq_num 1049) 2026-02-13T18:22:05.631 INFO:tasks.rados.rados.0.trial187.stdout:3578: write (excl) oid 17 current snap is 400 2026-02-13T18:22:05.632 INFO:tasks.rados.rados.0.trial187.stdout:3578: seq_num 1189 ranges {783523=422129,1827443=621747,3218409=654188} 2026-02-13T18:22:05.635 INFO:tasks.rados.rados.0.trial187.stdout:3578: writing trial18717860-17 from 783523 to 1205652 tid 1 2026-02-13T18:22:05.640 INFO:tasks.rados.rados.0.trial187.stdout:3578: writing trial18717860-17 from 1827443 to 2449190 tid 2 2026-02-13T18:22:05.646 INFO:tasks.rados.rados.0.trial187.stdout:3578: writing trial18717860-17 from 3218409 to 3872597 tid 3 2026-02-13T18:22:05.646 INFO:tasks.rados.rados.0.trial187.stdout:3579: rollback oid 15 current snap is 400 2026-02-13T18:22:05.646 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 399 2026-02-13T18:22:05.646 INFO:tasks.rados.rados.0.trial187.stdout:3570: finishing write tid 3 to trial18717860-16 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3580: read oid 1 snap -1 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3580: expect deleted 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3581: delete oid 38 current snap is 400 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: finishing write tid 4 to trial18717860-16 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: finishing write tid 5 to trial18717860-16 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: oid 16 updating version 0 to 1650 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: oid 16 version 1650 is already newer than 1649 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: oid 16 updating version 1650 to 1651 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: oid 16 updating version 1651 to 1652 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1652 (ObjNum 1186 snap 400 seq_num 1186) dirty exists 2026-02-13T18:22:05.647 INFO:tasks.rados.rados.0.trial187.stdout:3570: left oid 16 (ObjNum 1186 snap 400 seq_num 1186) 2026-02-13T18:22:05.648 INFO:tasks.rados.rados.0.trial187.stdout:3571: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:22:05.648 INFO:tasks.rados.rados.0.trial187.stdout:3572: expect (ObjNum 1073 snap 354 seq_num 1073) 2026-02-13T18:22:05.680 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:05.735 INFO:tasks.rados.rados.0.trial187.stdout:3571: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:22:05.735 INFO:tasks.rados.rados.0.trial187.stdout:3573: expect (ObjNum 1182 snap 396 seq_num 1182) 2026-02-13T18:22:05.759 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3388552 2026-02-13T18:22:05.767 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1395853 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3571: finishing rollback tid 2 to trial18717860-37 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 2309 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3570: done (11 left) 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3571: done (10 left) 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3572: done (9 left) 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3573: done (8 left) 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3581: done (7 left) 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3582: delete oid 33 current snap is 400 2026-02-13T18:22:05.838 INFO:tasks.rados.rados.0.trial187.stdout:3574: finishing copy_from racing read to trial18717860-6 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3574: finishing copy_from to trial18717860-6 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1635 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: finishing write tid 1 to trial18717860-39 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: finishing write tid 2 to trial18717860-39 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: finishing write tid 3 to trial18717860-39 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: finishing write tid 4 to trial18717860-39 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: finishing write tid 5 to trial18717860-39 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: oid 39 updating version 0 to 2070 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: oid 39 updating version 2070 to 2071 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: oid 39 version 2071 is already newer than 2068 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:3575: oid 39 version 2071 is already newer than 2069 2026-02-13T18:22:05.839 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 2071 (ObjNum 1187 snap 400 seq_num 1187) dirty exists 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3575: left oid 39 (ObjNum 1187 snap 400 seq_num 1187) 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: finishing write tid 1 to trial18717860-34 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: finishing write tid 2 to trial18717860-34 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: finishing write tid 3 to trial18717860-34 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: finishing write tid 4 to trial18717860-34 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: finishing write tid 5 to trial18717860-34 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: oid 34 updating version 0 to 1663 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: oid 34 version 1663 is already newer than 1662 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: oid 34 version 1663 is already newer than 1661 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: oid 34 version 1663 is already newer than 1660 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1663 (ObjNum 1188 snap 400 seq_num 1188) dirty exists 2026-02-13T18:22:05.840 INFO:tasks.rados.rados.0.trial187.stdout:3576: left oid 34 (ObjNum 1188 snap 400 seq_num 1188) 2026-02-13T18:22:05.841 INFO:tasks.rados.rados.0.trial187.stdout:3577: expect (ObjNum 1049 snap 344 seq_num 1049) 2026-02-13T18:22:05.880 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3126335 2026-02-13T18:22:05.886 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:06.004 INFO:tasks.rados.rados.0.trial187.stdout:3578: finishing write tid 1 to trial18717860-17 2026-02-13T18:22:06.004 INFO:tasks.rados.rados.0.trial187.stdout:3578: finishing write tid 2 to trial18717860-17 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3578: finishing write tid 3 to trial18717860-17 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3574: done (7 left) 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3575: done (6 left) 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3576: done (5 left) 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3577: done (4 left) 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3582: done (3 left) 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3583: copy_from oid 41 from oid 23 current snap is 400 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3578: finishing write tid 4 to trial18717860-17 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3579: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3578: finishing write tid 5 to trial18717860-17 2026-02-13T18:22:06.005 INFO:tasks.rados.rados.0.trial187.stdout:3578: oid 17 updating version 0 to 2072 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3578: oid 17 updating version 2072 to 2075 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3578: oid 17 version 2075 is already newer than 2073 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3578: oid 17 version 2075 is already newer than 2074 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2075 (ObjNum 1189 snap 400 seq_num 1189) dirty exists 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3578: left oid 17 (ObjNum 1189 snap 400 seq_num 1189) 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3579: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3579: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1655 (ObjNum 1047 snap 342 seq_num 1047) dirty exists 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3578: done (3 left) 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3579: done (2 left) 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3580: done (1 left) 2026-02-13T18:22:06.006 INFO:tasks.rados.rados.0.trial187.stdout:3584: snap_remove snap 389 2026-02-13T18:22:06.591 INFO:tasks.rados.rados.0.trial187.stdout:3584: done (1 left) 2026-02-13T18:22:06.591 INFO:tasks.rados.rados.0.trial187.stdout:3585: read oid 42 snap -1 2026-02-13T18:22:06.591 INFO:tasks.rados.rados.0.trial187.stdout:3585: expect (ObjNum 1180 snap 396 seq_num 1180) 2026-02-13T18:22:06.592 INFO:tasks.rados.rados.0.trial187.stdout:3586: write (excl) oid 2 current snap is 400 2026-02-13T18:22:06.592 INFO:tasks.rados.rados.0.trial187.stdout:3583: finishing copy_from racing read to trial18717860-41 2026-02-13T18:22:06.592 INFO:tasks.rados.rados.0.trial187.stdout:3583: finishing copy_from to trial18717860-41 2026-02-13T18:22:06.592 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1469 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:22:06.592 INFO:tasks.rados.rados.0.trial187.stdout:3586: seq_num 1192 ranges {433944=647876,1486536=547408} 2026-02-13T18:22:06.598 INFO:tasks.rados.rados.0.trial187.stdout:3586: writing trial18717860-2 from 433944 to 1081820 tid 1 2026-02-13T18:22:06.605 INFO:tasks.rados.rados.0.trial187.stdout:3586: writing trial18717860-2 from 1486536 to 2033944 tid 2 2026-02-13T18:22:06.605 INFO:tasks.rados.rados.0.trial187.stdout:3583: done (2 left) 2026-02-13T18:22:06.605 INFO:tasks.rados.rados.0.trial187.stdout:3587: read oid 16 snap -1 2026-02-13T18:22:06.606 INFO:tasks.rados.rados.0.trial187.stdout:3587: expect (ObjNum 1186 snap 400 seq_num 1186) 2026-02-13T18:22:06.606 INFO:tasks.rados.rados.0.trial187.stdout:3588: copy_from oid 24 from oid 4 current snap is 400 2026-02-13T18:22:06.606 INFO:tasks.rados.rados.0.trial187.stdout:3586: finishing write tid 1 to trial18717860-2 2026-02-13T18:22:06.606 INFO:tasks.rados.rados.0.trial187.stdout:3585: expect (ObjNum 1180 snap 396 seq_num 1180) 2026-02-13T18:22:06.606 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:06.727 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3586: finishing write tid 2 to trial18717860-2 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3588: finishing copy_from to trial18717860-24 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3588: got expected ENOENT (src dne) 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3586: finishing write tid 3 to trial18717860-2 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3588: finishing copy_from racing read to trial18717860-24 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3586: finishing write tid 4 to trial18717860-2 2026-02-13T18:22:06.789 INFO:tasks.rados.rados.0.trial187.stdout:3586: oid 2 updating version 0 to 1251 2026-02-13T18:22:06.790 INFO:tasks.rados.rados.0.trial187.stdout:3586: oid 2 version 1251 is already newer than 1249 2026-02-13T18:22:06.790 INFO:tasks.rados.rados.0.trial187.stdout:3586: oid 2 version 1251 is already newer than 1250 2026-02-13T18:22:06.790 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1251 (ObjNum 1192 snap 400 seq_num 1192) dirty exists 2026-02-13T18:22:06.790 INFO:tasks.rados.rados.0.trial187.stdout:3586: left oid 2 (ObjNum 1192 snap 400 seq_num 1192) 2026-02-13T18:22:06.790 INFO:tasks.rados.rados.0.trial187.stdout:3587: expect (ObjNum 1186 snap 400 seq_num 1186) 2026-02-13T18:22:06.790 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:06.851 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2699015 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3585: done (3 left) 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3586: done (2 left) 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3587: done (1 left) 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3588: done (0 left) 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3589: read oid 2 snap -1 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3589: expect (ObjNum 1192 snap 400 seq_num 1192) 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:3590: rollback oid 46 current snap is 400 2026-02-13T18:22:06.864 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 365 2026-02-13T18:22:06.865 INFO:tasks.rados.rados.0.trial187.stdout:3591: delete oid 16 current snap is 400 2026-02-13T18:22:06.865 INFO:tasks.rados.rados.0.trial187.stdout:3591: done (2 left) 2026-02-13T18:22:06.865 INFO:tasks.rados.rados.0.trial187.stdout:3592: copy_from oid 31 from oid 21 current snap is 400 2026-02-13T18:22:06.865 INFO:tasks.rados.rados.0.trial187.stdout:3593: read oid 28 snap 392 2026-02-13T18:22:06.865 INFO:tasks.rados.rados.0.trial187.stdout:3593: expect (ObjNum 1140 snap 382 seq_num 1140) 2026-02-13T18:22:06.866 INFO:tasks.rados.rados.0.trial187.stdout:3594: snap_remove snap 393 2026-02-13T18:22:07.595 INFO:tasks.rados.rados.0.trial187.stdout:3594: done (4 left) 2026-02-13T18:22:07.596 INFO:tasks.rados.rados.0.trial187.stdout:3595: delete oid 45 current snap is 400 2026-02-13T18:22:07.596 INFO:tasks.rados.rados.0.trial187.stdout:3589: expect (ObjNum 1192 snap 400 seq_num 1192) 2026-02-13T18:22:07.667 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:07.695 INFO:tasks.rados.rados.0.trial187.stdout:3590: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:22:07.695 INFO:tasks.rados.rados.0.trial187.stdout:3590: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:22:07.695 INFO:tasks.rados.rados.0.trial187.stdout:3590: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:22:07.695 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1655 (ObjNum 1094 snap 365 seq_num 1094) dirty exists 2026-02-13T18:22:07.695 INFO:tasks.rados.rados.0.trial187.stdout:3593: expect (ObjNum 1140 snap 382 seq_num 1140) 2026-02-13T18:22:07.702 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2060939 2026-02-13T18:22:07.715 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1376651 2026-02-13T18:22:07.727 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:3592: finishing copy_from racing read to trial18717860-31 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:3592: finishing copy_from to trial18717860-31 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1321 (ObjNum 1068 snap 352 seq_num 1068) dirty exists 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:3589: done (4 left) 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:3590: done (3 left) 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:3592: done (2 left) 2026-02-13T18:22:07.751 INFO:tasks.rados.rados.0.trial187.stdout:3593: done (1 left) 2026-02-13T18:22:07.752 INFO:tasks.rados.rados.0.trial187.stdout:3595: done (0 left) 2026-02-13T18:22:07.752 INFO:tasks.rados.rados.0.trial187.stdout:3596: rollback oid 45 current snap is 400 2026-02-13T18:22:07.752 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 45 to 397 2026-02-13T18:22:07.752 INFO:tasks.rados.rados.0.trial187.stdout:3597: write oid 34 current snap is 400 2026-02-13T18:22:07.752 INFO:tasks.rados.rados.0.trial187.stdout:3597: seq_num 1195 ranges {484365=589976,1661982=422383} 2026-02-13T18:22:07.758 INFO:tasks.rados.rados.0.trial187.stdout:3597: writing trial18717860-34 from 484365 to 1074341 tid 1 2026-02-13T18:22:07.766 INFO:tasks.rados.rados.0.trial187.stdout:3597: writing trial18717860-34 from 1661982 to 2084365 tid 2 2026-02-13T18:22:07.766 INFO:tasks.rados.rados.0.trial187.stdout:3598: delete oid 22 current snap is 400 2026-02-13T18:22:07.766 INFO:tasks.rados.rados.0.trial187.stdout:3596: finishing rollback tid 1 to trial18717860-45 2026-02-13T18:22:07.766 INFO:tasks.rados.rados.0.trial187.stdout:3596: finishing rollback tid 2 to trial18717860-45 2026-02-13T18:22:07.766 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1485 (ObjNum 1117 snap 375 seq_num 1117) dirty exists 2026-02-13T18:22:07.766 INFO:tasks.rados.rados.0.trial187.stdout:3597: finishing write tid 1 to trial18717860-34 2026-02-13T18:22:07.768 INFO:tasks.rados.rados.0.trial187.stdout:3596: done (2 left) 2026-02-13T18:22:07.768 INFO:tasks.rados.rados.0.trial187.stdout:3598: done (1 left) 2026-02-13T18:22:07.768 INFO:tasks.rados.rados.0.trial187.stdout:3599: write oid 45 current snap is 400 2026-02-13T18:22:07.768 INFO:tasks.rados.rados.0.trial187.stdout:3599: seq_num 1197 ranges {517979=740474,1778946=339033} 2026-02-13T18:22:07.776 INFO:tasks.rados.rados.0.trial187.stdout:3599: writing trial18717860-45 from 517979 to 1258453 tid 1 2026-02-13T18:22:07.782 INFO:tasks.rados.rados.0.trial187.stdout:3599: writing trial18717860-45 from 1778946 to 2117979 tid 2 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3600: copy_from oid 17 from oid 43 current snap is 400 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: finishing write tid 2 to trial18717860-34 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: finishing write tid 3 to trial18717860-34 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: finishing write tid 4 to trial18717860-34 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: oid 34 updating version 0 to 1665 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: oid 34 version 1665 is already newer than 1664 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: oid 34 updating version 1665 to 1666 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1666 (ObjNum 1195 snap 400 seq_num 1195) dirty exists 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3597: left oid 34 (ObjNum 1195 snap 400 seq_num 1195) 2026-02-13T18:22:07.783 INFO:tasks.rados.rados.0.trial187.stdout:3599: finishing write tid 1 to trial18717860-45 2026-02-13T18:22:07.784 INFO:tasks.rados.rados.0.trial187.stdout:3597: done (2 left) 2026-02-13T18:22:07.784 INFO:tasks.rados.rados.0.trial187.stdout:3601: snap_create 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: finishing write tid 2 to trial18717860-45 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: finishing write tid 3 to trial18717860-45 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: finishing write tid 4 to trial18717860-45 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: oid 45 updating version 0 to 1486 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: oid 45 updating version 1486 to 1487 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: oid 45 updating version 1487 to 1488 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1488 (ObjNum 1197 snap 400 seq_num 1197) dirty exists 2026-02-13T18:22:07.785 INFO:tasks.rados.rados.0.trial187.stdout:3599: left oid 45 (ObjNum 1197 snap 400 seq_num 1197) 2026-02-13T18:22:07.796 INFO:tasks.rados.rados.0.trial187.stdout:3600: finishing copy_from racing read to trial18717860-17 2026-02-13T18:22:07.797 INFO:tasks.rados.rados.0.trial187.stdout:3600: finishing copy_from to trial18717860-17 2026-02-13T18:22:07.797 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1652 (ObjNum 1179 snap 396 seq_num 1179) dirty exists 2026-02-13T18:22:08.599 INFO:tasks.rados.rados.0.trial187.stdout:3599: done (2 left) 2026-02-13T18:22:08.599 INFO:tasks.rados.rados.0.trial187.stdout:3600: done (1 left) 2026-02-13T18:22:08.600 INFO:tasks.rados.rados.0.trial187.stdout:3601: done (0 left) 2026-02-13T18:22:08.600 INFO:tasks.rados.rados.0.trial187.stdout:3602: snap_create 2026-02-13T18:22:09.600 INFO:tasks.rados.rados.0.trial187.stdout:3602: done (0 left) 2026-02-13T18:22:09.600 INFO:tasks.rados.rados.0.trial187.stdout:3603: snap_remove snap 392 2026-02-13T18:22:10.568 INFO:tasks.rados.rados.0.trial187.stdout:3603: done (0 left) 2026-02-13T18:22:10.569 INFO:tasks.rados.rados.0.trial187.stdout:3604: snap_remove snap 365 2026-02-13T18:22:11.569 INFO:tasks.rados.rados.0.trial187.stdout:3604: done (0 left) 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3605: rollback oid 27 current snap is 402 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 400 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3606: read oid 43 snap -1 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3606: expect (ObjNum 1179 snap 396 seq_num 1179) 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3607: read oid 34 snap -1 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3607: expect (ObjNum 1195 snap 400 seq_num 1195) 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3608: copy_from oid 32 from oid 29 current snap is 402 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3609: read oid 38 snap 397 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3609: expect (ObjNum 1165 snap 385 seq_num 1165) 2026-02-13T18:22:11.570 INFO:tasks.rados.rados.0.trial187.stdout:3610: snap_create 2026-02-13T18:22:11.575 INFO:tasks.rados.rados.0.trial187.stdout:3607: expect (ObjNum 1195 snap 400 seq_num 1195) 2026-02-13T18:22:11.609 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:11.670 INFO:tasks.rados.rados.0.trial187.stdout:3606: expect (ObjNum 1179 snap 396 seq_num 1179) 2026-02-13T18:22:11.681 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1826732 2026-02-13T18:22:11.852 INFO:tasks.rados.rados.0.trial187.stdout:3605: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:22:11.852 INFO:tasks.rados.rados.0.trial187.stdout:3605: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:22:11.852 INFO:tasks.rados.rados.0.trial187.stdout:3605: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:22:11.852 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1655 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:22:11.852 INFO:tasks.rados.rados.0.trial187.stdout:3609: expect (ObjNum 1165 snap 385 seq_num 1165) 2026-02-13T18:22:11.857 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 892233 2026-02-13T18:22:11.914 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:11.950 INFO:tasks.rados.rados.0.trial187.stdout:3608: finishing copy_from racing read to trial18717860-32 2026-02-13T18:22:11.950 INFO:tasks.rados.rados.0.trial187.stdout:3608: finishing copy_from to trial18717860-32 2026-02-13T18:22:11.950 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1241 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:22:12.570 INFO:tasks.rados.rados.0.trial187.stdout:3605: done (5 left) 2026-02-13T18:22:12.570 INFO:tasks.rados.rados.0.trial187.stdout:3606: done (4 left) 2026-02-13T18:22:12.570 INFO:tasks.rados.rados.0.trial187.stdout:3607: done (3 left) 2026-02-13T18:22:12.571 INFO:tasks.rados.rados.0.trial187.stdout:3608: done (2 left) 2026-02-13T18:22:12.571 INFO:tasks.rados.rados.0.trial187.stdout:3609: done (1 left) 2026-02-13T18:22:12.571 INFO:tasks.rados.rados.0.trial187.stdout:3610: done (0 left) 2026-02-13T18:22:12.571 INFO:tasks.rados.rados.0.trial187.stdout:3611: write oid 13 current snap is 403 2026-02-13T18:22:12.571 INFO:tasks.rados.rados.0.trial187.stdout:3611: seq_num 1198 ranges {534786=415723,1437428=697358} 2026-02-13T18:22:12.576 INFO:tasks.rados.rados.0.trial187.stdout:3611: writing trial18717860-13 from 534786 to 950509 tid 1 2026-02-13T18:22:12.584 INFO:tasks.rados.rados.0.trial187.stdout:3611: writing trial18717860-13 from 1437428 to 2134786 tid 2 2026-02-13T18:22:12.584 INFO:tasks.rados.rados.0.trial187.stdout:3612: write oid 45 current snap is 403 2026-02-13T18:22:12.584 INFO:tasks.rados.rados.0.trial187.stdout:3612: seq_num 1199 ranges {551593=490972,1779557=372036} 2026-02-13T18:22:12.591 INFO:tasks.rados.rados.0.trial187.stdout:3612: writing trial18717860-45 from 551593 to 1042565 tid 1 2026-02-13T18:22:12.599 INFO:tasks.rados.rados.0.trial187.stdout:3612: writing trial18717860-45 from 1779557 to 2151593 tid 2 2026-02-13T18:22:12.599 INFO:tasks.rados.rados.0.trial187.stdout:3613: snap_create 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: finishing write tid 1 to trial18717860-13 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3612: finishing write tid 1 to trial18717860-45 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: finishing write tid 2 to trial18717860-13 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: finishing write tid 3 to trial18717860-13 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: finishing write tid 4 to trial18717860-13 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: oid 13 updating version 0 to 1253 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: oid 13 updating version 1253 to 1254 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: oid 13 version 1254 is already newer than 1252 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1254 (ObjNum 1198 snap 403 seq_num 1198) dirty exists 2026-02-13T18:22:12.600 INFO:tasks.rados.rados.0.trial187.stdout:3611: left oid 13 (ObjNum 1198 snap 403 seq_num 1198) 2026-02-13T18:22:12.601 INFO:tasks.rados.rados.0.trial187.stdout:3612: finishing write tid 2 to trial18717860-45 2026-02-13T18:22:12.601 INFO:tasks.rados.rados.0.trial187.stdout:3612: finishing write tid 3 to trial18717860-45 2026-02-13T18:22:12.601 INFO:tasks.rados.rados.0.trial187.stdout:3612: finishing write tid 4 to trial18717860-45 2026-02-13T18:22:12.602 INFO:tasks.rados.rados.0.trial187.stdout:3612: oid 45 updating version 0 to 1489 2026-02-13T18:22:12.602 INFO:tasks.rados.rados.0.trial187.stdout:3612: oid 45 updating version 1489 to 1490 2026-02-13T18:22:12.602 INFO:tasks.rados.rados.0.trial187.stdout:3612: oid 45 updating version 1490 to 1491 2026-02-13T18:22:12.602 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1491 (ObjNum 1199 snap 403 seq_num 1199) dirty exists 2026-02-13T18:22:12.602 INFO:tasks.rados.rados.0.trial187.stdout:3612: left oid 45 (ObjNum 1199 snap 403 seq_num 1199) 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3611: done (2 left) 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3612: done (1 left) 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3613: done (0 left) 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3614: rollback oid 8 current snap is 404 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 390 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3615: copy_from oid 42 from oid 20 current snap is 404 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3616: read oid 13 snap 400 2026-02-13T18:22:13.572 INFO:tasks.rados.rados.0.trial187.stdout:3616: expect (ObjNum 1170 snap 389 seq_num 1170) 2026-02-13T18:22:13.573 INFO:tasks.rados.rados.0.trial187.stdout:3617: write (excl) oid 45 current snap is 404 2026-02-13T18:22:13.573 INFO:tasks.rados.rados.0.trial187.stdout:3617: seq_num 1200 ranges {568400=566221,1838039=330361} 2026-02-13T18:22:13.579 INFO:tasks.rados.rados.0.trial187.stdout:3617: writing trial18717860-45 from 568400 to 1134621 tid 1 2026-02-13T18:22:13.586 INFO:tasks.rados.rados.0.trial187.stdout:3617: writing trial18717860-45 from 1838039 to 2168400 tid 2 2026-02-13T18:22:13.586 INFO:tasks.rados.rados.0.trial187.stdout:3618: read oid 23 snap -1 2026-02-13T18:22:13.586 INFO:tasks.rados.rados.0.trial187.stdout:3618: expect (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:22:13.587 INFO:tasks.rados.rados.0.trial187.stdout:3619: snap_remove snap 329 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3619: done (5 left) 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3620: read oid 49 snap 403 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3620: expect (ObjNum 1151 snap 383 seq_num 1151) 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3621: copy_from oid 10 from oid 36 current snap is 404 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3614: finishing rollback tid 0 to trial18717860-8 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3614: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:22:14.577 INFO:tasks.rados.rados.0.trial187.stdout:3622: write oid 18 current snap is 404 2026-02-13T18:22:14.578 INFO:tasks.rados.rados.0.trial187.stdout:3622: seq_num 1201 ranges {585207=641470,1896521=288686} 2026-02-13T18:22:14.585 INFO:tasks.rados.rados.0.trial187.stdout:3622: writing trial18717860-18 from 585207 to 1226677 tid 1 2026-02-13T18:22:14.592 INFO:tasks.rados.rados.0.trial187.stdout:3622: writing trial18717860-18 from 1896521 to 2185207 tid 2 2026-02-13T18:22:14.592 INFO:tasks.rados.rados.0.trial187.stdout:3623: copy_from oid 34 from oid 37 current snap is 404 2026-02-13T18:22:14.592 INFO:tasks.rados.rados.0.trial187.stdout:3614: finishing rollback tid 2 to trial18717860-8 2026-02-13T18:22:14.592 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 2041 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:22:14.592 INFO:tasks.rados.rados.0.trial187.stdout:3616: expect (ObjNum 1170 snap 389 seq_num 1170) 2026-02-13T18:22:14.613 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2293077 2026-02-13T18:22:14.641 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:14.718 INFO:tasks.rados.rados.0.trial187.stdout:3617: finishing write tid 1 to trial18717860-45 2026-02-13T18:22:14.718 INFO:tasks.rados.rados.0.trial187.stdout:3615: finishing copy_from racing read to trial18717860-42 2026-02-13T18:22:14.719 INFO:tasks.rados.rados.0.trial187.stdout:3615: finishing copy_from to trial18717860-42 2026-02-13T18:22:14.719 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1643 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:22:14.719 INFO:tasks.rados.rados.0.trial187.stdout:3618: expect (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:22:14.761 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2654893 2026-02-13T18:22:14.904 INFO:tasks.rados.rados.0.trial187.stdout:3617: finishing write tid 2 to trial18717860-45 2026-02-13T18:22:14.904 INFO:tasks.rados.rados.0.trial187.stdout:3617: finishing write tid 3 to trial18717860-45 2026-02-13T18:22:14.904 INFO:tasks.rados.rados.0.trial187.stdout:3617: finishing write tid 4 to trial18717860-45 2026-02-13T18:22:14.904 INFO:tasks.rados.rados.0.trial187.stdout:3617: oid 45 updating version 0 to 1494 2026-02-13T18:22:14.904 INFO:tasks.rados.rados.0.trial187.stdout:3617: oid 45 version 1494 is already newer than 1492 2026-02-13T18:22:14.904 INFO:tasks.rados.rados.0.trial187.stdout:3617: oid 45 version 1494 is already newer than 1493 2026-02-13T18:22:14.905 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 1494 (ObjNum 1200 snap 404 seq_num 1200) dirty exists 2026-02-13T18:22:14.905 INFO:tasks.rados.rados.0.trial187.stdout:3617: left oid 45 (ObjNum 1200 snap 404 seq_num 1200) 2026-02-13T18:22:14.905 INFO:tasks.rados.rados.0.trial187.stdout:3620: expect (ObjNum 1151 snap 383 seq_num 1151) 2026-02-13T18:22:14.949 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1794293 2026-02-13T18:22:14.981 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2474873 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3621: finishing copy_from racing read to trial18717860-10 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3621: finishing copy_from to trial18717860-10 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1461 (ObjNum 1150 snap 383 seq_num 1150) dirty exists 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3614: done (8 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3615: done (7 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3616: done (6 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3617: done (5 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3618: done (4 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3620: done (3 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3621: done (2 left) 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3624: rollback oid 47 current snap is 404 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 47 to 345 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3622: finishing write tid 1 to trial18717860-18 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3622: finishing write tid 2 to trial18717860-18 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3622: finishing write tid 3 to trial18717860-18 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3622: finishing write tid 4 to trial18717860-18 2026-02-13T18:22:14.993 INFO:tasks.rados.rados.0.trial187.stdout:3622: oid 18 updating version 0 to 1255 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3622: oid 18 updating version 1255 to 1257 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3622: oid 18 version 1257 is already newer than 1256 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1257 (ObjNum 1201 snap 404 seq_num 1201) dirty exists 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3622: left oid 18 (ObjNum 1201 snap 404 seq_num 1201) 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3623: finishing copy_from racing read to trial18717860-34 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3623: finishing copy_from to trial18717860-34 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 2309 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3622: done (2 left) 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3623: done (1 left) 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3625: read oid 33 snap -1 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3625: expect deleted 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3626: read oid 20 snap -1 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3626: expect (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:22:14.994 INFO:tasks.rados.rados.0.trial187.stdout:3627: snap_create 2026-02-13T18:22:14.998 INFO:tasks.rados.rados.0.trial187.stdout:3624: finishing rollback tid 0 to trial18717860-47 2026-02-13T18:22:15.003 INFO:tasks.rados.rados.0.trial187.stdout:3624: finishing rollback tid 1 to trial18717860-47 2026-02-13T18:22:15.003 INFO:tasks.rados.rados.0.trial187.stdout:3624: finishing rollback tid 2 to trial18717860-47 2026-02-13T18:22:15.003 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1656 (ObjNum 1027 snap 331 seq_num 1027) dirty exists 2026-02-13T18:22:15.003 INFO:tasks.rados.rados.0.trial187.stdout:3626: expect (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:22:15.003 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 709672 2026-02-13T18:22:15.023 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:15.049 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1667591 2026-02-13T18:22:15.571 INFO:tasks.rados.rados.0.trial187.stdout:3624: done (3 left) 2026-02-13T18:22:15.571 INFO:tasks.rados.rados.0.trial187.stdout:3625: done (2 left) 2026-02-13T18:22:15.571 INFO:tasks.rados.rados.0.trial187.stdout:3626: done (1 left) 2026-02-13T18:22:15.571 INFO:tasks.rados.rados.0.trial187.stdout:3627: done (0 left) 2026-02-13T18:22:15.571 INFO:tasks.rados.rados.0.trial187.stdout:3628: write (excl) oid 2 current snap is 405 2026-02-13T18:22:15.571 INFO:tasks.rados.rados.0.trial187.stdout:3628: seq_num 1202 ranges {602014=433072,1671356=530658} 2026-02-13T18:22:15.578 INFO:tasks.rados.rados.0.trial187.stdout:3628: writing trial18717860-2 from 602014 to 1035086 tid 1 2026-02-13T18:22:15.586 INFO:tasks.rados.rados.0.trial187.stdout:3628: writing trial18717860-2 from 1671356 to 2202014 tid 2 2026-02-13T18:22:15.586 INFO:tasks.rados.rados.0.trial187.stdout:3629: copy_from oid 17 from oid 46 current snap is 405 2026-02-13T18:22:15.586 INFO:tasks.rados.rados.0.trial187.stdout:3628: finishing write tid 1 to trial18717860-2 2026-02-13T18:22:15.586 INFO:tasks.rados.rados.0.trial187.stdout:3630: read oid 42 snap -1 2026-02-13T18:22:15.586 INFO:tasks.rados.rados.0.trial187.stdout:3630: expect (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:22:15.587 INFO:tasks.rados.rados.0.trial187.stdout:3631: delete oid 50 current snap is 405 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:3628: finishing write tid 2 to trial18717860-2 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:3628: finishing write tid 3 to trial18717860-2 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:3628: finishing write tid 4 to trial18717860-2 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:3628: oid 2 updating version 0 to 1260 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:3628: oid 2 version 1260 is already newer than 1259 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:3628: oid 2 version 1260 is already newer than 1258 2026-02-13T18:22:15.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1260 (ObjNum 1202 snap 405 seq_num 1202) dirty exists 2026-02-13T18:22:15.590 INFO:tasks.rados.rados.0.trial187.stdout:3628: left oid 2 (ObjNum 1202 snap 405 seq_num 1202) 2026-02-13T18:22:15.594 INFO:tasks.rados.rados.0.trial187.stdout:3630: expect (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:22:15.659 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 295472 2026-02-13T18:22:15.681 INFO:tasks.rados.rados.0.trial187.stdout:3629: finishing copy_from racing read to trial18717860-17 2026-02-13T18:22:15.681 INFO:tasks.rados.rados.0.trial187.stdout:3629: finishing copy_from to trial18717860-17 2026-02-13T18:22:15.681 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1655 (ObjNum 1094 snap 365 seq_num 1094) dirty exists 2026-02-13T18:22:15.682 INFO:tasks.rados.rados.0.trial187.stdout:3628: done (3 left) 2026-02-13T18:22:15.682 INFO:tasks.rados.rados.0.trial187.stdout:3629: done (2 left) 2026-02-13T18:22:15.682 INFO:tasks.rados.rados.0.trial187.stdout:3630: done (1 left) 2026-02-13T18:22:15.682 INFO:tasks.rados.rados.0.trial187.stdout:3631: done (0 left) 2026-02-13T18:22:15.682 INFO:tasks.rados.rados.0.trial187.stdout:3632: copy_from oid 6 from oid 7 current snap is 405 2026-02-13T18:22:15.682 INFO:tasks.rados.rados.0.trial187.stdout:3633: snap_remove snap 386 2026-02-13T18:22:16.582 INFO:tasks.rados.rados.0.trial187.stdout:3633: done (1 left) 2026-02-13T18:22:16.582 INFO:tasks.rados.rados.0.trial187.stdout:3634: rollback oid 29 current snap is 405 2026-02-13T18:22:16.582 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 399 2026-02-13T18:22:16.582 INFO:tasks.rados.rados.0.trial187.stdout:3632: finishing copy_from racing read to trial18717860-6 2026-02-13T18:22:16.582 INFO:tasks.rados.rados.0.trial187.stdout:3632: finishing copy_from to trial18717860-6 2026-02-13T18:22:16.583 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 1652 (ObjNum 1171 snap 392 seq_num 1171) dirty exists 2026-02-13T18:22:16.583 INFO:tasks.rados.rados.0.trial187.stdout:3632: done (1 left) 2026-02-13T18:22:16.583 INFO:tasks.rados.rados.0.trial187.stdout:3635: write oid 11 current snap is 405 2026-02-13T18:22:16.583 INFO:tasks.rados.rados.0.trial187.stdout:3635: seq_num 1204 ranges {635628=583570,1671967=563661} 2026-02-13T18:22:16.589 INFO:tasks.rados.rados.0.trial187.stdout:3635: writing trial18717860-11 from 635628 to 1219198 tid 1 2026-02-13T18:22:16.597 INFO:tasks.rados.rados.0.trial187.stdout:3635: writing trial18717860-11 from 1671967 to 2235628 tid 2 2026-02-13T18:22:16.597 INFO:tasks.rados.rados.0.trial187.stdout:3636: rollback oid 34 current snap is 405 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 34 to 380 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3634: finishing rollback tid 0 to trial18717860-29 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3634: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3634: finishing rollback tid 2 to trial18717860-29 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1658 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3635: finishing write tid 1 to trial18717860-11 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3634: done (2 left) 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3637: read oid 29 snap -1 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3637: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:3638: rollback oid 17 current snap is 405 2026-02-13T18:22:16.598 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 17 to 321 2026-02-13T18:22:16.599 INFO:tasks.rados.rados.0.trial187.stdout:3639: read oid 41 snap 403 2026-02-13T18:22:16.599 INFO:tasks.rados.rados.0.trial187.stdout:3639: expect (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:22:16.599 INFO:tasks.rados.rados.0.trial187.stdout:3640: read oid 2 snap 380 2026-02-13T18:22:16.599 INFO:tasks.rados.rados.0.trial187.stdout:3640: expect deleted 2026-02-13T18:22:16.599 INFO:tasks.rados.rados.0.trial187.stdout:3641: snap_remove snap 401 2026-02-13T18:22:17.583 INFO:tasks.rados.rados.0.trial187.stdout:3641: done (6 left) 2026-02-13T18:22:17.583 INFO:tasks.rados.rados.0.trial187.stdout:3642: copy_from oid 50 from oid 38 current snap is 405 2026-02-13T18:22:17.583 INFO:tasks.rados.rados.0.trial187.stdout:3637: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:17.615 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2148215 2026-02-13T18:22:17.655 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1728253 2026-02-13T18:22:17.674 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3638: finishing rollback tid 0 to trial18717860-17 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3638: finishing rollback tid 1 to trial18717860-17 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3638: finishing rollback tid 2 to trial18717860-17 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2078 (ObjNum 738 snap 257 seq_num 738) dirty exists 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3635: finishing write tid 2 to trial18717860-11 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3635: finishing write tid 3 to trial18717860-11 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3635: finishing write tid 4 to trial18717860-11 2026-02-13T18:22:17.717 INFO:tasks.rados.rados.0.trial187.stdout:3635: oid 11 updating version 0 to 2312 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3635: oid 11 version 2312 is already newer than 2310 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3635: oid 11 version 2312 is already newer than 2311 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 2312 (ObjNum 1204 snap 405 seq_num 1204) dirty exists 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3635: left oid 11 (ObjNum 1204 snap 405 seq_num 1204) 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3636: finishing rollback tid 0 to trial18717860-34 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3636: finishing rollback tid 1 to trial18717860-34 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 2314 (ObjNum 129 snap 0 seq_num 3014695448) dirty dne 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3635: done (6 left) 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3636: done (5 left) 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3637: done (4 left) 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3638: done (3 left) 2026-02-13T18:22:17.718 INFO:tasks.rados.rados.0.trial187.stdout:3640: done (2 left) 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3643: read oid 10 snap 380 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3643: expect (ObjNum 1125 snap 378 seq_num 1125) 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3644: read oid 16 snap -1 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3644: expect deleted 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3645: read oid 36 snap -1 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3645: expect (ObjNum 1150 snap 383 seq_num 1150) 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3646: snap_create 2026-02-13T18:22:17.719 INFO:tasks.rados.rados.0.trial187.stdout:3639: expect (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:22:17.787 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:17.920 INFO:tasks.rados.rados.0.trial187.stdout:3642: finishing copy_from to trial18717860-50 2026-02-13T18:22:17.920 INFO:tasks.rados.rados.0.trial187.stdout:3642: got expected ENOENT (src dne) 2026-02-13T18:22:17.920 INFO:tasks.rados.rados.0.trial187.stdout:3642: finishing copy_from racing read to trial18717860-50 2026-02-13T18:22:17.920 INFO:tasks.rados.rados.0.trial187.stdout:3645: expect (ObjNum 1150 snap 383 seq_num 1150) 2026-02-13T18:22:17.960 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:18.005 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:18.050 INFO:tasks.rados.rados.0.trial187.stdout:3643: expect (ObjNum 1125 snap 378 seq_num 1125) 2026-02-13T18:22:18.050 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:18.097 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 473040 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3639: done (5 left) 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3642: done (4 left) 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3643: done (3 left) 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3644: done (2 left) 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3645: done (1 left) 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3646: done (0 left) 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3647: write (excl) oid 46 current snap is 406 2026-02-13T18:22:18.589 INFO:tasks.rados.rados.0.trial187.stdout:3647: seq_num 1205 ranges {652435=658819,1730449=521986} 2026-02-13T18:22:18.597 INFO:tasks.rados.rados.0.trial187.stdout:3647: writing trial18717860-46 from 652435 to 1311254 tid 1 2026-02-13T18:22:18.603 INFO:tasks.rados.rados.0.trial187.stdout:3647: writing trial18717860-46 from 1730449 to 2252435 tid 2 2026-02-13T18:22:18.603 INFO:tasks.rados.rados.0.trial187.stdout:3648: read oid 7 snap -1 2026-02-13T18:22:18.604 INFO:tasks.rados.rados.0.trial187.stdout:3648: expect (ObjNum 1171 snap 392 seq_num 1171) 2026-02-13T18:22:18.604 INFO:tasks.rados.rados.0.trial187.stdout:3649: snap_create 2026-02-13T18:22:18.604 INFO:tasks.rados.rados.0.trial187.stdout:3647: finishing write tid 1 to trial18717860-46 2026-02-13T18:22:18.609 INFO:tasks.rados.rados.0.trial187.stdout:3647: finishing write tid 2 to trial18717860-46 2026-02-13T18:22:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3648: expect (ObjNum 1171 snap 392 seq_num 1171) 2026-02-13T18:22:18.634 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2508347 2026-02-13T18:22:18.659 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:18.699 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:18.738 INFO:tasks.rados.rados.0.trial187.stdout:3647: finishing write tid 3 to trial18717860-46 2026-02-13T18:22:18.738 INFO:tasks.rados.rados.0.trial187.stdout:3647: finishing write tid 4 to trial18717860-46 2026-02-13T18:22:18.739 INFO:tasks.rados.rados.0.trial187.stdout:3647: oid 46 updating version 0 to 1657 2026-02-13T18:22:18.739 INFO:tasks.rados.rados.0.trial187.stdout:3647: oid 46 updating version 1657 to 1658 2026-02-13T18:22:18.739 INFO:tasks.rados.rados.0.trial187.stdout:3647: oid 46 version 1658 is already newer than 1656 2026-02-13T18:22:18.739 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1658 (ObjNum 1205 snap 406 seq_num 1205) dirty exists 2026-02-13T18:22:18.739 INFO:tasks.rados.rados.0.trial187.stdout:3647: left oid 46 (ObjNum 1205 snap 406 seq_num 1205) 2026-02-13T18:22:19.590 INFO:tasks.rados.rados.0.trial187.stdout:3647: done (2 left) 2026-02-13T18:22:19.590 INFO:tasks.rados.rados.0.trial187.stdout:3648: done (1 left) 2026-02-13T18:22:19.590 INFO:tasks.rados.rados.0.trial187.stdout:3649: done (0 left) 2026-02-13T18:22:19.590 INFO:tasks.rados.rados.0.trial187.stdout:3650: copy_from oid 43 from oid 12 current snap is 407 2026-02-13T18:22:19.591 INFO:tasks.rados.rados.0.trial187.stdout:3651: write (excl) oid 23 current snap is 407 2026-02-13T18:22:19.591 INFO:tasks.rados.rados.0.trial187.stdout:3651: seq_num 1206 ranges {669242=734068,2188931=80311} 2026-02-13T18:22:19.599 INFO:tasks.rados.rados.0.trial187.stdout:3651: writing trial18717860-23 from 669242 to 1403310 tid 1 2026-02-13T18:22:19.605 INFO:tasks.rados.rados.0.trial187.stdout:3651: writing trial18717860-23 from 2188931 to 2269242 tid 2 2026-02-13T18:22:19.605 INFO:tasks.rados.rados.0.trial187.stdout:3652: read oid 4 snap -1 2026-02-13T18:22:19.606 INFO:tasks.rados.rados.0.trial187.stdout:3652: expect deleted 2026-02-13T18:22:19.606 INFO:tasks.rados.rados.0.trial187.stdout:3653: snap_remove snap 403 2026-02-13T18:22:20.572 INFO:tasks.rados.rados.0.trial187.stdout:3653: done (3 left) 2026-02-13T18:22:20.572 INFO:tasks.rados.rados.0.trial187.stdout:3654: rollback oid 44 current snap is 407 2026-02-13T18:22:20.572 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 44 to 406 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: finishing write tid 1 to trial18717860-23 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3650: finishing copy_from racing read to trial18717860-43 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3650: finishing copy_from to trial18717860-43 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1651 (ObjNum 1153 snap 383 seq_num 1153) dirty exists 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: finishing write tid 2 to trial18717860-23 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: finishing write tid 3 to trial18717860-23 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: finishing write tid 4 to trial18717860-23 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: oid 23 updating version 0 to 1481 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: oid 23 version 1481 is already newer than 1480 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:3651: oid 23 version 1481 is already newer than 1479 2026-02-13T18:22:20.573 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 23 v 1481 (ObjNum 1206 snap 407 seq_num 1206) dirty exists 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3651: left oid 23 (ObjNum 1206 snap 407 seq_num 1206) 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3650: done (3 left) 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3651: done (2 left) 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3652: done (1 left) 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3655: read oid 10 snap 366 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3655: expect deleted 2026-02-13T18:22:20.574 INFO:tasks.rados.rados.0.trial187.stdout:3656: snap_remove snap 404 2026-02-13T18:22:21.571 INFO:tasks.rados.rados.0.trial187.stdout:3656: done (2 left) 2026-02-13T18:22:21.572 INFO:tasks.rados.rados.0.trial187.stdout:3657: snap_create 2026-02-13T18:22:21.572 INFO:tasks.rados.rados.0.trial187.stdout:3654: finishing rollback tid 0 to trial18717860-44 2026-02-13T18:22:21.572 INFO:tasks.rados.rados.0.trial187.stdout:3654: finishing rollback tid 1 to trial18717860-44 2026-02-13T18:22:21.572 INFO:tasks.rados.rados.0.trial187.stdout:3654: finishing rollback tid 2 to trial18717860-44 2026-02-13T18:22:21.572 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2363 (ObjNum 1136 snap 381 seq_num 1136) dirty exists 2026-02-13T18:22:22.572 INFO:tasks.rados.rados.0.trial187.stdout:3654: done (2 left) 2026-02-13T18:22:22.573 INFO:tasks.rados.rados.0.trial187.stdout:3655: done (1 left) 2026-02-13T18:22:22.573 INFO:tasks.rados.rados.0.trial187.stdout:3657: done (0 left) 2026-02-13T18:22:22.573 INFO:tasks.rados.rados.0.trial187.stdout:3658: copy_from oid 28 from oid 41 current snap is 408 2026-02-13T18:22:22.573 INFO:tasks.rados.rados.0.trial187.stdout:3659: copy_from oid 21 from oid 31 current snap is 408 2026-02-13T18:22:22.573 INFO:tasks.rados.rados.0.trial187.stdout:3660: write oid 20 current snap is 408 2026-02-13T18:22:22.573 INFO:tasks.rados.rados.0.trial187.stdout:3660: seq_num 1207 ranges {686049=409317,1847413=438636} 2026-02-13T18:22:22.579 INFO:tasks.rados.rados.0.trial187.stdout:3660: writing trial18717860-20 from 686049 to 1095366 tid 1 2026-02-13T18:22:22.587 INFO:tasks.rados.rados.0.trial187.stdout:3660: writing trial18717860-20 from 1847413 to 2286049 tid 2 2026-02-13T18:22:22.587 INFO:tasks.rados.rados.0.trial187.stdout:3661: write oid 38 current snap is 408 2026-02-13T18:22:22.587 INFO:tasks.rados.rados.0.trial187.stdout:3661: seq_num 1208 ranges {702856=484566,1789542=513314} 2026-02-13T18:22:22.595 INFO:tasks.rados.rados.0.trial187.stdout:3661: writing trial18717860-38 from 702856 to 1187422 tid 1 2026-02-13T18:22:22.603 INFO:tasks.rados.rados.0.trial187.stdout:3661: writing trial18717860-38 from 1789542 to 2302856 tid 2 2026-02-13T18:22:22.603 INFO:tasks.rados.rados.0.trial187.stdout:3662: rollback oid 7 current snap is 408 2026-02-13T18:22:22.603 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 7 to 321 2026-02-13T18:22:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3660: finishing write tid 1 to trial18717860-20 2026-02-13T18:22:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3659: finishing copy_from racing read to trial18717860-21 2026-02-13T18:22:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3663: rollback oid 13 current snap is 408 2026-02-13T18:22:22.604 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 13 to 396 2026-02-13T18:22:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3658: finishing copy_from racing read to trial18717860-28 2026-02-13T18:22:22.604 INFO:tasks.rados.rados.0.trial187.stdout:3658: finishing copy_from to trial18717860-28 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1469 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:3659: finishing copy_from to trial18717860-21 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1321 (ObjNum 1068 snap 352 seq_num 1068) dirty exists 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:3660: finishing write tid 2 to trial18717860-20 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:3660: finishing write tid 3 to trial18717860-20 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:3658: done (5 left) 2026-02-13T18:22:22.605 INFO:tasks.rados.rados.0.trial187.stdout:3659: done (4 left) 2026-02-13T18:22:22.606 INFO:tasks.rados.rados.0.trial187.stdout:3664: snap_remove snap 397 2026-02-13T18:22:23.598 INFO:tasks.rados.rados.0.trial187.stdout:3664: done (4 left) 2026-02-13T18:22:23.599 INFO:tasks.rados.rados.0.trial187.stdout:3665: write oid 21 current snap is 408 2026-02-13T18:22:23.599 INFO:tasks.rados.rados.0.trial187.stdout:3665: seq_num 1209 ranges {719663=676168,1964377=355286} 2026-02-13T18:22:23.608 INFO:tasks.rados.rados.0.trial187.stdout:3665: writing trial18717860-21 from 719663 to 1395831 tid 1 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:3665: writing trial18717860-21 from 1964377 to 2319663 tid 2 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:3666: copy_from oid 25 from oid 32 current snap is 408 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:3660: finishing write tid 4 to trial18717860-20 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:3660: oid 20 updating version 0 to 1657 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:3660: oid 20 updating version 1657 to 1659 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:3660: oid 20 version 1659 is already newer than 1658 2026-02-13T18:22:23.616 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1659 (ObjNum 1207 snap 408 seq_num 1207) dirty exists 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3660: left oid 20 (ObjNum 1207 snap 408 seq_num 1207) 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: finishing write tid 1 to trial18717860-38 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: finishing write tid 2 to trial18717860-38 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: finishing write tid 3 to trial18717860-38 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: finishing write tid 4 to trial18717860-38 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: oid 38 updating version 0 to 1838 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: oid 38 updating version 1838 to 1839 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: oid 38 version 1839 is already newer than 1837 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1839 (ObjNum 1208 snap 408 seq_num 1208) dirty exists 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3661: left oid 38 (ObjNum 1208 snap 408 seq_num 1208) 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3662: finishing rollback tid 0 to trial18717860-7 2026-02-13T18:22:23.617 INFO:tasks.rados.rados.0.trial187.stdout:3662: finishing rollback tid 1 to trial18717860-7 2026-02-13T18:22:23.618 INFO:tasks.rados.rados.0.trial187.stdout:3660: done (5 left) 2026-02-13T18:22:23.618 INFO:tasks.rados.rados.0.trial187.stdout:3661: done (4 left) 2026-02-13T18:22:23.618 INFO:tasks.rados.rados.0.trial187.stdout:3667: snap_remove snap 407 2026-02-13T18:22:24.600 INFO:tasks.rados.rados.0.trial187.stdout:3667: done (4 left) 2026-02-13T18:22:24.600 INFO:tasks.rados.rados.0.trial187.stdout:3668: write oid 17 current snap is 408 2026-02-13T18:22:24.600 INFO:tasks.rados.rados.0.trial187.stdout:3668: seq_num 1210 ranges {736470=751417,2022859=313611} 2026-02-13T18:22:24.610 INFO:tasks.rados.rados.0.trial187.stdout:3668: writing trial18717860-17 from 736470 to 1487887 tid 1 2026-02-13T18:22:24.615 INFO:tasks.rados.rados.0.trial187.stdout:3668: writing trial18717860-17 from 2022859 to 2336470 tid 2 2026-02-13T18:22:24.616 INFO:tasks.rados.rados.0.trial187.stdout:3669: read oid 8 snap -1 2026-02-13T18:22:24.616 INFO:tasks.rados.rados.0.trial187.stdout:3669: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:22:24.616 INFO:tasks.rados.rados.0.trial187.stdout:3670: snap_remove snap 390 2026-02-13T18:22:25.572 INFO:tasks.rados.rados.0.trial187.stdout:3670: done (6 left) 2026-02-13T18:22:25.572 INFO:tasks.rados.rados.0.trial187.stdout:3671: write (excl) oid 6 current snap is 408 2026-02-13T18:22:25.572 INFO:tasks.rados.rados.0.trial187.stdout:3671: seq_num 1211 ranges {753277=426666,1681341=545753} 2026-02-13T18:22:25.580 INFO:tasks.rados.rados.0.trial187.stdout:3671: writing trial18717860-6 from 753277 to 1179943 tid 1 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3671: writing trial18717860-6 from 1681341 to 2227094 tid 2 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3672: copy_from oid 31 from oid 10 current snap is 408 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3662: finishing rollback tid 2 to trial18717860-7 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 7 v 1661 (ObjNum 914 snap 301 seq_num 914) dirty exists 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3663: finishing rollback tid 0 to trial18717860-13 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3663: finishing rollback tid 1 to trial18717860-13 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3663: finishing rollback tid 2 to trial18717860-13 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1263 (ObjNum 1170 snap 389 seq_num 1170) dirty exists 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3665: finishing write tid 1 to trial18717860-21 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3662: done (7 left) 2026-02-13T18:22:25.588 INFO:tasks.rados.rados.0.trial187.stdout:3663: done (6 left) 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3673: snap_create 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: finishing write tid 2 to trial18717860-21 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: finishing write tid 3 to trial18717860-21 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: finishing write tid 4 to trial18717860-21 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: oid 21 updating version 0 to 1663 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: oid 21 version 1663 is already newer than 1662 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: oid 21 updating version 1663 to 1664 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1664 (ObjNum 1209 snap 408 seq_num 1209) dirty exists 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3665: left oid 21 (ObjNum 1209 snap 408 seq_num 1209) 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3666: finishing copy_from racing read to trial18717860-25 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:3666: finishing copy_from to trial18717860-25 2026-02-13T18:22:25.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1241 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: finishing write tid 1 to trial18717860-17 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: finishing write tid 2 to trial18717860-17 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: finishing write tid 3 to trial18717860-17 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: finishing write tid 4 to trial18717860-17 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: oid 17 updating version 0 to 2081 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: oid 17 version 2081 is already newer than 2079 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: oid 17 version 2081 is already newer than 2080 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 2081 (ObjNum 1210 snap 408 seq_num 1210) dirty exists 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3668: left oid 17 (ObjNum 1210 snap 408 seq_num 1210) 2026-02-13T18:22:25.590 INFO:tasks.rados.rados.0.trial187.stdout:3669: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:22:25.637 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:25.671 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: finishing write tid 1 to trial18717860-6 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: finishing write tid 2 to trial18717860-6 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: finishing write tid 3 to trial18717860-6 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: finishing write tid 4 to trial18717860-6 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: oid 6 updating version 0 to 2277 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: oid 6 updating version 2277 to 2278 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:3671: oid 6 updating version 2278 to 2279 2026-02-13T18:22:25.707 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 2279 (ObjNum 1211 snap 408 seq_num 1211) dirty exists 2026-02-13T18:22:25.708 INFO:tasks.rados.rados.0.trial187.stdout:3671: left oid 6 (ObjNum 1211 snap 408 seq_num 1211) 2026-02-13T18:22:25.708 INFO:tasks.rados.rados.0.trial187.stdout:3672: finishing copy_from racing read to trial18717860-31 2026-02-13T18:22:25.708 INFO:tasks.rados.rados.0.trial187.stdout:3672: finishing copy_from to trial18717860-31 2026-02-13T18:22:25.708 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1461 (ObjNum 1150 snap 383 seq_num 1150) dirty exists 2026-02-13T18:22:26.588 INFO:tasks.rados.rados.0.trial187.stdout:3665: done (6 left) 2026-02-13T18:22:26.588 INFO:tasks.rados.rados.0.trial187.stdout:3666: done (5 left) 2026-02-13T18:22:26.588 INFO:tasks.rados.rados.0.trial187.stdout:3668: done (4 left) 2026-02-13T18:22:26.588 INFO:tasks.rados.rados.0.trial187.stdout:3669: done (3 left) 2026-02-13T18:22:26.588 INFO:tasks.rados.rados.0.trial187.stdout:3671: done (2 left) 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3672: done (1 left) 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3673: done (0 left) 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3674: rollback oid 37 current snap is 409 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 37 to 398 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3675: read oid 2 snap -1 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3675: expect (ObjNum 1202 snap 405 seq_num 1202) 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3676: write oid 22 current snap is 409 2026-02-13T18:22:26.589 INFO:tasks.rados.rados.0.trial187.stdout:3676: seq_num 1212 ranges {770084=501915,2023470=346614} 2026-02-13T18:22:26.596 INFO:tasks.rados.rados.0.trial187.stdout:3676: writing trial18717860-22 from 770084 to 1271999 tid 1 2026-02-13T18:22:26.603 INFO:tasks.rados.rados.0.trial187.stdout:3676: writing trial18717860-22 from 2023470 to 2370084 tid 2 2026-02-13T18:22:26.604 INFO:tasks.rados.rados.0.trial187.stdout:3677: write (excl) oid 43 current snap is 409 2026-02-13T18:22:26.604 INFO:tasks.rados.rados.0.trial187.stdout:3677: seq_num 1213 ranges {786891=577164,2081952=304939} 2026-02-13T18:22:26.612 INFO:tasks.rados.rados.0.trial187.stdout:3677: writing trial18717860-43 from 786891 to 1364055 tid 1 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:3677: writing trial18717860-43 from 2081952 to 2386891 tid 2 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:3678: rollback oid 38 current snap is 409 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 321 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:3674: finishing rollback tid 0 to trial18717860-37 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:3674: finishing rollback tid 1 to trial18717860-37 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:3674: finishing rollback tid 2 to trial18717860-37 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 2389 (ObjNum 1138 snap 382 seq_num 1138) dirty exists 2026-02-13T18:22:26.620 INFO:tasks.rados.rados.0.trial187.stdout:3675: expect (ObjNum 1202 snap 405 seq_num 1202) 2026-02-13T18:22:26.700 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1858346 2026-02-13T18:22:26.703 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: finishing write tid 1 to trial18717860-22 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: finishing write tid 2 to trial18717860-22 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: finishing write tid 3 to trial18717860-22 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: finishing write tid 4 to trial18717860-22 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: oid 22 updating version 0 to 2391 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: oid 22 version 2391 is already newer than 2390 2026-02-13T18:22:26.739 INFO:tasks.rados.rados.0.trial187.stdout:3676: oid 22 updating version 2391 to 2392 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 2392 (ObjNum 1212 snap 409 seq_num 1212) dirty exists 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3676: left oid 22 (ObjNum 1212 snap 409 seq_num 1212) 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3677: finishing write tid 1 to trial18717860-43 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3677: finishing write tid 2 to trial18717860-43 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3674: done (4 left) 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3675: done (3 left) 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3676: done (2 left) 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3679: snap_create 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3677: finishing write tid 3 to trial18717860-43 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3677: finishing write tid 4 to trial18717860-43 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3677: oid 43 updating version 0 to 2395 2026-02-13T18:22:26.740 INFO:tasks.rados.rados.0.trial187.stdout:3677: oid 43 version 2395 is already newer than 2394 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:3677: oid 43 updating version 2395 to 2396 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 2396 (ObjNum 1213 snap 409 seq_num 1213) dirty exists 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:3677: left oid 43 (ObjNum 1213 snap 409 seq_num 1213) 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:3678: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:3678: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:3678: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:22:26.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1842 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:22:27.606 INFO:tasks.rados.rados.0.trial187.stdout:3677: done (2 left) 2026-02-13T18:22:27.606 INFO:tasks.rados.rados.0.trial187.stdout:3678: done (1 left) 2026-02-13T18:22:27.606 INFO:tasks.rados.rados.0.trial187.stdout:3679: done (0 left) 2026-02-13T18:22:27.606 INFO:tasks.rados.rados.0.trial187.stdout:3680: write (excl) oid 9 current snap is 410 2026-02-13T18:22:27.606 INFO:tasks.rados.rados.0.trial187.stdout:3680: seq_num 1214 ranges {403698=652413,1740434=663264} 2026-02-13T18:22:27.613 INFO:tasks.rados.rados.0.trial187.stdout:3680: writing trial18717860-9 from 403698 to 1056111 tid 1 2026-02-13T18:22:27.623 INFO:tasks.rados.rados.0.trial187.stdout:3680: writing trial18717860-9 from 1740434 to 2403698 tid 2 2026-02-13T18:22:27.623 INFO:tasks.rados.rados.0.trial187.stdout:3681: read oid 49 snap -1 2026-02-13T18:22:27.623 INFO:tasks.rados.rados.0.trial187.stdout:3681: expect (ObjNum 1151 snap 383 seq_num 1151) 2026-02-13T18:22:27.623 INFO:tasks.rados.rados.0.trial187.stdout:3682: snap_remove snap 399 2026-02-13T18:22:28.609 INFO:tasks.rados.rados.0.trial187.stdout:3682: done (2 left) 2026-02-13T18:22:28.609 INFO:tasks.rados.rados.0.trial187.stdout:3683: copy_from oid 42 from oid 20 current snap is 410 2026-02-13T18:22:28.610 INFO:tasks.rados.rados.0.trial187.stdout:3680: finishing write tid 1 to trial18717860-9 2026-02-13T18:22:28.610 INFO:tasks.rados.rados.0.trial187.stdout:3681: expect (ObjNum 1151 snap 383 seq_num 1151) 2026-02-13T18:22:28.711 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2851875 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: finishing write tid 2 to trial18717860-9 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: finishing write tid 3 to trial18717860-9 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: finishing write tid 4 to trial18717860-9 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: oid 9 updating version 0 to 2083 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: oid 9 updating version 2083 to 2084 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: oid 9 version 2084 is already newer than 2082 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 2084 (ObjNum 1214 snap 410 seq_num 1214) dirty exists 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3680: left oid 9 (ObjNum 1214 snap 410 seq_num 1214) 2026-02-13T18:22:28.720 INFO:tasks.rados.rados.0.trial187.stdout:3683: finishing copy_from racing read to trial18717860-42 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:3683: finishing copy_from to trial18717860-42 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1659 (ObjNum 1207 snap 408 seq_num 1207) dirty exists 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:3680: done (2 left) 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:3681: done (1 left) 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:3683: done (0 left) 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:3684: rollback oid 38 current snap is 410 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 38 to 321 2026-02-13T18:22:28.721 INFO:tasks.rados.rados.0.trial187.stdout:3685: snap_remove snap 345 2026-02-13T18:22:29.613 INFO:tasks.rados.rados.0.trial187.stdout:3685: done (1 left) 2026-02-13T18:22:29.613 INFO:tasks.rados.rados.0.trial187.stdout:3686: copy_from oid 36 from oid 24 current snap is 410 2026-02-13T18:22:29.613 INFO:tasks.rados.rados.0.trial187.stdout:3684: finishing rollback tid 0 to trial18717860-38 2026-02-13T18:22:29.613 INFO:tasks.rados.rados.0.trial187.stdout:3684: finishing rollback tid 1 to trial18717860-38 2026-02-13T18:22:29.613 INFO:tasks.rados.rados.0.trial187.stdout:3684: finishing rollback tid 2 to trial18717860-38 2026-02-13T18:22:29.613 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1845 (ObjNum 854 snap 281 seq_num 854) dirty exists 2026-02-13T18:22:29.614 INFO:tasks.rados.rados.0.trial187.stdout:3684: done (1 left) 2026-02-13T18:22:29.614 INFO:tasks.rados.rados.0.trial187.stdout:3687: snap_remove snap 370 2026-02-13T18:22:30.574 INFO:tasks.rados.rados.0.trial187.stdout:3687: done (1 left) 2026-02-13T18:22:30.574 INFO:tasks.rados.rados.0.trial187.stdout:3688: write oid 38 current snap is 410 2026-02-13T18:22:30.574 INFO:tasks.rados.rados.0.trial187.stdout:3688: seq_num 1215 ranges {420505=727662,1798916=553091} 2026-02-13T18:22:30.582 INFO:tasks.rados.rados.0.trial187.stdout:3688: writing trial18717860-38 from 420505 to 1148167 tid 1 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:3688: writing trial18717860-38 from 1798916 to 2352007 tid 2 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:3689: read oid 37 snap -1 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:3689: expect (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:3690: copy_from oid 45 from oid 3 current snap is 410 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:3686: finishing copy_from racing read to trial18717860-36 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:3686: finishing copy_from to trial18717860-36 2026-02-13T18:22:30.591 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1652 (ObjNum 1147 snap 382 seq_num 1147) dirty exists 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3688: finishing write tid 1 to trial18717860-38 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3686: done (3 left) 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3691: rollback oid 5 current snap is 410 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 5 to 408 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3692: read oid 44 snap -1 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3692: expect (ObjNum 1136 snap 381 seq_num 1136) 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3693: copy_from oid 43 from oid 28 current snap is 410 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3694: read oid 18 snap -1 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3694: expect (ObjNum 1201 snap 404 seq_num 1201) 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3695: read oid 19 snap -1 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3695: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:22:30.592 INFO:tasks.rados.rados.0.trial187.stdout:3696: snap_create 2026-02-13T18:22:30.593 INFO:tasks.rados.rados.0.trial187.stdout:3688: finishing write tid 2 to trial18717860-38 2026-02-13T18:22:30.595 INFO:tasks.rados.rados.0.trial187.stdout:3688: finishing write tid 3 to trial18717860-38 2026-02-13T18:22:30.595 INFO:tasks.rados.rados.0.trial187.stdout:3691: finishing rollback tid 0 to trial18717860-5 2026-02-13T18:22:30.596 INFO:tasks.rados.rados.0.trial187.stdout:3691: finishing rollback tid 1 to trial18717860-5 2026-02-13T18:22:30.596 INFO:tasks.rados.rados.0.trial187.stdout:3688: finishing write tid 4 to trial18717860-38 2026-02-13T18:22:30.596 INFO:tasks.rados.rados.0.trial187.stdout:3688: oid 38 updating version 0 to 1846 2026-02-13T18:22:30.596 INFO:tasks.rados.rados.0.trial187.stdout:3688: oid 38 updating version 1846 to 1847 2026-02-13T18:22:30.596 INFO:tasks.rados.rados.0.trial187.stdout:3688: oid 38 updating version 1847 to 1848 2026-02-13T18:22:30.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1848 (ObjNum 1215 snap 410 seq_num 1215) dirty exists 2026-02-13T18:22:30.597 INFO:tasks.rados.rados.0.trial187.stdout:3688: left oid 38 (ObjNum 1215 snap 410 seq_num 1215) 2026-02-13T18:22:30.597 INFO:tasks.rados.rados.0.trial187.stdout:3691: finishing rollback tid 2 to trial18717860-5 2026-02-13T18:22:30.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1497 (ObjNum 1112 snap 373 seq_num 1112) dirty exists 2026-02-13T18:22:30.597 INFO:tasks.rados.rados.0.trial187.stdout:3694: expect (ObjNum 1201 snap 404 seq_num 1201) 2026-02-13T18:22:30.597 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:30.699 INFO:tasks.rados.rados.0.trial187.stdout:3689: expect (ObjNum 1138 snap 382 seq_num 1138) 2026-02-13T18:22:30.706 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1940675 2026-02-13T18:22:30.737 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:30.760 INFO:tasks.rados.rados.0.trial187.stdout:3695: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:22:30.826 INFO:tasks.rados.rados.0.trial187.stdout:3692: expect (ObjNum 1136 snap 381 seq_num 1136) 2026-02-13T18:22:30.846 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1749145 2026-02-13T18:22:30.883 INFO:tasks.rados.rados.0.trial187.stdout:3693: finishing copy_from racing read to trial18717860-43 2026-02-13T18:22:30.883 INFO:tasks.rados.rados.0.trial187.stdout:3690: finishing copy_from racing read to trial18717860-45 2026-02-13T18:22:30.883 INFO:tasks.rados.rados.0.trial187.stdout:3693: finishing copy_from to trial18717860-43 2026-02-13T18:22:30.883 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1469 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:22:30.884 INFO:tasks.rados.rados.0.trial187.stdout:3690: finishing copy_from to trial18717860-45 2026-02-13T18:22:30.884 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 2067 (ObjNum 1181 snap 396 seq_num 1181) dirty exists 2026-02-13T18:22:31.574 INFO:tasks.rados.rados.0.trial187.stdout:3688: done (8 left) 2026-02-13T18:22:31.574 INFO:tasks.rados.rados.0.trial187.stdout:3689: done (7 left) 2026-02-13T18:22:31.574 INFO:tasks.rados.rados.0.trial187.stdout:3690: done (6 left) 2026-02-13T18:22:31.574 INFO:tasks.rados.rados.0.trial187.stdout:3691: done (5 left) 2026-02-13T18:22:31.575 INFO:tasks.rados.rados.0.trial187.stdout:3692: done (4 left) 2026-02-13T18:22:31.575 INFO:tasks.rados.rados.0.trial187.stdout:3693: done (3 left) 2026-02-13T18:22:31.575 INFO:tasks.rados.rados.0.trial187.stdout:3694: done (2 left) 2026-02-13T18:22:31.575 INFO:tasks.rados.rados.0.trial187.stdout:3695: done (1 left) 2026-02-13T18:22:31.575 INFO:tasks.rados.rados.0.trial187.stdout:3696: done (0 left) 2026-02-13T18:22:31.575 INFO:tasks.rados.rados.0.trial187.stdout:3697: delete oid 5 current snap is 411 2026-02-13T18:22:31.578 INFO:tasks.rados.rados.0.trial187.stdout:3697: done (0 left) 2026-02-13T18:22:31.578 INFO:tasks.rados.rados.0.trial187.stdout:3698: read oid 1 snap 408 2026-02-13T18:22:31.579 INFO:tasks.rados.rados.0.trial187.stdout:3698: expect deleted 2026-02-13T18:22:31.579 INFO:tasks.rados.rados.0.trial187.stdout:3699: snap_create 2026-02-13T18:22:32.574 INFO:tasks.rados.rados.0.trial187.stdout:3698: done (1 left) 2026-02-13T18:22:32.575 INFO:tasks.rados.rados.0.trial187.stdout:3699: done (0 left) 2026-02-13T18:22:32.575 INFO:tasks.rados.rados.0.trial187.stdout:3700: snap_create 2026-02-13T18:22:33.575 INFO:tasks.rados.rados.0.trial187.stdout:3700: done (0 left) 2026-02-13T18:22:33.575 INFO:tasks.rados.rados.0.trial187.stdout:3701: copy_from oid 34 from oid 41 current snap is 413 2026-02-13T18:22:33.575 INFO:tasks.rados.rados.0.trial187.stdout:3702: snap_create 2026-02-13T18:22:33.593 INFO:tasks.rados.rados.0.trial187.stdout:3701: finishing copy_from racing read to trial18717860-34 2026-02-13T18:22:33.593 INFO:tasks.rados.rados.0.trial187.stdout:3701: finishing copy_from to trial18717860-34 2026-02-13T18:22:33.593 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 34 v 1469 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:22:34.577 INFO:tasks.rados.rados.0.trial187.stdout:3701: done (1 left) 2026-02-13T18:22:34.577 INFO:tasks.rados.rados.0.trial187.stdout:3702: done (0 left) 2026-02-13T18:22:34.577 INFO:tasks.rados.rados.0.trial187.stdout:3703: rollback oid 27 current snap is 414 2026-02-13T18:22:34.577 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 405 2026-02-13T18:22:34.577 INFO:tasks.rados.rados.0.trial187.stdout:3704: delete oid 15 current snap is 414 2026-02-13T18:22:34.581 INFO:tasks.rados.rados.0.trial187.stdout:3704: done (1 left) 2026-02-13T18:22:34.581 INFO:tasks.rados.rados.0.trial187.stdout:3705: write (excl) oid 37 current snap is 414 2026-02-13T18:22:34.581 INFO:tasks.rados.rados.0.trial187.stdout:3705: seq_num 1218 ranges {470926=669762,1574362=700418} 2026-02-13T18:22:34.588 INFO:tasks.rados.rados.0.trial187.stdout:3705: writing trial18717860-37 from 470926 to 1140688 tid 1 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3705: writing trial18717860-37 from 1574362 to 2274780 tid 2 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3706: rollback oid 11 current snap is 414 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 11 to 396 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3703: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3703: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3703: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1658 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3705: finishing write tid 1 to trial18717860-37 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3703: done (2 left) 2026-02-13T18:22:34.597 INFO:tasks.rados.rados.0.trial187.stdout:3707: rollback oid 21 current snap is 414 2026-02-13T18:22:34.598 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 409 2026-02-13T18:22:34.598 INFO:tasks.rados.rados.0.trial187.stdout:3708: snap_create 2026-02-13T18:22:34.599 INFO:tasks.rados.rados.0.trial187.stdout:3707: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:22:34.600 INFO:tasks.rados.rados.0.trial187.stdout:3707: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:22:34.600 INFO:tasks.rados.rados.0.trial187.stdout:3707: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:22:34.601 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1667 (ObjNum 1209 snap 408 seq_num 1209) dirty exists 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3705: finishing write tid 2 to trial18717860-37 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3705: finishing write tid 3 to trial18717860-37 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3706: finishing rollback tid 0 to trial18717860-11 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3705: finishing write tid 4 to trial18717860-37 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3705: oid 37 updating version 0 to 2424 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3705: oid 37 updating version 2424 to 2426 2026-02-13T18:22:34.602 INFO:tasks.rados.rados.0.trial187.stdout:3705: oid 37 version 2426 is already newer than 2425 2026-02-13T18:22:34.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 37 v 2426 (ObjNum 1218 snap 414 seq_num 1218) dirty exists 2026-02-13T18:22:34.603 INFO:tasks.rados.rados.0.trial187.stdout:3705: left oid 37 (ObjNum 1218 snap 414 seq_num 1218) 2026-02-13T18:22:34.603 INFO:tasks.rados.rados.0.trial187.stdout:3706: finishing rollback tid 1 to trial18717860-11 2026-02-13T18:22:34.603 INFO:tasks.rados.rados.0.trial187.stdout:3706: finishing rollback tid 2 to trial18717860-11 2026-02-13T18:22:34.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 2317 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2026-02-13T18:22:35.574 INFO:tasks.rados.rados.0.trial187.stdout:3705: done (3 left) 2026-02-13T18:22:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3706: done (2 left) 2026-02-13T18:22:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3707: done (1 left) 2026-02-13T18:22:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3708: done (0 left) 2026-02-13T18:22:35.575 INFO:tasks.rados.rados.0.trial187.stdout:3709: snap_remove snap 410 2026-02-13T18:22:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3709: done (0 left) 2026-02-13T18:22:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3710: write (excl) oid 44 current snap is 415 2026-02-13T18:22:36.575 INFO:tasks.rados.rados.0.trial187.stdout:3710: seq_num 1219 ranges {487733=745011,1632844=560429} 2026-02-13T18:22:36.583 INFO:tasks.rados.rados.0.trial187.stdout:3710: writing trial18717860-44 from 487733 to 1232744 tid 1 2026-02-13T18:22:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3710: writing trial18717860-44 from 1632844 to 2193273 tid 2 2026-02-13T18:22:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3711: snap_create 2026-02-13T18:22:36.590 INFO:tasks.rados.rados.0.trial187.stdout:3710: finishing write tid 1 to trial18717860-44 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: finishing write tid 2 to trial18717860-44 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: finishing write tid 3 to trial18717860-44 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: finishing write tid 4 to trial18717860-44 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: oid 44 updating version 0 to 2431 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: oid 44 updating version 2431 to 2432 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: oid 44 version 2432 is already newer than 2430 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2432 (ObjNum 1219 snap 415 seq_num 1219) dirty exists 2026-02-13T18:22:36.593 INFO:tasks.rados.rados.0.trial187.stdout:3710: left oid 44 (ObjNum 1219 snap 415 seq_num 1219) 2026-02-13T18:22:37.583 INFO:tasks.rados.rados.0.trial187.stdout:3710: done (1 left) 2026-02-13T18:22:37.584 INFO:tasks.rados.rados.0.trial187.stdout:3711: done (0 left) 2026-02-13T18:22:37.584 INFO:tasks.rados.rados.0.trial187.stdout:3712: write oid 45 current snap is 416 2026-02-13T18:22:37.584 INFO:tasks.rados.rados.0.trial187.stdout:3712: seq_num 1220 ranges {504540=420260,1574973=704087} 2026-02-13T18:22:37.589 INFO:tasks.rados.rados.0.trial187.stdout:3712: writing trial18717860-45 from 504540 to 924800 tid 1 2026-02-13T18:22:37.599 INFO:tasks.rados.rados.0.trial187.stdout:3712: writing trial18717860-45 from 1574973 to 2279060 tid 2 2026-02-13T18:22:37.599 INFO:tasks.rados.rados.0.trial187.stdout:3713: read oid 22 snap -1 2026-02-13T18:22:37.599 INFO:tasks.rados.rados.0.trial187.stdout:3713: expect (ObjNum 1212 snap 409 seq_num 1212) 2026-02-13T18:22:37.600 INFO:tasks.rados.rados.0.trial187.stdout:3714: read oid 46 snap -1 2026-02-13T18:22:37.600 INFO:tasks.rados.rados.0.trial187.stdout:3714: expect (ObjNum 1205 snap 406 seq_num 1205) 2026-02-13T18:22:37.600 INFO:tasks.rados.rados.0.trial187.stdout:3715: read oid 24 snap 413 2026-02-13T18:22:37.600 INFO:tasks.rados.rados.0.trial187.stdout:3715: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:22:37.600 INFO:tasks.rados.rados.0.trial187.stdout:3716: snap_create 2026-02-13T18:22:37.600 INFO:tasks.rados.rados.0.trial187.stdout:3712: finishing write tid 1 to trial18717860-45 2026-02-13T18:22:37.602 INFO:tasks.rados.rados.0.trial187.stdout:3715: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: finishing write tid 2 to trial18717860-45 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: finishing write tid 3 to trial18717860-45 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: finishing write tid 4 to trial18717860-45 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: oid 45 updating version 0 to 2071 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: oid 45 version 2071 is already newer than 2070 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: oid 45 version 2071 is already newer than 2069 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 2071 (ObjNum 1220 snap 416 seq_num 1220) dirty exists 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3712: left oid 45 (ObjNum 1220 snap 416 seq_num 1220) 2026-02-13T18:22:37.683 INFO:tasks.rados.rados.0.trial187.stdout:3713: expect (ObjNum 1212 snap 409 seq_num 1212) 2026-02-13T18:22:37.734 INFO:tasks.rados.rados.0.trial187.stdout:3714: expect (ObjNum 1205 snap 406 seq_num 1205) 2026-02-13T18:22:38.587 INFO:tasks.rados.rados.0.trial187.stdout:3712: done (4 left) 2026-02-13T18:22:38.587 INFO:tasks.rados.rados.0.trial187.stdout:3713: done (3 left) 2026-02-13T18:22:38.587 INFO:tasks.rados.rados.0.trial187.stdout:3714: done (2 left) 2026-02-13T18:22:38.587 INFO:tasks.rados.rados.0.trial187.stdout:3715: done (1 left) 2026-02-13T18:22:38.587 INFO:tasks.rados.rados.0.trial187.stdout:3716: done (0 left) 2026-02-13T18:22:38.587 INFO:tasks.rados.rados.0.trial187.stdout:3717: delete oid 3 current snap is 417 2026-02-13T18:22:38.591 INFO:tasks.rados.rados.0.trial187.stdout:3717: done (0 left) 2026-02-13T18:22:38.591 INFO:tasks.rados.rados.0.trial187.stdout:3718: snap_create 2026-02-13T18:22:39.590 INFO:tasks.rados.rados.0.trial187.stdout:3718: done (0 left) 2026-02-13T18:22:39.590 INFO:tasks.rados.rados.0.trial187.stdout:3719: delete oid 31 current snap is 418 2026-02-13T18:22:39.594 INFO:tasks.rados.rados.0.trial187.stdout:3719: done (0 left) 2026-02-13T18:22:39.594 INFO:tasks.rados.rados.0.trial187.stdout:3720: snap_create 2026-02-13T18:22:40.575 INFO:tasks.rados.rados.0.trial187.stdout:3720: done (0 left) 2026-02-13T18:22:40.575 INFO:tasks.rados.rados.0.trial187.stdout:3721: delete oid 27 current snap is 419 2026-02-13T18:22:40.578 INFO:tasks.rados.rados.0.trial187.stdout:3721: done (0 left) 2026-02-13T18:22:40.579 INFO:tasks.rados.rados.0.trial187.stdout:3722: read oid 7 snap -1 2026-02-13T18:22:40.579 INFO:tasks.rados.rados.0.trial187.stdout:3722: expect (ObjNum 914 snap 301 seq_num 914) 2026-02-13T18:22:40.579 INFO:tasks.rados.rados.0.trial187.stdout:3723: read oid 11 snap -1 2026-02-13T18:22:40.579 INFO:tasks.rados.rados.0.trial187.stdout:3723: expect (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:22:40.579 INFO:tasks.rados.rados.0.trial187.stdout:3724: delete oid 2 current snap is 419 2026-02-13T18:22:40.583 INFO:tasks.rados.rados.0.trial187.stdout:3723: expect (ObjNum 1106 snap 370 seq_num 1106) 2026-02-13T18:22:40.610 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:40.663 INFO:tasks.rados.rados.0.trial187.stdout:3722: expect (ObjNum 914 snap 301 seq_num 914) 2026-02-13T18:22:40.663 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:40.731 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1302611 2026-02-13T18:22:40.756 INFO:tasks.rados.rados.0.trial187.stdout:3722: done (2 left) 2026-02-13T18:22:40.756 INFO:tasks.rados.rados.0.trial187.stdout:3723: done (1 left) 2026-02-13T18:22:40.756 INFO:tasks.rados.rados.0.trial187.stdout:3724: done (0 left) 2026-02-13T18:22:40.756 INFO:tasks.rados.rados.0.trial187.stdout:3725: delete oid 25 current snap is 419 2026-02-13T18:22:40.758 INFO:tasks.rados.rados.0.trial187.stdout:3725: done (0 left) 2026-02-13T18:22:40.758 INFO:tasks.rados.rados.0.trial187.stdout:3726: copy_from oid 12 from oid 47 current snap is 419 2026-02-13T18:22:40.759 INFO:tasks.rados.rados.0.trial187.stdout:3727: delete oid 45 current snap is 419 2026-02-13T18:22:40.761 INFO:tasks.rados.rados.0.trial187.stdout:3727: done (1 left) 2026-02-13T18:22:40.761 INFO:tasks.rados.rados.0.trial187.stdout:3728: snap_create 2026-02-13T18:22:40.771 INFO:tasks.rados.rados.0.trial187.stdout:3726: finishing copy_from racing read to trial18717860-12 2026-02-13T18:22:40.771 INFO:tasks.rados.rados.0.trial187.stdout:3726: finishing copy_from to trial18717860-12 2026-02-13T18:22:40.771 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1656 (ObjNum 1027 snap 331 seq_num 1027) dirty exists 2026-02-13T18:22:41.594 INFO:tasks.rados.rados.0.trial187.stdout:3726: done (1 left) 2026-02-13T18:22:41.594 INFO:tasks.rados.rados.0.trial187.stdout:3728: done (0 left) 2026-02-13T18:22:41.594 INFO:tasks.rados.rados.0.trial187.stdout:3729: delete oid 46 current snap is 420 2026-02-13T18:22:41.598 INFO:tasks.rados.rados.0.trial187.stdout:3729: done (0 left) 2026-02-13T18:22:41.598 INFO:tasks.rados.rados.0.trial187.stdout:3730: write (excl) oid 22 current snap is 420 2026-02-13T18:22:41.598 INFO:tasks.rados.rados.0.trial187.stdout:3730: seq_num 1228 ranges {638996=738605,1926476=712520} 2026-02-13T18:22:41.608 INFO:tasks.rados.rados.0.trial187.stdout:3730: writing trial18717860-22 from 638996 to 1377601 tid 1 2026-02-13T18:22:41.616 INFO:tasks.rados.rados.0.trial187.stdout:3730: writing trial18717860-22 from 1926476 to 2638996 tid 2 2026-02-13T18:22:41.616 INFO:tasks.rados.rados.0.trial187.stdout:3731: snap_create 2026-02-13T18:22:41.617 INFO:tasks.rados.rados.0.trial187.stdout:3730: finishing write tid 1 to trial18717860-22 2026-02-13T18:22:41.620 INFO:tasks.rados.rados.0.trial187.stdout:3730: finishing write tid 2 to trial18717860-22 2026-02-13T18:22:41.620 INFO:tasks.rados.rados.0.trial187.stdout:3730: finishing write tid 3 to trial18717860-22 2026-02-13T18:22:41.620 INFO:tasks.rados.rados.0.trial187.stdout:3730: finishing write tid 4 to trial18717860-22 2026-02-13T18:22:41.620 INFO:tasks.rados.rados.0.trial187.stdout:3730: oid 22 updating version 0 to 2435 2026-02-13T18:22:41.621 INFO:tasks.rados.rados.0.trial187.stdout:3730: oid 22 version 2435 is already newer than 2434 2026-02-13T18:22:41.621 INFO:tasks.rados.rados.0.trial187.stdout:3730: oid 22 updating version 2435 to 2436 2026-02-13T18:22:41.621 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 2436 (ObjNum 1228 snap 420 seq_num 1228) dirty exists 2026-02-13T18:22:41.621 INFO:tasks.rados.rados.0.trial187.stdout:3730: left oid 22 (ObjNum 1228 snap 420 seq_num 1228) 2026-02-13T18:22:42.600 INFO:tasks.rados.rados.0.trial187.stdout:3730: done (1 left) 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3731: done (0 left) 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3732: rollback oid 29 current snap is 421 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 29 to 409 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3733: read oid 20 snap -1 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3733: expect (ObjNum 1207 snap 408 seq_num 1207) 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3734: read oid 10 snap -1 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3734: expect (ObjNum 1150 snap 383 seq_num 1150) 2026-02-13T18:22:42.601 INFO:tasks.rados.rados.0.trial187.stdout:3735: snap_create 2026-02-13T18:22:42.603 INFO:tasks.rados.rados.0.trial187.stdout:3732: finishing rollback tid 0 to trial18717860-29 2026-02-13T18:22:42.604 INFO:tasks.rados.rados.0.trial187.stdout:3732: finishing rollback tid 1 to trial18717860-29 2026-02-13T18:22:42.604 INFO:tasks.rados.rados.0.trial187.stdout:3732: finishing rollback tid 2 to trial18717860-29 2026-02-13T18:22:42.604 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1662 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:22:42.605 INFO:tasks.rados.rados.0.trial187.stdout:3733: expect (ObjNum 1207 snap 408 seq_num 1207) 2026-02-13T18:22:42.634 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:42.782 INFO:tasks.rados.rados.0.trial187.stdout:3734: expect (ObjNum 1150 snap 383 seq_num 1150) 2026-02-13T18:22:42.782 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:42.873 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2985013 2026-02-13T18:22:42.880 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 623355 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3732: done (3 left) 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3733: done (2 left) 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3734: done (1 left) 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3735: done (0 left) 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3736: read oid 8 snap -1 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3736: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3737: write (excl) oid 42 current snap is 422 2026-02-13T18:22:43.602 INFO:tasks.rados.rados.0.trial187.stdout:3737: seq_num 1229 ranges {655803=413854,1584958=462421} 2026-02-13T18:22:43.609 INFO:tasks.rados.rados.0.trial187.stdout:3737: writing trial18717860-42 from 655803 to 1069657 tid 1 2026-02-13T18:22:43.616 INFO:tasks.rados.rados.0.trial187.stdout:3737: writing trial18717860-42 from 1584958 to 2047379 tid 2 2026-02-13T18:22:43.616 INFO:tasks.rados.rados.0.trial187.stdout:3738: write oid 50 current snap is 422 2026-02-13T18:22:43.616 INFO:tasks.rados.rados.0.trial187.stdout:3738: seq_num 1230 ranges {672610=489103,1643440=722432} 2026-02-13T18:22:43.624 INFO:tasks.rados.rados.0.trial187.stdout:3738: writing trial18717860-50 from 672610 to 1161713 tid 1 2026-02-13T18:22:43.633 INFO:tasks.rados.rados.0.trial187.stdout:3738: writing trial18717860-50 from 1643440 to 2365872 tid 2 2026-02-13T18:22:43.633 INFO:tasks.rados.rados.0.trial187.stdout:3739: delete oid 46 current snap is 422 2026-02-13T18:22:43.633 INFO:tasks.rados.rados.0.trial187.stdout:3736: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:22:43.633 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:43.685 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:43.755 INFO:tasks.rados.rados.0.trial187.stdout:3737: finishing write tid 1 to trial18717860-42 2026-02-13T18:22:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3737: finishing write tid 2 to trial18717860-42 2026-02-13T18:22:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3737: finishing write tid 3 to trial18717860-42 2026-02-13T18:22:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3736: done (3 left) 2026-02-13T18:22:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3739: done (2 left) 2026-02-13T18:22:43.756 INFO:tasks.rados.rados.0.trial187.stdout:3740: snap_remove snap 408 2026-02-13T18:22:44.607 INFO:tasks.rados.rados.0.trial187.stdout:3740: done (2 left) 2026-02-13T18:22:44.608 INFO:tasks.rados.rados.0.trial187.stdout:3741: write oid 40 current snap is 422 2026-02-13T18:22:44.608 INFO:tasks.rados.rados.0.trial187.stdout:3741: seq_num 1232 ranges {706224=755954,2160404=545820} 2026-02-13T18:22:44.617 INFO:tasks.rados.rados.0.trial187.stdout:3741: writing trial18717860-40 from 706224 to 1462178 tid 1 2026-02-13T18:22:44.626 INFO:tasks.rados.rados.0.trial187.stdout:3741: writing trial18717860-40 from 2160404 to 2706224 tid 2 2026-02-13T18:22:44.626 INFO:tasks.rados.rados.0.trial187.stdout:3742: read oid 2 snap -1 2026-02-13T18:22:44.626 INFO:tasks.rados.rados.0.trial187.stdout:3742: expect deleted 2026-02-13T18:22:44.626 INFO:tasks.rados.rados.0.trial187.stdout:3743: snap_remove snap 380 2026-02-13T18:22:45.577 INFO:tasks.rados.rados.0.trial187.stdout:3743: done (4 left) 2026-02-13T18:22:45.577 INFO:tasks.rados.rados.0.trial187.stdout:3744: snap_create 2026-02-13T18:22:45.577 INFO:tasks.rados.rados.0.trial187.stdout:3737: finishing write tid 4 to trial18717860-42 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3737: oid 42 updating version 0 to 1662 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3737: oid 42 version 1662 is already newer than 1661 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3737: oid 42 version 1662 is already newer than 1660 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1662 (ObjNum 1229 snap 422 seq_num 1229) dirty exists 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3737: left oid 42 (ObjNum 1229 snap 422 seq_num 1229) 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3738: finishing write tid 1 to trial18717860-50 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3738: finishing write tid 2 to trial18717860-50 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3738: finishing write tid 3 to trial18717860-50 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3738: finishing write tid 4 to trial18717860-50 2026-02-13T18:22:45.578 INFO:tasks.rados.rados.0.trial187.stdout:3738: oid 50 updating version 0 to 1665 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3738: oid 50 version 1665 is already newer than 1663 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3738: oid 50 version 1665 is already newer than 1664 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 1665 (ObjNum 1230 snap 422 seq_num 1230) dirty exists 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3738: left oid 50 (ObjNum 1230 snap 422 seq_num 1230) 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: finishing write tid 1 to trial18717860-40 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: finishing write tid 2 to trial18717860-40 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: finishing write tid 3 to trial18717860-40 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: finishing write tid 4 to trial18717860-40 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: oid 40 updating version 0 to 2073 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: oid 40 updating version 2073 to 2075 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:3741: oid 40 version 2075 is already newer than 2074 2026-02-13T18:22:45.579 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 2075 (ObjNum 1232 snap 422 seq_num 1232) dirty exists 2026-02-13T18:22:45.580 INFO:tasks.rados.rados.0.trial187.stdout:3741: left oid 40 (ObjNum 1232 snap 422 seq_num 1232) 2026-02-13T18:22:46.577 INFO:tasks.rados.rados.0.trial187.stdout:3737: done (4 left) 2026-02-13T18:22:46.577 INFO:tasks.rados.rados.0.trial187.stdout:3738: done (3 left) 2026-02-13T18:22:46.577 INFO:tasks.rados.rados.0.trial187.stdout:3741: done (2 left) 2026-02-13T18:22:46.577 INFO:tasks.rados.rados.0.trial187.stdout:3742: done (1 left) 2026-02-13T18:22:46.577 INFO:tasks.rados.rados.0.trial187.stdout:3744: done (0 left) 2026-02-13T18:22:46.577 INFO:tasks.rados.rados.0.trial187.stdout:3745: snap_remove snap 419 2026-02-13T18:22:47.578 INFO:tasks.rados.rados.0.trial187.stdout:3745: done (0 left) 2026-02-13T18:22:47.578 INFO:tasks.rados.rados.0.trial187.stdout:3746: read oid 24 snap -1 2026-02-13T18:22:47.578 INFO:tasks.rados.rados.0.trial187.stdout:3746: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:22:47.578 INFO:tasks.rados.rados.0.trial187.stdout:3747: write (excl) oid 36 current snap is 423 2026-02-13T18:22:47.578 INFO:tasks.rados.rados.0.trial187.stdout:3747: seq_num 1233 ranges {723031=431203,1818886=469759} 2026-02-13T18:22:47.585 INFO:tasks.rados.rados.0.trial187.stdout:3747: writing trial18717860-36 from 723031 to 1154234 tid 1 2026-02-13T18:22:47.593 INFO:tasks.rados.rados.0.trial187.stdout:3747: writing trial18717860-36 from 1818886 to 2288645 tid 2 2026-02-13T18:22:47.593 INFO:tasks.rados.rados.0.trial187.stdout:3748: write oid 44 current snap is 423 2026-02-13T18:22:47.593 INFO:tasks.rados.rados.0.trial187.stdout:3748: seq_num 1234 ranges {739838=506452,1877368=613417} 2026-02-13T18:22:47.602 INFO:tasks.rados.rados.0.trial187.stdout:3748: writing trial18717860-44 from 739838 to 1246290 tid 1 2026-02-13T18:22:47.610 INFO:tasks.rados.rados.0.trial187.stdout:3748: writing trial18717860-44 from 1877368 to 2490785 tid 2 2026-02-13T18:22:47.610 INFO:tasks.rados.rados.0.trial187.stdout:3749: write oid 46 current snap is 423 2026-02-13T18:22:47.610 INFO:tasks.rados.rados.0.trial187.stdout:3749: seq_num 1235 ranges {756645=581701,1935850=473428} 2026-02-13T18:22:47.619 INFO:tasks.rados.rados.0.trial187.stdout:3749: writing trial18717860-46 from 756645 to 1338346 tid 1 2026-02-13T18:22:47.625 INFO:tasks.rados.rados.0.trial187.stdout:3749: writing trial18717860-46 from 1935850 to 2409278 tid 2 2026-02-13T18:22:47.625 INFO:tasks.rados.rados.0.trial187.stdout:3750: delete oid 30 current snap is 423 2026-02-13T18:22:47.625 INFO:tasks.rados.rados.0.trial187.stdout:3746: expect (ObjNum 1147 snap 382 seq_num 1147) 2026-02-13T18:22:47.625 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: finishing write tid 1 to trial18717860-36 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: finishing write tid 2 to trial18717860-36 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: finishing write tid 3 to trial18717860-36 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: finishing write tid 4 to trial18717860-36 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: oid 36 updating version 0 to 1654 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: oid 36 version 1654 is already newer than 1653 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: oid 36 updating version 1654 to 1655 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1655 (ObjNum 1233 snap 423 seq_num 1233) dirty exists 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3747: left oid 36 (ObjNum 1233 snap 423 seq_num 1233) 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: finishing write tid 1 to trial18717860-44 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: finishing write tid 2 to trial18717860-44 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: finishing write tid 3 to trial18717860-44 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: finishing write tid 4 to trial18717860-44 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: oid 44 updating version 0 to 2451 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: oid 44 version 2451 is already newer than 2450 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: oid 44 updating version 2451 to 2452 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2452 (ObjNum 1234 snap 423 seq_num 1234) dirty exists 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3748: left oid 44 (ObjNum 1234 snap 423 seq_num 1234) 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: finishing write tid 1 to trial18717860-46 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: finishing write tid 2 to trial18717860-46 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: finishing write tid 3 to trial18717860-46 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: finishing write tid 4 to trial18717860-46 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: oid 46 updating version 0 to 1671 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: oid 46 version 1671 is already newer than 1669 2026-02-13T18:22:47.716 INFO:tasks.rados.rados.0.trial187.stdout:3749: oid 46 version 1671 is already newer than 1670 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1671 (ObjNum 1235 snap 423 seq_num 1235) dirty exists 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3749: left oid 46 (ObjNum 1235 snap 423 seq_num 1235) 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3746: done (4 left) 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3747: done (3 left) 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3748: done (2 left) 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3749: done (1 left) 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3750: done (0 left) 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3751: write oid 33 current snap is 423 2026-02-13T18:22:47.717 INFO:tasks.rados.rados.0.trial187.stdout:3751: seq_num 1237 ranges {790259=732199,1936461=477097} 2026-02-13T18:22:47.726 INFO:tasks.rados.rados.0.trial187.stdout:3751: writing trial18717860-33 from 790259 to 1522458 tid 1 2026-02-13T18:22:47.732 INFO:tasks.rados.rados.0.trial187.stdout:3751: writing trial18717860-33 from 1936461 to 2413558 tid 2 2026-02-13T18:22:47.732 INFO:tasks.rados.rados.0.trial187.stdout:3752: read oid 15 snap -1 2026-02-13T18:22:47.732 INFO:tasks.rados.rados.0.trial187.stdout:3752: expect deleted 2026-02-13T18:22:47.732 INFO:tasks.rados.rados.0.trial187.stdout:3753: snap_remove snap 420 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3753: done (2 left) 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3754: copy_from oid 43 from oid 19 current snap is 423 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: finishing write tid 1 to trial18717860-33 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: finishing write tid 2 to trial18717860-33 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: finishing write tid 3 to trial18717860-33 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: finishing write tid 4 to trial18717860-33 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: oid 33 updating version 0 to 2453 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: oid 33 updating version 2453 to 2454 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: oid 33 updating version 2454 to 2455 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2455 (ObjNum 1237 snap 423 seq_num 1237) dirty exists 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: left oid 33 (ObjNum 1237 snap 423 seq_num 1237) 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3751: done (2 left) 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3752: done (1 left) 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3755: read oid 32 snap -1 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3755: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3756: copy_from oid 44 from oid 22 current snap is 423 2026-02-13T18:22:48.585 INFO:tasks.rados.rados.0.trial187.stdout:3757: snap_remove snap 416 2026-02-13T18:22:49.586 INFO:tasks.rados.rados.0.trial187.stdout:3757: done (3 left) 2026-02-13T18:22:49.587 INFO:tasks.rados.rados.0.trial187.stdout:3758: snap_remove snap 396 2026-02-13T18:22:50.577 INFO:tasks.rados.rados.0.trial187.stdout:3758: done (3 left) 2026-02-13T18:22:50.578 INFO:tasks.rados.rados.0.trial187.stdout:3759: write oid 6 current snap is 423 2026-02-13T18:22:50.578 INFO:tasks.rados.rados.0.trial187.stdout:3759: seq_num 1238 ranges {407066=407448,1594943=620755} 2026-02-13T18:22:50.582 INFO:tasks.rados.rados.0.trial187.stdout:3759: writing trial18717860-6 from 407066 to 814514 tid 1 2026-02-13T18:22:50.592 INFO:tasks.rados.rados.0.trial187.stdout:3759: writing trial18717860-6 from 1594943 to 2215698 tid 2 2026-02-13T18:22:50.592 INFO:tasks.rados.rados.0.trial187.stdout:3760: write (excl) oid 27 current snap is 423 2026-02-13T18:22:50.592 INFO:tasks.rados.rados.0.trial187.stdout:3760: seq_num 1239 ranges {423873=482697,1653425=480766,2691441=132432} 2026-02-13T18:22:50.598 INFO:tasks.rados.rados.0.trial187.stdout:3760: writing trial18717860-27 from 423873 to 906570 tid 1 2026-02-13T18:22:50.606 INFO:tasks.rados.rados.0.trial187.stdout:3760: writing trial18717860-27 from 1653425 to 2134191 tid 2 2026-02-13T18:22:50.611 INFO:tasks.rados.rados.0.trial187.stdout:3760: writing trial18717860-27 from 2691441 to 2823873 tid 3 2026-02-13T18:22:50.612 INFO:tasks.rados.rados.0.trial187.stdout:3761: snap_create 2026-02-13T18:22:50.612 INFO:tasks.rados.rados.0.trial187.stdout:3755: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:50.614 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 477357 2026-02-13T18:22:50.674 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1069534 2026-02-13T18:22:50.708 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 535040 2026-02-13T18:22:50.745 INFO:tasks.rados.rados.0.trial187.stdout:3754: finishing copy_from racing read to trial18717860-43 2026-02-13T18:22:50.745 INFO:tasks.rados.rados.0.trial187.stdout:3756: finishing copy_from racing read to trial18717860-44 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3756: finishing copy_from to trial18717860-44 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2436 (ObjNum 1228 snap 420 seq_num 1228) dirty exists 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3754: finishing copy_from to trial18717860-43 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 1652 (ObjNum 1167 snap 387 seq_num 1167) dirty exists 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3759: finishing write tid 1 to trial18717860-6 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3759: finishing write tid 2 to trial18717860-6 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3759: finishing write tid 3 to trial18717860-6 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3759: finishing write tid 4 to trial18717860-6 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3759: oid 6 updating version 0 to 2280 2026-02-13T18:22:50.746 INFO:tasks.rados.rados.0.trial187.stdout:3759: oid 6 updating version 2280 to 2281 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3759: oid 6 updating version 2281 to 2282 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 2282 (ObjNum 1238 snap 423 seq_num 1238) dirty exists 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3759: left oid 6 (ObjNum 1238 snap 423 seq_num 1238) 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: finishing write tid 1 to trial18717860-27 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: finishing write tid 2 to trial18717860-27 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: finishing write tid 3 to trial18717860-27 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: finishing write tid 4 to trial18717860-27 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: finishing write tid 5 to trial18717860-27 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: oid 27 updating version 0 to 1664 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: oid 27 version 1664 is already newer than 1661 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: oid 27 version 1664 is already newer than 1662 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:3760: oid 27 version 1664 is already newer than 1663 2026-02-13T18:22:50.747 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1664 (ObjNum 1239 snap 423 seq_num 1239) dirty exists 2026-02-13T18:22:50.748 INFO:tasks.rados.rados.0.trial187.stdout:3760: left oid 27 (ObjNum 1239 snap 423 seq_num 1239) 2026-02-13T18:22:51.596 INFO:tasks.rados.rados.0.trial187.stdout:3754: done (5 left) 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3755: done (4 left) 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3756: done (3 left) 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3759: done (2 left) 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3760: done (1 left) 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3761: done (0 left) 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3762: write oid 28 current snap is 424 2026-02-13T18:22:51.597 INFO:tasks.rados.rados.0.trial187.stdout:3762: seq_num 1240 ranges {440680=674299,1711907=624424} 2026-02-13T18:22:51.605 INFO:tasks.rados.rados.0.trial187.stdout:3762: writing trial18717860-28 from 440680 to 1114979 tid 1 2026-02-13T18:22:51.613 INFO:tasks.rados.rados.0.trial187.stdout:3762: writing trial18717860-28 from 1711907 to 2336331 tid 2 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3763: read oid 46 snap 417 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3763: expect (ObjNum 1205 snap 406 seq_num 1205) 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3764: copy_from oid 30 from oid 37 current snap is 424 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3762: finishing write tid 1 to trial18717860-28 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3765: rollback oid 10 current snap is 424 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 10 to 411 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3766: copy_from oid 17 from oid 13 current snap is 424 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3767: write oid 3 current snap is 424 2026-02-13T18:22:51.614 INFO:tasks.rados.rados.0.trial187.stdout:3767: seq_num 1241 ranges {457487=749548,1770389=484435,2746287=111200} 2026-02-13T18:22:51.621 INFO:tasks.rados.rados.0.trial187.stdout:3767: writing trial18717860-3 from 457487 to 1207035 tid 1 2026-02-13T18:22:51.628 INFO:tasks.rados.rados.0.trial187.stdout:3767: writing trial18717860-3 from 1770389 to 2254824 tid 2 2026-02-13T18:22:51.633 INFO:tasks.rados.rados.0.trial187.stdout:3767: writing trial18717860-3 from 2746287 to 2857487 tid 3 2026-02-13T18:22:51.633 INFO:tasks.rados.rados.0.trial187.stdout:3768: copy_from oid 42 from oid 40 current snap is 424 2026-02-13T18:22:51.633 INFO:tasks.rados.rados.0.trial187.stdout:3762: finishing write tid 2 to trial18717860-28 2026-02-13T18:22:51.633 INFO:tasks.rados.rados.0.trial187.stdout:3763: expect (ObjNum 1205 snap 406 seq_num 1205) 2026-02-13T18:22:51.633 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:51.719 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 970423 2026-02-13T18:22:51.740 INFO:tasks.rados.rados.0.trial187.stdout:3765: finishing rollback tid 0 to trial18717860-10 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3762: finishing write tid 3 to trial18717860-28 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3765: finishing rollback tid 1 to trial18717860-10 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3762: finishing write tid 4 to trial18717860-28 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3762: oid 28 updating version 0 to 2283 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3762: oid 28 updating version 2283 to 2285 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3762: oid 28 version 2285 is already newer than 2284 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 2285 (ObjNum 1240 snap 424 seq_num 1240) dirty exists 2026-02-13T18:22:51.741 INFO:tasks.rados.rados.0.trial187.stdout:3762: left oid 28 (ObjNum 1240 snap 424 seq_num 1240) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3764: finishing copy_from racing read to trial18717860-30 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3765: finishing rollback tid 2 to trial18717860-10 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1659 (ObjNum 1150 snap 383 seq_num 1150) dirty exists 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3764: finishing copy_from to trial18717860-30 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 2426 (ObjNum 1218 snap 414 seq_num 1218) dirty exists 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3762: done (6 left) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3763: done (5 left) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3764: done (4 left) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3765: done (3 left) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3769: read oid 32 snap 423 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3769: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3770: rollback oid 22 current snap is 424 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 22 to 418 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3766: finishing copy_from racing read to trial18717860-17 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: finishing write tid 1 to trial18717860-3 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3766: finishing copy_from to trial18717860-17 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1263 (ObjNum 1170 snap 389 seq_num 1170) dirty exists 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: finishing write tid 2 to trial18717860-3 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: finishing write tid 3 to trial18717860-3 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: finishing write tid 4 to trial18717860-3 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: finishing write tid 5 to trial18717860-3 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: oid 3 updating version 0 to 2087 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: oid 3 updating version 2087 to 2088 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: oid 3 version 2088 is already newer than 2086 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: oid 3 updating version 2088 to 2089 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 2089 (ObjNum 1241 snap 424 seq_num 1241) dirty exists 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: left oid 3 (ObjNum 1241 snap 424 seq_num 1241) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3768: finishing copy_from racing read to trial18717860-42 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3768: finishing copy_from to trial18717860-42 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 2075 (ObjNum 1232 snap 422 seq_num 1232) dirty exists 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3766: done (4 left) 2026-02-13T18:22:51.742 INFO:tasks.rados.rados.0.trial187.stdout:3767: done (3 left) 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3768: done (2 left) 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3771: delete oid 12 current snap is 424 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3771: done (2 left) 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3772: copy_from oid 11 from oid 25 current snap is 424 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3773: read oid 4 snap -1 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3773: expect deleted 2026-02-13T18:22:51.743 INFO:tasks.rados.rados.0.trial187.stdout:3774: snap_remove snap 412 2026-02-13T18:22:52.600 INFO:tasks.rados.rados.0.trial187.stdout:3774: done (4 left) 2026-02-13T18:22:52.601 INFO:tasks.rados.rados.0.trial187.stdout:3775: copy_from oid 30 from oid 3 current snap is 424 2026-02-13T18:22:52.601 INFO:tasks.rados.rados.0.trial187.stdout:3769: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:22:52.601 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:22:52.720 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2121474 2026-02-13T18:22:52.738 INFO:tasks.rados.rados.0.trial187.stdout:3772: finishing copy_from to trial18717860-11 2026-02-13T18:22:52.738 INFO:tasks.rados.rados.0.trial187.stdout:3772: got expected ENOENT (src dne) 2026-02-13T18:22:52.738 INFO:tasks.rados.rados.0.trial187.stdout:3769: done (4 left) 2026-02-13T18:22:52.738 INFO:tasks.rados.rados.0.trial187.stdout:3773: done (3 left) 2026-02-13T18:22:52.738 INFO:tasks.rados.rados.0.trial187.stdout:3776: write (excl) oid 10 current snap is 424 2026-02-13T18:22:52.738 INFO:tasks.rados.rados.0.trial187.stdout:3776: seq_num 1243 ranges {491101=500046,1487353=488104,2401133=489968} 2026-02-13T18:22:52.744 INFO:tasks.rados.rados.0.trial187.stdout:3776: writing trial18717860-10 from 491101 to 991147 tid 1 2026-02-13T18:22:52.751 INFO:tasks.rados.rados.0.trial187.stdout:3776: writing trial18717860-10 from 1487353 to 1975457 tid 2 2026-02-13T18:22:52.758 INFO:tasks.rados.rados.0.trial187.stdout:3776: writing trial18717860-10 from 2401133 to 2891101 tid 3 2026-02-13T18:22:52.758 INFO:tasks.rados.rados.0.trial187.stdout:3777: rollback oid 32 current snap is 424 2026-02-13T18:22:52.758 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 423 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3772: finishing copy_from racing read to trial18717860-11 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3770: finishing rollback tid 0 to trial18717860-22 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3770: finishing rollback tid 1 to trial18717860-22 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3770: finishing rollback tid 2 to trial18717860-22 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 22 v 2480 (ObjNum 1212 snap 409 seq_num 1212) dirty exists 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3775: finishing copy_from racing read to trial18717860-30 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3775: finishing copy_from to trial18717860-30 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 2089 (ObjNum 1241 snap 424 seq_num 1241) dirty exists 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3776: finishing write tid 1 to trial18717860-10 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3776: finishing write tid 2 to trial18717860-10 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3770: done (4 left) 2026-02-13T18:22:52.759 INFO:tasks.rados.rados.0.trial187.stdout:3772: done (3 left) 2026-02-13T18:22:52.760 INFO:tasks.rados.rados.0.trial187.stdout:3775: done (2 left) 2026-02-13T18:22:52.760 INFO:tasks.rados.rados.0.trial187.stdout:3778: snap_create 2026-02-13T18:22:52.761 INFO:tasks.rados.rados.0.trial187.stdout:3777: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:22:52.761 INFO:tasks.rados.rados.0.trial187.stdout:3776: finishing write tid 3 to trial18717860-10 2026-02-13T18:22:52.761 INFO:tasks.rados.rados.0.trial187.stdout:3777: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:22:52.761 INFO:tasks.rados.rados.0.trial187.stdout:3776: finishing write tid 4 to trial18717860-10 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3777: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 2429 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3776: finishing write tid 5 to trial18717860-10 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3776: oid 10 updating version 0 to 1664 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3776: oid 10 version 1664 is already newer than 1663 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3776: oid 10 version 1664 is already newer than 1661 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3776: oid 10 version 1664 is already newer than 1662 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1664 (ObjNum 1243 snap 424 seq_num 1243) dirty exists 2026-02-13T18:22:52.762 INFO:tasks.rados.rados.0.trial187.stdout:3776: left oid 10 (ObjNum 1243 snap 424 seq_num 1243) 2026-02-13T18:22:53.603 INFO:tasks.rados.rados.0.trial187.stdout:3776: done (2 left) 2026-02-13T18:22:53.604 INFO:tasks.rados.rados.0.trial187.stdout:3777: done (1 left) 2026-02-13T18:22:53.604 INFO:tasks.rados.rados.0.trial187.stdout:3778: done (0 left) 2026-02-13T18:22:53.604 INFO:tasks.rados.rados.0.trial187.stdout:3779: snap_create 2026-02-13T18:22:54.607 INFO:tasks.rados.rados.0.trial187.stdout:3779: done (0 left) 2026-02-13T18:22:54.607 INFO:tasks.rados.rados.0.trial187.stdout:3780: copy_from oid 11 from oid 42 current snap is 426 2026-02-13T18:22:54.607 INFO:tasks.rados.rados.0.trial187.stdout:3781: snap_create 2026-02-13T18:22:54.621 INFO:tasks.rados.rados.0.trial187.stdout:3780: finishing copy_from racing read to trial18717860-11 2026-02-13T18:22:54.621 INFO:tasks.rados.rados.0.trial187.stdout:3780: finishing copy_from to trial18717860-11 2026-02-13T18:22:54.621 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 2075 (ObjNum 1232 snap 422 seq_num 1232) dirty exists 2026-02-13T18:22:55.577 INFO:tasks.rados.rados.0.trial187.stdout:3780: done (1 left) 2026-02-13T18:22:55.578 INFO:tasks.rados.rados.0.trial187.stdout:3781: done (0 left) 2026-02-13T18:22:55.578 INFO:tasks.rados.rados.0.trial187.stdout:3782: copy_from oid 13 from oid 5 current snap is 427 2026-02-13T18:22:55.578 INFO:tasks.rados.rados.0.trial187.stdout:3783: delete oid 37 current snap is 427 2026-02-13T18:22:55.586 INFO:tasks.rados.rados.0.trial187.stdout:3782: finishing copy_from to trial18717860-13 2026-02-13T18:22:55.586 INFO:tasks.rados.rados.0.trial187.stdout:3782: got expected ENOENT (src dne) 2026-02-13T18:22:55.586 INFO:tasks.rados.rados.0.trial187.stdout:3782: finishing copy_from racing read to trial18717860-13 2026-02-13T18:22:55.588 INFO:tasks.rados.rados.0.trial187.stdout:3782: done (1 left) 2026-02-13T18:22:55.588 INFO:tasks.rados.rados.0.trial187.stdout:3783: done (0 left) 2026-02-13T18:22:55.588 INFO:tasks.rados.rados.0.trial187.stdout:3784: snap_remove snap 398 2026-02-13T18:22:56.581 INFO:tasks.rados.rados.0.trial187.stdout:3784: done (0 left) 2026-02-13T18:22:56.581 INFO:tasks.rados.rados.0.trial187.stdout:3785: delete oid 1 current snap is 427 2026-02-13T18:22:56.588 INFO:tasks.rados.rados.0.trial187.stdout:3785: done (0 left) 2026-02-13T18:22:56.588 INFO:tasks.rados.rados.0.trial187.stdout:3786: snap_create 2026-02-13T18:22:57.582 INFO:tasks.rados.rados.0.trial187.stdout:3786: done (0 left) 2026-02-13T18:22:57.583 INFO:tasks.rados.rados.0.trial187.stdout:3787: write oid 31 current snap is 428 2026-02-13T18:22:57.583 INFO:tasks.rados.rados.0.trial187.stdout:3787: seq_num 1246 ranges {541522=725793,1946446=635431} 2026-02-13T18:22:57.591 INFO:tasks.rados.rados.0.trial187.stdout:3787: writing trial18717860-31 from 541522 to 1267315 tid 1 2026-02-13T18:22:57.600 INFO:tasks.rados.rados.0.trial187.stdout:3787: writing trial18717860-31 from 1946446 to 2581877 tid 2 2026-02-13T18:22:57.600 INFO:tasks.rados.rados.0.trial187.stdout:3788: snap_create 2026-02-13T18:22:57.600 INFO:tasks.rados.rados.0.trial187.stdout:3787: finishing write tid 1 to trial18717860-31 2026-02-13T18:22:57.602 INFO:tasks.rados.rados.0.trial187.stdout:3787: finishing write tid 2 to trial18717860-31 2026-02-13T18:22:57.602 INFO:tasks.rados.rados.0.trial187.stdout:3787: finishing write tid 3 to trial18717860-31 2026-02-13T18:22:57.603 INFO:tasks.rados.rados.0.trial187.stdout:3787: finishing write tid 4 to trial18717860-31 2026-02-13T18:22:57.603 INFO:tasks.rados.rados.0.trial187.stdout:3787: oid 31 updating version 0 to 1465 2026-02-13T18:22:57.603 INFO:tasks.rados.rados.0.trial187.stdout:3787: oid 31 version 1465 is already newer than 1463 2026-02-13T18:22:57.603 INFO:tasks.rados.rados.0.trial187.stdout:3787: oid 31 version 1465 is already newer than 1464 2026-02-13T18:22:57.603 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1465 (ObjNum 1246 snap 428 seq_num 1246) dirty exists 2026-02-13T18:22:57.603 INFO:tasks.rados.rados.0.trial187.stdout:3787: left oid 31 (ObjNum 1246 snap 428 seq_num 1246) 2026-02-13T18:22:58.587 INFO:tasks.rados.rados.0.trial187.stdout:3787: done (1 left) 2026-02-13T18:22:58.588 INFO:tasks.rados.rados.0.trial187.stdout:3788: done (0 left) 2026-02-13T18:22:58.588 INFO:tasks.rados.rados.0.trial187.stdout:3789: write oid 25 current snap is 429 2026-02-13T18:22:58.588 INFO:tasks.rados.rados.0.trial187.stdout:3789: seq_num 1247 ranges {558329=517395,1721281=779089} 2026-02-13T18:22:58.595 INFO:tasks.rados.rados.0.trial187.stdout:3789: writing trial18717860-25 from 558329 to 1075724 tid 1 2026-02-13T18:22:58.605 INFO:tasks.rados.rados.0.trial187.stdout:3789: writing trial18717860-25 from 1721281 to 2500370 tid 2 2026-02-13T18:22:58.605 INFO:tasks.rados.rados.0.trial187.stdout:3790: snap_remove snap 427 2026-02-13T18:22:59.589 INFO:tasks.rados.rados.0.trial187.stdout:3790: done (1 left) 2026-02-13T18:22:59.589 INFO:tasks.rados.rados.0.trial187.stdout:3791: read oid 48 snap -1 2026-02-13T18:22:59.589 INFO:tasks.rados.rados.0.trial187.stdout:3791: expect (ObjNum 1182 snap 396 seq_num 1182) 2026-02-13T18:22:59.589 INFO:tasks.rados.rados.0.trial187.stdout:3792: read oid 2 snap -1 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3792: expect deleted 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3793: snap_create 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: finishing write tid 1 to trial18717860-25 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: finishing write tid 2 to trial18717860-25 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: finishing write tid 3 to trial18717860-25 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: finishing write tid 4 to trial18717860-25 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: oid 25 updating version 0 to 1666 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: oid 25 updating version 1666 to 1667 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: oid 25 version 1667 is already newer than 1665 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1667 (ObjNum 1247 snap 429 seq_num 1247) dirty exists 2026-02-13T18:22:59.590 INFO:tasks.rados.rados.0.trial187.stdout:3789: left oid 25 (ObjNum 1247 snap 429 seq_num 1247) 2026-02-13T18:22:59.598 INFO:tasks.rados.rados.0.trial187.stdout:3791: expect (ObjNum 1182 snap 396 seq_num 1182) 2026-02-13T18:22:59.659 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:00.580 INFO:tasks.rados.rados.0.trial187.stdout:3789: done (3 left) 2026-02-13T18:23:00.580 INFO:tasks.rados.rados.0.trial187.stdout:3791: done (2 left) 2026-02-13T18:23:00.580 INFO:tasks.rados.rados.0.trial187.stdout:3792: done (1 left) 2026-02-13T18:23:00.580 INFO:tasks.rados.rados.0.trial187.stdout:3793: done (0 left) 2026-02-13T18:23:00.580 INFO:tasks.rados.rados.0.trial187.stdout:3794: delete oid 48 current snap is 430 2026-02-13T18:23:00.584 INFO:tasks.rados.rados.0.trial187.stdout:3794: done (0 left) 2026-02-13T18:23:00.584 INFO:tasks.rados.rados.0.trial187.stdout:3795: write oid 47 current snap is 430 2026-02-13T18:23:00.584 INFO:tasks.rados.rados.0.trial187.stdout:3795: seq_num 1249 ranges {591943=667893,1721892=782758} 2026-02-13T18:23:00.594 INFO:tasks.rados.rados.0.trial187.stdout:3795: writing trial18717860-47 from 591943 to 1259836 tid 1 2026-02-13T18:23:00.602 INFO:tasks.rados.rados.0.trial187.stdout:3795: writing trial18717860-47 from 1721892 to 2504650 tid 2 2026-02-13T18:23:00.602 INFO:tasks.rados.rados.0.trial187.stdout:3796: delete oid 11 current snap is 430 2026-02-13T18:23:00.603 INFO:tasks.rados.rados.0.trial187.stdout:3795: finishing write tid 1 to trial18717860-47 2026-02-13T18:23:00.605 INFO:tasks.rados.rados.0.trial187.stdout:3796: done (1 left) 2026-02-13T18:23:00.605 INFO:tasks.rados.rados.0.trial187.stdout:3797: snap_create 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: finishing write tid 2 to trial18717860-47 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: finishing write tid 3 to trial18717860-47 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: finishing write tid 4 to trial18717860-47 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: oid 47 updating version 0 to 1662 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: oid 47 version 1662 is already newer than 1660 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: oid 47 version 1662 is already newer than 1661 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1662 (ObjNum 1249 snap 430 seq_num 1249) dirty exists 2026-02-13T18:23:00.606 INFO:tasks.rados.rados.0.trial187.stdout:3795: left oid 47 (ObjNum 1249 snap 430 seq_num 1249) 2026-02-13T18:23:01.597 INFO:tasks.rados.rados.0.trial187.stdout:3795: done (1 left) 2026-02-13T18:23:01.597 INFO:tasks.rados.rados.0.trial187.stdout:3797: done (0 left) 2026-02-13T18:23:01.597 INFO:tasks.rados.rados.0.trial187.stdout:3798: write (excl) oid 46 current snap is 431 2026-02-13T18:23:01.597 INFO:tasks.rados.rados.0.trial187.stdout:3798: seq_num 1251 ranges {625557=418391,1838856=786427} 2026-02-13T18:23:01.604 INFO:tasks.rados.rados.0.trial187.stdout:3798: writing trial18717860-46 from 625557 to 1043948 tid 1 2026-02-13T18:23:01.615 INFO:tasks.rados.rados.0.trial187.stdout:3798: writing trial18717860-46 from 1838856 to 2625283 tid 2 2026-02-13T18:23:01.615 INFO:tasks.rados.rados.0.trial187.stdout:3799: write (excl) oid 15 current snap is 431 2026-02-13T18:23:01.615 INFO:tasks.rados.rados.0.trial187.stdout:3799: seq_num 1252 ranges {642364=493640,1897338=646438} 2026-02-13T18:23:01.622 INFO:tasks.rados.rados.0.trial187.stdout:3799: writing trial18717860-15 from 642364 to 1136004 tid 1 2026-02-13T18:23:01.632 INFO:tasks.rados.rados.0.trial187.stdout:3799: writing trial18717860-15 from 1897338 to 2543776 tid 2 2026-02-13T18:23:01.632 INFO:tasks.rados.rados.0.trial187.stdout:3800: snap_remove snap 422 2026-02-13T18:23:02.604 INFO:tasks.rados.rados.0.trial187.stdout:3800: done (2 left) 2026-02-13T18:23:02.604 INFO:tasks.rados.rados.0.trial187.stdout:3801: copy_from oid 6 from oid 3 current snap is 431 2026-02-13T18:23:02.604 INFO:tasks.rados.rados.0.trial187.stdout:3798: finishing write tid 1 to trial18717860-46 2026-02-13T18:23:02.604 INFO:tasks.rados.rados.0.trial187.stdout:3798: finishing write tid 2 to trial18717860-46 2026-02-13T18:23:02.604 INFO:tasks.rados.rados.0.trial187.stdout:3798: finishing write tid 3 to trial18717860-46 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3798: finishing write tid 4 to trial18717860-46 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3798: oid 46 updating version 0 to 1673 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3798: oid 46 version 1673 is already newer than 1672 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3798: oid 46 updating version 1673 to 1674 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 1674 (ObjNum 1251 snap 431 seq_num 1251) dirty exists 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3798: left oid 46 (ObjNum 1251 snap 431 seq_num 1251) 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3799: finishing write tid 1 to trial18717860-15 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3799: finishing write tid 2 to trial18717860-15 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3799: finishing write tid 3 to trial18717860-15 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3799: finishing write tid 4 to trial18717860-15 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3799: oid 15 updating version 0 to 1665 2026-02-13T18:23:02.605 INFO:tasks.rados.rados.0.trial187.stdout:3799: oid 15 version 1665 is already newer than 1664 2026-02-13T18:23:02.606 INFO:tasks.rados.rados.0.trial187.stdout:3799: oid 15 version 1665 is already newer than 1663 2026-02-13T18:23:02.606 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1665 (ObjNum 1252 snap 431 seq_num 1252) dirty exists 2026-02-13T18:23:02.606 INFO:tasks.rados.rados.0.trial187.stdout:3799: left oid 15 (ObjNum 1252 snap 431 seq_num 1252) 2026-02-13T18:23:02.606 INFO:tasks.rados.rados.0.trial187.stdout:3798: done (2 left) 2026-02-13T18:23:02.606 INFO:tasks.rados.rados.0.trial187.stdout:3799: done (1 left) 2026-02-13T18:23:02.606 INFO:tasks.rados.rados.0.trial187.stdout:3802: delete oid 24 current snap is 431 2026-02-13T18:23:02.608 INFO:tasks.rados.rados.0.trial187.stdout:3802: done (1 left) 2026-02-13T18:23:02.608 INFO:tasks.rados.rados.0.trial187.stdout:3803: write (excl) oid 14 current snap is 431 2026-02-13T18:23:02.608 INFO:tasks.rados.rados.0.trial187.stdout:3803: seq_num 1254 ranges {675978=644138,1897949=650107} 2026-02-13T18:23:02.617 INFO:tasks.rados.rados.0.trial187.stdout:3803: writing trial18717860-14 from 675978 to 1320116 tid 1 2026-02-13T18:23:02.626 INFO:tasks.rados.rados.0.trial187.stdout:3803: writing trial18717860-14 from 1897949 to 2548056 tid 2 2026-02-13T18:23:02.626 INFO:tasks.rados.rados.0.trial187.stdout:3804: snap_create 2026-02-13T18:23:02.626 INFO:tasks.rados.rados.0.trial187.stdout:3801: finishing copy_from racing read to trial18717860-6 2026-02-13T18:23:02.626 INFO:tasks.rados.rados.0.trial187.stdout:3801: finishing copy_from to trial18717860-6 2026-02-13T18:23:02.626 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 2089 (ObjNum 1241 snap 424 seq_num 1241) dirty exists 2026-02-13T18:23:02.626 INFO:tasks.rados.rados.0.trial187.stdout:3803: finishing write tid 1 to trial18717860-14 2026-02-13T18:23:02.628 INFO:tasks.rados.rados.0.trial187.stdout:3803: finishing write tid 2 to trial18717860-14 2026-02-13T18:23:02.629 INFO:tasks.rados.rados.0.trial187.stdout:3803: finishing write tid 3 to trial18717860-14 2026-02-13T18:23:02.629 INFO:tasks.rados.rados.0.trial187.stdout:3803: finishing write tid 4 to trial18717860-14 2026-02-13T18:23:02.629 INFO:tasks.rados.rados.0.trial187.stdout:3803: oid 14 updating version 0 to 1658 2026-02-13T18:23:02.629 INFO:tasks.rados.rados.0.trial187.stdout:3803: oid 14 version 1658 is already newer than 1657 2026-02-13T18:23:02.629 INFO:tasks.rados.rados.0.trial187.stdout:3803: oid 14 version 1658 is already newer than 1656 2026-02-13T18:23:02.630 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 1658 (ObjNum 1254 snap 431 seq_num 1254) dirty exists 2026-02-13T18:23:02.630 INFO:tasks.rados.rados.0.trial187.stdout:3803: left oid 14 (ObjNum 1254 snap 431 seq_num 1254) 2026-02-13T18:23:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3801: done (2 left) 2026-02-13T18:23:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3803: done (1 left) 2026-02-13T18:23:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3804: done (0 left) 2026-02-13T18:23:03.604 INFO:tasks.rados.rados.0.trial187.stdout:3805: read oid 18 snap -1 2026-02-13T18:23:03.605 INFO:tasks.rados.rados.0.trial187.stdout:3805: expect (ObjNum 1201 snap 404 seq_num 1201) 2026-02-13T18:23:03.605 INFO:tasks.rados.rados.0.trial187.stdout:3806: snap_create 2026-02-13T18:23:03.613 INFO:tasks.rados.rados.0.trial187.stdout:3805: expect (ObjNum 1201 snap 404 seq_num 1201) 2026-02-13T18:23:03.613 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 225409 2026-02-13T18:23:03.678 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2176356 2026-02-13T18:23:04.605 INFO:tasks.rados.rados.0.trial187.stdout:3805: done (1 left) 2026-02-13T18:23:04.605 INFO:tasks.rados.rados.0.trial187.stdout:3806: done (0 left) 2026-02-13T18:23:04.605 INFO:tasks.rados.rados.0.trial187.stdout:3807: write (excl) oid 25 current snap is 433 2026-02-13T18:23:04.605 INFO:tasks.rados.rados.0.trial187.stdout:3807: seq_num 1255 ranges {692785=435740,1672784=793765,2897503=195282} 2026-02-13T18:23:04.612 INFO:tasks.rados.rados.0.trial187.stdout:3807: writing trial18717860-25 from 692785 to 1128525 tid 1 2026-02-13T18:23:04.621 INFO:tasks.rados.rados.0.trial187.stdout:3807: writing trial18717860-25 from 1672784 to 2466549 tid 2 2026-02-13T18:23:04.626 INFO:tasks.rados.rados.0.trial187.stdout:3807: writing trial18717860-25 from 2897503 to 3092785 tid 3 2026-02-13T18:23:04.626 INFO:tasks.rados.rados.0.trial187.stdout:3808: read oid 48 snap 366 2026-02-13T18:23:04.626 INFO:tasks.rados.rados.0.trial187.stdout:3808: expect deleted 2026-02-13T18:23:04.627 INFO:tasks.rados.rados.0.trial187.stdout:3809: write oid 11 current snap is 433 2026-02-13T18:23:04.627 INFO:tasks.rados.rados.0.trial187.stdout:3807: finishing write tid 1 to trial18717860-25 2026-02-13T18:23:04.627 INFO:tasks.rados.rados.0.trial187.stdout:3807: finishing write tid 2 to trial18717860-25 2026-02-13T18:23:04.627 INFO:tasks.rados.rados.0.trial187.stdout:3809: seq_num 1256 ranges {709592=510989,1731266=653776,3041279=68313} 2026-02-13T18:23:04.634 INFO:tasks.rados.rados.0.trial187.stdout:3809: writing trial18717860-11 from 709592 to 1220581 tid 1 2026-02-13T18:23:04.642 INFO:tasks.rados.rados.0.trial187.stdout:3809: writing trial18717860-11 from 1731266 to 2385042 tid 2 2026-02-13T18:23:04.647 INFO:tasks.rados.rados.0.trial187.stdout:3809: writing trial18717860-11 from 3041279 to 3109592 tid 3 2026-02-13T18:23:04.647 INFO:tasks.rados.rados.0.trial187.stdout:3810: write (excl) oid 2 current snap is 433 2026-02-13T18:23:04.647 INFO:tasks.rados.rados.0.trial187.stdout:3810: seq_num 1257 ranges {726399=586238,2073395=797434} 2026-02-13T18:23:04.655 INFO:tasks.rados.rados.0.trial187.stdout:3810: writing trial18717860-2 from 726399 to 1312637 tid 1 2026-02-13T18:23:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3810: writing trial18717860-2 from 2073395 to 2870829 tid 2 2026-02-13T18:23:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3811: read oid 15 snap -1 2026-02-13T18:23:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3811: expect (ObjNum 1252 snap 431 seq_num 1252) 2026-02-13T18:23:04.661 INFO:tasks.rados.rados.0.trial187.stdout:3812: write oid 18 current snap is 433 2026-02-13T18:23:04.662 INFO:tasks.rados.rados.0.trial187.stdout:3812: seq_num 1258 ranges {743206=661487,2131877=541092} 2026-02-13T18:23:04.666 INFO:tasks.rados.rados.0.trial187.stdout:3812: writing trial18717860-18 from 743206 to 1404693 tid 1 2026-02-13T18:23:04.672 INFO:tasks.rados.rados.0.trial187.stdout:3812: writing trial18717860-18 from 2131877 to 2672969 tid 2 2026-02-13T18:23:04.672 INFO:tasks.rados.rados.0.trial187.stdout:3813: write oid 10 current snap is 433 2026-02-13T18:23:04.672 INFO:tasks.rados.rados.0.trial187.stdout:3813: seq_num 1259 ranges {760013=736736,2190359=401103} 2026-02-13T18:23:04.677 INFO:tasks.rados.rados.0.trial187.stdout:3813: writing trial18717860-10 from 760013 to 1496749 tid 1 2026-02-13T18:23:04.681 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T18:23:04.681 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T18:23:04.681 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T18:23:04.682 DEBUG:teuthology.orchestra.run.trial187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T18:23:04.683 INFO:tasks.rados.rados.0.trial187.stdout:3813: writing trial18717860-10 from 2190359 to 2591462 tid 2 2026-02-13T18:23:04.683 INFO:tasks.rados.rados.0.trial187.stdout:3814: snap_remove snap 321 2026-02-13T18:23:04.685 INFO:tasks.ceph.mon.b:Started 2026-02-13T18:23:04.685 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.a 2026-02-13T18:23:04.685 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-13T18:23:04.685 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-13T18:23:04.685 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T18:23:09.865 INFO:tasks.rados.rados.0.trial187.stdout:3814: done (7 left) 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3815: read oid 24 snap -1 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3815: expect deleted 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3816: read oid 23 snap -1 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3816: expect (ObjNum 1206 snap 407 seq_num 1206) 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3817: rollback oid 41 current snap is 433 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 41 to 432 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: finishing write tid 3 to trial18717860-25 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: finishing write tid 4 to trial18717860-25 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: finishing write tid 5 to trial18717860-25 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: oid 25 updating version 0 to 1668 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: oid 25 updating version 1668 to 1670 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: oid 25 updating version 1670 to 1671 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: oid 25 version 1671 is already newer than 1669 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1671 (ObjNum 1255 snap 433 seq_num 1255) dirty exists 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: left oid 25 (ObjNum 1255 snap 433 seq_num 1255) 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3809: finishing write tid 1 to trial18717860-11 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3809: finishing write tid 2 to trial18717860-11 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3807: done (9 left) 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3808: done (8 left) 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3818: write oid 44 current snap is 433 2026-02-13T18:23:09.866 INFO:tasks.rados.rados.0.trial187.stdout:3818: seq_num 1260 ranges {776820=411985,1848841=544761,2918265=258555} 2026-02-13T18:23:09.870 INFO:tasks.rados.rados.0.trial187.stdout:3818: writing trial18717860-44 from 776820 to 1188805 tid 1 2026-02-13T18:23:09.875 INFO:tasks.rados.rados.0.trial187.stdout:3818: writing trial18717860-44 from 1848841 to 2393602 tid 2 2026-02-13T18:23:09.878 INFO:tasks.rados.rados.0.trial187.stdout:3818: writing trial18717860-44 from 2918265 to 3176820 tid 3 2026-02-13T18:23:09.878 INFO:tasks.rados.rados.0.trial187.stdout:3819: write oid 21 current snap is 433 2026-02-13T18:23:09.878 INFO:tasks.rados.rados.0.trial187.stdout:3819: seq_num 1261 ranges {793627=487234,1790970=404772,2829335=364292} 2026-02-13T18:23:09.883 INFO:tasks.rados.rados.0.trial187.stdout:3819: writing trial18717860-21 from 793627 to 1280861 tid 1 2026-02-13T18:23:09.886 INFO:tasks.rados.rados.0.trial187.stdout:3819: writing trial18717860-21 from 1790970 to 2195742 tid 2 2026-02-13T18:23:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3819: writing trial18717860-21 from 2829335 to 3193627 tid 3 2026-02-13T18:23:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3820: read oid 33 snap 424 2026-02-13T18:23:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3820: expect (ObjNum 1237 snap 423 seq_num 1237) 2026-02-13T18:23:09.890 INFO:tasks.rados.rados.0.trial187.stdout:3821: snap_remove snap 425 2026-02-13T18:23:10.581 INFO:tasks.rados.rados.0.trial187.stdout:3821: done (11 left) 2026-02-13T18:23:10.582 INFO:tasks.rados.rados.0.trial187.stdout:3822: write (excl) oid 1 current snap is 433 2026-02-13T18:23:10.582 INFO:tasks.rados.rados.0.trial187.stdout:3822: seq_num 1262 ranges {410434=678836,1565805=548430,2573111=637323} 2026-02-13T18:23:10.586 INFO:tasks.rados.rados.0.trial187.stdout:3822: writing trial18717860-1 from 410434 to 1089270 tid 1 2026-02-13T18:23:10.589 INFO:tasks.rados.rados.0.trial187.stdout:3822: writing trial18717860-1 from 1565805 to 2114235 tid 2 2026-02-13T18:23:10.594 INFO:tasks.rados.rados.0.trial187.stdout:3822: writing trial18717860-1 from 2573111 to 3210434 tid 3 2026-02-13T18:23:10.594 INFO:tasks.rados.rados.0.trial187.stdout:3823: write (excl) oid 39 current snap is 433 2026-02-13T18:23:10.595 INFO:tasks.rados.rados.0.trial187.stdout:3823: seq_num 1263 ranges {427241=754085,1624287=408441,2600534=549964} 2026-02-13T18:23:10.599 INFO:tasks.rados.rados.0.trial187.stdout:3823: writing trial18717860-39 from 427241 to 1181326 tid 1 2026-02-13T18:23:10.602 INFO:tasks.rados.rados.0.trial187.stdout:3823: writing trial18717860-39 from 1624287 to 2032728 tid 2 2026-02-13T18:23:10.607 INFO:tasks.rados.rados.0.trial187.stdout:3823: writing trial18717860-39 from 2600534 to 3150498 tid 3 2026-02-13T18:23:10.607 INFO:tasks.rados.rados.0.trial187.stdout:3824: read oid 31 snap -1 2026-02-13T18:23:10.607 INFO:tasks.rados.rados.0.trial187.stdout:3824: expect (ObjNum 1246 snap 428 seq_num 1246) 2026-02-13T18:23:10.607 INFO:tasks.rados.rados.0.trial187.stdout:3825: snap_remove snap 409 2026-02-13T18:23:11.584 INFO:tasks.rados.rados.0.trial187.stdout:3825: done (14 left) 2026-02-13T18:23:11.585 INFO:tasks.rados.rados.0.trial187.stdout:3826: write oid 38 current snap is 433 2026-02-13T18:23:11.585 INFO:tasks.rados.rados.0.trial187.stdout:3826: seq_num 1264 ranges {444048=429334,1282769=552099,2627957=616091} 2026-02-13T18:23:11.588 INFO:tasks.rados.rados.0.trial187.stdout:3826: writing trial18717860-38 from 444048 to 873382 tid 1 2026-02-13T18:23:11.592 INFO:tasks.rados.rados.0.trial187.stdout:3826: writing trial18717860-38 from 1282769 to 1834868 tid 2 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3826: writing trial18717860-38 from 2627957 to 3244048 tid 3 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3827: snap_create 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: finishing write tid 3 to trial18717860-11 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: finishing write tid 4 to trial18717860-11 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: finishing write tid 5 to trial18717860-11 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: oid 11 updating version 0 to 2321 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: oid 11 version 2321 is already newer than 2320 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: oid 11 updating version 2321 to 2322 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: oid 11 version 2322 is already newer than 2319 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 11 v 2322 (ObjNum 1256 snap 433 seq_num 1256) dirty exists 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3809: left oid 11 (ObjNum 1256 snap 433 seq_num 1256) 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3810: finishing write tid 1 to trial18717860-2 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:3811: expect (ObjNum 1252 snap 431 seq_num 1252) 2026-02-13T18:23:11.598 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: finishing write tid 2 to trial18717860-2 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: finishing write tid 3 to trial18717860-2 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: finishing write tid 4 to trial18717860-2 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: oid 2 updating version 0 to 1266 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: oid 2 version 1266 is already newer than 1265 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: oid 2 updating version 1266 to 1267 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1267 (ObjNum 1257 snap 433 seq_num 1257) dirty exists 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3810: left oid 2 (ObjNum 1257 snap 433 seq_num 1257) 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: finishing write tid 1 to trial18717860-18 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: finishing write tid 2 to trial18717860-18 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: finishing write tid 3 to trial18717860-18 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: finishing write tid 4 to trial18717860-18 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: oid 18 updating version 0 to 1269 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: oid 18 version 1269 is already newer than 1268 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: oid 18 updating version 1269 to 1270 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1270 (ObjNum 1258 snap 433 seq_num 1258) dirty exists 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3812: left oid 18 (ObjNum 1258 snap 433 seq_num 1258) 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: finishing write tid 1 to trial18717860-10 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: finishing write tid 2 to trial18717860-10 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: finishing write tid 3 to trial18717860-10 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: finishing write tid 4 to trial18717860-10 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: oid 10 updating version 0 to 1666 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: oid 10 updating version 1666 to 1667 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:3813: oid 10 version 1667 is already newer than 1665 2026-02-13T18:23:11.688 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1667 (ObjNum 1259 snap 433 seq_num 1259) dirty exists 2026-02-13T18:23:11.689 INFO:tasks.rados.rados.0.trial187.stdout:3813: left oid 10 (ObjNum 1259 snap 433 seq_num 1259) 2026-02-13T18:23:11.689 INFO:tasks.rados.rados.0.trial187.stdout:3816: expect (ObjNum 1206 snap 407 seq_num 1206) 2026-02-13T18:23:11.732 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 294851 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3817: finishing rollback tid 0 to trial18717860-41 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3817: finishing rollback tid 1 to trial18717860-41 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3817: finishing rollback tid 2 to trial18717860-41 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 2078 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: finishing write tid 1 to trial18717860-44 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: finishing write tid 2 to trial18717860-44 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: finishing write tid 3 to trial18717860-44 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: finishing write tid 4 to trial18717860-44 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: finishing write tid 5 to trial18717860-44 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: oid 44 updating version 0 to 2523 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: oid 44 updating version 2523 to 2525 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: oid 44 version 2525 is already newer than 2524 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: oid 44 version 2525 is already newer than 2518 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2525 (ObjNum 1260 snap 433 seq_num 1260) dirty exists 2026-02-13T18:23:11.817 INFO:tasks.rados.rados.0.trial187.stdout:3818: left oid 44 (ObjNum 1260 snap 433 seq_num 1260) 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: finishing write tid 1 to trial18717860-21 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: finishing write tid 2 to trial18717860-21 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: finishing write tid 3 to trial18717860-21 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: finishing write tid 4 to trial18717860-21 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: finishing write tid 5 to trial18717860-21 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: oid 21 updating version 0 to 1678 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: oid 21 version 1678 is already newer than 1677 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: oid 21 version 1678 is already newer than 1675 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: oid 21 version 1678 is already newer than 1676 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1678 (ObjNum 1261 snap 433 seq_num 1261) dirty exists 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3819: left oid 21 (ObjNum 1261 snap 433 seq_num 1261) 2026-02-13T18:23:11.818 INFO:tasks.rados.rados.0.trial187.stdout:3820: expect (ObjNum 1237 snap 423 seq_num 1237) 2026-02-13T18:23:11.831 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 187030 2026-02-13T18:23:11.855 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1667774 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: finishing write tid 1 to trial18717860-1 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: finishing write tid 2 to trial18717860-1 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: finishing write tid 3 to trial18717860-1 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: finishing write tid 4 to trial18717860-1 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: finishing write tid 5 to trial18717860-1 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: oid 1 updating version 0 to 1667 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: oid 1 version 1667 is already newer than 1666 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: oid 1 updating version 1667 to 1669 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: oid 1 version 1669 is already newer than 1668 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 1669 (ObjNum 1262 snap 433 seq_num 1262) dirty exists 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3822: left oid 1 (ObjNum 1262 snap 433 seq_num 1262) 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3823: finishing write tid 1 to trial18717860-39 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3823: finishing write tid 2 to trial18717860-39 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3823: finishing write tid 3 to trial18717860-39 2026-02-13T18:23:11.867 INFO:tasks.rados.rados.0.trial187.stdout:3824: expect (ObjNum 1246 snap 428 seq_num 1246) 2026-02-13T18:23:11.910 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2647696 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: finishing write tid 4 to trial18717860-39 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: finishing write tid 5 to trial18717860-39 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: oid 39 updating version 0 to 2091 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: oid 39 updating version 2091 to 2093 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: oid 39 version 2093 is already newer than 2090 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: oid 39 version 2093 is already newer than 2092 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 39 v 2093 (ObjNum 1263 snap 433 seq_num 1263) dirty exists 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3823: left oid 39 (ObjNum 1263 snap 433 seq_num 1263) 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: finishing write tid 1 to trial18717860-38 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: finishing write tid 2 to trial18717860-38 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: finishing write tid 3 to trial18717860-38 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: finishing write tid 4 to trial18717860-38 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: finishing write tid 5 to trial18717860-38 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: oid 38 updating version 0 to 1851 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: oid 38 updating version 1851 to 1852 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: oid 38 version 1852 is already newer than 1849 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: oid 38 version 1852 is already newer than 1850 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1852 (ObjNum 1264 snap 433 seq_num 1264) dirty exists 2026-02-13T18:23:11.916 INFO:tasks.rados.rados.0.trial187.stdout:3826: left oid 38 (ObjNum 1264 snap 433 seq_num 1264) 2026-02-13T18:23:12.589 INFO:tasks.rados.rados.0.trial187.stdout:3809: done (15 left) 2026-02-13T18:23:12.589 INFO:tasks.rados.rados.0.trial187.stdout:3810: done (14 left) 2026-02-13T18:23:12.589 INFO:tasks.rados.rados.0.trial187.stdout:3811: done (13 left) 2026-02-13T18:23:12.589 INFO:tasks.rados.rados.0.trial187.stdout:3812: done (12 left) 2026-02-13T18:23:12.589 INFO:tasks.rados.rados.0.trial187.stdout:3813: done (11 left) 2026-02-13T18:23:12.589 INFO:tasks.rados.rados.0.trial187.stdout:3815: done (10 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3816: done (9 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3817: done (8 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3818: done (7 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3819: done (6 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3820: done (5 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3822: done (4 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3823: done (3 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3824: done (2 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3826: done (1 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3827: done (0 left) 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3828: read oid 41 snap -1 2026-02-13T18:23:12.590 INFO:tasks.rados.rados.0.trial187.stdout:3828: expect (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:23:12.591 INFO:tasks.rados.rados.0.trial187.stdout:3829: delete oid 22 current snap is 434 2026-02-13T18:23:12.595 INFO:tasks.rados.rados.0.trial187.stdout:3828: expect (ObjNum 1164 snap 384 seq_num 1164) 2026-02-13T18:23:12.799 INFO:tasks.rados.rados.0.trial187.stdout:3828: done (1 left) 2026-02-13T18:23:12.799 INFO:tasks.rados.rados.0.trial187.stdout:3829: done (0 left) 2026-02-13T18:23:12.799 INFO:tasks.rados.rados.0.trial187.stdout:3830: copy_from oid 33 from oid 44 current snap is 434 2026-02-13T18:23:12.799 INFO:tasks.rados.rados.0.trial187.stdout:3831: write (excl) oid 21 current snap is 434 2026-02-13T18:23:12.799 INFO:tasks.rados.rados.0.trial187.stdout:3831: seq_num 1266 ranges {477662=579832,1683380=555768,2966450=311212} 2026-02-13T18:23:12.806 INFO:tasks.rados.rados.0.trial187.stdout:3831: writing trial18717860-21 from 477662 to 1057494 tid 1 2026-02-13T18:23:12.814 INFO:tasks.rados.rados.0.trial187.stdout:3831: writing trial18717860-21 from 1683380 to 2239148 tid 2 2026-02-13T18:23:12.822 INFO:tasks.rados.rados.0.trial187.stdout:3831: writing trial18717860-21 from 2966450 to 3277662 tid 3 2026-02-13T18:23:12.822 INFO:tasks.rados.rados.0.trial187.stdout:3832: rollback oid 6 current snap is 434 2026-02-13T18:23:12.822 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 429 2026-02-13T18:23:12.822 INFO:tasks.rados.rados.0.trial187.stdout:3830: finishing copy_from racing read to trial18717860-33 2026-02-13T18:23:12.823 INFO:tasks.rados.rados.0.trial187.stdout:3831: finishing write tid 1 to trial18717860-21 2026-02-13T18:23:12.823 INFO:tasks.rados.rados.0.trial187.stdout:3830: finishing copy_from to trial18717860-33 2026-02-13T18:23:12.823 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2525 (ObjNum 1260 snap 433 seq_num 1260) dirty exists 2026-02-13T18:23:12.823 INFO:tasks.rados.rados.0.trial187.stdout:3831: finishing write tid 2 to trial18717860-21 2026-02-13T18:23:12.823 INFO:tasks.rados.rados.0.trial187.stdout:3830: done (2 left) 2026-02-13T18:23:12.823 INFO:tasks.rados.rados.0.trial187.stdout:3833: snap_remove snap 402 2026-02-13T18:23:13.592 INFO:tasks.rados.rados.0.trial187.stdout:3833: done (2 left) 2026-02-13T18:23:13.592 INFO:tasks.rados.rados.0.trial187.stdout:3834: copy_from oid 20 from oid 29 current snap is 434 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: finishing write tid 3 to trial18717860-21 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: finishing write tid 4 to trial18717860-21 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: finishing write tid 5 to trial18717860-21 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: oid 21 updating version 0 to 1679 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: oid 21 updating version 1679 to 1681 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: oid 21 version 1681 is already newer than 1680 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: oid 21 updating version 1681 to 1682 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1682 (ObjNum 1266 snap 434 seq_num 1266) dirty exists 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3831: left oid 21 (ObjNum 1266 snap 434 seq_num 1266) 2026-02-13T18:23:13.593 INFO:tasks.rados.rados.0.trial187.stdout:3832: finishing rollback tid 0 to trial18717860-6 2026-02-13T18:23:13.594 INFO:tasks.rados.rados.0.trial187.stdout:3832: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:23:13.594 INFO:tasks.rados.rados.0.trial187.stdout:3832: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:23:13.594 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 2289 (ObjNum 1238 snap 423 seq_num 1238) dirty exists 2026-02-13T18:23:13.594 INFO:tasks.rados.rados.0.trial187.stdout:3831: done (2 left) 2026-02-13T18:23:13.594 INFO:tasks.rados.rados.0.trial187.stdout:3832: done (1 left) 2026-02-13T18:23:13.594 INFO:tasks.rados.rados.0.trial187.stdout:3835: snap_remove snap 413 2026-02-13T18:23:14.594 INFO:tasks.rados.rados.0.trial187.stdout:3835: done (1 left) 2026-02-13T18:23:14.594 INFO:tasks.rados.rados.0.trial187.stdout:3836: rollback oid 15 current snap is 434 2026-02-13T18:23:14.594 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 366 2026-02-13T18:23:14.594 INFO:tasks.rados.rados.0.trial187.stdout:3834: finishing copy_from racing read to trial18717860-20 2026-02-13T18:23:14.595 INFO:tasks.rados.rados.0.trial187.stdout:3834: finishing copy_from to trial18717860-20 2026-02-13T18:23:14.595 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 20 v 1662 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:23:14.595 INFO:tasks.rados.rados.0.trial187.stdout:3834: done (1 left) 2026-02-13T18:23:14.595 INFO:tasks.rados.rados.0.trial187.stdout:3837: write (excl) oid 5 current snap is 434 2026-02-13T18:23:14.595 INFO:tasks.rados.rados.0.trial187.stdout:3837: seq_num 1267 ranges {494469=655081,1741862=415779,2710226=584243} 2026-02-13T18:23:14.602 INFO:tasks.rados.rados.0.trial187.stdout:3837: writing trial18717860-5 from 494469 to 1149550 tid 1 2026-02-13T18:23:14.609 INFO:tasks.rados.rados.0.trial187.stdout:3837: writing trial18717860-5 from 1741862 to 2157641 tid 2 2026-02-13T18:23:14.616 INFO:tasks.rados.rados.0.trial187.stdout:3837: writing trial18717860-5 from 2710226 to 3294469 tid 3 2026-02-13T18:23:14.617 INFO:tasks.rados.rados.0.trial187.stdout:3838: snap_remove snap 400 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3838: done (2 left) 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3839: rollback oid 9 current snap is 434 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 395 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3836: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3836: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3836: finishing rollback tid 2 to trial18717860-15 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1672 (ObjNum 1047 snap 342 seq_num 1047) dirty exists 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: finishing write tid 1 to trial18717860-5 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: finishing write tid 2 to trial18717860-5 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: finishing write tid 3 to trial18717860-5 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: finishing write tid 4 to trial18717860-5 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: finishing write tid 5 to trial18717860-5 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: oid 5 updating version 0 to 2077 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: oid 5 updating version 2077 to 2078 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: oid 5 version 2078 is already newer than 2076 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: oid 5 updating version 2078 to 2079 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 2079 (ObjNum 1267 snap 434 seq_num 1267) dirty exists 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3837: left oid 5 (ObjNum 1267 snap 434 seq_num 1267) 2026-02-13T18:23:15.582 INFO:tasks.rados.rados.0.trial187.stdout:3836: done (2 left) 2026-02-13T18:23:15.583 INFO:tasks.rados.rados.0.trial187.stdout:3837: done (1 left) 2026-02-13T18:23:15.583 INFO:tasks.rados.rados.0.trial187.stdout:3840: rollback oid 3 current snap is 434 2026-02-13T18:23:15.583 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 395 2026-02-13T18:23:15.583 INFO:tasks.rados.rados.0.trial187.stdout:3841: copy_from oid 28 from oid 6 current snap is 434 2026-02-13T18:23:15.583 INFO:tasks.rados.rados.0.trial187.stdout:3842: write oid 8 current snap is 434 2026-02-13T18:23:15.583 INFO:tasks.rados.rados.0.trial187.stdout:3842: seq_num 1268 ranges {511276=730330,1800344=559437,3021296=289980} 2026-02-13T18:23:15.590 INFO:tasks.rados.rados.0.trial187.stdout:3842: writing trial18717860-8 from 511276 to 1241606 tid 1 2026-02-13T18:23:15.598 INFO:tasks.rados.rados.0.trial187.stdout:3842: writing trial18717860-8 from 1800344 to 2359781 tid 2 2026-02-13T18:23:15.606 INFO:tasks.rados.rados.0.trial187.stdout:3842: writing trial18717860-8 from 3021296 to 3311276 tid 3 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3843: read oid 36 snap -1 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3843: expect (ObjNum 1233 snap 423 seq_num 1233) 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3844: rollback oid 27 current snap is 434 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 433 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3839: finishing rollback tid 0 to trial18717860-9 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3839: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 2095 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3840: finishing rollback tid 0 to trial18717860-3 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3840: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:3840: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:23:15.607 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 2098 (ObjNum 1035 snap 337 seq_num 1035) dirty exists 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3842: finishing write tid 1 to trial18717860-8 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3841: finishing copy_from racing read to trial18717860-28 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3841: finishing copy_from to trial18717860-28 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 2289 (ObjNum 1238 snap 423 seq_num 1238) dirty exists 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3842: finishing write tid 2 to trial18717860-8 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3839: done (5 left) 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3840: done (4 left) 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3841: done (3 left) 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3845: read oid 22 snap 426 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3845: expect (ObjNum 1212 snap 409 seq_num 1212) 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:3846: rollback oid 19 current snap is 434 2026-02-13T18:23:15.608 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 415 2026-02-13T18:23:15.609 INFO:tasks.rados.rados.0.trial187.stdout:3847: read oid 38 snap -1 2026-02-13T18:23:15.609 INFO:tasks.rados.rados.0.trial187.stdout:3847: expect (ObjNum 1264 snap 433 seq_num 1264) 2026-02-13T18:23:15.609 INFO:tasks.rados.rados.0.trial187.stdout:3848: read oid 15 snap -1 2026-02-13T18:23:15.609 INFO:tasks.rados.rados.0.trial187.stdout:3848: expect (ObjNum 1047 snap 342 seq_num 1047) 2026-02-13T18:23:15.609 INFO:tasks.rados.rados.0.trial187.stdout:3849: copy_from oid 2 from oid 50 current snap is 434 2026-02-13T18:23:15.609 INFO:tasks.rados.rados.0.trial187.stdout:3850: delete oid 6 current snap is 434 2026-02-13T18:23:15.610 INFO:tasks.rados.rados.0.trial187.stdout:3844: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:23:15.610 INFO:tasks.rados.rados.0.trial187.stdout:3844: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:23:15.610 INFO:tasks.rados.rados.0.trial187.stdout:3842: finishing write tid 3 to trial18717860-8 2026-02-13T18:23:15.610 INFO:tasks.rados.rados.0.trial187.stdout:3844: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:23:15.610 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1674 (ObjNum 1239 snap 423 seq_num 1239) dirty exists 2026-02-13T18:23:15.610 INFO:tasks.rados.rados.0.trial187.stdout:3842: finishing write tid 4 to trial18717860-8 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3842: finishing write tid 5 to trial18717860-8 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3842: oid 8 updating version 0 to 2431 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3842: oid 8 updating version 2431 to 2432 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3842: oid 8 updating version 2432 to 2433 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3842: oid 8 version 2433 is already newer than 2430 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 2433 (ObjNum 1268 snap 434 seq_num 1268) dirty exists 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3842: left oid 8 (ObjNum 1268 snap 434 seq_num 1268) 2026-02-13T18:23:15.611 INFO:tasks.rados.rados.0.trial187.stdout:3845: expect (ObjNum 1212 snap 409 seq_num 1212) 2026-02-13T18:23:15.641 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:15.680 INFO:tasks.rados.rados.0.trial187.stdout:3846: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:23:15.680 INFO:tasks.rados.rados.0.trial187.stdout:3846: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:23:15.680 INFO:tasks.rados.rados.0.trial187.stdout:3847: expect (ObjNum 1264 snap 433 seq_num 1264) 2026-02-13T18:23:15.697 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2057631 2026-02-13T18:23:15.792 INFO:tasks.rados.rados.0.trial187.stdout:3848: expect (ObjNum 1047 snap 342 seq_num 1047) 2026-02-13T18:23:15.792 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:16.005 INFO:tasks.rados.rados.0.trial187.stdout:3849: finishing copy_from racing read to trial18717860-2 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:3849: finishing copy_from to trial18717860-2 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 2 v 1665 (ObjNum 1230 snap 422 seq_num 1230) dirty exists 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:3846: finishing rollback tid 2 to trial18717860-19 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1675 (ObjNum 1167 snap 387 seq_num 1167) dirty exists 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:3842: done (8 left) 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:3844: done (7 left) 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:3845: done (6 left) 2026-02-13T18:23:16.006 INFO:tasks.rados.rados.0.trial187.stdout:3846: done (5 left) 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3847: done (4 left) 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3848: done (3 left) 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3849: done (2 left) 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3850: done (1 left) 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3851: read oid 37 snap 433 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3851: expect deleted 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3852: read oid 11 snap -1 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3852: expect (ObjNum 1256 snap 433 seq_num 1256) 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3853: delete oid 43 current snap is 434 2026-02-13T18:23:16.007 INFO:tasks.rados.rados.0.trial187.stdout:3843: expect (ObjNum 1233 snap 423 seq_num 1233) 2026-02-13T18:23:16.062 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:16.091 INFO:tasks.rados.rados.0.trial187.stdout:3852: expect (ObjNum 1256 snap 433 seq_num 1256) 2026-02-13T18:23:16.113 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1319697 2026-02-13T18:23:16.129 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:16.154 INFO:tasks.rados.rados.0.trial187.stdout:3843: done (3 left) 2026-02-13T18:23:16.154 INFO:tasks.rados.rados.0.trial187.stdout:3851: done (2 left) 2026-02-13T18:23:16.154 INFO:tasks.rados.rados.0.trial187.stdout:3852: done (1 left) 2026-02-13T18:23:16.154 INFO:tasks.rados.rados.0.trial187.stdout:3853: done (0 left) 2026-02-13T18:23:16.154 INFO:tasks.rados.rados.0.trial187.stdout:3854: snap_create 2026-02-13T18:23:16.601 INFO:tasks.rados.rados.0.trial187.stdout:3854: done (0 left) 2026-02-13T18:23:16.602 INFO:tasks.rados.rados.0.trial187.stdout:3855: rollback oid 15 current snap is 435 2026-02-13T18:23:16.602 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 15 to 430 2026-02-13T18:23:16.602 INFO:tasks.rados.rados.0.trial187.stdout:3856: read oid 46 snap -1 2026-02-13T18:23:16.602 INFO:tasks.rados.rados.0.trial187.stdout:3856: expect (ObjNum 1251 snap 431 seq_num 1251) 2026-02-13T18:23:16.602 INFO:tasks.rados.rados.0.trial187.stdout:3857: snap_remove snap 414 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:3857: done (2 left) 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:3858: copy_from oid 28 from oid 34 current snap is 435 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:3855: finishing rollback tid 0 to trial18717860-15 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:3855: finishing rollback tid 1 to trial18717860-15 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1677 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:3856: expect (ObjNum 1251 snap 431 seq_num 1251) 2026-02-13T18:23:17.605 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3858: finishing copy_from racing read to trial18717860-28 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3858: finishing copy_from to trial18717860-28 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1469 (ObjNum 1164 snap 384 seq_num 1164) dirty exists 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3855: done (2 left) 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3856: done (1 left) 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3858: done (0 left) 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3859: copy_from oid 30 from oid 45 current snap is 435 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3860: copy_from oid 9 from oid 8 current snap is 435 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:3861: rollback oid 10 current snap is 435 2026-02-13T18:23:17.698 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 10 to 411 2026-02-13T18:23:17.699 INFO:tasks.rados.rados.0.trial187.stdout:3862: write (excl) oid 41 current snap is 435 2026-02-13T18:23:17.699 INFO:tasks.rados.rados.0.trial187.stdout:3862: seq_num 1271 ranges {561697=672430,1975790=706764,3103565=258132} 2026-02-13T18:23:17.706 INFO:tasks.rados.rados.0.trial187.stdout:3862: writing trial18717860-41 from 561697 to 1234127 tid 1 2026-02-13T18:23:17.716 INFO:tasks.rados.rados.0.trial187.stdout:3862: writing trial18717860-41 from 1975790 to 2682554 tid 2 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3862: writing trial18717860-41 from 3103565 to 3361697 tid 3 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3863: write (excl) oid 16 current snap is 435 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3861: finishing rollback tid 0 to trial18717860-10 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3861: finishing rollback tid 1 to trial18717860-10 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3861: finishing rollback tid 2 to trial18717860-10 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1670 (ObjNum 1150 snap 383 seq_num 1150) dirty exists 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3859: finishing copy_from to trial18717860-30 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3859: got expected ENOENT (src dne) 2026-02-13T18:23:17.722 INFO:tasks.rados.rados.0.trial187.stdout:3863: seq_num 1272 ranges {578504=747679,2034272=566775,3130988=247516} 2026-02-13T18:23:17.730 INFO:tasks.rados.rados.0.trial187.stdout:3863: writing trial18717860-16 from 578504 to 1326183 tid 1 2026-02-13T18:23:17.739 INFO:tasks.rados.rados.0.trial187.stdout:3863: writing trial18717860-16 from 2034272 to 2601047 tid 2 2026-02-13T18:23:17.745 INFO:tasks.rados.rados.0.trial187.stdout:3863: writing trial18717860-16 from 3130988 to 3378504 tid 3 2026-02-13T18:23:17.745 INFO:tasks.rados.rados.0.trial187.stdout:3861: done (4 left) 2026-02-13T18:23:17.745 INFO:tasks.rados.rados.0.trial187.stdout:3864: copy_from oid 42 from oid 14 current snap is 435 2026-02-13T18:23:17.745 INFO:tasks.rados.rados.0.trial187.stdout:3859: finishing copy_from racing read to trial18717860-30 2026-02-13T18:23:17.745 INFO:tasks.rados.rados.0.trial187.stdout:3860: finishing copy_from racing read to trial18717860-9 2026-02-13T18:23:17.745 INFO:tasks.rados.rados.0.trial187.stdout:3860: finishing copy_from to trial18717860-9 2026-02-13T18:23:17.746 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 2433 (ObjNum 1268 snap 434 seq_num 1268) dirty exists 2026-02-13T18:23:17.746 INFO:tasks.rados.rados.0.trial187.stdout:3859: done (4 left) 2026-02-13T18:23:17.746 INFO:tasks.rados.rados.0.trial187.stdout:3860: done (3 left) 2026-02-13T18:23:17.746 INFO:tasks.rados.rados.0.trial187.stdout:3865: read oid 50 snap -1 2026-02-13T18:23:17.746 INFO:tasks.rados.rados.0.trial187.stdout:3865: expect (ObjNum 1230 snap 422 seq_num 1230) 2026-02-13T18:23:17.746 INFO:tasks.rados.rados.0.trial187.stdout:3866: snap_remove snap 431 2026-02-13T18:23:18.610 INFO:tasks.rados.rados.0.trial187.stdout:3866: done (4 left) 2026-02-13T18:23:18.610 INFO:tasks.rados.rados.0.trial187.stdout:3867: rollback oid 6 current snap is 435 2026-02-13T18:23:18.610 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 6 to 426 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: finishing write tid 1 to trial18717860-41 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: finishing write tid 2 to trial18717860-41 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: finishing write tid 3 to trial18717860-41 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: finishing write tid 4 to trial18717860-41 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: finishing write tid 5 to trial18717860-41 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: oid 41 updating version 0 to 2079 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: oid 41 updating version 2079 to 2081 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: oid 41 version 2081 is already newer than 2080 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: oid 41 updating version 2081 to 2082 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 2082 (ObjNum 1271 snap 435 seq_num 1271) dirty exists 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3862: left oid 41 (ObjNum 1271 snap 435 seq_num 1271) 2026-02-13T18:23:18.611 INFO:tasks.rados.rados.0.trial187.stdout:3863: finishing write tid 1 to trial18717860-16 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: finishing write tid 2 to trial18717860-16 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: finishing write tid 3 to trial18717860-16 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: finishing write tid 4 to trial18717860-16 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: finishing write tid 5 to trial18717860-16 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: oid 16 updating version 0 to 1664 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: oid 16 updating version 1664 to 1666 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: oid 16 version 1666 is already newer than 1663 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: oid 16 version 1666 is already newer than 1665 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1666 (ObjNum 1272 snap 435 seq_num 1272) dirty exists 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3863: left oid 16 (ObjNum 1272 snap 435 seq_num 1272) 2026-02-13T18:23:18.612 INFO:tasks.rados.rados.0.trial187.stdout:3865: expect (ObjNum 1230 snap 422 seq_num 1230) 2026-02-13T18:23:18.614 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 981389 2026-02-13T18:23:18.668 INFO:tasks.rados.rados.0.trial187.stdout:3864: finishing copy_from racing read to trial18717860-42 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3864: finishing copy_from to trial18717860-42 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 42 v 1658 (ObjNum 1254 snap 431 seq_num 1254) dirty exists 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3867: finishing rollback tid 1 to trial18717860-6 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3867: finishing rollback tid 2 to trial18717860-6 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 2292 (ObjNum 1238 snap 423 seq_num 1238) dirty exists 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3862: done (4 left) 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3863: done (3 left) 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3864: done (2 left) 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3865: done (1 left) 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3867: done (0 left) 2026-02-13T18:23:18.669 INFO:tasks.rados.rados.0.trial187.stdout:3868: rollback oid 19 current snap is 435 2026-02-13T18:23:18.670 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 19 to 417 2026-02-13T18:23:18.670 INFO:tasks.rados.rados.0.trial187.stdout:3869: read oid 27 snap 406 2026-02-13T18:23:18.670 INFO:tasks.rados.rados.0.trial187.stdout:3869: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:23:18.670 INFO:tasks.rados.rados.0.trial187.stdout:3870: copy_from oid 21 from oid 32 current snap is 435 2026-02-13T18:23:18.670 INFO:tasks.rados.rados.0.trial187.stdout:3871: write (excl) oid 33 current snap is 435 2026-02-13T18:23:18.670 INFO:tasks.rados.rados.0.trial187.stdout:3871: seq_num 1273 ranges {595311=422928,1576401=710433,3042058=353253} 2026-02-13T18:23:18.675 INFO:tasks.rados.rados.0.trial187.stdout:3871: writing trial18717860-33 from 595311 to 1018239 tid 1 2026-02-13T18:23:18.684 INFO:tasks.rados.rados.0.trial187.stdout:3871: writing trial18717860-33 from 1576401 to 2286834 tid 2 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:3871: writing trial18717860-33 from 3042058 to 3395311 tid 3 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:3872: delete oid 24 current snap is 435 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:3868: finishing rollback tid 0 to trial18717860-19 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:3868: finishing rollback tid 1 to trial18717860-19 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:3868: finishing rollback tid 2 to trial18717860-19 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 19 v 1680 (ObjNum 1167 snap 387 seq_num 1167) dirty exists 2026-02-13T18:23:18.692 INFO:tasks.rados.rados.0.trial187.stdout:3869: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:23:18.745 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:18.809 INFO:tasks.rados.rados.0.trial187.stdout:3871: finishing write tid 1 to trial18717860-33 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3870: finishing copy_from racing read to trial18717860-21 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3870: finishing copy_from to trial18717860-21 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 2429 (ObjNum 992 snap 321 seq_num 992) dirty exists 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: finishing write tid 2 to trial18717860-33 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: finishing write tid 3 to trial18717860-33 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: finishing write tid 4 to trial18717860-33 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: finishing write tid 5 to trial18717860-33 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: oid 33 updating version 0 to 2593 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: oid 33 updating version 2593 to 2594 2026-02-13T18:23:18.810 INFO:tasks.rados.rados.0.trial187.stdout:3871: oid 33 updating version 2594 to 2595 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3871: oid 33 updating version 2595 to 2596 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2596 (ObjNum 1273 snap 435 seq_num 1273) dirty exists 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3871: left oid 33 (ObjNum 1273 snap 435 seq_num 1273) 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3868: done (4 left) 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3869: done (3 left) 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3870: done (2 left) 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3871: done (1 left) 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3872: done (0 left) 2026-02-13T18:23:18.811 INFO:tasks.rados.rados.0.trial187.stdout:3873: snap_create 2026-02-13T18:23:19.611 INFO:tasks.rados.rados.0.trial187.stdout:3873: done (0 left) 2026-02-13T18:23:19.611 INFO:tasks.rados.rados.0.trial187.stdout:3874: rollback oid 3 current snap is 436 2026-02-13T18:23:19.611 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 3 to 411 2026-02-13T18:23:19.611 INFO:tasks.rados.rados.0.trial187.stdout:3875: snap_create 2026-02-13T18:23:19.616 INFO:tasks.rados.rados.0.trial187.stdout:3874: finishing rollback tid 0 to trial18717860-3 2026-02-13T18:23:19.617 INFO:tasks.rados.rados.0.trial187.stdout:3874: finishing rollback tid 1 to trial18717860-3 2026-02-13T18:23:19.617 INFO:tasks.rados.rados.0.trial187.stdout:3874: finishing rollback tid 2 to trial18717860-3 2026-02-13T18:23:19.617 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 3 v 2436 (ObjNum 1181 snap 396 seq_num 1181) dirty exists 2026-02-13T18:23:19.686 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.a 2026-02-13T18:23:19.686 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-13T18:23:19.687 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-13T18:23:19.687 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:23:19.687 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:23:19.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient: get_monmap_and_config 2026-02-13T18:23:19.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient: build_initial_monmap 2026-02-13T18:23:19.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient: monmap: 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:19.736910+0000 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:19.736910+0000 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:19.748 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 1 Processor -- start 2026-02-13T18:23:19.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 1 -- start start 2026-02-13T18:23:19.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient: init 2026-02-13T18:23:19.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:19.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient(hunting): picked mon.noname-b con 0x7f1abc08cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.731+0000 7f1ac2451640 10 monclient(hunting): picked mon.noname-c con 0x7f1abc08d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac2451640 10 monclient(hunting): picked mon.noname-a con 0x7f1abc08d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac2451640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc085ad0 con 0x7f1abc08d5d0 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac2451640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc085ee0 con 0x7f1abc08d190 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac2451640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc08e000 con 0x7f1abc08cdc0 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac2451640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac2451640 10 monclient(hunting): authenticate will time out at 1630.792045s 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1abbfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1abc08cdc0 0x7f1abc08c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42338/0 (socket says 10.20.193.78:42338) 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1abbfff640 1 -- 10.20.193.78:0/1298276320 learned_addr learned my addr 10.20.193.78:0/1298276320 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:19.751 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1abbfff640 1 -- 10.20.193.78:0/1298276320 >> v1:10.20.193.78:6790/0 conn(0x7f1abc08cdc0 legacy=0x7f1abc08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1ac09c7640 1 -- 10.20.193.78:0/1298276320 >> v1:10.20.193.78:6789/0 conn(0x7f1abc08d5d0 legacy=0x7f1abc1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.752 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.735+0000 7f1abb7fe640 1 -- 10.20.193.78:0/1298276320 >> v1:10.20.193.187:6789/0 conn(0x7f1abc08d190 legacy=0x7f1abc183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841939646 0 0) 0x7f1aac002cb0 con 0x7f1abc08d190 2026-02-13T18:23:19.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:19.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:19.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:19.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient(hunting): my global_id is 134098 2026-02-13T18:23:19.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa0003620 con 0x7f1abc08d190 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3554926511 0 0) 0x7f1aa0003620 con 0x7f1abc08d190 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 >> v1:10.20.193.78:6790/0 conn(0x7f1abc08cdc0 legacy=0x7f1abc08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 >> v1:10.20.193.78:6789/0 conn(0x7f1abc08d5d0 legacy=0x7f1abc1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 monclient: found mon.noname-c 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.187:6789/0 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc086f80 con 0x7f1abc08d190 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:19.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1aac003330 con 0x7f1abc08d190 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 5 monclient: authenticate success, global_id 134098 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: dump: 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.757 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 <== mon.1 v1:10.20.193.187:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aac003710 con 0x7f1abc08d190 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 4 set_mon_vals no callback set 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 1 -- 10.20.193.78:0/1298276320 <== mon.1 v1:10.20.193.187:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1aac003b20 con 0x7f1abc08d190 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:19.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abaffd640 10 monclient: dump: 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.759 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: shutdown 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- 10.20.193.78:0/1298276320 >> v1:10.20.193.187:6789/0 conn(0x7f1abc08d190 legacy=0x7f1abc183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- 10.20.193.78:0/1298276320 shutdown_connections 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- 10.20.193.78:0/1298276320 >> 10.20.193.78:0/1298276320 conn(0x7f1abc091720 msgr2=0x7f1abc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- 10.20.193.78:0/1298276320 shutdown_connections 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- 10.20.193.78:0/1298276320 wait complete. 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: build_initial_monmap 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: monmap: 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:19.760 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 Processor -- start 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- start start 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: init 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient(hunting): picked mon.noname-c con 0x7f1abc08cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:19.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient(hunting): picked mon.noname-b con 0x7f1abc08d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient(hunting): picked mon.noname-a con 0x7f1abc08d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc0835e0 con 0x7f1abc08d5d0 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc05dec0 con 0x7f1abc08d190 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc081280 con 0x7f1abc08cdc0 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1ac2451640 10 monclient(hunting): authenticate will time out at 1630.798889s 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abbfff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f1abc08cdc0 0x7f1abc084b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42342/0 (socket says 10.20.193.78:42342) 2026-02-13T18:23:19.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.739+0000 7f1abbfff640 1 -- 10.20.193.78:0/1632352832 learned_addr learned my addr 10.20.193.78:0/1632352832 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:19.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1abbfff640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.78:6790/0 conn(0x7f1abc08cdc0 legacy=0x7f1abc084b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac09c7640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.78:6789/0 conn(0x7f1abc08d5d0 legacy=0x7f1abc195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1abb7fe640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.187:6789/0 conn(0x7f1abc08d190 legacy=0x7f1abc194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961094459 0 0) 0x7f1abc05dec0 con 0x7f1abc08d190 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): my global_id is 134101 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a8c003620 con 0x7f1abc08d190 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2512337377 0 0) 0x7f1a8c003620 con 0x7f1abc08d190 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1abc05dec0 con 0x7f1abc08d190 2026-02-13T18:23:19.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1aac002d10 con 0x7f1abc08d190 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): dump: 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.767 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1591052560 0 0) 0x7f1abc05dec0 con 0x7f1abc08d190 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.78:6790/0 conn(0x7f1abc08cdc0 legacy=0x7f1abc084b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.78:6789/0 conn(0x7f1abc08d5d0 legacy=0x7f1abc195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 monclient: found mon.b 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc081f70 con 0x7f1abc08d190 2026-02-13T18:23:19.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: _finish_auth 0 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 5 monclient: authenticate success, global_id 134101 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 monclient: _renew_subs 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc085220 con 0x7f1abc08d190 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 monclient: _renew_subs 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1abc1530d0 con 0x7f1abc08d190 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aac003710 con 0x7f1abc08d190 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1aac003fc0 con 0x7f1abc08d190 2026-02-13T18:23:19.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 10 monclient: dump: 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.770 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1aba7fc640 4 set_mon_vals no callback set 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc1533b0 con 0x7f1abc08d190 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1aac004290 con 0x7f1abc08d190 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(881..881 src has 621..881) ==== 3979+0+0 (unknown 158204148 0 0) 0x7f1aac04c660 con 0x7f1abc08d190 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.743+0000 7f1abbfff640 10 monclient: get_auth_request con 0x7f1a8c03d4d0 auth_method 0 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.747+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f1abc085ee0 con 0x7f1abc08d190 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.747+0000 7f1ab8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:19.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.747+0000 7f1ab8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:19.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.867+0000 7f1ac2451640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:23:19.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.867+0000 7f1ac2451640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:19.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.867+0000 7f1ac2451640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:19.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.867+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1abc088910 con 0x7f1abc08d190 2026-02-13T18:23:19.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ab8ff9640 1 -- 10.20.193.78:0/1632352832 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1016229341) 0x7f1aac017690 con 0x7f1abc08d190 2026-02-13T18:23:19.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ab8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:19.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ab8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:19.885 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:23:19.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1a8c03d4d0 legacy=0x7f1a8c05d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 10 monclient: shutdown 2026-02-13T18:23:19.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:19.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 >> v1:10.20.193.187:6789/0 conn(0x7f1abc08d190 legacy=0x7f1abc194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 shutdown_connections 2026-02-13T18:23:19.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 >> 10.20.193.78:0/1632352832 conn(0x7f1abc091720 msgr2=0x7f1abc05ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:19.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 shutdown_connections 2026-02-13T18:23:19.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.871+0000 7f1ac2451640 1 -- 10.20.193.78:0/1632352832 wait complete. 2026-02-13T18:23:19.895 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:23:19.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:23:19.895 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient: get_monmap_and_config 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient: build_initial_monmap 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient: monmap: 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:19.948411+0000 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:19.948411+0000 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:19.959 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.960 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:19.960 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:19.960 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:19.960 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 1 Processor -- start 2026-02-13T18:23:19.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 1 -- start start 2026-02-13T18:23:19.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient: init 2026-02-13T18:23:19.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:19.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient(hunting): picked mon.noname-b con 0x7f0e9013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient(hunting): picked mon.noname-c con 0x7f0e9005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient(hunting): picked mon.noname-a con 0x7f0e901853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e90095530 con 0x7f0e901853c0 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e90140390 con 0x7f0e9005e4b0 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9005d230 con 0x7f0e9013f8b0 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.943+0000 7f0e960b0640 10 monclient(hunting): authenticate will time out at 1631.003924s 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8f7fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0e9013f8b0 0x7f0e9013fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42354/0 (socket says 10.20.193.78:42354) 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8f7fe640 1 -- 10.20.193.78:0/638208264 learned_addr learned my addr 10.20.193.78:0/638208264 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:19.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0e901853c0 0x7f0e901a57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:38788/0 (socket says 10.20.193.78:38788) 2026-02-13T18:23:19.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8ffff640 1 -- 10.20.193.78:0/638208264 >> v1:10.20.193.78:6789/0 conn(0x7f0e901853c0 legacy=0x7f0e901a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8f7fe640 1 -- 10.20.193.78:0/638208264 >> v1:10.20.193.78:6790/0 conn(0x7f0e9013f8b0 legacy=0x7f0e9013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8effd640 1 -- 10.20.193.78:0/638208264 >> v1:10.20.193.187:6789/0 conn(0x7f0e9005e4b0 legacy=0x7f0e90183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659581478 0 0) 0x7f0e9005d230 con 0x7f0e9013f8b0 2026-02-13T18:23:19.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): my global_id is 104381 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e74003620 con 0x7f0e9013f8b0 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640428032 0 0) 0x7f0e80002cb0 con 0x7f0e9005e4b0 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient(hunting): my global_id is 134104 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e9005d230 con 0x7f0e9005e4b0 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577500212 0 0) 0x7f0e74003620 con 0x7f0e9013f8b0 2026-02-13T18:23:19.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 >> v1:10.20.193.187:6789/0 conn(0x7f0e9005e4b0 legacy=0x7f0e90183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 >> v1:10.20.193.78:6789/0 conn(0x7f0e901853c0 legacy=0x7f0e901a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 monclient: found mon.noname-b 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9005d510 con 0x7f0e9013f8b0 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 5 monclient: authenticate success, global_id 104381 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e7c003040 con 0x7f0e9013f8b0 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:19.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: dump: 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e7c003310 con 0x7f0e9013f8b0 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 1 -- 10.20.193.78:0/638208264 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e7c0049a0 con 0x7f0e9013f8b0 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e8e7fc640 10 monclient: dump: 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.970 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 4 set_mon_vals no callback set 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 10 monclient: shutdown 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 1 -- 10.20.193.78:0/638208264 >> v1:10.20.193.78:6790/0 conn(0x7f0e9013f8b0 legacy=0x7f0e9013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 1 -- 10.20.193.78:0/638208264 shutdown_connections 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 1 -- 10.20.193.78:0/638208264 >> 10.20.193.78:0/638208264 conn(0x7f0e900545d0 msgr2=0x7f0e900549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 1 -- 10.20.193.78:0/638208264 shutdown_connections 2026-02-13T18:23:19.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 1 -- 10.20.193.78:0/638208264 wait complete. 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 10 monclient: build_initial_monmap 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.947+0000 7f0e960b0640 10 monclient: monmap: 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 Processor -- start 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 -- start start 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: init 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient(hunting): picked mon.noname-b con 0x7f0e9005e4b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient(hunting): picked mon.noname-c con 0x7f0e9013f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient(hunting): picked mon.noname-a con 0x7f0e901853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9010fea0 con 0x7f0e901853c0 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9008ad20 con 0x7f0e9005e4b0 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e90111960 con 0x7f0e9013f8b0 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:19.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient(hunting): authenticate will time out at 1631.008760s 2026-02-13T18:23:19.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8effd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f0e9013f8b0 0x7f0e90180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:42358/0 (socket says 10.20.193.78:42358) 2026-02-13T18:23:19.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f0e901853c0 0x7f0e90181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:38802/0 (socket says 10.20.193.78:38802) 2026-02-13T18:23:19.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8effd640 1 -- 10.20.193.78:0/3035727756 learned_addr learned my addr 10.20.193.78:0/3035727756 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:19.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8ffff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e901853c0 legacy=0x7f0e90181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8effd640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6790/0 conn(0x7f0e9013f8b0 legacy=0x7f0e90180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8f7fe640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.187:6789/0 conn(0x7f0e9005e4b0 legacy=0x7f0e9013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:19.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038729556 0 0) 0x7f0e90111960 con 0x7f0e9013f8b0 2026-02-13T18:23:19.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): my global_id is 104384 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e60003620 con 0x7f0e9013f8b0 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413458445 0 0) 0x7f0e9008ad20 con 0x7f0e9005e4b0 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): my global_id is 134107 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e90111960 con 0x7f0e9005e4b0 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3897136245 0 0) 0x7f0e60003620 con 0x7f0e9013f8b0 2026-02-13T18:23:19.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e9008ad20 con 0x7f0e9013f8b0 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e80003530 con 0x7f0e9013f8b0 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): dump: 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.979 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2175866812 0 0) 0x7f0e90111960 con 0x7f0e9005e4b0 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e60003620 con 0x7f0e9005e4b0 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e7c0034c0 con 0x7f0e9005e4b0 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient(hunting): dump: 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.980 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1895114516 0 0) 0x7f0e9008ad20 con 0x7f0e9013f8b0 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.187:6789/0 conn(0x7f0e9005e4b0 legacy=0x7f0e9013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e901853c0 legacy=0x7f0e90181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 monclient: found mon.c 2026-02-13T18:23:19.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e90111c40 con 0x7f0e9013f8b0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: _finish_auth 0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 5 monclient: authenticate success, global_id 104384 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: _renew_subs 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9013f420 con 0x7f0e9013f8b0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: _renew_subs 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e90110bd0 con 0x7f0e9013f8b0 2026-02-13T18:23:19.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e800039c0 con 0x7f0e9013f8b0 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e80003d20 con 0x7f0e9013f8b0 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e6bfff640 10 monclient: dump: 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:19.983 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.951+0000 7f0e8dffb640 4 set_mon_vals no callback set 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.955+0000 7f0e960b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.955+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e50025d70 con 0x7f0e50004020 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.955+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0e80003ff0 con 0x7f0e9013f8b0 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.955+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(881..881 src has 621..881) ==== 3979+0+0 (unknown 158204148 0 0) 0x7f0e8004c750 con 0x7f0e9013f8b0 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.955+0000 7f0e8ffff640 10 monclient: get_auth_request con 0x7f0e6003d6a0 auth_method 0 2026-02-13T18:23:19.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:19.955+0000 7f0e8f7fe640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e50004020 legacy=0x7f0e500244b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821407577 0 0) 0x7f0e50025d70 con 0x7f0e50004020 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient(hunting): my global_id is 124176 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e9008ad20 con 0x7f0e50004020 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2676225712 0 0) 0x7f0e9008ad20 con 0x7f0e50004020 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e50025d70 con 0x7f0e50004020 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e7c004d10 con 0x7f0e50004020 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient: dump: 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1589640310 0 0) 0x7f0e50025d70 con 0x7f0e50004020 2026-02-13T18:23:20.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e50028200 con 0x7f0e50004020 2026-02-13T18:23:20.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0e7c004f40 con 0x7f0e50004020 2026-02-13T18:23:20.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:20.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e50004020 legacy=0x7f0e500244b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.567+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e50004020 legacy=0x7f0e500244b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:20.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e960b0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:20.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e50027fd0 con 0x7f0e50026150 2026-02-13T18:23:20.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e8f7fe640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e50026150 legacy=0x7f0e500265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036377664 0 0) 0x7f0e60003620 con 0x7f0e50026150 2026-02-13T18:23:20.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient(hunting): my global_id is 124179 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e50025d70 con 0x7f0e50026150 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3566248759 0 0) 0x7f0e50025d70 con 0x7f0e50026150 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e60003620 con 0x7f0e50026150 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0e7c005510 con 0x7f0e50026150 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 10 monclient: dump: 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.589 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 28621293 0 0) 0x7f0e60003620 con 0x7f0e50026150 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.571+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e5002a610 con 0x7f0e50026150 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 1947431069) 0x7f0e7c006880 con 0x7f0e50026150 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e6bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:20.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e6bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e50026150 legacy=0x7f0e500265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e6bfff640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6789/0 conn(0x7f0e50026150 legacy=0x7f0e500265d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:23:20.591 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 62, 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 129114, 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:20.592 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.593 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.594 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:20.595 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:20.596 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.597 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.598 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:20.599 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.600 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.601 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.602 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.603 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.604 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:23:20.605 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.605 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.605 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.605 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:20.605 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:20.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.187:6812/2668687789 conn(0x7f0e6003d6a0 legacy=0x7f0e6005db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 10 monclient: shutdown 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 >> v1:10.20.193.78:6790/0 conn(0x7f0e9013f8b0 legacy=0x7f0e90180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e8ffff640 1 -- 10.20.193.78:0/3035727756 reap_dead start 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e8ffff640 1 -- 10.20.193.78:0/3035727756 reap_dead start 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 shutdown_connections 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 >> 10.20.193.78:0/3035727756 conn(0x7f0e900545d0 msgr2=0x7f0e900965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 shutdown_connections 2026-02-13T18:23:20.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.575+0000 7f0e960b0640 1 -- 10.20.193.78:0/3035727756 wait complete. 2026-02-13T18:23:20.608 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:23:20.608 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:23:20.608 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3874: done (1 left) 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3875: done (0 left) 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3876: copy_from oid 14 from oid 44 current snap is 437 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3877: read oid 30 snap -1 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3877: expect (ObjNum 1241 snap 424 seq_num 1241) 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3878: snap_create 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:3877: expect (ObjNum 1241 snap 424 seq_num 1241) 2026-02-13T18:23:20.610 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1090084 2026-02-13T18:23:20.656 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:20.677 INFO:tasks.rados.rados.0.trial187.stdout:3876: finishing copy_from racing read to trial18717860-14 2026-02-13T18:23:20.677 INFO:tasks.rados.rados.0.trial187.stdout:3876: finishing copy_from to trial18717860-14 2026-02-13T18:23:20.677 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 2525 (ObjNum 1260 snap 433 seq_num 1260) dirty exists 2026-02-13T18:23:20.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient: get_monmap_and_config 2026-02-13T18:23:20.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient: build_initial_monmap 2026-02-13T18:23:20.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient: monmap: 2026-02-13T18:23:20.678 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:20.668427+0000 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:20.668427+0000 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 1 Processor -- start 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 1 -- start start 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient: init 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:20.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient(hunting): picked mon.noname-a con 0x7f7cc8085b00 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient(hunting): picked mon.noname-b con 0x7f7cc8085ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient(hunting): picked mon.noname-c con 0x7f7cc80862a0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc808d4e0 con 0x7f7cc8085b00 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc8054660 con 0x7f7cc80862a0 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc81a8b20 con 0x7f7cc8085ed0 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cd050b640 10 monclient(hunting): authenticate will time out at 1631.723880s 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7ccda7f640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f7cc8085ed0 0x7f7cc8183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39638/0 (socket says 10.20.193.78:39638) 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7ccda7f640 1 -- 10.20.193.78:0/258189821 learned_addr learned my addr 10.20.193.78:0/258189821 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:20.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.663+0000 7f7cce280640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7cc8085b00 0x7f7cc808e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:34876/0 (socket says 10.20.193.78:34876) 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccda7f640 1 -- 10.20.193.78:0/258189821 >> v1:10.20.193.78:6790/0 conn(0x7f7cc8085ed0 legacy=0x7f7cc8183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cce280640 1 -- 10.20.193.78:0/258189821 >> v1:10.20.193.78:6789/0 conn(0x7f7cc8085b00 legacy=0x7f7cc808e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328114050 0 0) 0x7f7cc81a8b20 con 0x7f7cc8085ed0 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): my global_id is 104387 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb0003620 con 0x7f7cc8085ed0 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727563597 0 0) 0x7f7cc808d4e0 con 0x7f7cc8085b00 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient(hunting): my global_id is 124182 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc81a8b20 con 0x7f7cc8085b00 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccea81640 1 -- 10.20.193.78:0/258189821 >> v1:10.20.193.187:6789/0 conn(0x7f7cc80862a0 legacy=0x7f7cc81a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3969737463 0 0) 0x7f7cb0003620 con 0x7f7cc8085ed0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 >> v1:10.20.193.187:6789/0 conn(0x7f7cc80862a0 legacy=0x7f7cc81a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 >> v1:10.20.193.78:6789/0 conn(0x7f7cc8085b00 legacy=0x7f7cc808e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: _finish_hunting 0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 monclient: found mon.noname-b 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc81a9d00 con 0x7f7cc8085ed0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: _finish_auth 0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: _check_auth_tickets 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cbc003110 con 0x7f7cc8085ed0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: dump: 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 5 monclient: authenticate success, global_id 104387 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cbc0033e0 con 0x7f7cc8085ed0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 1 -- 10.20.193.78:0/258189821 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cbc004b50 con 0x7f7cc8085ed0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7ccd27e640 10 monclient: dump: 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.683 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 4 set_mon_vals no callback set 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 10 monclient: shutdown 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 1 -- 10.20.193.78:0/258189821 >> v1:10.20.193.78:6790/0 conn(0x7f7cc8085ed0 legacy=0x7f7cc8183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 1 -- 10.20.193.78:0/258189821 shutdown_connections 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 1 -- 10.20.193.78:0/258189821 >> 10.20.193.78:0/258189821 conn(0x7f7cc8056aa0 msgr2=0x7f7cc80928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 1 -- 10.20.193.78:0/258189821 shutdown_connections 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 1 -- 10.20.193.78:0/258189821 wait complete. 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 10 monclient: build_initial_monmap 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.667+0000 7f7cd050b640 10 monclient: monmap: 2026-02-13T18:23:20.684 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 1 Processor -- start 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 1 -- start start 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient: init 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient(hunting): picked mon.noname-a con 0x7f7cc8085b00 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient(hunting): picked mon.noname-b con 0x7f7cc8085ed0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient(hunting): picked mon.noname-c con 0x7f7cc80862a0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc807f520 con 0x7f7cc8085b00 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc807e390 con 0x7f7cc8085ed0 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc807d1c0 con 0x7f7cc80862a0 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cd050b640 10 monclient(hunting): authenticate will time out at 1631.728603s 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cce280640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f7cc8085b00 0x7f7cc8082a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:34886/0 (socket says 10.20.193.78:34886) 2026-02-13T18:23:20.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cce280640 1 -- 10.20.193.78:0/2327303322 learned_addr learned my addr 10.20.193.78:0/2327303322 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:20.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7cce280640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6789/0 conn(0x7f7cc8085b00 legacy=0x7f7cc8082a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7ccea81640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc80862a0 legacy=0x7f7cc823ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418178484 0 0) 0x7f7cc807d1c0 con 0x7f7cc80862a0 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): my global_id is 104390 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c98003620 con 0x7f7cc80862a0 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987674531 0 0) 0x7f7cc807f520 con 0x7f7cc8085b00 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 10 monclient(hunting): my global_id is 124185 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc807d1c0 con 0x7f7cc8085b00 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:23:20.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.671+0000 7f7ccda7f640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.187:6789/0 conn(0x7f7cc8085ed0 legacy=0x7f7cc821b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 111736604 0 0) 0x7f7c98003620 con 0x7f7cc80862a0 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cc807f520 con 0x7f7cc80862a0 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1952835154 0 0) 0x7f7cc807d1c0 con 0x7f7cc8085b00 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c98003620 con 0x7f7cc8085b00 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246880127 0 0) 0x7f7cc807e390 con 0x7f7cc8085ed0 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): my global_id is 134113 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc807d1c0 con 0x7f7cc8085ed0 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cc4004890 con 0x7f7cc80862a0 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): dump: 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.689 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cb8003440 con 0x7f7cc8085b00 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient(hunting): dump: 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3589053584 0 0) 0x7f7cc807f520 con 0x7f7cc80862a0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.187:6789/0 conn(0x7f7cc8085ed0 legacy=0x7f7cc821b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6789/0 conn(0x7f7cc8085b00 legacy=0x7f7cc8082a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 monclient: found mon.c 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc807ec80 con 0x7f7cc80862a0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 5 monclient: authenticate success, global_id 104390 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 10 monclient: _renew_subs 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc807dd20 con 0x7f7cc80862a0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 10 monclient: _renew_subs 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cc8083350 con 0x7f7cc80862a0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc4004ed0 con 0x7f7cc80862a0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cc40052e0 con 0x7f7cc80862a0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 10 monclient: dump: 2026-02-13T18:23:20.690 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7ccca7d640 4 set_mon_vals no callback set 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f7cc4005500 con 0x7f7cc80862a0 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7cc80008e0 con 0x7f7cc80907d0 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(882..882 src has 621..882) ==== 4007+0+0 (unknown 4186777172 0 0) 0x7f7cc404db60 con 0x7f7cc80862a0 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.675+0000 7f7ccda7f640 10 monclient: get_auth_request con 0x7f7c9803d850 auth_method 0 2026-02-13T18:23:20.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7cce280640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc80907d0 legacy=0x7f7cc80867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142465311 0 0) 0x7f7cc80008e0 con 0x7f7cc80907d0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient(hunting): my global_id is 104393 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc807f520 con 0x7f7cc80907d0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2938730065 0 0) 0x7f7cc807f520 con 0x7f7cc80907d0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cc80008e0 con 0x7f7cc80907d0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cb8004cb0 con 0x7f7cc80907d0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient: dump: 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2096020875 0 0) 0x7f7cc80008e0 con 0x7f7cc80907d0 2026-02-13T18:23:20.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cc807f1a0 con 0x7f7cc80907d0 2026-02-13T18:23:20.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7cb8005910 con 0x7f7cc80907d0 2026-02-13T18:23:20.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:20.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc80907d0 legacy=0x7f7cc80867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.679+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc80907d0 legacy=0x7f7cc80867f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:20.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:20.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7cc807eec0 con 0x7f7cc81a8f40 2026-02-13T18:23:20.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cce280640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc81a8f40 legacy=0x7f7cc8086f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414183164 0 0) 0x7f7cc807eec0 con 0x7f7cc81a8f40 2026-02-13T18:23:20.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient(hunting): my global_id is 104396 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc80008e0 con 0x7f7cc81a8f40 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 761022741 0 0) 0x7f7cc80008e0 con 0x7f7cc81a8f40 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cc807eec0 con 0x7f7cc81a8f40 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7cb8005420 con 0x7f7cc81a8f40 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient: dump: 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3655660685 0 0) 0x7f7cc807eec0 con 0x7f7cc81a8f40 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7cc8087610 con 0x7f7cc81a8f40 2026-02-13T18:23:20.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 1546850981) 0x7f7cb8005b60 con 0x7f7cc81a8f40 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc81a8f40 legacy=0x7f7cc8086f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7caeffd640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc81a8f40 legacy=0x7f7cc8086f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 62, 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 345184, 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.700 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:20.701 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.702 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:20.703 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:20.704 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:20.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.187:6812/2668687789 conn(0x7f7c9803d850 legacy=0x7f7c9805dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 10 monclient: shutdown 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 >> v1:10.20.193.78:6790/0 conn(0x7f7cc80862a0 legacy=0x7f7cc823ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7ccea81640 1 -- 10.20.193.78:0/2327303322 reap_dead start 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7ccea81640 1 -- 10.20.193.78:0/2327303322 reap_dead start 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 shutdown_connections 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 >> 10.20.193.78:0/2327303322 conn(0x7f7cc8056aa0 msgr2=0x7f7cc808a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 shutdown_connections 2026-02-13T18:23:20.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.683+0000 7f7cd050b640 1 -- 10.20.193.78:0/2327303322 wait complete. 2026-02-13T18:23:20.707 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:23:20.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:23:20.707 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient: get_monmap_and_config 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient: build_initial_monmap 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient: monmap: 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:20.767842+0000 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:20.767842+0000 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.778 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:20.779 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:20.779 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:20.779 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 1 Processor -- start 2026-02-13T18:23:20.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 1 -- start start 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient: init 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient(hunting): picked mon.noname-b con 0x7fc7f008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient(hunting): picked mon.noname-c con 0x7fc7f008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient(hunting): picked mon.noname-a con 0x7fc7f008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f0089e80 con 0x7fc7f008cdd0 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f0088c20 con 0x7fc7f008dc80 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f0089ba0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7f4bac640 10 monclient(hunting): authenticate will time out at 1631.822989s 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7ee575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fc7f008c2f0 0x7fc7f008c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39678/0 (socket says 10.20.193.78:39678) 2026-02-13T18:23:20.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.763+0000 7fc7ee575640 1 -- 10.20.193.78:0/1927269243 learned_addr learned my addr 10.20.193.78:0/1927269243 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ee575640 1 -- 10.20.193.78:0/1927269243 >> v1:10.20.193.78:6790/0 conn(0x7fc7f008c2f0 legacy=0x7fc7f008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7eed76640 1 -- 10.20.193.78:0/1927269243 >> v1:10.20.193.78:6789/0 conn(0x7fc7f008cdd0 legacy=0x7fc7f01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7edd74640 1 -- 10.20.193.78:0/1927269243 >> v1:10.20.193.187:6789/0 conn(0x7fc7f008dc80 legacy=0x7fc7f0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583168675 0 0) 0x7fc7f0089ba0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient(hunting): my global_id is 104399 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7dc003620 con 0x7fc7f008c2f0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4165065064 0 0) 0x7fc7dc003620 con 0x7fc7f008c2f0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 >> v1:10.20.193.187:6789/0 conn(0x7fc7f008dc80 legacy=0x7fc7f0181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 >> v1:10.20.193.78:6789/0 conn(0x7fc7f008cdd0 legacy=0x7fc7f01a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: _finish_hunting 0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 monclient: found mon.noname-b 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f008d370 con 0x7fc7f008c2f0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: _finish_auth 0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: _check_auth_tickets 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7e4003190 con 0x7fc7f008c2f0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: dump: 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 5 monclient: authenticate success, global_id 104399 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7e4003420 con 0x7fc7f008c2f0 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 1 -- 10.20.193.78:0/1927269243 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7e4004b50 con 0x7fc7f008c2f0 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ed573640 10 monclient: dump: 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 4 set_mon_vals no callback set 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: shutdown 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- 10.20.193.78:0/1927269243 >> v1:10.20.193.78:6790/0 conn(0x7fc7f008c2f0 legacy=0x7fc7f008c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- 10.20.193.78:0/1927269243 shutdown_connections 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- 10.20.193.78:0/1927269243 >> 10.20.193.78:0/1927269243 conn(0x7fc7f0091720 msgr2=0x7fc7f0091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- 10.20.193.78:0/1927269243 shutdown_connections 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- 10.20.193.78:0/1927269243 wait complete. 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: build_initial_monmap 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: monmap: 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:20.786 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 Processor -- start 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- start start 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: init 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient(hunting): picked mon.noname-c con 0x7fc7f008c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient(hunting): picked mon.noname-a con 0x7fc7f008cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient(hunting): picked mon.noname-b con 0x7fc7f008dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f005d660 con 0x7fc7f008cdd0 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f00821e0 con 0x7fc7f008dc80 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f00579a0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7f4bac640 10 monclient(hunting): authenticate will time out at 1631.827505s 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ee575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fc7f008c2f0 0x7fc7f01530e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39688/0 (socket says 10.20.193.78:39688) 2026-02-13T18:23:20.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.767+0000 7fc7ee575640 1 -- 10.20.193.78:0/3745750387 learned_addr learned my addr 10.20.193.78:0/3745750387 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:20.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7ee575640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.78:6790/0 conn(0x7fc7f008c2f0 legacy=0x7fc7f01530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7edd74640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.78:6789/0 conn(0x7fc7f008cdd0 legacy=0x7fc7f00839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413493595 0 0) 0x7fc7f00579a0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): my global_id is 104402 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7bc003620 con 0x7fc7f008c2f0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3883773513 0 0) 0x7fc7bc003620 con 0x7fc7f008c2f0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7eed76640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f008dc80 legacy=0x7fc7f0195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7f00579a0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7e4003190 con 0x7fc7f008c2f0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): dump: 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2615758869 0 0) 0x7fc7f00579a0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f008dc80 legacy=0x7fc7f0195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.78:6789/0 conn(0x7fc7f008cdd0 legacy=0x7fc7f00839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 monclient: found mon.c 2026-02-13T18:23:20.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0087200 con 0x7fc7f008c2f0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 5 monclient: authenticate success, global_id 104402 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 10 monclient: _renew_subs 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f0084100 con 0x7fc7f008c2f0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 10 monclient: _renew_subs 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7f0196d40 con 0x7fc7f008c2f0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7e4003420 con 0x7fc7f008c2f0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7e4005320 con 0x7fc7f008c2f0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 10 monclient: dump: 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7ecd72640 4 set_mon_vals no callback set 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fc7e40119b0 con 0x7fc7f008c2f0 2026-02-13T18:23:20.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7f00876d0 con 0x7fc7f005adb0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(882..882 src has 621..882) ==== 4007+0+0 (unknown 4186777172 0 0) 0x7fc7e404c850 con 0x7fc7f008c2f0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.771+0000 7fc7eed76640 10 monclient: get_auth_request con 0x7fc7bc03d450 auth_method 0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7edd74640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f005adb0 legacy=0x7fc7f004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432944766 0 0) 0x7fc7f00876d0 con 0x7fc7f005adb0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient(hunting): my global_id is 134122 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7f00579a0 con 0x7fc7f005adb0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3207821901 0 0) 0x7fc7f00579a0 con 0x7fc7f005adb0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7f00876d0 con 0x7fc7f005adb0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7d80031a0 con 0x7fc7f005adb0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.791 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient: dump: 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1786956699 0 0) 0x7fc7f00876d0 con 0x7fc7f005adb0 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7f0088910 con 0x7fc7f005adb0 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc7d80058c0 con 0x7fc7f005adb0 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f005adb0 legacy=0x7fc7f004d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.775+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f005adb0 legacy=0x7fc7f004d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:20.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.779+0000 7fc7f4bac640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:20.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.779+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7f008f620 con 0x7fc7f005b180 2026-02-13T18:23:20.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.779+0000 7fc7edd74640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f005b180 legacy=0x7fc7f0198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137914970 0 0) 0x7fc7f0088c20 con 0x7fc7f005b180 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient(hunting): my global_id is 134125 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7f00876d0 con 0x7fc7f005b180 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2106229628 0 0) 0x7fc7f00876d0 con 0x7fc7f005b180 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7f0088c20 con 0x7fc7f005b180 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc7d80038c0 con 0x7fc7f005b180 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:20.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient: dump: 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3698661263 0 0) 0x7fc7f0088c20 con 0x7fc7f005b180 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc7f0090810 con 0x7fc7f005b180 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 2939947942) 0x7fc7d8005b40 con 0x7fc7f005b180 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f005b180 legacy=0x7fc7f0198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7d6ffd640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6789/0 conn(0x7fc7f005b180 legacy=0x7fc7f0198090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:20.797 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 62, 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 16072, 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 1, 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:20.798 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:20.799 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:20.800 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:20.801 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:20.802 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc7bc03d450 legacy=0x7fc7bc05d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 10 monclient: shutdown 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 >> v1:10.20.193.78:6790/0 conn(0x7fc7f008c2f0 legacy=0x7fc7f01530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7eed76640 1 -- 10.20.193.78:0/3745750387 reap_dead start 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7eed76640 1 -- 10.20.193.78:0/3745750387 reap_dead start 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 shutdown_connections 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 >> 10.20.193.78:0/3745750387 conn(0x7fc7f0091720 msgr2=0x7fc7f005dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 shutdown_connections 2026-02-13T18:23:20.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.783+0000 7fc7f4bac640 1 -- 10.20.193.78:0/3745750387 wait complete. 2026-02-13T18:23:20.805 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:23:20.805 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:23:20.805 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient: get_monmap_and_config 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient: build_initial_monmap 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient: monmap: 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:20.856339+0000 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:20.856339+0000 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:20.868 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 1 Processor -- start 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 1 -- start start 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient: init 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient(hunting): picked mon.noname-a con 0x7f4e0808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient(hunting): picked mon.noname-c con 0x7f4e0808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient(hunting): picked mon.noname-b con 0x7f4e0808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08089e80 con 0x7f4e0808c2f0 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08088c20 con 0x7f4e0808dc80 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08089ba0 con 0x7f4e0808cdd0 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e0d55c640 10 monclient(hunting): authenticate will time out at 1631.911482s 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e06ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f4e0808c2f0 0x7f4e0808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:34922/0 (socket says 10.20.193.78:34922) 2026-02-13T18:23:20.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.851+0000 7f4e06ffd640 1 -- 10.20.193.78:0/3603565794 learned_addr learned my addr 10.20.193.78:0/3603565794 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:20.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e077fe640 1 -- 10.20.193.78:0/3603565794 >> v1:10.20.193.78:6790/0 conn(0x7f4e0808cdd0 legacy=0x7f4e081a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e06ffd640 1 -- 10.20.193.78:0/3603565794 >> v1:10.20.193.78:6789/0 conn(0x7f4e0808c2f0 legacy=0x7f4e0808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841531346 0 0) 0x7f4e08089ba0 con 0x7f4e0808cdd0 2026-02-13T18:23:20.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): my global_id is 104405 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e067fc640 1 -- 10.20.193.78:0/3603565794 >> v1:10.20.193.187:6789/0 conn(0x7f4e0808dc80 legacy=0x7f4e08181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df4003620 con 0x7f4e0808cdd0 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486240254 0 0) 0x7f4e08089e80 con 0x7f4e0808c2f0 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient(hunting): my global_id is 124188 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e08089ba0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3435917771 0 0) 0x7f4df4003620 con 0x7f4e0808cdd0 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 >> v1:10.20.193.187:6789/0 conn(0x7f4e0808dc80 legacy=0x7f4e08181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 >> v1:10.20.193.78:6789/0 conn(0x7f4e0808c2f0 legacy=0x7f4e0808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 monclient: found mon.noname-b 2026-02-13T18:23:20.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0808d370 con 0x7f4e0808cdd0 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: _finish_auth 0 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4df8004670 con 0x7f4e0808cdd0 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: dump: 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.873 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 5 monclient: authenticate success, global_id 104405 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4df8004940 con 0x7f4e0808cdd0 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 1 -- 10.20.193.78:0/3603565794 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4df8004dd0 con 0x7f4e0808cdd0 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e05ffb640 10 monclient: dump: 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.874 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 4 set_mon_vals no callback set 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 10 monclient: shutdown 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 -- 10.20.193.78:0/3603565794 >> v1:10.20.193.78:6790/0 conn(0x7f4e0808cdd0 legacy=0x7f4e081a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 -- 10.20.193.78:0/3603565794 shutdown_connections 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 -- 10.20.193.78:0/3603565794 >> 10.20.193.78:0/3603565794 conn(0x7f4e08091720 msgr2=0x7f4e08091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 -- 10.20.193.78:0/3603565794 shutdown_connections 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 -- 10.20.193.78:0/3603565794 wait complete. 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 10 monclient: build_initial_monmap 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 10 monclient: monmap: 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:20.875 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 Processor -- start 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 1 -- start start 2026-02-13T18:23:20.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.855+0000 7f4e0d55c640 10 monclient: init 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient(hunting): picked mon.noname-c con 0x7f4e0808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient(hunting): picked mon.noname-a con 0x7f4e0808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient(hunting): picked mon.noname-b con 0x7f4e0808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e080800e0 con 0x7f4e0808cdd0 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08085af0 con 0x7f4e0808dc80 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08088910 con 0x7f4e0808c2f0 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e0d55c640 10 monclient(hunting): authenticate will time out at 1631.916136s 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e06ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f4e0808c2f0 0x7f4e08153100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39706/0 (socket says 10.20.193.78:39706) 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e06ffd640 1 -- 10.20.193.78:0/1057186674 learned_addr learned my addr 10.20.193.78:0/1057186674 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e06ffd640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.78:6790/0 conn(0x7f4e0808c2f0 legacy=0x7f4e08153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e067fc640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.78:6789/0 conn(0x7f4e0808cdd0 legacy=0x7f4e08083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2371390193 0 0) 0x7f4e08088910 con 0x7f4e0808c2f0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): my global_id is 104408 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd4003620 con 0x7f4e0808c2f0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507514428 0 0) 0x7f4e080800e0 con 0x7f4e0808cdd0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): _negotiate 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 10 monclient(hunting): my global_id is 124191 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e08088910 con 0x7f4e0808cdd0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4e077fe640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.187:6789/0 conn(0x7f4e0808dc80 legacy=0x7f4e08195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.859+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3702789500 0 0) 0x7f4dd4003620 con 0x7f4e0808c2f0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e080800e0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1675225962 0 0) 0x7f4e08088910 con 0x7f4e0808cdd0 2026-02-13T18:23:20.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4dd4003620 con 0x7f4e0808cdd0 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4dfc003360 con 0x7f4e0808c2f0 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): dump: 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4df0003380 con 0x7f4e0808cdd0 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:20.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient(hunting): dump: 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4269375974 0 0) 0x7f4e080800e0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.187:6789/0 conn(0x7f4e0808dc80 legacy=0x7f4e08195470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.78:6789/0 conn(0x7f4e0808cdd0 legacy=0x7f4e08083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: _finish_hunting 0 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 monclient: found mon.c 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e08082440 con 0x7f4e0808c2f0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: _finish_auth 0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: _check_auth_tickets 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 5 monclient: authenticate success, global_id 104408 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 monclient: _renew_subs 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e08081ba0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 monclient: _renew_subs 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e08084080 con 0x7f4e0808c2f0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dfc004b90 con 0x7f4e0808c2f0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4dfc004f20 con 0x7f4e0808c2f0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 10 monclient: dump: 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:20.883 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e057fa640 4 set_mon_vals no callback set 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0808f5e0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4dfc0051f0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(882..882 src has 621..882) ==== 4007+0+0 (unknown 4186777172 0 0) 0x7f4dfc04c7f0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.863+0000 7f4e067fc640 10 monclient: get_auth_request con 0x7f4dd403d790 auth_method 0 2026-02-13T18:23:20.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.867+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f4dfc0176e0 con 0x7f4e0808c2f0 2026-02-13T18:23:20.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.867+0000 7f4de77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:20.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.867+0000 7f4de77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:21.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:23:21.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:23:21.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:21.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4e08090810 con 0x7f4e0808c2f0 2026-02-13T18:23:21.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4de77fe640 1 -- 10.20.193.78:0/1057186674 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f4dfc01ca00 con 0x7f4e0808c2f0 2026-02-13T18:23:21.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4de77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:23:21.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4de77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:21.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.187:6812/2668687789 conn(0x7f4dd403d790 legacy=0x7f4dd405dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 10 monclient: shutdown 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 >> v1:10.20.193.78:6790/0 conn(0x7f4e0808c2f0 legacy=0x7f4e08153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 shutdown_connections 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 >> 10.20.193.78:0/1057186674 conn(0x7f4e08091720 msgr2=0x7f4e0805b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 shutdown_connections 2026-02-13T18:23:21.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:20.987+0000 7f4e0d55c640 1 -- 10.20.193.78:0/1057186674 wait complete. 2026-02-13T18:23:21.012 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:23:21.572 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.572 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=13,kv=11,logm=53} crc {auth=1651972599,config=1618278320,health=3664264050,kv=4087868365,logm=1573758619}) 2026-02-13T18:23:21.572 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=12,kv=11,logm=53} crc {auth=2336033581,config=1618278320,health=812255667,kv=1432210264,logm=2969265927}) 2026-02-13T18:23:21.572 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.572 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=13,kv=11,logm=53} crc {auth=1651972599,config=1618278320,health=3664264050,kv=4087868365,logm=1573758619}) 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=22,config=2,health=13,kv=10,logm=53} crc {auth=2775222593,config=1618278320,health=3664264050,kv=1881317687,logm=4119686917}) 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2534529016}) 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545449234}) 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2534529016}) 2026-02-13T18:23:21.573 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2488972442}) 2026-02-13T18:23:21.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=775034236}) 2026-02-13T18:23:21.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=941768981}) 2026-02-13T18:23:21.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=775034236}) 2026-02-13T18:23:21.574 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3151571603}) 2026-02-13T18:23:21.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2814568772}) 2026-02-13T18:23:21.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305842262}) 2026-02-13T18:23:21.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2814568772}) 2026-02-13T18:23:21.575 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.559+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3060302736}) 2026-02-13T18:23:21.576 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.576 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3826705101}) 2026-02-13T18:23:21.576 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1299305402}) 2026-02-13T18:23:21.576 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.576 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3826705101}) 2026-02-13T18:23:21.576 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=485337922}) 2026-02-13T18:23:21.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1567384699}) 2026-02-13T18:23:21.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1233792374}) 2026-02-13T18:23:21.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.578 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1567384699}) 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=961110164}) 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1981584687}) 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=625512046}) 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1981584687}) 2026-02-13T18:23:21.579 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2071168284}) 2026-02-13T18:23:21.580 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2116614930}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3062895614}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2116614930}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=904827952}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2331638560}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3391233692}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2331638560}) 2026-02-13T18:23:21.581 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.563+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4017383789}) 2026-02-13T18:23:21.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.575+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.575+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3448625967}) 2026-02-13T18:23:21.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.575+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2864353295}) 2026-02-13T18:23:21.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.575+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.575+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3448625967}) 2026-02-13T18:23:21.591 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.575+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4140778340}) 2026-02-13T18:23:21.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1070253807}) 2026-02-13T18:23:21.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1377507608}) 2026-02-13T18:23:21.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1070253807}) 2026-02-13T18:23:21.593 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=219666712}) 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3876: done (2 left) 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3877: done (1 left) 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3878: done (0 left) 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3879: read oid 19 snap -1 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3879: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3880: write (excl) oid 38 current snap is 438 2026-02-13T18:23:21.595 INFO:tasks.rados.rados.0.trial187.stdout:3880: seq_num 1275 ranges {628925=573426,1693365=714102,3096904=332021} 2026-02-13T18:23:21.599 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193619577}) 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3467998458}) 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193619577}) 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3975011837}) 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1504874082}) 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799526402}) 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.600 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1504874082}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1550481653}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1141665162}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1296742050}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1141665162}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2539647055}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1017414237}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434816991}) 2026-02-13T18:23:21.601 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1017414237}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.579+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2134169224}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2119082921}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3457476677}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2119082921}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3545187208}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=409883006}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1328965815}) 2026-02-13T18:23:21.602 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=409883006}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2257686089}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1840267513}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=513802273}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1840267513}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1033973094}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=621891093}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693781776}) 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.603 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=621891093}) 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2338299873}) 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2997068732}) 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3209328843}) 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2997068732}) 2026-02-13T18:23:21.604 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.583+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1081382361}) 2026-02-13T18:23:21.605 INFO:tasks.rados.rados.0.trial187.stdout:3880: writing trial18717860-38 from 628925 to 1202351 tid 1 2026-02-13T18:23:21.610 INFO:tasks.rados.rados.0.trial187.stdout:3880: writing trial18717860-38 from 1693365 to 2407467 tid 2 2026-02-13T18:23:21.617 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2166924125}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3603500435}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2166924125}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3359195566}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2346054999}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088275738}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2346054999}) 2026-02-13T18:23:21.618 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3148406849}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2792225914}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600448018}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2792225914}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2263557041}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3919792769}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546185876}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3919792769}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4203498692}) 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.619 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1879901488}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=340896950}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1879901488}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.587+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=402787458}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2851802375}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1697022467}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2851802375}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=761024680}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2415411498}) 2026-02-13T18:23:21.620 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2236963965}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2415411498}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=175893134}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1952184757}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1433187796}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1952184757}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=408988939}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1601845987}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3820914569}) 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.621 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1601845987}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3203062120}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1204775958}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2281186131}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1204775958}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1164694530}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1822719207}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046652861}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1822719207}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.591+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3634587846}) 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.622 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3370255861}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2810402382}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3370255861}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=708535056}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=433592046}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1509270724}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=433592046}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1979532556}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1955200852}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059290768}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1955200852}) 2026-02-13T18:23:21.623 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4262072222}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2773521982}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=582021195}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2773521982}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=179937608}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=744105192}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4034170888}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=744105192}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.595+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3342997305}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1989851887}) 2026-02-13T18:23:21.624 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1432085973}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1989851887}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2983449362}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1825347716}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2994347346}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1825347716}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3828583184}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=494930882}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100544641}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=494930882}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3732082994}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2352981589}) 2026-02-13T18:23:21.625 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2369337729}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2352981589}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2372555529}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=10,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=47} crc {logm=3032621884,mdsmap=1435686815,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=507655583,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707893,osd_metadata=1061172747,osd_pg_creating=973796451,osd_snap=3114970029}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=44} crc {logm=3227934087,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=507655583,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=973796451,osd_snap=1749090145}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=10,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=47} crc {logm=3032621884,mdsmap=1435686815,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=507655583,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707893,osd_metadata=1061172747,osd_pg_creating=973796451,osd_snap=3114970029}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.599+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=2,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=49} crc {logm=3227934087,mdsmap=685858242,mgr=174722761,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=507655583,mon_config_key=2737823772,monmap=2557257461,nvmeofgw=3360707892,osd_metadata=3492138135,osd_pg_creating=973796451,osd_snap=2299397523}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=3841663819}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=476677614}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=3841663819}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=2570342043}) 2026-02-13T18:23:21.626 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.627 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=25,osdmap=75} crc {osd_snap=428773324,osdmap=877817932}) 2026-02-13T18:23:21.627 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=26,osdmap=74} crc {osd_snap=3795047294,osdmap=3964204947}) 2026-02-13T18:23:21.627 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.627 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=25,osdmap=75} crc {osd_snap=428773324,osdmap=877817932}) 2026-02-13T18:23:21.627 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=22,osdmap=78} crc {osd_snap=988671621,osdmap=732101193}) 2026-02-13T18:23:21.628 INFO:tasks.rados.rados.0.trial187.stdout:3880: writing trial18717860-38 from 3096904 to 3428925 tid 3 2026-02-13T18:23:21.628 INFO:tasks.rados.rados.0.trial187.stdout:3881: snap_create 2026-02-13T18:23:21.628 INFO:tasks.rados.rados.0.trial187.stdout:3879: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3559134092}) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3677460896}) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3559134092}) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3401702902}) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4070967563}) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1181800069}) 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.629 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4070967563}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.603+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2236273962}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=218369473}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3494076453}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=218369473}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2646960152}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=23} crc {osdmap=498681917}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=23} crc {osdmap=2372938670}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=23} crc {osdmap=498681917}) 2026-02-13T18:23:21.630 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:23:21.607+0000 7f8e7f808640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=23} crc {osdmap=2223127493}) 2026-02-13T18:23:21.644 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:21.671 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: finishing write tid 1 to trial18717860-38 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: finishing write tid 2 to trial18717860-38 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: finishing write tid 3 to trial18717860-38 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: finishing write tid 4 to trial18717860-38 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: finishing write tid 5 to trial18717860-38 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: oid 38 updating version 0 to 1854 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: oid 38 updating version 1854 to 1855 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: oid 38 updating version 1855 to 1856 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:3880: oid 38 version 1856 is already newer than 1853 2026-02-13T18:23:21.699 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 38 v 1856 (ObjNum 1275 snap 438 seq_num 1275) dirty exists 2026-02-13T18:23:21.700 INFO:tasks.rados.rados.0.trial187.stdout:3880: left oid 38 (ObjNum 1275 snap 438 seq_num 1275) 2026-02-13T18:23:22.013 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:23:22.013 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:23:22.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient: get_monmap_and_config 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient: monmap: 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:22.063626+0000 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:22.063626+0000 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:22.076 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 1 Processor -- start 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 1 -- start start 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient: init 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient(hunting): picked mon.noname-c con 0x7f856408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient(hunting): picked mon.noname-b con 0x7f856408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient(hunting): picked mon.noname-a con 0x7f856408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564089e80 con 0x7f856408cdd0 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564088c20 con 0x7f856408c2f0 2026-02-13T18:23:22.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564089ba0 con 0x7f856408dc80 2026-02-13T18:23:22.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8569d00640 10 monclient(hunting): authenticate will time out at 1633.118806s 2026-02-13T18:23:22.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8562ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f856408dc80 0x7f8564181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39712/0 (socket says 10.20.193.78:39712) 2026-02-13T18:23:22.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.059+0000 7f8562ffd640 1 -- 10.20.193.78:0/1364125801 learned_addr learned my addr 10.20.193.78:0/1364125801 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8563fff640 1 -- 10.20.193.78:0/1364125801 >> v1:10.20.193.78:6789/0 conn(0x7f856408cdd0 legacy=0x7f85641a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8562ffd640 1 -- 10.20.193.78:0/1364125801 >> v1:10.20.193.78:6790/0 conn(0x7f856408dc80 legacy=0x7f8564181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542940269 0 0) 0x7f8564089e80 con 0x7f856408cdd0 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): my global_id is 124194 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8548003620 con 0x7f856408cdd0 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85637fe640 1 -- 10.20.193.78:0/1364125801 >> v1:10.20.193.187:6789/0 conn(0x7f856408c2f0 legacy=0x7f856408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129802832 0 0) 0x7f8564089ba0 con 0x7f856408dc80 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient(hunting): my global_id is 104411 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8564089e80 con 0x7f856408dc80 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3836785908 0 0) 0x7f8548003620 con 0x7f856408cdd0 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 >> v1:10.20.193.78:6790/0 conn(0x7f856408dc80 legacy=0x7f8564181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 >> v1:10.20.193.187:6789/0 conn(0x7f856408c2f0 legacy=0x7f856408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 monclient: found mon.noname-a 2026-02-13T18:23:22.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856408d370 con 0x7f856408cdd0 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 5 monclient: authenticate success, global_id 124194 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85580046f0 con 0x7f856408cdd0 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: dump: 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.087 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8558004980 con 0x7f856408cdd0 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 1 -- 10.20.193.78:0/1364125801 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8558004dd0 con 0x7f856408cdd0 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f85627fc640 10 monclient: dump: 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.089 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 4 set_mon_vals no callback set 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: shutdown 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- 10.20.193.78:0/1364125801 >> v1:10.20.193.78:6789/0 conn(0x7f856408cdd0 legacy=0x7f85641a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- 10.20.193.78:0/1364125801 shutdown_connections 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- 10.20.193.78:0/1364125801 >> 10.20.193.78:0/1364125801 conn(0x7f8564091720 msgr2=0x7f8564091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- 10.20.193.78:0/1364125801 shutdown_connections 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- 10.20.193.78:0/1364125801 wait complete. 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: monmap: 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 Processor -- start 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- start start 2026-02-13T18:23:22.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: init 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient(hunting): picked mon.noname-b con 0x7f856408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient(hunting): picked mon.noname-c con 0x7f856408cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient(hunting): picked mon.noname-a con 0x7f856408dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564088910 con 0x7f856408dc80 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564080330 con 0x7f856408c2f0 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564080610 con 0x7f856408cdd0 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8569d00640 10 monclient(hunting): authenticate will time out at 1633.123310s 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8562ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f856408cdd0 0x7f856407cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39720/0 (socket says 10.20.193.78:39720) 2026-02-13T18:23:22.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.063+0000 7f8562ffd640 1 -- 10.20.193.78:0/3390264390 learned_addr learned my addr 10.20.193.78:0/3390264390 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8562ffd640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.78:6790/0 conn(0x7f856408cdd0 legacy=0x7f856407cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8563fff640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.78:6789/0 conn(0x7f856408dc80 legacy=0x7f85641935c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984021650 0 0) 0x7f856408d370 con 0x7f856408dc80 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): my global_id is 124197 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8534003620 con 0x7f856408dc80 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774376038 0 0) 0x7f8564080610 con 0x7f856408cdd0 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): my global_id is 104414 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f85637fe640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.187:6789/0 conn(0x7f856408c2f0 legacy=0x7f856407c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f856408d370 con 0x7f856408cdd0 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4175568867 0 0) 0x7f8534003620 con 0x7f856408dc80 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8564080610 con 0x7f856408dc80 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8558004dd0 con 0x7f856408dc80 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): dump: 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.094 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921941809 0 0) 0x7f8564080330 con 0x7f856408c2f0 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): my global_id is 134131 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8534003620 con 0x7f856408c2f0 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2192167944 0 0) 0x7f856408d370 con 0x7f856408cdd0 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8564080330 con 0x7f856408cdd0 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85540033a0 con 0x7f856408cdd0 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient(hunting): dump: 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.096 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3301473138 0 0) 0x7f8564080610 con 0x7f856408dc80 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.78:6790/0 conn(0x7f856408cdd0 legacy=0x7f856407cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.187:6789/0 conn(0x7f856408c2f0 legacy=0x7f856407c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 monclient: found mon.a 2026-02-13T18:23:22.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856407d650 con 0x7f856408dc80 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 5 monclient: authenticate success, global_id 124197 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 monclient: _renew_subs 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f856405dd50 con 0x7f856408dc80 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 monclient: _renew_subs 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8564194ce0 con 0x7f856408dc80 2026-02-13T18:23:22.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85580048e0 con 0x7f856408dc80 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f85580055a0 con 0x7f856408dc80 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 10 monclient: dump: 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.099 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8561ffb640 4 set_mon_vals no callback set 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856408f5e0 con 0x7f856408dc80 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f8558005840 con 0x7f856408dc80 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7f855804daa0 con 0x7f856408dc80 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.067+0000 7f85637fe640 10 monclient: get_auth_request con 0x7f853403d880 auth_method 0 2026-02-13T18:23:22.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.071+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f8564088910 con 0x7f856408dc80 2026-02-13T18:23:22.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.071+0000 7f853ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.071+0000 7f853ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f856408ea40 con 0x7f856408dc80 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f853ffff640 1 -- 10.20.193.78:0/3390264390 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3839242053) 0x7f8558018ab0 con 0x7f856408dc80 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f853ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f853ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:22.201 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.187:6812/2668687789 conn(0x7f853403d880 legacy=0x7f853405dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 10 monclient: shutdown 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 >> v1:10.20.193.78:6789/0 conn(0x7f856408dc80 legacy=0x7f85641935c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 shutdown_connections 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 >> 10.20.193.78:0/3390264390 conn(0x7f8564091720 msgr2=0x7f856408ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 shutdown_connections 2026-02-13T18:23:22.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.187+0000 7f8569d00640 1 -- 10.20.193.78:0/3390264390 wait complete. 2026-02-13T18:23:22.212 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:23:22.212 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T18:23:22.212 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:23:22.212 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.267+0000 7f83c8cee640 10 monclient: get_monmap_and_config 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.267+0000 7f83c8cee640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.267+0000 7f83c8cee640 10 monclient: monmap: 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:22.273082+0000 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:22.273082+0000 2026-02-13T18:23:22.284 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.267+0000 7f83c8cee640 1 Processor -- start 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.267+0000 7f83c8cee640 1 -- start start 2026-02-13T18:23:22.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.267+0000 7f83c8cee640 10 monclient: init 2026-02-13T18:23:22.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient(hunting): picked mon.noname-b con 0x7f83c408e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient(hunting): picked mon.noname-a con 0x7f83c408eee0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient(hunting): picked mon.noname-c con 0x7f83c4057870 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c4056e90 con 0x7f83c408eee0 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c40565f0 con 0x7f83c4057870 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c40568d0 con 0x7f83c408e400 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient(hunting): authenticate will time out at 1633.328351s 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c2575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f83c408e400 0x7f83c408e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39724/0 (socket says 10.20.193.78:39724) 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c2575640 1 -- 10.20.193.78:0/1836549579 learned_addr learned my addr 10.20.193.78:0/1836549579 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c2575640 1 -- 10.20.193.78:0/1836549579 >> v1:10.20.193.78:6790/0 conn(0x7f83c408e400 legacy=0x7f83c408e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1d74640 1 -- 10.20.193.78:0/1836549579 >> v1:10.20.193.78:6789/0 conn(0x7f83c408eee0 legacy=0x7f83c4183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c2d76640 1 -- 10.20.193.78:0/1836549579 >> v1:10.20.193.187:6789/0 conn(0x7f83c4057870 legacy=0x7f83c41a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650828737 0 0) 0x7f83c40568d0 con 0x7f83c408e400 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): my global_id is 104417 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b0003620 con 0x7f83c408e400 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506123842 0 0) 0x7f83c4056e90 con 0x7f83c408eee0 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): my global_id is 124200 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c40568d0 con 0x7f83c408eee0 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167910720 0 0) 0x7f83c40565f0 con 0x7f83c4057870 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient(hunting): my global_id is 134134 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c4056e90 con 0x7f83c4057870 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 521905359 0 0) 0x7f83b0003620 con 0x7f83c408e400 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 >> v1:10.20.193.187:6789/0 conn(0x7f83c4057870 legacy=0x7f83c41a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 >> v1:10.20.193.78:6789/0 conn(0x7f83c408eee0 legacy=0x7f83c4183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 monclient: found mon.noname-b 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c408f530 con 0x7f83c408e400 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83b8003110 con 0x7f83c408e400 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: dump: 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.293 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 5 monclient: authenticate success, global_id 104417 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83b80033e0 con 0x7f83c408e400 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 1 -- 10.20.193.78:0/1836549579 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83b8004b50 con 0x7f83c408e400 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c1573640 10 monclient: dump: 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.295 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 4 set_mon_vals no callback set 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 10 monclient: shutdown 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- 10.20.193.78:0/1836549579 >> v1:10.20.193.78:6790/0 conn(0x7f83c408e400 legacy=0x7f83c408e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- 10.20.193.78:0/1836549579 shutdown_connections 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- 10.20.193.78:0/1836549579 >> 10.20.193.78:0/1836549579 conn(0x7f83c4054e30 msgr2=0x7f83c4093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- 10.20.193.78:0/1836549579 shutdown_connections 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.271+0000 7f83c8cee640 1 -- 10.20.193.78:0/1836549579 wait complete. 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: monmap: 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 Processor -- start 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- start start 2026-02-13T18:23:22.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: init 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient(hunting): picked mon.noname-a con 0x7f83c4057870 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient(hunting): picked mon.noname-c con 0x7f83c408e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient(hunting): picked mon.noname-b con 0x7f83c408eee0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c413f820 con 0x7f83c4057870 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c408abf0 con 0x7f83c408eee0 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c41538b0 con 0x7f83c408e400 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient(hunting): authenticate will time out at 1633.332617s 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c1d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f83c408e400 0x7f83c4194560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39730/0 (socket says 10.20.193.78:39730) 2026-02-13T18:23:22.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c1d74640 1 -- 10.20.193.78:0/3889939871 learned_addr learned my addr 10.20.193.78:0/3889939871 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c1d74640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6790/0 conn(0x7f83c408e400 legacy=0x7f83c4194560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c2575640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c4057870 legacy=0x7f83c41430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211897642 0 0) 0x7f83c413f820 con 0x7f83c4057870 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c2d76640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.187:6789/0 conn(0x7f83c408eee0 legacy=0x7f83c4195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): my global_id is 124203 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8390003620 con 0x7f83c4057870 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277554866 0 0) 0x7f83c41538b0 con 0x7f83c408e400 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): my global_id is 104420 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c413f820 con 0x7f83c408e400 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144875932 0 0) 0x7f83c408abf0 con 0x7f83c408eee0 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): my global_id is 134137 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c41538b0 con 0x7f83c408eee0 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1045350688 0 0) 0x7f8390003620 con 0x7f83c4057870 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83c408abf0 con 0x7f83c4057870 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83b80048e0 con 0x7f83c4057870 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): dump: 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.306 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1124232223 0 0) 0x7f83c413f820 con 0x7f83c408e400 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8390003620 con 0x7f83c408e400 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83ac003710 con 0x7f83c408e400 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.307 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient(hunting): dump: 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2078166063 0 0) 0x7f83c408abf0 con 0x7f83c4057870 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6790/0 conn(0x7f83c408e400 legacy=0x7f83c4194560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.308 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.187:6789/0 conn(0x7f83c408eee0 legacy=0x7f83c4195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 monclient: found mon.a 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4141b80 con 0x7f83c4057870 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 5 monclient: authenticate success, global_id 124203 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: _renew_subs 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.309 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f83c41412e0 con 0x7f83c4057870 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: _renew_subs 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f83c41437c0 con 0x7f83c4057870 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83b80033c0 con 0x7f83c4057870 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83b8005320 con 0x7f83c4057870 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c0d72640 4 set_mon_vals no callback set 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 10 monclient: dump: 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.310 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f83b80119b0 con 0x7f83c4057870 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.275+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83c41535d0 con 0x7f83c4153200 2026-02-13T18:23:22.311 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7f83b804c5e0 con 0x7f83c4057870 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83c2d76640 10 monclient: get_auth_request con 0x7f839003d7b0 auth_method 0 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83c1d74640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c4153200 legacy=0x7f83c4139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353140310 0 0) 0x7f83c41535d0 con 0x7f83c4153200 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient(hunting): my global_id is 124206 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c408abf0 con 0x7f83c4153200 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2891462821 0 0) 0x7f83c408abf0 con 0x7f83c4153200 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83c41535d0 con 0x7f83c4153200 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83ac003c90 con 0x7f83c4153200 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.312 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient: dump: 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 769828465 0 0) 0x7f83c41535d0 con 0x7f83c4153200 2026-02-13T18:23:22.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83c408dac0 con 0x7f83c4153200 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f83ac0058c0 con 0x7f83c4153200 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c4153200 legacy=0x7f83c4139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.279+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c4153200 legacy=0x7f83c4139ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.283+0000 7f83c8cee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.283+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83c4050ff0 con 0x7f83c413a1f0 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c1d74640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c413a1f0 legacy=0x7f83c41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521364914 0 0) 0x7f83c4050ff0 con 0x7f83c413a1f0 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient(hunting): my global_id is 124209 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c41535d0 con 0x7f83c413a1f0 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1159732278 0 0) 0x7f83c41535d0 con 0x7f83c413a1f0 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83c4050ff0 con 0x7f83c413a1f0 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f83ac0042c0 con 0x7f83c413a1f0 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient: dump: 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.315 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 793851221 0 0) 0x7f83c4050ff0 con 0x7f83c413a1f0 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83c405e1b0 con 0x7f83c413a1f0 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 3916596602) 0x7f83ac005a70 con 0x7f83c413a1f0 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c413a1f0 legacy=0x7f83c41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83aaffd640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c413a1f0 legacy=0x7f83c41983b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:22.317 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:22.317 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:22.317 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:22.317 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:23:22.317 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 62, 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 130826, 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.318 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:22.319 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.320 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:22.321 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.322 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.323 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.324 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.325 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.326 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.327 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:22.328 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:22.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.187:6812/2668687789 conn(0x7f839003d7b0 legacy=0x7f839005dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 10 monclient: shutdown 2026-02-13T18:23:22.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 >> v1:10.20.193.78:6789/0 conn(0x7f83c4057870 legacy=0x7f83c41430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c2d76640 1 -- 10.20.193.78:0/3889939871 reap_dead start 2026-02-13T18:23:22.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c2d76640 1 -- 10.20.193.78:0/3889939871 reap_dead start 2026-02-13T18:23:22.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 shutdown_connections 2026-02-13T18:23:22.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 >> 10.20.193.78:0/3889939871 conn(0x7f83c4054e30 msgr2=0x7f83c4088650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 shutdown_connections 2026-02-13T18:23:22.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.287+0000 7f83c8cee640 1 -- 10.20.193.78:0/3889939871 wait complete. 2026-02-13T18:23:22.330 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:23:22.330 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:23:22.330 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient: get_monmap_and_config 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient: monmap: 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:22.380402+0000 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:22.380402+0000 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.391 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:22.392 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:22.392 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 1 Processor -- start 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 1 -- start start 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient: init 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient(hunting): picked mon.noname-a con 0x7f496c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient(hunting): picked mon.noname-c con 0x7f496c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient(hunting): picked mon.noname-b con 0x7f496c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496c089e80 con 0x7f496c08c2f0 2026-02-13T18:23:22.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496c088c20 con 0x7f496c08dc80 2026-02-13T18:23:22.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496c089ba0 con 0x7f496c08cdd0 2026-02-13T18:23:22.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f4970aa2640 10 monclient(hunting): authenticate will time out at 1633.435720s 2026-02-13T18:23:22.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f496a575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f496c08c2f0 0x7f496c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35002/0 (socket says 10.20.193.78:35002) 2026-02-13T18:23:22.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f496ad76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f496c08cdd0 0x7f496c1a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39742/0 (socket says 10.20.193.78:39742) 2026-02-13T18:23:22.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.375+0000 7f496a575640 1 -- 10.20.193.78:0/3478964895 learned_addr learned my addr 10.20.193.78:0/3478964895 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f496a575640 1 -- 10.20.193.78:0/3478964895 >> v1:10.20.193.78:6789/0 conn(0x7f496c08c2f0 legacy=0x7f496c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f496ad76640 1 -- 10.20.193.78:0/3478964895 >> v1:10.20.193.78:6790/0 conn(0x7f496c08cdd0 legacy=0x7f496c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969506037 0 0) 0x7f496c089ba0 con 0x7f496c08cdd0 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): my global_id is 104423 2026-02-13T18:23:22.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4958003620 con 0x7f496c08cdd0 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969d74640 1 -- 10.20.193.78:0/3478964895 >> v1:10.20.193.187:6789/0 conn(0x7f496c08dc80 legacy=0x7f496c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840634402 0 0) 0x7f496c089e80 con 0x7f496c08c2f0 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient(hunting): my global_id is 124212 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f496c089ba0 con 0x7f496c08c2f0 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2554153830 0 0) 0x7f4958003620 con 0x7f496c08cdd0 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 >> v1:10.20.193.187:6789/0 conn(0x7f496c08dc80 legacy=0x7f496c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 >> v1:10.20.193.78:6789/0 conn(0x7f496c08c2f0 legacy=0x7f496c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 monclient: found mon.noname-b 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:22.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496c08d370 con 0x7f496c08cdd0 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 5 monclient: authenticate success, global_id 104423 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f495c004550 con 0x7f496c08cdd0 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: dump: 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.399 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f495c004820 con 0x7f496c08cdd0 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 1 -- 10.20.193.78:0/3478964895 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f495c005df0 con 0x7f496c08cdd0 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4969573640 10 monclient: dump: 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.400 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 4 set_mon_vals no callback set 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: shutdown 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- 10.20.193.78:0/3478964895 >> v1:10.20.193.78:6790/0 conn(0x7f496c08cdd0 legacy=0x7f496c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- 10.20.193.78:0/3478964895 shutdown_connections 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- 10.20.193.78:0/3478964895 >> 10.20.193.78:0/3478964895 conn(0x7f496c091720 msgr2=0x7f496c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- 10.20.193.78:0/3478964895 shutdown_connections 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- 10.20.193.78:0/3478964895 wait complete. 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: monmap: 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 Processor -- start 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- start start 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: init 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:23:22.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient(hunting): picked mon.noname-a con 0x7f496c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient(hunting): picked mon.noname-b con 0x7f496c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient(hunting): picked mon.noname-c con 0x7f496c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496c081a70 con 0x7f496c08c2f0 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496c088910 con 0x7f496c08cdd0 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f496c087230 con 0x7f496c08dc80 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f4970aa2640 10 monclient(hunting): authenticate will time out at 1633.439814s 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f496ad76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f496c08dc80 0x7f496c195340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39746/0 (socket says 10.20.193.78:39746) 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f496a575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f496c08c2f0 0x7f496c152fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35016/0 (socket says 10.20.193.78:35016) 2026-02-13T18:23:22.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.379+0000 7f496ad76640 1 -- 10.20.193.78:0/220004731 learned_addr learned my addr 10.20.193.78:0/220004731 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f496ad76640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c08dc80 legacy=0x7f496c195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f496a575640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6789/0 conn(0x7f496c08c2f0 legacy=0x7f496c152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4969d74640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.187:6789/0 conn(0x7f496c08cdd0 legacy=0x7f496c083840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934840293 0 0) 0x7f496c087230 con 0x7f496c08dc80 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): my global_id is 104426 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4938003620 con 0x7f496c08dc80 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486142224 0 0) 0x7f4960002db0 con 0x7f496c08c2f0 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): my global_id is 124215 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f496c087230 con 0x7f496c08c2f0 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121053490 0 0) 0x7f496c088910 con 0x7f496c08cdd0 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): my global_id is 134143 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4960002db0 con 0x7f496c08cdd0 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1353833129 0 0) 0x7f4938003620 con 0x7f496c08dc80 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f496c088910 con 0x7f496c08dc80 2026-02-13T18:23:22.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f495c005df0 con 0x7f496c08dc80 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): dump: 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3786319771 0 0) 0x7f496c087230 con 0x7f496c08c2f0 2026-02-13T18:23:22.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4938003620 con 0x7f496c08c2f0 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f49600048e0 con 0x7f496c08c2f0 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient(hunting): dump: 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2790369850 0 0) 0x7f496c088910 con 0x7f496c08dc80 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.187:6789/0 conn(0x7f496c08cdd0 legacy=0x7f496c083840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6789/0 conn(0x7f496c08c2f0 legacy=0x7f496c152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 monclient: found mon.c 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496c082310 con 0x7f496c08dc80 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 5 monclient: authenticate success, global_id 104426 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 10 monclient: _renew_subs 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f496c080b10 con 0x7f496c08dc80 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 10 monclient: _renew_subs 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:23:22.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f496c084120 con 0x7f496c08dc80 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f495c0047c0 con 0x7f496c08dc80 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f495c003fb0 con 0x7f496c08dc80 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 10 monclient: dump: 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.412 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4968d72640 4 set_mon_vals no callback set 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f496c08f5e0 con 0x7f496c05ace0 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f495c006720 con 0x7f496c08dc80 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7f495c04da60 con 0x7f496c08dc80 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.383+0000 7f4969d74640 10 monclient: get_auth_request con 0x7f493803d7b0 auth_method 0 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f496a575640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c05ace0 legacy=0x7f496c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063524416 0 0) 0x7f496c08f5e0 con 0x7f496c05ace0 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient(hunting): my global_id is 104429 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f496c088910 con 0x7f496c05ace0 2026-02-13T18:23:22.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1076369984 0 0) 0x7f496c088910 con 0x7f496c05ace0 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f496c08f5e0 con 0x7f496c05ace0 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4960004ea0 con 0x7f496c05ace0 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient: dump: 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 960441114 0 0) 0x7f496c08f5e0 con 0x7f496c05ace0 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f496c090810 con 0x7f496c05ace0 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f49600062e0 con 0x7f496c05ace0 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c05ace0 legacy=0x7f496c04d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.387+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c05ace0 legacy=0x7f496c04d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4970aa2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:22.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f496c0510e0 con 0x7f496c05b0b0 2026-02-13T18:23:22.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f496a575640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c05b0b0 legacy=0x7f496c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827995544 0 0) 0x7f496c0510e0 con 0x7f496c05b0b0 2026-02-13T18:23:22.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient(hunting): my global_id is 104432 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f496c08f5e0 con 0x7f496c05b0b0 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 646255539 0 0) 0x7f496c08f5e0 con 0x7f496c05b0b0 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f496c0510e0 con 0x7f496c05b0b0 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4960005280 con 0x7f496c05b0b0 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.391+0000 7f4952ffd640 10 monclient: dump: 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.417 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3112058976 0 0) 0x7f496c0510e0 con 0x7f496c05b0b0 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f496c04d910 con 0x7f496c05b0b0 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4677 (unknown 0 0 3473915448) 0x7f4960005660 con 0x7f496c05b0b0 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c05b0b0 legacy=0x7f496c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.418 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4952ffd640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c05b0b0 legacy=0x7f496c197a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 62, 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 346896, 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:22.419 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.420 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.421 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:22.422 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.423 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.424 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.425 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.426 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.427 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "num": 6 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.428 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:22.429 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.187:6812/2668687789 conn(0x7f493803d7b0 legacy=0x7f493805dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 10 monclient: shutdown 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 >> v1:10.20.193.78:6790/0 conn(0x7f496c08dc80 legacy=0x7f496c195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f496ad76640 1 -- 10.20.193.78:0/220004731 reap_dead start 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f496ad76640 1 -- 10.20.193.78:0/220004731 reap_dead start 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 shutdown_connections 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 >> 10.20.193.78:0/220004731 conn(0x7f496c091720 msgr2=0x7f496c05db10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 shutdown_connections 2026-02-13T18:23:22.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.395+0000 7f4970aa2640 1 -- 10.20.193.78:0/220004731 wait complete. 2026-02-13T18:23:22.431 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:23:22.431 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:23:22.431 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient: get_monmap_and_config 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient: monmap: 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:22.483478+0000 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:22.483478+0000 2026-02-13T18:23:22.494 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 1 Processor -- start 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 1 -- start start 2026-02-13T18:23:22.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient: init 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient(hunting): picked mon.noname-b con 0x7f041c08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient(hunting): picked mon.noname-c con 0x7f041c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient(hunting): picked mon.noname-a con 0x7f041c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c089e80 con 0x7f041c08cdd0 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c088c20 con 0x7f041c08dc80 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c089ba0 con 0x7f041c08c2f0 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f042372c640 10 monclient(hunting): authenticate will time out at 1633.538745s 2026-02-13T18:23:22.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f04214a1640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f041c08c2f0 0x7f041c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:39786/0 (socket says 10.20.193.78:39786) 2026-02-13T18:23:22.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.479+0000 7f04214a1640 1 -- 10.20.193.78:0/1934946834 learned_addr learned my addr 10.20.193.78:0/1934946834 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f04214a1640 1 -- 10.20.193.78:0/1934946834 >> v1:10.20.193.78:6790/0 conn(0x7f041c08c2f0 legacy=0x7f041c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f0421ca2640 1 -- 10.20.193.78:0/1934946834 >> v1:10.20.193.78:6789/0 conn(0x7f041c08cdd0 legacy=0x7f041c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068064829 0 0) 0x7f041c089ba0 con 0x7f041c08c2f0 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f0420ca0640 1 -- 10.20.193.78:0/1934946834 >> v1:10.20.193.187:6789/0 conn(0x7f041c08dc80 legacy=0x7f041c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): my global_id is 104435 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0404003620 con 0x7f041c08c2f0 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587123531 0 0) 0x7f041c089e80 con 0x7f041c08cdd0 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient(hunting): my global_id is 124218 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f041c089ba0 con 0x7f041c08cdd0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3960106004 0 0) 0x7f0404003620 con 0x7f041c08c2f0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 >> v1:10.20.193.187:6789/0 conn(0x7f041c08dc80 legacy=0x7f041c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 >> v1:10.20.193.78:6789/0 conn(0x7f041c08cdd0 legacy=0x7f041c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 monclient: found mon.noname-b 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c08d370 con 0x7f041c08c2f0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f040c003110 con 0x7f041c08c2f0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: dump: 2026-02-13T18:23:22.500 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 5 monclient: authenticate success, global_id 104435 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f040c0033e0 con 0x7f041c08c2f0 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 1 -- 10.20.193.78:0/1934946834 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f040c004b50 con 0x7f041c08c2f0 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f040bfff640 10 monclient: dump: 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.501 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 4 set_mon_vals no callback set 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: shutdown 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- 10.20.193.78:0/1934946834 >> v1:10.20.193.78:6790/0 conn(0x7f041c08c2f0 legacy=0x7f041c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- 10.20.193.78:0/1934946834 shutdown_connections 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- 10.20.193.78:0/1934946834 >> 10.20.193.78:0/1934946834 conn(0x7f041c091720 msgr2=0x7f041c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- 10.20.193.78:0/1934946834 shutdown_connections 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- 10.20.193.78:0/1934946834 wait complete. 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: monmap: 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 Processor -- start 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- start start 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: init 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient(hunting): picked mon.noname-b con 0x7f041c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient(hunting): picked mon.noname-c con 0x7f041c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient(hunting): picked mon.noname-a con 0x7f041c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c05dce0 con 0x7f041c08dc80 2026-02-13T18:23:22.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c088910 con 0x7f041c08c2f0 2026-02-13T18:23:22.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041c07def0 con 0x7f041c08cdd0 2026-02-13T18:23:22.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f042372c640 10 monclient(hunting): authenticate will time out at 1633.542516s 2026-02-13T18:23:22.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f0421ca2640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f041c08dc80 0x7f041c1939a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35030/0 (socket says 10.20.193.78:35030) 2026-02-13T18:23:22.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.483+0000 7f0421ca2640 1 -- 10.20.193.78:0/1434548096 learned_addr learned my addr 10.20.193.78:0/1434548096 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0421ca2640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.78:6789/0 conn(0x7f041c08dc80 legacy=0x7f041c1939a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0420ca0640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.78:6790/0 conn(0x7f041c08cdd0 legacy=0x7f041c192280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503829261 0 0) 0x7f041c05dce0 con 0x7f041c08dc80 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): my global_id is 124221 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03ec003620 con 0x7f041c08dc80 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010020185 0 0) 0x7f041c07def0 con 0x7f041c08cdd0 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): my global_id is 104438 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f041c05dce0 con 0x7f041c08cdd0 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 26422771 0 0) 0x7f03ec003620 con 0x7f041c08dc80 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f041c07def0 con 0x7f041c08dc80 2026-02-13T18:23:22.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f04180049a0 con 0x7f041c08dc80 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): dump: 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f04214a1640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c08c2f0 legacy=0x7f041c0837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2289673851 0 0) 0x7f041c07def0 con 0x7f041c08dc80 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.78:6790/0 conn(0x7f041c08cdd0 legacy=0x7f041c192280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c08c2f0 legacy=0x7f041c0837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 monclient: found mon.a 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c080250 con 0x7f041c08dc80 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 5 monclient: authenticate success, global_id 124221 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 10 monclient: _renew_subs 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f041c07f9b0 con 0x7f041c08dc80 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 10 monclient: _renew_subs 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f041c083eb0 con 0x7f041c08dc80 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04180050d0 con 0x7f041c08dc80 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0418005460 con 0x7f041c08dc80 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f040b7fe640 4 set_mon_vals no callback set 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 10 monclient: dump: 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f041c08f600 con 0x7f041c151180 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0418005640 con 0x7f041c08dc80 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7f041804dc50 con 0x7f041c08dc80 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.487+0000 7f0420ca0640 10 monclient: get_auth_request con 0x7f03ec03d510 auth_method 0 2026-02-13T18:23:22.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f04214a1640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c151180 legacy=0x7f041c05b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992358157 0 0) 0x7f041c08f600 con 0x7f041c151180 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient(hunting): my global_id is 134152 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f041c07def0 con 0x7f041c151180 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 941133617 0 0) 0x7f041c07def0 con 0x7f041c151180 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f041c08f600 con 0x7f041c151180 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f040c002d90 con 0x7f041c151180 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient: dump: 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.511 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1101325173 0 0) 0x7f041c08f600 con 0x7f041c151180 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f041c07fe20 con 0x7f041c151180 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f040c002f50 con 0x7f041c151180 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c151180 legacy=0x7f041c05b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.491+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c151180 legacy=0x7f041c05b550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:22.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f042372c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:22.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f041c090810 con 0x7f041c04d200 2026-02-13T18:23:22.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f04214a1640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c04d200 legacy=0x7f041c1960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756179870 0 0) 0x7f041c090810 con 0x7f041c04d200 2026-02-13T18:23:22.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient(hunting): my global_id is 134155 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f041c08f600 con 0x7f041c04d200 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3803378676 0 0) 0x7f041c08f600 con 0x7f041c04d200 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f041c090810 con 0x7f041c04d200 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f040c005000 con 0x7f041c04d200 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 10 monclient: dump: 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.514 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 215624474 0 0) 0x7f041c090810 con 0x7f041c04d200 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.495+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f041c0510e0 con 0x7f041c04d200 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 1132018518) 0x7f040c0051b0 con 0x7f041c04d200 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0409ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0409ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c04d200 legacy=0x7f041c1960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0409ffb640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6789/0 conn(0x7f041c04d200 legacy=0x7f041c1960d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 62, 2026-02-13T18:23:22.515 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 17788, 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 2, 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.516 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.517 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:22.518 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.519 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.520 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:22.521 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:22.522 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.523 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:22.524 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:22.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.187:6812/2668687789 conn(0x7f03ec03d510 legacy=0x7f03ec05d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 10 monclient: shutdown 2026-02-13T18:23:22.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 >> v1:10.20.193.78:6789/0 conn(0x7f041c08dc80 legacy=0x7f041c1939a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0421ca2640 1 -- 10.20.193.78:0/1434548096 reap_dead start 2026-02-13T18:23:22.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f0421ca2640 1 -- 10.20.193.78:0/1434548096 reap_dead start 2026-02-13T18:23:22.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 shutdown_connections 2026-02-13T18:23:22.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 >> 10.20.193.78:0/1434548096 conn(0x7f041c091720 msgr2=0x7f041c058cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 shutdown_connections 2026-02-13T18:23:22.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.499+0000 7f042372c640 1 -- 10.20.193.78:0/1434548096 wait complete. 2026-02-13T18:23:22.526 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:23:22.526 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-13T18:23:22.526 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T18:23:22.526 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-13T18:23:22.526 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-13T18:23:22.526 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T18:23:22.527 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:23:22.542 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T18:23:22.542 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T18:23:22.542 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:23:22.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient: get_monmap_and_config 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient: monmap: 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:22.632274+0000 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:22.632274+0000 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.643 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:22.644 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:22.644 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 1 Processor -- start 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 1 -- start start 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient: init 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient(hunting): picked mon.noname-b con 0x7fe0f808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient(hunting): picked mon.noname-a con 0x7fe0f808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient(hunting): picked mon.noname-c con 0x7fe0f808cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f8089e80 con 0x7fe0f808dc80 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f8088c20 con 0x7fe0f808cdd0 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f8089ba0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0fcc82640 10 monclient(hunting): authenticate will time out at 1633.687424s 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0f6575640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fe0f808c2f0 legacy=0x7fe0f808c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0f5d74640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe0f808dc80 0x7fe0f8181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35064/0 (socket says 10.20.193.78:35064) 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.627+0000 7fe0f5d74640 1 -- 10.20.193.78:0/1615514816 learned_addr learned my addr 10.20.193.78:0/1615514816 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5d74640 1 -- 10.20.193.78:0/1615514816 >> v1:10.20.193.78:6789/0 conn(0x7fe0f808dc80 legacy=0x7fe0f8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f6d76640 1 -- 10.20.193.78:0/1615514816 >> v1:10.20.193.187:6789/0 conn(0x7fe0f808cdd0 legacy=0x7fe0f81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101126785 0 0) 0x7fe0f8089e80 con 0x7fe0f808dc80 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): my global_id is 124224 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e4003620 con 0x7fe0f808dc80 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943911293 0 0) 0x7fe0f8088c20 con 0x7fe0f808cdd0 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient(hunting): my global_id is 134158 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f8089e80 con 0x7fe0f808cdd0 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 566268421 0 0) 0x7fe0e4003620 con 0x7fe0f808dc80 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 >> v1:10.20.193.78:6790/0 conn(0x7fe0f808c2f0 legacy=0x7fe0f808c6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 >> v1:10.20.193.187:6789/0 conn(0x7fe0f808cdd0 legacy=0x7fe0f81a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 monclient: found mon.noname-a 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f808d370 con 0x7fe0f808dc80 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0e0003110 con 0x7fe0f808dc80 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 5 monclient: authenticate success, global_id 124224 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: dump: 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.653 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0e00033e0 con 0x7fe0f808dc80 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 1 -- 10.20.193.78:0/1615514816 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0e0004b50 con 0x7fe0f808dc80 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0f5573640 10 monclient: dump: 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:22.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 4 set_mon_vals no callback set 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 10 monclient: shutdown 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 -- 10.20.193.78:0/1615514816 >> v1:10.20.193.78:6789/0 conn(0x7fe0f808dc80 legacy=0x7fe0f8181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 -- 10.20.193.78:0/1615514816 shutdown_connections 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 -- 10.20.193.78:0/1615514816 >> 10.20.193.78:0/1615514816 conn(0x7fe0f8091720 msgr2=0x7fe0f8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 -- 10.20.193.78:0/1615514816 shutdown_connections 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 -- 10.20.193.78:0/1615514816 wait complete. 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 10 monclient: build_initial_monmap 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 10 monclient: monmap: 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:22.656 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 Processor -- start 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 1 -- start start 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 10 monclient: init 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.631+0000 7fe0fcc82640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:22.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient(hunting): picked mon.noname-a con 0x7fe0f808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient(hunting): picked mon.noname-c con 0x7fe0f808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient(hunting): picked mon.noname-b con 0x7fe0f808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f807f2d0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f5d74640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fe0f808cdd0 legacy=0x7fe0f8192220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f8088910 con 0x7fe0f808dc80 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f807db20 con 0x7fe0f808cdd0 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient(hunting): authenticate will time out at 1633.692090s 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f6575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe0f808c2f0 0x7fe0f8151010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35072/0 (socket says 10.20.193.78:35072) 2026-02-13T18:23:22.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f6575640 1 -- 10.20.193.78:0/3035354188 learned_addr learned my addr 10.20.193.78:0/3035354188 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f6575640 1 -- 10.20.193.78:0/3035354188 >> v1:10.20.193.78:6789/0 conn(0x7fe0f808c2f0 legacy=0x7fe0f8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f6d76640 1 -- 10.20.193.78:0/3035354188 >> v1:10.20.193.187:6789/0 conn(0x7fe0f808dc80 legacy=0x7fe0f8193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381718645 0 0) 0x7fe0f807f2d0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): my global_id is 124227 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c4003620 con 0x7fe0f808c2f0 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889642258 0 0) 0x7fe0f8088910 con 0x7fe0f808dc80 2026-02-13T18:23:22.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): my global_id is 134161 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f807f2d0 con 0x7fe0f808dc80 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2627310585 0 0) 0x7fe0c4003620 con 0x7fe0f808c2f0 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0f8088910 con 0x7fe0f808c2f0 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0ec0045c0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): dump: 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.663 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 910812975 0 0) 0x7fe0f8088910 con 0x7fe0f808c2f0 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 >> v1:10.20.193.78:6790/0 conn(0x7fe0f808cdd0 legacy=0x7fe0f8192220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:23:22.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 >> v1:10.20.193.187:6789/0 conn(0x7fe0f808dc80 legacy=0x7fe0f8193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 monclient: found mon.a 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f807fe80 con 0x7fe0f808c2f0 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 5 monclient: authenticate success, global_id 124227 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _renew_subs 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f807f5e0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _renew_subs 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0f807d1a0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0ec004890 con 0x7fe0f808c2f0 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe0ec004c20 con 0x7fe0f808c2f0 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f4d72640 4 set_mon_vals no callback set 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 10 monclient: dump: 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:22.666 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f808f620 con 0x7fe0f808c2f0 2026-02-13T18:23:22.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe0ec004eb0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7fe0ec04c6f0 con 0x7fe0f808c2f0 2026-02-13T18:23:22.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.635+0000 7fe0f5d74640 10 monclient: get_auth_request con 0x7fe0c403d240 auth_method 0 2026-02-13T18:23:22.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.639+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fe0f808f620 con 0x7fe0f808c2f0 2026-02-13T18:23:22.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.639+0000 7fe0deffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:22.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.639+0000 7fe0deffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:22.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:23:22.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:22.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:22.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0f807d530 con 0x7fe0f808c2f0 2026-02-13T18:23:22.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0deffd640 1 -- 10.20.193.78:0/3035354188 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2297695753) 0x7fe0ec017630 con 0x7fe0f808c2f0 2026-02-13T18:23:22.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0deffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:22.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0deffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:22.772 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:23:22.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe0c403d240 legacy=0x7fe0c405d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 10 monclient: shutdown 2026-02-13T18:23:22.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:22.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 >> v1:10.20.193.78:6789/0 conn(0x7fe0f808c2f0 legacy=0x7fe0f8151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:22.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 shutdown_connections 2026-02-13T18:23:22.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 >> 10.20.193.78:0/3035354188 conn(0x7fe0f8091720 msgr2=0x7fe0f805cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:22.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 shutdown_connections 2026-02-13T18:23:22.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:22.755+0000 7fe0fcc82640 1 -- 10.20.193.78:0/3035354188 wait complete. 2026-02-13T18:23:25.782 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:23:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient: get_monmap_and_config 2026-02-13T18:23:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient: build_initial_monmap 2026-02-13T18:23:25.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient: monmap: 2026-02-13T18:23:25.856 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:25.856 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:25.844362+0000 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:25.844362+0000 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 1 Processor -- start 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 1 -- start start 2026-02-13T18:23:25.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient: init 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient(hunting): picked mon.noname-a con 0x7f3fbc08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient(hunting): picked mon.noname-b con 0x7f3fbc08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient(hunting): picked mon.noname-c con 0x7f3fbc08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc089e80 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc088c20 con 0x7f3fbc08cdd0 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc089ba0 con 0x7f3fbc08dc80 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc2c06640 10 monclient(hunting): authenticate will time out at 1636.899489s 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fb3fff640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f3fbc08dc80 legacy=0x7f3fbc181ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:25.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc097b640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3fbc08c2f0 0x7f3fbc08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35082/0 (socket says 10.20.193.78:35082) 2026-02-13T18:23:25.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.839+0000 7f3fc097b640 1 -- 10.20.193.78:0/2828207216 learned_addr learned my addr 10.20.193.78:0/2828207216 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:25.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc097b640 1 -- 10.20.193.78:0/2828207216 >> v1:10.20.193.78:6789/0 conn(0x7f3fbc08c2f0 legacy=0x7f3fbc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:25.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559922672 0 0) 0x7f3fbc089e80 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient(hunting): _negotiate 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient(hunting): my global_id is 124230 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa8003620 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc117c640 1 -- 10.20.193.78:0/2828207216 >> v1:10.20.193.187:6789/0 conn(0x7f3fbc08cdd0 legacy=0x7f3fbc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2219140274 0 0) 0x7f3fa8003620 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 >> v1:10.20.193.78:6790/0 conn(0x7f3fbc08dc80 legacy=0x7f3fbc181ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 >> v1:10.20.193.187:6789/0 conn(0x7f3fbc08cdd0 legacy=0x7f3fbc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: _finish_hunting 0 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 monclient: found mon.noname-a 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:25.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc08d370 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: _finish_auth 0 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: _check_auth_tickets 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3fac003110 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 5 monclient: authenticate success, global_id 124230 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: dump: 2026-02-13T18:23:25.867 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:25.868 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:25.869 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:25.869 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:25.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:25.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fac0033e0 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:25.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 1 -- 10.20.193.78:0/2828207216 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3fac004b50 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fb37fe640 10 monclient: dump: 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.870 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 4 set_mon_vals no callback set 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 10 monclient: shutdown 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2828207216 >> v1:10.20.193.78:6789/0 conn(0x7f3fbc08c2f0 legacy=0x7f3fbc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:25.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2828207216 shutdown_connections 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2828207216 >> 10.20.193.78:0/2828207216 conn(0x7f3fbc091720 msgr2=0x7f3fbc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2828207216 shutdown_connections 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2828207216 wait complete. 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 10 monclient: build_initial_monmap 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 10 monclient: monmap: 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:25.872 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 Processor -- start 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 1 -- start start 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.843+0000 7f3fc2c06640 10 monclient: init 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient(hunting): picked mon.noname-c con 0x7f3fbc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient(hunting): picked mon.noname-b con 0x7f3fbc08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient(hunting): picked mon.noname-a con 0x7f3fbc08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:25.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc082240 con 0x7f3fbc08dc80 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc0812e0 con 0x7f3fbc08cdd0 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fbc05d520 con 0x7f3fbc08c2f0 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient(hunting): authenticate will time out at 1636.904168s 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc097b640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f3fbc08c2f0 legacy=0x7f3fbc153170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc117c640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f3fbc08dc80 0x7f3fbc1954e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35090/0 (socket says 10.20.193.78:35090) 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc117c640 1 -- 10.20.193.78:0/2509951591 learned_addr learned my addr 10.20.193.78:0/2509951591 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc117c640 1 -- 10.20.193.78:0/2509951591 >> v1:10.20.193.78:6789/0 conn(0x7f3fbc08dc80 legacy=0x7f3fbc1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb3fff640 1 -- 10.20.193.78:0/2509951591 >> v1:10.20.193.187:6789/0 conn(0x7f3fbc08cdd0 legacy=0x7f3fbc083a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022852911 0 0) 0x7f3fbc082240 con 0x7f3fbc08dc80 2026-02-13T18:23:25.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): my global_id is 124233 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8c003620 con 0x7f3fbc08dc80 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313012157 0 0) 0x7f3fbc0812e0 con 0x7f3fbc08cdd0 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _negotiate 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): my global_id is 134167 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fbc082240 con 0x7f3fbc08cdd0 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2101191405 0 0) 0x7f3f8c003620 con 0x7f3fbc08dc80 2026-02-13T18:23:25.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fbc0812e0 con 0x7f3fbc08dc80 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3fb8004930 con 0x7f3fbc08dc80 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): dump: 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:25.876 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1115269136 0 0) 0x7f3fbc0812e0 con 0x7f3fbc08dc80 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 >> v1:10.20.193.78:6790/0 conn(0x7f3fbc08c2f0 legacy=0x7f3fbc153170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 >> v1:10.20.193.187:6789/0 conn(0x7f3fbc08cdd0 legacy=0x7f3fbc083a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: _finish_hunting 0 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 monclient: found mon.a 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc0578c0 con 0x7f3fbc08dc80 2026-02-13T18:23:25.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: _finish_auth 0 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: _check_auth_tickets 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 5 monclient: authenticate success, global_id 124233 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _renew_subs 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc081f60 con 0x7f3fbc08dc80 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _renew_subs 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fbc196c00 con 0x7f3fbc08dc80 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fb8004f90 con 0x7f3fbc08dc80 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f3fb8005320 con 0x7f3fbc08dc80 2026-02-13T18:23:25.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb2ffd640 4 set_mon_vals no callback set 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 10 monclient: dump: 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:25.879 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fbc08f600 con 0x7f3fbc08dc80 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.847+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f3fb8005570 con 0x7f3fbc08dc80 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.851+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7f3fb804dbb0 con 0x7f3fbc08dc80 2026-02-13T18:23:25.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.851+0000 7f3fc097b640 10 monclient: get_auth_request con 0x7f3f8c03d1f0 auth_method 0 2026-02-13T18:23:25.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.851+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f3fb8018b50 con 0x7f3fbc08dc80 2026-02-13T18:23:25.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.851+0000 7f3fb17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:25.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.851+0000 7f3fb17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:25.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fc2c06640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:23:25.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fc2c06640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:25.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fc2c06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:25.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3fbc0585c0 con 0x7f3fbc08dc80 2026-02-13T18:23:25.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fb17fa640 1 -- 10.20.193.78:0/2509951591 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1370676356) 0x7f3fb801de10 con 0x7f3fbc08dc80 2026-02-13T18:23:25.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fb17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:25.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.975+0000 7f3fb17fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:25.993 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":62,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 >> v1:10.20.193.187:6812/2668687789 conn(0x7f3f8c03d1f0 legacy=0x7f3f8c05d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 10 monclient: shutdown 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 >> v1:10.20.193.78:6789/0 conn(0x7f3fbc08dc80 legacy=0x7f3fbc1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 shutdown_connections 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 >> 10.20.193.78:0/2509951591 conn(0x7f3fbc091720 msgr2=0x7f3fbc085790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:25.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 shutdown_connections 2026-02-13T18:23:25.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:25.979+0000 7f3fc2c06640 1 -- 10.20.193.78:0/2509951591 wait complete. 2026-02-13T18:23:29.003 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:23:29.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient: get_monmap_and_config 2026-02-13T18:23:29.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient: build_initial_monmap 2026-02-13T18:23:29.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient: monmap: 2026-02-13T18:23:29.077 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:29.077 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:29.077 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:29.064833+0000 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:29.064833+0000 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 1 Processor -- start 2026-02-13T18:23:29.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 1 -- start start 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient: init 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient(hunting): picked mon.noname-b con 0x7feeb4085b00 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient(hunting): picked mon.noname-a con 0x7feeb4085ed0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 10 monclient(hunting): picked mon.noname-c con 0x7feeb40862a0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb408d4e0 con 0x7feeb4085ed0 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feebb399640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb4054660 con 0x7feeb40862a0 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feebb399640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb41a8b20 con 0x7feeb4085b00 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feebb399640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.059+0000 7feeb910e640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7feeb408e760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:29.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feebb399640 10 monclient(hunting): authenticate will time out at 1640.120011s 2026-02-13T18:23:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feeb890d640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 0x7feeb4183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:35106/0 (socket says 10.20.193.78:35106) 2026-02-13T18:23:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 learned_addr learned my addr 10.20.193.78:0/2682544208 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:29.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 legacy=0x7feeb4183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:29.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.063+0000 7feeb990f640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.187:6789/0 conn(0x7feeb40862a0 legacy=0x7feeb41a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:29.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.267+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7feeb408e760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:29.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:29.671+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7feeb408e760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:30.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:30.475+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7feeb408e760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:32.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.059+0000 7feea2ffd640 10 monclient(hunting): tick 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.059+0000 7feea2ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.059+0000 7feea2ffd640 1 monclient(hunting): continuing hunt 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.059+0000 7feea2ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.059+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7feeb408e760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.059+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.187:6789/0 conn(0x7feeb40862a0 legacy=0x7feeb41a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 legacy=0x7feeb4183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7feeb4085b00 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 10 monclient(hunting): picked mon.noname-a con 0x7feeb4085ed0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:32.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 10 monclient(hunting): picked mon.noname-c con 0x7feeb40862a0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:32.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb41a9d00 con 0x7feeb4085ed0 2026-02-13T18:23:32.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:32.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb41a8b20 con 0x7feeb40862a0 2026-02-13T18:23:32.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9806a0c0 con 0x7feeb4085b00 2026-02-13T18:23:32.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feea2ffd640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:32.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 legacy=0x7fee980450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:32.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.063+0000 7feeb990f640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.187:6789/0 conn(0x7feeb40862a0 legacy=0x7fee980668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:32.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.267+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:32.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:32.671+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:33.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:33.475+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:35.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): tick 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 monclient(hunting): continuing hunt 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.187:6789/0 conn(0x7feeb40862a0 legacy=0x7fee980668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 legacy=0x7fee980450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:23:35.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fee9806a440 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7feeb4085b00 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): picked mon.noname-a con 0x7feeb4085ed0 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9806b420 con 0x7feeb4085ed0 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9806a0c0 con 0x7fee9806a440 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee98046810 con 0x7feeb4085b00 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea2ffd640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:35.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:35.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feeb910e640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.187:6789/0 conn(0x7fee9806a440 legacy=0x7fee9806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:35.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feeb990f640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 legacy=0x7fee980450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:35.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.063+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:23:35.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.267+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:35.671+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:36.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.475+0000 7feeb890d640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:36.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347285025 0 0) 0x7fee9806b420 con 0x7feeb4085ed0 2026-02-13T18:23:36.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient(hunting): my global_id is 124236 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee9c003620 con 0x7feeb4085ed0 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683078536 0 0) 0x7fee9c003620 con 0x7feeb4085ed0 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085b00 legacy=0x7fee980238d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.187:6789/0 conn(0x7fee9806a440 legacy=0x7fee9806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 monclient: found mon.noname-a 2026-02-13T18:23:36.850 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee98047a40 con 0x7feeb4085ed0 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: _finish_auth 0 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feeb00045d0 con 0x7feeb4085ed0 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: dump: 2026-02-13T18:23:36.851 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:36.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 5 monclient: authenticate success, global_id 124236 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feeb00047b0 con 0x7feeb4085ed0 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 1 -- 10.20.193.78:0/2682544208 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feeb0004c20 con 0x7feeb4085ed0 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 4 set_mon_vals no callback set 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feea3fff640 10 monclient: dump: 2026-02-13T18:23:36.853 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 10 monclient: shutdown 2026-02-13T18:23:36.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 -- 10.20.193.78:0/2682544208 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085ed0 legacy=0x7fee980450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 -- 10.20.193.78:0/2682544208 shutdown_connections 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 -- 10.20.193.78:0/2682544208 >> 10.20.193.78:0/2682544208 conn(0x7feeb4056aa0 msgr2=0x7feeb40928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 -- 10.20.193.78:0/2682544208 shutdown_connections 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 -- 10.20.193.78:0/2682544208 wait complete. 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 10 monclient: build_initial_monmap 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 10 monclient: monmap: 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:36.855 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 Processor -- start 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 1 -- start start 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.831+0000 7feebb399640 10 monclient: init 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:36.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient(hunting): picked mon.noname-b con 0x7fee9806a440 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient(hunting): picked mon.noname-a con 0x7feeb4085b00 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient(hunting): picked mon.noname-c con 0x7feeb4085ed0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb407e9f0 con 0x7feeb4085b00 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb41dae00 con 0x7fee9806a440 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb4083e70 con 0x7feeb4085ed0 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient(hunting): authenticate will time out at 1647.892352s 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feeb990f640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7feeb4085ed0 legacy=0x7feeb423c450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:36.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feeb910e640 1 --1- >> v1:10.20.193.187:6789/0 conn(0x7fee9806a440 0x7feeb41d9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.187:6789/0 says I am v1:10.20.193.78:35200/0 (socket says 10.20.193.78:35200) 2026-02-13T18:23:36.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feeb910e640 1 -- 10.20.193.78:0/69164029 learned_addr learned my addr 10.20.193.78:0/69164029 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:36.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feeb910e640 1 -- 10.20.193.78:0/69164029 >> v1:10.20.193.187:6789/0 conn(0x7fee9806a440 legacy=0x7feeb41d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:36.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775556025 0 0) 0x7feeb41dae00 con 0x7fee9806a440 2026-02-13T18:23:36.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:36.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:36.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:36.861 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): my global_id is 134170 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee84003620 con 0x7fee9806a440 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feeb890d640 1 -- 10.20.193.78:0/69164029 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085b00 legacy=0x7feeb41da6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2813029320 0 0) 0x7fee84003620 con 0x7fee9806a440 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feeb41dae00 con 0x7fee9806a440 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feea4004750 con 0x7fee9806a440 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): dump: 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:36.862 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:36.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 843536291 0 0) 0x7feeb41dae00 con 0x7fee9806a440 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 >> v1:10.20.193.78:6790/0 conn(0x7feeb4085ed0 legacy=0x7feeb423c450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 >> v1:10.20.193.78:6789/0 conn(0x7feeb4085b00 legacy=0x7feeb41da6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 monclient: found mon.b 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb407e710 con 0x7fee9806a440 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: _finish_auth 0 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:36.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 5 monclient: authenticate success, global_id 134170 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient: _renew_subs 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feeb407d330 con 0x7fee9806a440 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient: _renew_subs 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feeb407c8e0 con 0x7fee9806a440 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feea4004c60 con 0x7fee9806a440 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7feea4004fc0 con 0x7fee9806a440 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:36.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea1ffb640 10 monclient: dump: 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:36.866 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.835+0000 7feea37fe640 4 set_mon_vals no callback set 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feebb399640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7feea4005290 con 0x7fee9806a440 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feebb399640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feebb399640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb408cd30 con 0x7fee9806a440 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(883..883 src has 621..883) ==== 3931+0+0 (unknown 818170285 0 0) 0x7feea404c8d0 con 0x7fee9806a440 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.839+0000 7feeb890d640 10 monclient: get_auth_request con 0x7fee8403d340 auth_method 0 2026-02-13T18:23:36.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.843+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7feea4017870 con 0x7fee9806a440 2026-02-13T18:23:36.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.843+0000 7feea1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:36.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.843+0000 7feea1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:36.901 INFO:tasks.rados.rados.0.trial187.stdout:3879: done (2 left) 2026-02-13T18:23:36.902 INFO:tasks.rados.rados.0.trial187.stdout:3880: done (1 left) 2026-02-13T18:23:36.902 INFO:tasks.rados.rados.0.trial187.stdout:3881: done (0 left) 2026-02-13T18:23:36.902 INFO:tasks.rados.rados.0.trial187.stdout:3882: snap_create 2026-02-13T18:23:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:23:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:23:36.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 --> v1:10.20.193.187:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feeb407ef40 con 0x7fee9806a440 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feea1ffb640 1 -- 10.20.193.78:0/69164029 <== mon.1 v1:10.20.193.187:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1598 (unknown 254746657 0 3871139145) 0x7feea4017150 con 0x7fee9806a440 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feea1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feea1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 >> v1:10.20.193.187:6812/2668687789 conn(0x7fee8403d340 legacy=0x7fee8405d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 10 monclient: shutdown 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 >> v1:10.20.193.187:6789/0 conn(0x7fee9806a440 legacy=0x7feeb41d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 shutdown_connections 2026-02-13T18:23:36.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 >> 10.20.193.78:0/69164029 conn(0x7feeb4056aa0 msgr2=0x7feeb408c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 shutdown_connections 2026-02-13T18:23:36.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:36.959+0000 7feebb399640 1 -- 10.20.193.78:0/69164029 wait complete. 2026-02-13T18:23:36.986 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T18:23:36.986 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T18:23:36.987 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:23:37.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient: get_monmap_and_config 2026-02-13T18:23:37.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient: build_initial_monmap 2026-02-13T18:23:37.051 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient: monmap: 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:37.040577+0000 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:37.040577+0000 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:37.052 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 1 Processor -- start 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 1 -- start start 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient: init 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient(hunting): picked mon.noname-b con 0x7f1f6c05e570 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient(hunting): picked mon.noname-c con 0x7f1f6c08cad0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient(hunting): picked mon.noname-a con 0x7f1f6c08cf30 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6c05e940 con 0x7f1f6c08cf30 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6c08e000 con 0x7f1f6c08cad0 2026-02-13T18:23:37.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6c084e70 con 0x7f1f6c05e570 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f7440c640 10 monclient(hunting): authenticate will time out at 1648.095715s 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f72181640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f1f6c05e570 legacy=0x7f1f6c08c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f72982640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f1f6c08cf30 0x7f1f6c1aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:42004/0 (socket says 10.20.193.78:42004) 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.035+0000 7f1f72982640 1 -- 10.20.193.78:0/401084338 learned_addr learned my addr 10.20.193.78:0/401084338 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f72982640 1 -- 10.20.193.78:0/401084338 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c08cf30 legacy=0x7f1f6c1aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f71980640 1 -- 10.20.193.78:0/401084338 >> v1:10.20.193.187:6789/0 conn(0x7f1f6c08cad0 legacy=0x7f1f6c188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945121093 0 0) 0x7f1f6c05e940 con 0x7f1f6c08cf30 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): my global_id is 124239 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f54003620 con 0x7f1f6c08cf30 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714614657 0 0) 0x7f1f6c08e000 con 0x7f1f6c08cad0 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient(hunting): my global_id is 134173 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6c05e940 con 0x7f1f6c08cad0 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3779513547 0 0) 0x7f1f54003620 con 0x7f1f6c08cf30 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 >> v1:10.20.193.78:6790/0 conn(0x7f1f6c05e570 legacy=0x7f1f6c08c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 >> v1:10.20.193.187:6789/0 conn(0x7f1f6c08cad0 legacy=0x7f1f6c188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: _finish_hunting 0 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 monclient: found mon.noname-a 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c0845d0 con 0x7f1f6c08cf30 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: _finish_auth 0 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: _check_auth_tickets 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1f68004620 con 0x7f1f6c08cf30 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: dump: 2026-02-13T18:23:37.061 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 5 monclient: authenticate success, global_id 124239 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:37.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f680048f0 con 0x7f1f6c08cf30 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 1 -- 10.20.193.78:0/401084338 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1f68006060 con 0x7f1f6c08cf30 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7117f640 10 monclient: dump: 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.063 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 4 set_mon_vals no callback set 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 10 monclient: shutdown 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 -- 10.20.193.78:0/401084338 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c08cf30 legacy=0x7f1f6c1aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 -- 10.20.193.78:0/401084338 shutdown_connections 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 -- 10.20.193.78:0/401084338 >> 10.20.193.78:0/401084338 conn(0x7f1f6c091720 msgr2=0x7f1f6c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 -- 10.20.193.78:0/401084338 shutdown_connections 2026-02-13T18:23:37.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 -- 10.20.193.78:0/401084338 wait complete. 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 10 monclient: build_initial_monmap 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 10 monclient: monmap: 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:37.065 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 Processor -- start 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 1 -- start start 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.039+0000 7f1f7440c640 10 monclient: init 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient(hunting): picked mon.noname-a con 0x7f1f6c05e570 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient(hunting): picked mon.noname-c con 0x7f1f6c08cad0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient(hunting): picked mon.noname-b con 0x7f1f6c08cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6c19e3c0 con 0x7f1f6c05e570 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6c19e6a0 con 0x7f1f6c08cf30 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f71980640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f1f6c08cad0 legacy=0x7f1f6c21fc60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6c088ed0 con 0x7f1f6c08cad0 2026-02-13T18:23:37.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:37.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient(hunting): authenticate will time out at 1648.100397s 2026-02-13T18:23:37.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f72181640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f1f6c05e570 0x7f1f6c1dec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:42010/0 (socket says 10.20.193.78:42010) 2026-02-13T18:23:37.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f72181640 1 -- 10.20.193.78:0/4097913506 learned_addr learned my addr 10.20.193.78:0/4097913506 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f72181640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c05e570 legacy=0x7f1f6c1dec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163651677 0 0) 0x7f1f6c19e3c0 con 0x7f1f6c05e570 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): my global_id is 124242 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f3c003620 con 0x7f1f6c05e570 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3207873266 0 0) 0x7f1f3c003620 con 0x7f1f6c05e570 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f6c19e3c0 con 0x7f1f6c05e570 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1f5c0045c0 con 0x7f1f6c05e570 2026-02-13T18:23:37.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): dump: 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.073 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f72982640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.187:6789/0 conn(0x7f1f6c08cf30 legacy=0x7f1f6c241390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3153852451 0 0) 0x7f1f6c19e3c0 con 0x7f1f6c05e570 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6790/0 conn(0x7f1f6c08cad0 legacy=0x7f1f6c21fc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.187:6789/0 conn(0x7f1f6c08cf30 legacy=0x7f1f6c241390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 monclient: found mon.a 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c05d350 con 0x7f1f6c05e570 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: _finish_auth 0 2026-02-13T18:23:37.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 5 monclient: authenticate success, global_id 124242 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient: _renew_subs 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c19e980 con 0x7f1f6c05e570 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient: _renew_subs 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f6c05c8a0 con 0x7f1f6c05e570 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f5c004890 con 0x7f1f6c05e570 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1f5c004c30 con 0x7f1f6c05e570 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 10 monclient: dump: 2026-02-13T18:23:37.075 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7097e640 4 set_mon_vals no callback set 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1f5c004f00 con 0x7f1f6c05e570 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.043+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f6c08f620 con 0x7f1f6c1df390 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(884..884 src has 621..884) ==== 3931+0+0 (unknown 2089892461 0 0) 0x7f1f5c04c7c0 con 0x7f1f6c05e570 2026-02-13T18:23:37.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f72982640 10 monclient: get_auth_request con 0x7f1f3c03d390 auth_method 0 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f71980640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c1df390 legacy=0x7f1f6c057020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903651841 0 0) 0x7f1f60003450 con 0x7f1f6c1df390 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient(hunting): my global_id is 124245 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6c19e3c0 con 0x7f1f6c1df390 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1858808891 0 0) 0x7f1f6c19e3c0 con 0x7f1f6c1df390 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f60003450 con 0x7f1f6c1df390 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1f60003710 con 0x7f1f6c1df390 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient: dump: 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.077 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1198952939 0 0) 0x7f1f60003450 con 0x7f1f6c1df390 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f6c05cc30 con 0x7f1f6c1df390 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1f600058c0 con 0x7f1f6c1df390 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c1df390 legacy=0x7f1f6c057020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.047+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c1df390 legacy=0x7f1f6c057020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:37.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.051+0000 7f1f7440c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.051+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f6c19dd50 con 0x7f1f6c057730 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f71980640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c057730 legacy=0x7f1f6c263ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972550174 0 0) 0x7f1f6c19dd50 con 0x7f1f6c057730 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient(hunting): my global_id is 124248 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f60003450 con 0x7f1f6c057730 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 362985353 0 0) 0x7f1f60003450 con 0x7f1f6c057730 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f6c19dd50 con 0x7f1f6c057730 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1f60003d80 con 0x7f1f6c057730 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient: dump: 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.079 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1296949847 0 0) 0x7f1f6c19dd50 con 0x7f1f6c057730 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f6c08a050 con 0x7f1f6c057730 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4664 (unknown 0 0 2198689542) 0x7f1f60005b10 con 0x7f1f6c057730 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c057730 legacy=0x7f1f6c263ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f52ffd640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c057730 legacy=0x7f1f6c263ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 64, 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 145593, 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: 1 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:37.081 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:37.082 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:37.083 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:37.084 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:37.085 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.086 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:37.087 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:37.088 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.089 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.090 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:37.091 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:37.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.187:6812/2668687789 conn(0x7f1f3c03d390 legacy=0x7f1f3c05d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 10 monclient: shutdown 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 >> v1:10.20.193.78:6789/0 conn(0x7f1f6c05e570 legacy=0x7f1f6c1dec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f72982640 1 -- 10.20.193.78:0/4097913506 reap_dead start 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 shutdown_connections 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 >> 10.20.193.78:0/4097913506 conn(0x7f1f6c091720 msgr2=0x7f1f6c08b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 shutdown_connections 2026-02-13T18:23:37.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.055+0000 7f1f7440c640 1 -- 10.20.193.78:0/4097913506 wait complete. 2026-02-13T18:23:37.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:23:37.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T18:23:37.094 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient: get_monmap_and_config 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient: build_initial_monmap 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient: monmap: 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:23:37.151715+0000 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:23:37.151715+0000 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 1 Processor -- start 2026-02-13T18:23:37.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 1 -- start start 2026-02-13T18:23:37.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient: init 2026-02-13T18:23:37.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient(hunting): picked mon.noname-c con 0x7fb64813f820 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient(hunting): picked mon.noname-a con 0x7fb648088e40 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient(hunting): picked mon.noname-b con 0x7fb64813f3a0 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb648089750 con 0x7fb648088e40 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb648089a30 con 0x7fb64813f820 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64805db10 con 0x7fb64813f3a0 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64f4a1640 10 monclient(hunting): authenticate will time out at 1648.206882s 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64da17640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fb64813f3a0 legacy=0x7fb6481a5390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64ca15640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb648088e40 0x7fb648183c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:42046/0 (socket says 10.20.193.78:42046) 2026-02-13T18:23:37.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.147+0000 7fb64ca15640 1 -- 10.20.193.78:0/1294100437 learned_addr learned my addr 10.20.193.78:0/1294100437 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64ca15640 1 -- 10.20.193.78:0/1294100437 >> v1:10.20.193.78:6789/0 conn(0x7fb648088e40 legacy=0x7fb648183c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64d216640 1 -- 10.20.193.78:0/1294100437 >> v1:10.20.193.187:6789/0 conn(0x7fb64813f820 legacy=0x7fb64813fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867509064 0 0) 0x7fb648089750 con 0x7fb648088e40 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient(hunting): my global_id is 124251 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb630003620 con 0x7fb648088e40 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 619209669 0 0) 0x7fb630003620 con 0x7fb648088e40 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 >> v1:10.20.193.78:6790/0 conn(0x7fb64813f3a0 legacy=0x7fb6481a5390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:23:37.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 >> v1:10.20.193.187:6789/0 conn(0x7fb64813f820 legacy=0x7fb64813fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: _finish_hunting 0 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 monclient: found mon.noname-a 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6481a9ae0 con 0x7fb648088e40 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: _finish_auth 0 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: _check_auth_tickets 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 5 monclient: authenticate success, global_id 124251 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb63c003110 con 0x7fb648088e40 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: dump: 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.168 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb63c003450 con 0x7fb648088e40 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 1 -- 10.20.193.78:0/1294100437 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb63c004b50 con 0x7fb648088e40 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb637fff640 10 monclient: dump: 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.169 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: get_monmap_and_config success 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 4 set_mon_vals no callback set 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: shutdown 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- 10.20.193.78:0/1294100437 >> v1:10.20.193.78:6789/0 conn(0x7fb648088e40 legacy=0x7fb648183c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- 10.20.193.78:0/1294100437 shutdown_connections 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- 10.20.193.78:0/1294100437 >> 10.20.193.78:0/1294100437 conn(0x7fb648054e70 msgr2=0x7fb648093b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- 10.20.193.78:0/1294100437 shutdown_connections 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- 10.20.193.78:0/1294100437 wait complete. 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: build_initial_monmap 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: monmap: 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:23:37.170 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 Processor -- start 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- start start 2026-02-13T18:23:37.171 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: init 2026-02-13T18:23:37.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: _reopen_session rank -1 2026-02-13T18:23:37.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:23:37.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient(hunting): picked mon.noname-b con 0x7fb64813f3a0 addr v1:10.20.193.187:6789/0 2026-02-13T18:23:37.173 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient(hunting): picked mon.noname-c con 0x7fb64813f820 addr v1:10.20.193.78:6790/0 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient(hunting): picked mon.noname-a con 0x7fb648127940 addr v1:10.20.193.78:6789/0 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64812a190 con 0x7fb648127940 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb648115020 con 0x7fb64813f3a0 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb648128650 con 0x7fb64813f820 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient(hunting): _renew_subs 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64ca15640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fb64813f820 legacy=0x7fb648114910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64f4a1640 10 monclient(hunting): authenticate will time out at 1648.211404s 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64da17640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fb648127940 0x7fb6481a14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:42052/0 (socket says 10.20.193.78:42052) 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.151+0000 7fb64da17640 1 -- 10.20.193.78:0/4024581256 learned_addr learned my addr 10.20.193.78:0/4024581256 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64da17640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.78:6789/0 conn(0x7fb648127940 legacy=0x7fb6481a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820854838 0 0) 0x7fb64812a190 con 0x7fb648127940 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): my global_id is 124254 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64d216640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb64813f3a0 legacy=0x7fb648114200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb618003620 con 0x7fb648127940 2026-02-13T18:23:37.174 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783612966 0 0) 0x7fb648115020 con 0x7fb64813f3a0 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): my global_id is 134182 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb64812a190 con 0x7fb64813f3a0 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 676827854 0 0) 0x7fb618003620 con 0x7fb648127940 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb648115020 con 0x7fb648127940 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb644005900 con 0x7fb648127940 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): dump: 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.175 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3427323616 0 0) 0x7fb648115020 con 0x7fb648127940 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.78:6790/0 conn(0x7fb64813f820 legacy=0x7fb648114910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb64813f3a0 legacy=0x7fb648114200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 monclient: found mon.a 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64805e3d0 con 0x7fb648127940 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: _finish_auth 0 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 5 monclient: authenticate success, global_id 124254 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 10 monclient: _renew_subs 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6481a89c0 con 0x7fb648127940 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 10 monclient: _renew_subs 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6481a2c10 con 0x7fb648127940 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb644005bd0 con 0x7fb648127940 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb644005f30 con 0x7fb648127940 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 10 monclient: dump: 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.177 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb6377fe640 4 set_mon_vals no callback set 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb648091a10 con 0x7fb648088e40 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb644006200 con 0x7fb648127940 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(884..884 src has 621..884) ==== 3931+0+0 (unknown 2089892461 0 0) 0x7fb64404da70 con 0x7fb648127940 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.155+0000 7fb64ca15640 10 monclient: get_auth_request con 0x7fb61803d470 auth_method 0 2026-02-13T18:23:37.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb64d216640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb648088e40 legacy=0x7fb64808b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889611402 0 0) 0x7fb648091a10 con 0x7fb648088e40 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient(hunting): my global_id is 134185 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb648115020 con 0x7fb648088e40 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1649236141 0 0) 0x7fb648115020 con 0x7fb648088e40 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb648091a10 con 0x7fb648088e40 2026-02-13T18:23:37.179 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb638003350 con 0x7fb648088e40 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient: dump: 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 605293436 0 0) 0x7fb648091a10 con 0x7fb648088e40 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6481a8490 con 0x7fb648088e40 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb6380058c0 con 0x7fb648088e40 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:23:37.180 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb648088e40 legacy=0x7fb64808b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.159+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb648088e40 legacy=0x7fb64808b6f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:37.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.163+0000 7fb64f4a1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:23:37.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.163+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb64812a6b0 con 0x7fb6481a6cc0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64d216640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb6481a6cc0 legacy=0x7fb64808be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134473421 0 0) 0x7fb64812a6b0 con 0x7fb6481a6cc0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient(hunting): my global_id is 134188 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb648091a10 con 0x7fb6481a6cc0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1754937899 0 0) 0x7fb648091a10 con 0x7fb6481a6cc0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb64812a6b0 con 0x7fb6481a6cc0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb638003b80 con 0x7fb6481a6cc0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:23:37.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient: dump: 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3079515250 0 0) 0x7fb64812a6b0 con 0x7fb6481a6cc0 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb648051150 con 0x7fb6481a6cc0 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4498 (unknown 0 0 1696887451) 0x7fb638005b40 con 0x7fb6481a6cc0 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb6481a6cc0 legacy=0x7fb64808be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.183 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb635ffb640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6789/0 conn(0x7fb6481a6cc0 legacy=0x7fb64808be00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 64, 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 32456, 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: 1 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 0, 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:23:37.184 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:37.185 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:23:37.186 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:23:37.187 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:23:37.188 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:37.189 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.190 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.191 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: "num": 4 2026-02-13T18:23:37.192 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:23:37.193 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:23:37.193 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:23:37.193 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:23:37.193 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb61803d470 legacy=0x7fb61805d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 10 monclient: shutdown 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 >> v1:10.20.193.78:6789/0 conn(0x7fb648127940 legacy=0x7fb6481a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64da17640 1 -- 10.20.193.78:0/4024581256 reap_dead start 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64da17640 1 -- 10.20.193.78:0/4024581256 reap_dead start 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 shutdown_connections 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 >> 10.20.193.78:0/4024581256 conn(0x7fb648054e70 msgr2=0x7fb648124390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 shutdown_connections 2026-02-13T18:23:37.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:23:37.167+0000 7fb64f4a1640 1 -- 10.20.193.78:0/4024581256 wait complete. 2026-02-13T18:23:37.195 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T18:23:37.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T18:23:37.907 INFO:tasks.rados.rados.0.trial187.stdout:3882: done (0 left) 2026-02-13T18:23:37.907 INFO:tasks.rados.rados.0.trial187.stdout:3883: read oid 19 snap -1 2026-02-13T18:23:37.907 INFO:tasks.rados.rados.0.trial187.stdout:3883: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:23:37.907 INFO:tasks.rados.rados.0.trial187.stdout:3884: snap_remove snap 415 2026-02-13T18:23:38.911 INFO:tasks.rados.rados.0.trial187.stdout:3884: done (1 left) 2026-02-13T18:23:38.911 INFO:tasks.rados.rados.0.trial187.stdout:3885: write (excl) oid 41 current snap is 440 2026-02-13T18:23:38.911 INFO:tasks.rados.rados.0.trial187.stdout:3885: seq_num 1276 ranges {645732=648675,1751847=574113,3124327=321405} 2026-02-13T18:23:38.919 INFO:tasks.rados.rados.0.trial187.stdout:3885: writing trial18717860-41 from 645732 to 1294407 tid 1 2026-02-13T18:23:38.926 INFO:tasks.rados.rados.0.trial187.stdout:3885: writing trial18717860-41 from 1751847 to 2325960 tid 2 2026-02-13T18:23:38.934 INFO:tasks.rados.rados.0.trial187.stdout:3885: writing trial18717860-41 from 3124327 to 3445732 tid 3 2026-02-13T18:23:38.934 INFO:tasks.rados.rados.0.trial187.stdout:3886: delete oid 12 current snap is 440 2026-02-13T18:23:38.934 INFO:tasks.rados.rados.0.trial187.stdout:3883: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:23:38.967 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 393516 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: finishing write tid 1 to trial18717860-41 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: finishing write tid 2 to trial18717860-41 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: finishing write tid 3 to trial18717860-41 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: finishing write tid 4 to trial18717860-41 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: finishing write tid 5 to trial18717860-41 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: oid 41 updating version 0 to 2083 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: oid 41 updating version 2083 to 2086 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: oid 41 version 2086 is already newer than 2084 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:3885: oid 41 version 2086 is already newer than 2085 2026-02-13T18:23:39.024 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 2086 (ObjNum 1276 snap 440 seq_num 1276) dirty exists 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:3885: left oid 41 (ObjNum 1276 snap 440 seq_num 1276) 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:3883: done (2 left) 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:3885: done (1 left) 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:3886: done (0 left) 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:3887: rollback oid 9 current snap is 440 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 9 to 377 2026-02-13T18:23:39.025 INFO:tasks.rados.rados.0.trial187.stdout:3888: delete oid 6 current snap is 440 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:3888: done (1 left) 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:3889: read oid 38 snap -1 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:3889: expect (ObjNum 1275 snap 438 seq_num 1275) 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:3890: copy_from oid 1 from oid 42 current snap is 440 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:3891: rollback oid 31 current snap is 440 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 31 to 436 2026-02-13T18:23:39.026 INFO:tasks.rados.rados.0.trial187.stdout:3892: write (excl) oid 14 current snap is 440 2026-02-13T18:23:39.027 INFO:tasks.rados.rados.0.trial187.stdout:3892: seq_num 1279 ranges {696153=590775,1927293=721440,3206596=289557} 2026-02-13T18:23:39.034 INFO:tasks.rados.rados.0.trial187.stdout:3892: writing trial18717860-14 from 696153 to 1286928 tid 1 2026-02-13T18:23:39.043 INFO:tasks.rados.rados.0.trial187.stdout:3892: writing trial18717860-14 from 1927293 to 2648733 tid 2 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3892: writing trial18717860-14 from 3206596 to 3496153 tid 3 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3893: write oid 12 current snap is 440 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3891: finishing rollback tid 0 to trial18717860-31 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3891: finishing rollback tid 1 to trial18717860-31 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3891: finishing rollback tid 2 to trial18717860-31 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 31 v 1468 (ObjNum 1246 snap 428 seq_num 1246) dirty exists 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3887: finishing rollback tid 0 to trial18717860-9 2026-02-13T18:23:39.050 INFO:tasks.rados.rados.0.trial187.stdout:3893: seq_num 1280 ranges {712960=666024,1985775=581451,3234019=278941} 2026-02-13T18:23:39.059 INFO:tasks.rados.rados.0.trial187.stdout:3893: writing trial18717860-12 from 712960 to 1378984 tid 1 2026-02-13T18:23:39.066 INFO:tasks.rados.rados.0.trial187.stdout:3893: writing trial18717860-12 from 1985775 to 2567226 tid 2 2026-02-13T18:23:39.073 INFO:tasks.rados.rados.0.trial187.stdout:3893: writing trial18717860-12 from 3234019 to 3512960 tid 3 2026-02-13T18:23:39.073 INFO:tasks.rados.rados.0.trial187.stdout:3891: done (5 left) 2026-02-13T18:23:39.073 INFO:tasks.rados.rados.0.trial187.stdout:3894: copy_from oid 44 from oid 33 current snap is 440 2026-02-13T18:23:39.074 INFO:tasks.rados.rados.0.trial187.stdout:3887: finishing rollback tid 1 to trial18717860-9 2026-02-13T18:23:39.074 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 2438 (ObjNum 225 snap 0 seq_num 3014085168) dirty dne 2026-02-13T18:23:39.074 INFO:tasks.rados.rados.0.trial187.stdout:3889: expect (ObjNum 1275 snap 438 seq_num 1275) 2026-02-13T18:23:39.074 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:39.200 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1142376 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3892: finishing write tid 1 to trial18717860-14 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3890: finishing copy_from racing read to trial18717860-1 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3890: finishing copy_from to trial18717860-1 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 1658 (ObjNum 1254 snap 431 seq_num 1254) dirty exists 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3892: finishing write tid 2 to trial18717860-14 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3892: finishing write tid 3 to trial18717860-14 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3892: finishing write tid 4 to trial18717860-14 2026-02-13T18:23:39.246 INFO:tasks.rados.rados.0.trial187.stdout:3892: finishing write tid 5 to trial18717860-14 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3892: oid 14 updating version 0 to 2526 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3892: oid 14 updating version 2526 to 2529 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3892: oid 14 version 2529 is already newer than 2528 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3892: oid 14 version 2529 is already newer than 2527 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 2529 (ObjNum 1279 snap 440 seq_num 1279) dirty exists 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3892: left oid 14 (ObjNum 1279 snap 440 seq_num 1279) 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: finishing write tid 1 to trial18717860-12 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: finishing write tid 2 to trial18717860-12 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: finishing write tid 3 to trial18717860-12 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: finishing write tid 4 to trial18717860-12 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: finishing write tid 5 to trial18717860-12 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: oid 12 updating version 0 to 1674 2026-02-13T18:23:39.247 INFO:tasks.rados.rados.0.trial187.stdout:3893: oid 12 version 1674 is already newer than 1671 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3893: oid 12 version 1674 is already newer than 1673 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3893: oid 12 version 1674 is already newer than 1672 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1674 (ObjNum 1280 snap 440 seq_num 1280) dirty exists 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3893: left oid 12 (ObjNum 1280 snap 440 seq_num 1280) 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3894: finishing copy_from racing read to trial18717860-44 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3894: finishing copy_from to trial18717860-44 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2596 (ObjNum 1273 snap 435 seq_num 1273) dirty exists 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3887: done (5 left) 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3889: done (4 left) 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3890: done (3 left) 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3892: done (2 left) 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3893: done (1 left) 2026-02-13T18:23:39.248 INFO:tasks.rados.rados.0.trial187.stdout:3894: done (0 left) 2026-02-13T18:23:39.249 INFO:tasks.rados.rados.0.trial187.stdout:3895: copy_from oid 32 from oid 36 current snap is 440 2026-02-13T18:23:39.249 INFO:tasks.rados.rados.0.trial187.stdout:3896: delete oid 35 current snap is 440 2026-02-13T18:23:39.249 INFO:tasks.rados.rados.0.trial187.stdout:3896: done (1 left) 2026-02-13T18:23:39.249 INFO:tasks.rados.rados.0.trial187.stdout:3897: write (excl) oid 10 current snap is 440 2026-02-13T18:23:39.249 INFO:tasks.rados.rados.0.trial187.stdout:3897: seq_num 1282 ranges {746574=416522,1586386=468767,2772512=629544} 2026-02-13T18:23:39.255 INFO:tasks.rados.rados.0.trial187.stdout:3897: writing trial18717860-10 from 746574 to 1163096 tid 1 2026-02-13T18:23:39.261 INFO:tasks.rados.rados.0.trial187.stdout:3897: writing trial18717860-10 from 1586386 to 2055153 tid 2 2026-02-13T18:23:39.271 INFO:tasks.rados.rados.0.trial187.stdout:3897: writing trial18717860-10 from 2772512 to 3402056 tid 3 2026-02-13T18:23:39.271 INFO:tasks.rados.rados.0.trial187.stdout:3898: read oid 21 snap -1 2026-02-13T18:23:39.271 INFO:tasks.rados.rados.0.trial187.stdout:3898: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3899: rollback oid 46 current snap is 440 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 46 to 437 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3895: finishing copy_from racing read to trial18717860-32 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3895: finishing copy_from to trial18717860-32 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 1655 (ObjNum 1233 snap 423 seq_num 1233) dirty exists 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3897: finishing write tid 1 to trial18717860-10 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3897: finishing write tid 2 to trial18717860-10 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3895: done (3 left) 2026-02-13T18:23:39.272 INFO:tasks.rados.rados.0.trial187.stdout:3900: snap_remove snap 428 2026-02-13T18:23:39.731 INFO:tasks.rados.rados.0.trial187.stdout:3900: done (3 left) 2026-02-13T18:23:39.731 INFO:tasks.rados.rados.0.trial187.stdout:3901: snap_remove snap 438 2026-02-13T18:23:40.731 INFO:tasks.rados.rados.0.trial187.stdout:3901: done (3 left) 2026-02-13T18:23:40.732 INFO:tasks.rados.rados.0.trial187.stdout:3902: copy_from oid 27 from oid 25 current snap is 440 2026-02-13T18:23:40.732 INFO:tasks.rados.rados.0.trial187.stdout:3897: finishing write tid 3 to trial18717860-10 2026-02-13T18:23:40.732 INFO:tasks.rados.rados.0.trial187.stdout:3898: expect (ObjNum 992 snap 321 seq_num 992) 2026-02-13T18:23:40.732 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:40.850 INFO:tasks.rados.rados.0.trial187.stdout:3897: finishing write tid 4 to trial18717860-10 2026-02-13T18:23:40.850 INFO:tasks.rados.rados.0.trial187.stdout:3897: finishing write tid 5 to trial18717860-10 2026-02-13T18:23:40.850 INFO:tasks.rados.rados.0.trial187.stdout:3897: oid 10 updating version 0 to 1678 2026-02-13T18:23:40.850 INFO:tasks.rados.rados.0.trial187.stdout:3897: oid 10 version 1678 is already newer than 1676 2026-02-13T18:23:40.850 INFO:tasks.rados.rados.0.trial187.stdout:3897: oid 10 version 1678 is already newer than 1677 2026-02-13T18:23:40.850 INFO:tasks.rados.rados.0.trial187.stdout:3897: oid 10 version 1678 is already newer than 1675 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 10 v 1678 (ObjNum 1282 snap 440 seq_num 1282) dirty exists 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3897: left oid 10 (ObjNum 1282 snap 440 seq_num 1282) 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3899: finishing rollback tid 0 to trial18717860-46 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3899: finishing rollback tid 1 to trial18717860-46 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3899: finishing rollback tid 2 to trial18717860-46 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 2432 (ObjNum 1251 snap 431 seq_num 1251) dirty exists 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3902: finishing copy_from racing read to trial18717860-27 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3902: finishing copy_from to trial18717860-27 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1671 (ObjNum 1255 snap 433 seq_num 1255) dirty exists 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3897: done (3 left) 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3898: done (2 left) 2026-02-13T18:23:40.851 INFO:tasks.rados.rados.0.trial187.stdout:3899: done (1 left) 2026-02-13T18:23:40.852 INFO:tasks.rados.rados.0.trial187.stdout:3902: done (0 left) 2026-02-13T18:23:40.852 INFO:tasks.rados.rados.0.trial187.stdout:3903: write oid 4 current snap is 440 2026-02-13T18:23:40.852 INFO:tasks.rados.rados.0.trial187.stdout:3903: seq_num 1283 ranges {763381=491771,2044868=728778,3199935=363446} 2026-02-13T18:23:40.858 INFO:tasks.rados.rados.0.trial187.stdout:3903: writing trial18717860-4 from 763381 to 1255152 tid 1 2026-02-13T18:23:40.869 INFO:tasks.rados.rados.0.trial187.stdout:3903: writing trial18717860-4 from 2044868 to 2773646 tid 2 2026-02-13T18:23:40.875 INFO:tasks.rados.rados.0.trial187.stdout:3903: writing trial18717860-4 from 3199935 to 3563381 tid 3 2026-02-13T18:23:40.875 INFO:tasks.rados.rados.0.trial187.stdout:3904: rollback oid 27 current snap is 440 2026-02-13T18:23:40.875 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 27 to 395 2026-02-13T18:23:40.875 INFO:tasks.rados.rados.0.trial187.stdout:3903: finishing write tid 1 to trial18717860-4 2026-02-13T18:23:40.875 INFO:tasks.rados.rados.0.trial187.stdout:3903: finishing write tid 2 to trial18717860-4 2026-02-13T18:23:40.876 INFO:tasks.rados.rados.0.trial187.stdout:3905: read oid 45 snap -1 2026-02-13T18:23:40.876 INFO:tasks.rados.rados.0.trial187.stdout:3905: expect deleted 2026-02-13T18:23:40.876 INFO:tasks.rados.rados.0.trial187.stdout:3906: rollback oid 8 current snap is 440 2026-02-13T18:23:40.876 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 8 to 430 2026-02-13T18:23:40.876 INFO:tasks.rados.rados.0.trial187.stdout:3907: write (excl) oid 13 current snap is 440 2026-02-13T18:23:40.876 INFO:tasks.rados.rados.0.trial187.stdout:3907: seq_num 1284 ranges {780188=567020,2103350=472436,3227358=352830} 2026-02-13T18:23:40.884 INFO:tasks.rados.rados.0.trial187.stdout:3907: writing trial18717860-13 from 780188 to 1347208 tid 1 2026-02-13T18:23:40.892 INFO:tasks.rados.rados.0.trial187.stdout:3907: writing trial18717860-13 from 2103350 to 2575786 tid 2 2026-02-13T18:23:40.899 INFO:tasks.rados.rados.0.trial187.stdout:3907: writing trial18717860-13 from 3227358 to 3580188 tid 3 2026-02-13T18:23:40.899 INFO:tasks.rados.rados.0.trial187.stdout:3908: write (excl) oid 28 current snap is 440 2026-02-13T18:23:40.899 INFO:tasks.rados.rados.0.trial187.stdout:3908: seq_num 1285 ranges {796995=758622,2161832=732447} 2026-02-13T18:23:40.905 INFO:tasks.rados.rados.0.trial187.stdout:3908: writing trial18717860-28 from 796995 to 1555617 tid 1 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3908: writing trial18717860-28 from 2161832 to 2894279 tid 2 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3909: rollback oid 12 current snap is 440 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 12 to 436 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3903: finishing write tid 3 to trial18717860-4 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3903: finishing write tid 4 to trial18717860-4 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3903: finishing write tid 5 to trial18717860-4 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3903: oid 4 updating version 0 to 1472 2026-02-13T18:23:40.911 INFO:tasks.rados.rados.0.trial187.stdout:3903: oid 4 version 1472 is already newer than 1470 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3903: oid 4 version 1472 is already newer than 1471 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3903: oid 4 version 1472 is already newer than 1469 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1472 (ObjNum 1283 snap 440 seq_num 1283) dirty exists 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3903: left oid 4 (ObjNum 1283 snap 440 seq_num 1283) 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3904: finishing rollback tid 0 to trial18717860-27 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3904: finishing rollback tid 1 to trial18717860-27 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3904: finishing rollback tid 2 to trial18717860-27 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1677 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3906: finishing rollback tid 0 to trial18717860-8 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3906: finishing rollback tid 1 to trial18717860-8 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:3906: finishing rollback tid 2 to trial18717860-8 2026-02-13T18:23:40.912 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 8 v 2436 (ObjNum 1142 snap 382 seq_num 1142) dirty exists 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: finishing write tid 1 to trial18717860-13 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: finishing write tid 2 to trial18717860-13 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3903: done (6 left) 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3904: done (5 left) 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3905: done (4 left) 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3906: done (3 left) 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3910: delete oid 23 current snap is 440 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: finishing write tid 3 to trial18717860-13 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: finishing write tid 4 to trial18717860-13 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: finishing write tid 5 to trial18717860-13 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: oid 13 updating version 0 to 1669 2026-02-13T18:23:40.913 INFO:tasks.rados.rados.0.trial187.stdout:3907: oid 13 version 1669 is already newer than 1667 2026-02-13T18:23:40.914 INFO:tasks.rados.rados.0.trial187.stdout:3907: oid 13 version 1669 is already newer than 1668 2026-02-13T18:23:40.914 INFO:tasks.rados.rados.0.trial187.stdout:3907: oid 13 version 1669 is already newer than 1666 2026-02-13T18:23:40.914 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 13 v 1669 (ObjNum 1284 snap 440 seq_num 1284) dirty exists 2026-02-13T18:23:40.914 INFO:tasks.rados.rados.0.trial187.stdout:3907: left oid 13 (ObjNum 1284 snap 440 seq_num 1284) 2026-02-13T18:23:40.914 INFO:tasks.rados.rados.0.trial187.stdout:3908: finishing write tid 1 to trial18717860-28 2026-02-13T18:23:40.915 INFO:tasks.rados.rados.0.trial187.stdout:3907: done (3 left) 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3910: done (2 left) 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3911: rollback oid 16 current snap is 440 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 16 to 435 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3912: snap_create 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3909: finishing rollback tid 0 to trial18717860-12 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3908: finishing write tid 2 to trial18717860-28 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3908: finishing write tid 3 to trial18717860-28 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3909: finishing rollback tid 1 to trial18717860-12 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 12 v 1680 (ObjNum 225 snap 0 seq_num 3014101568) dirty dne 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3908: finishing write tid 4 to trial18717860-28 2026-02-13T18:23:40.916 INFO:tasks.rados.rados.0.trial187.stdout:3908: oid 28 updating version 0 to 2296 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:3908: oid 28 version 2296 is already newer than 2295 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:3908: oid 28 version 2296 is already newer than 2294 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 2296 (ObjNum 1285 snap 440 seq_num 1285) dirty exists 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:3908: left oid 28 (ObjNum 1285 snap 440 seq_num 1285) 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:3911: finishing rollback tid 0 to trial18717860-16 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:3911: finishing rollback tid 1 to trial18717860-16 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:3911: finishing rollback tid 2 to trial18717860-16 2026-02-13T18:23:40.917 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 16 v 1669 (ObjNum 1272 snap 435 seq_num 1272) dirty exists 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3908: done (3 left) 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3909: done (2 left) 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3911: done (1 left) 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3912: done (0 left) 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3913: read oid 8 snap -1 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3913: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:23:41.915 INFO:tasks.rados.rados.0.trial187.stdout:3914: delete oid 13 current snap is 441 2026-02-13T18:23:41.919 INFO:tasks.rados.rados.0.trial187.stdout:3914: done (1 left) 2026-02-13T18:23:41.919 INFO:tasks.rados.rados.0.trial187.stdout:3915: rollback oid 18 current snap is 441 2026-02-13T18:23:41.919 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 18 to 432 2026-02-13T18:23:41.919 INFO:tasks.rados.rados.0.trial187.stdout:3916: read oid 33 snap -1 2026-02-13T18:23:41.919 INFO:tasks.rados.rados.0.trial187.stdout:3916: expect (ObjNum 1273 snap 435 seq_num 1273) 2026-02-13T18:23:41.919 INFO:tasks.rados.rados.0.trial187.stdout:3917: read oid 24 snap -1 2026-02-13T18:23:41.920 INFO:tasks.rados.rados.0.trial187.stdout:3917: expect deleted 2026-02-13T18:23:41.920 INFO:tasks.rados.rados.0.trial187.stdout:3918: write oid 6 current snap is 441 2026-02-13T18:23:41.920 INFO:tasks.rados.rados.0.trial187.stdout:3918: seq_num 1288 ranges {447416=584369,1537278=479774,2537050=529882,3524784=122632} 2026-02-13T18:23:41.926 INFO:tasks.rados.rados.0.trial187.stdout:3918: writing trial18717860-6 from 447416 to 1031785 tid 1 2026-02-13T18:23:41.932 INFO:tasks.rados.rados.0.trial187.stdout:3918: writing trial18717860-6 from 1537278 to 2017052 tid 2 2026-02-13T18:23:41.939 INFO:tasks.rados.rados.0.trial187.stdout:3918: writing trial18717860-6 from 2537050 to 3066932 tid 3 2026-02-13T18:23:41.943 INFO:tasks.rados.rados.0.trial187.stdout:3918: writing trial18717860-6 from 3524784 to 3647416 tid 4 2026-02-13T18:23:41.943 INFO:tasks.rados.rados.0.trial187.stdout:3919: write (excl) oid 14 current snap is 441 2026-02-13T18:23:41.944 INFO:tasks.rados.rados.0.trial187.stdout:3919: seq_num 1289 ranges {464223=659618,1879407=739785,3248120=416103} 2026-02-13T18:23:41.951 INFO:tasks.rados.rados.0.trial187.stdout:3919: writing trial18717860-14 from 464223 to 1123841 tid 1 2026-02-13T18:23:41.961 INFO:tasks.rados.rados.0.trial187.stdout:3919: writing trial18717860-14 from 1879407 to 2619192 tid 2 2026-02-13T18:23:41.966 INFO:tasks.rados.rados.0.trial187.stdout:3919: writing trial18717860-14 from 3248120 to 3664223 tid 3 2026-02-13T18:23:41.966 INFO:tasks.rados.rados.0.trial187.stdout:3920: write (excl) oid 44 current snap is 441 2026-02-13T18:23:41.966 INFO:tasks.rados.rados.0.trial187.stdout:3920: seq_num 1290 ranges {481030=734867,1937889=483443,2875543=552426} 2026-02-13T18:23:41.970 INFO:tasks.rados.rados.0.trial187.stdout:3920: writing trial18717860-44 from 481030 to 1215897 tid 1 2026-02-13T18:23:41.975 INFO:tasks.rados.rados.0.trial187.stdout:3920: writing trial18717860-44 from 1937889 to 2421332 tid 2 2026-02-13T18:23:41.979 INFO:tasks.rados.rados.0.trial187.stdout:3920: writing trial18717860-44 from 2875543 to 3427969 tid 3 2026-02-13T18:23:41.979 INFO:tasks.rados.rados.0.trial187.stdout:3921: snap_remove snap 418 2026-02-13T18:23:42.918 INFO:tasks.rados.rados.0.trial187.stdout:3921: done (7 left) 2026-02-13T18:23:42.918 INFO:tasks.rados.rados.0.trial187.stdout:3922: write oid 29 current snap is 441 2026-02-13T18:23:42.918 INFO:tasks.rados.rados.0.trial187.stdout:3922: seq_num 1291 ranges {497837=410116,1596371=743454,2902966=763698} 2026-02-13T18:23:42.923 INFO:tasks.rados.rados.0.trial187.stdout:3922: writing trial18717860-29 from 497837 to 907953 tid 1 2026-02-13T18:23:42.929 INFO:tasks.rados.rados.0.trial187.stdout:3922: writing trial18717860-29 from 1596371 to 2339825 tid 2 2026-02-13T18:23:42.934 INFO:tasks.rados.rados.0.trial187.stdout:3922: writing trial18717860-29 from 2902966 to 3666664 tid 3 2026-02-13T18:23:42.934 INFO:tasks.rados.rados.0.trial187.stdout:3923: write oid 9 current snap is 441 2026-02-13T18:23:42.934 INFO:tasks.rados.rados.0.trial187.stdout:3923: seq_num 1292 ranges {514644=485365,1654853=487112,2930389=574970} 2026-02-13T18:23:42.938 INFO:tasks.rados.rados.0.trial187.stdout:3923: writing trial18717860-9 from 514644 to 1000009 tid 1 2026-02-13T18:23:42.942 INFO:tasks.rados.rados.0.trial187.stdout:3923: writing trial18717860-9 from 1654853 to 2141965 tid 2 2026-02-13T18:23:42.948 INFO:tasks.rados.rados.0.trial187.stdout:3923: writing trial18717860-9 from 2930389 to 3505359 tid 3 2026-02-13T18:23:42.948 INFO:tasks.rados.rados.0.trial187.stdout:3924: read oid 1 snap -1 2026-02-13T18:23:42.948 INFO:tasks.rados.rados.0.trial187.stdout:3924: expect (ObjNum 1254 snap 431 seq_num 1254) 2026-02-13T18:23:42.949 INFO:tasks.rados.rados.0.trial187.stdout:3925: delete oid 20 current snap is 441 2026-02-13T18:23:42.949 INFO:tasks.rados.rados.0.trial187.stdout:3913: expect (ObjNum 1142 snap 382 seq_num 1142) 2026-02-13T18:23:42.949 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:43.064 INFO:tasks.rados.rados.0.trial187.stdout:3915: finishing rollback tid 0 to trial18717860-18 2026-02-13T18:23:43.065 INFO:tasks.rados.rados.0.trial187.stdout:3915: finishing rollback tid 1 to trial18717860-18 2026-02-13T18:23:43.065 INFO:tasks.rados.rados.0.trial187.stdout:3915: finishing rollback tid 2 to trial18717860-18 2026-02-13T18:23:43.065 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1673 (ObjNum 1201 snap 404 seq_num 1201) dirty exists 2026-02-13T18:23:43.065 INFO:tasks.rados.rados.0.trial187.stdout:3918: finishing write tid 1 to trial18717860-6 2026-02-13T18:23:43.065 INFO:tasks.rados.rados.0.trial187.stdout:3916: expect (ObjNum 1273 snap 435 seq_num 1273) 2026-02-13T18:23:43.079 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1784259 2026-02-13T18:23:43.136 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3348435 2026-02-13T18:23:43.137 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3918: finishing write tid 2 to trial18717860-6 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3918: finishing write tid 3 to trial18717860-6 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3918: finishing write tid 4 to trial18717860-6 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3918: finishing write tid 5 to trial18717860-6 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3913: done (10 left) 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3915: done (9 left) 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3916: done (8 left) 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3917: done (7 left) 2026-02-13T18:23:43.183 INFO:tasks.rados.rados.0.trial187.stdout:3925: done (6 left) 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3926: rollback oid 21 current snap is 441 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 21 to 411 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: finishing write tid 6 to trial18717860-6 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: oid 6 updating version 0 to 2297 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: oid 6 updating version 2297 to 2301 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: oid 6 version 2301 is already newer than 2300 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: oid 6 version 2301 is already newer than 2299 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: oid 6 version 2301 is already newer than 2298 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 6 v 2301 (ObjNum 1288 snap 441 seq_num 1288) dirty exists 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3918: left oid 6 (ObjNum 1288 snap 441 seq_num 1288) 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3919: finishing write tid 1 to trial18717860-14 2026-02-13T18:23:43.184 INFO:tasks.rados.rados.0.trial187.stdout:3919: finishing write tid 2 to trial18717860-14 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: finishing write tid 3 to trial18717860-14 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: finishing write tid 4 to trial18717860-14 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: finishing write tid 5 to trial18717860-14 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: oid 14 updating version 0 to 2534 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: oid 14 version 2534 is already newer than 2532 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: oid 14 version 2534 is already newer than 2533 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: oid 14 version 2534 is already newer than 2531 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 14 v 2534 (ObjNum 1289 snap 441 seq_num 1289) dirty exists 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3919: left oid 14 (ObjNum 1289 snap 441 seq_num 1289) 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3920: finishing write tid 1 to trial18717860-44 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3920: finishing write tid 2 to trial18717860-44 2026-02-13T18:23:43.185 INFO:tasks.rados.rados.0.trial187.stdout:3920: finishing write tid 3 to trial18717860-44 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: finishing write tid 4 to trial18717860-44 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: finishing write tid 5 to trial18717860-44 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: oid 44 updating version 0 to 2622 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: oid 44 updating version 2622 to 2624 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: oid 44 version 2624 is already newer than 2623 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: oid 44 updating version 2624 to 2625 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 44 v 2625 (ObjNum 1290 snap 441 seq_num 1290) dirty exists 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3920: left oid 44 (ObjNum 1290 snap 441 seq_num 1290) 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3922: finishing write tid 1 to trial18717860-29 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3922: finishing write tid 2 to trial18717860-29 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3922: finishing write tid 3 to trial18717860-29 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3922: finishing write tid 4 to trial18717860-29 2026-02-13T18:23:43.186 INFO:tasks.rados.rados.0.trial187.stdout:3922: finishing write tid 5 to trial18717860-29 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3922: oid 29 updating version 0 to 1683 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3922: oid 29 updating version 1683 to 1684 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3922: oid 29 version 1684 is already newer than 1682 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3922: oid 29 version 1684 is already newer than 1681 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 29 v 1684 (ObjNum 1291 snap 441 seq_num 1291) dirty exists 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3922: left oid 29 (ObjNum 1291 snap 441 seq_num 1291) 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3923: finishing write tid 1 to trial18717860-9 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3923: finishing write tid 2 to trial18717860-9 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3923: finishing write tid 3 to trial18717860-9 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3918: done (6 left) 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3919: done (5 left) 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3920: done (4 left) 2026-02-13T18:23:43.187 INFO:tasks.rados.rados.0.trial187.stdout:3922: done (3 left) 2026-02-13T18:23:43.188 INFO:tasks.rados.rados.0.trial187.stdout:3927: write (excl) oid 18 current snap is 441 2026-02-13T18:23:43.188 INFO:tasks.rados.rados.0.trial187.stdout:3927: seq_num 1294 ranges {548258=752216,1771817=490781,2985235=713867} 2026-02-13T18:23:43.191 INFO:tasks.rados.rados.0.trial187.stdout:3927: writing trial18717860-18 from 548258 to 1300474 tid 1 2026-02-13T18:23:43.197 INFO:tasks.rados.rados.0.trial187.stdout:3927: writing trial18717860-18 from 1771817 to 2262598 tid 2 2026-02-13T18:23:43.208 INFO:tasks.rados.rados.0.trial187.stdout:3927: writing trial18717860-18 from 2985235 to 3699102 tid 3 2026-02-13T18:23:43.208 INFO:tasks.rados.rados.0.trial187.stdout:3928: rollback oid 32 current snap is 441 2026-02-13T18:23:43.208 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 32 to 440 2026-02-13T18:23:43.208 INFO:tasks.rados.rados.0.trial187.stdout:3923: finishing write tid 4 to trial18717860-9 2026-02-13T18:23:43.208 INFO:tasks.rados.rados.0.trial187.stdout:3924: expect (ObjNum 1254 snap 431 seq_num 1254) 2026-02-13T18:23:43.259 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1427042 2026-02-13T18:23:43.334 INFO:tasks.rados.rados.0.trial187.stdout:3923: finishing write tid 5 to trial18717860-9 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3923: oid 9 updating version 0 to 2439 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3923: oid 9 updating version 2439 to 2441 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3923: oid 9 updating version 2441 to 2442 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3923: oid 9 version 2442 is already newer than 2440 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 9 v 2442 (ObjNum 1292 snap 441 seq_num 1292) dirty exists 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3923: left oid 9 (ObjNum 1292 snap 441 seq_num 1292) 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3926: finishing rollback tid 0 to trial18717860-21 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3926: finishing rollback tid 1 to trial18717860-21 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3926: finishing rollback tid 2 to trial18717860-21 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 2435 (ObjNum 1209 snap 408 seq_num 1209) dirty exists 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3927: finishing write tid 1 to trial18717860-18 2026-02-13T18:23:43.335 INFO:tasks.rados.rados.0.trial187.stdout:3927: finishing write tid 2 to trial18717860-18 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3927: finishing write tid 3 to trial18717860-18 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3927: finishing write tid 4 to trial18717860-18 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3928: finishing rollback tid 0 to trial18717860-32 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3923: done (4 left) 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3924: done (3 left) 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3926: done (2 left) 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3929: snap_create 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3928: finishing rollback tid 1 to trial18717860-32 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3927: finishing write tid 5 to trial18717860-18 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3927: oid 18 updating version 0 to 1677 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3927: oid 18 version 1677 is already newer than 1675 2026-02-13T18:23:43.336 INFO:tasks.rados.rados.0.trial187.stdout:3927: oid 18 version 1677 is already newer than 1674 2026-02-13T18:23:43.337 INFO:tasks.rados.rados.0.trial187.stdout:3927: oid 18 version 1677 is already newer than 1676 2026-02-13T18:23:43.337 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1677 (ObjNum 1294 snap 441 seq_num 1294) dirty exists 2026-02-13T18:23:43.337 INFO:tasks.rados.rados.0.trial187.stdout:3927: left oid 18 (ObjNum 1294 snap 441 seq_num 1294) 2026-02-13T18:23:43.337 INFO:tasks.rados.rados.0.trial187.stdout:3928: finishing rollback tid 2 to trial18717860-32 2026-02-13T18:23:43.337 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 32 v 2439 (ObjNum 1233 snap 423 seq_num 1233) dirty exists 2026-02-13T18:23:43.923 INFO:tasks.rados.rados.0.trial187.stdout:3927: done (2 left) 2026-02-13T18:23:43.924 INFO:tasks.rados.rados.0.trial187.stdout:3928: done (1 left) 2026-02-13T18:23:43.924 INFO:tasks.rados.rados.0.trial187.stdout:3929: done (0 left) 2026-02-13T18:23:43.924 INFO:tasks.rados.rados.0.trial187.stdout:3930: write oid 25 current snap is 442 2026-02-13T18:23:43.924 INFO:tasks.rados.rados.0.trial187.stdout:3930: seq_num 1295 ranges {565065=427465,1430299=634439,2496305=525139,3472104=292961} 2026-02-13T18:23:43.930 INFO:tasks.rados.rados.0.trial187.stdout:3930: writing trial18717860-25 from 565065 to 992530 tid 1 2026-02-13T18:23:43.937 INFO:tasks.rados.rados.0.trial187.stdout:3930: writing trial18717860-25 from 1430299 to 2064738 tid 2 2026-02-13T18:23:43.943 INFO:tasks.rados.rados.0.trial187.stdout:3930: writing trial18717860-25 from 2496305 to 3021444 tid 3 2026-02-13T18:23:43.948 INFO:tasks.rados.rados.0.trial187.stdout:3930: writing trial18717860-25 from 3472104 to 3765065 tid 4 2026-02-13T18:23:43.948 INFO:tasks.rados.rados.0.trial187.stdout:3931: snap_remove snap 421 2026-02-13T18:23:44.732 INFO:tasks.rados.rados.0.trial187.stdout:3931: done (1 left) 2026-02-13T18:23:44.732 INFO:tasks.rados.rados.0.trial187.stdout:3932: read oid 31 snap -1 2026-02-13T18:23:44.732 INFO:tasks.rados.rados.0.trial187.stdout:3932: expect (ObjNum 1246 snap 428 seq_num 1246) 2026-02-13T18:23:44.732 INFO:tasks.rados.rados.0.trial187.stdout:3933: snap_remove snap 411 2026-02-13T18:23:45.733 INFO:tasks.rados.rados.0.trial187.stdout:3933: done (2 left) 2026-02-13T18:23:45.733 INFO:tasks.rados.rados.0.trial187.stdout:3934: snap_create 2026-02-13T18:23:45.733 INFO:tasks.rados.rados.0.trial187.stdout:3930: finishing write tid 1 to trial18717860-25 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: finishing write tid 2 to trial18717860-25 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: finishing write tid 3 to trial18717860-25 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: finishing write tid 4 to trial18717860-25 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: finishing write tid 5 to trial18717860-25 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: finishing write tid 6 to trial18717860-25 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: oid 25 updating version 0 to 1678 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: oid 25 updating version 1678 to 1679 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: oid 25 updating version 1679 to 1681 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: oid 25 version 1681 is already newer than 1680 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:3930: oid 25 updating version 1681 to 1682 2026-02-13T18:23:45.734 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 25 v 1682 (ObjNum 1295 snap 442 seq_num 1295) dirty exists 2026-02-13T18:23:45.735 INFO:tasks.rados.rados.0.trial187.stdout:3930: left oid 25 (ObjNum 1295 snap 442 seq_num 1295) 2026-02-13T18:23:45.735 INFO:tasks.rados.rados.0.trial187.stdout:3932: expect (ObjNum 1246 snap 428 seq_num 1246) 2026-02-13T18:23:45.735 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:45.792 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1526535 2026-02-13T18:23:46.736 INFO:tasks.rados.rados.0.trial187.stdout:3930: done (2 left) 2026-02-13T18:23:46.736 INFO:tasks.rados.rados.0.trial187.stdout:3932: done (1 left) 2026-02-13T18:23:46.736 INFO:tasks.rados.rados.0.trial187.stdout:3934: done (0 left) 2026-02-13T18:23:46.736 INFO:tasks.rados.rados.0.trial187.stdout:3935: write oid 24 current snap is 443 2026-02-13T18:23:46.736 INFO:tasks.rados.rados.0.trial187.stdout:3935: seq_num 1296 ranges {581872=502714,1488781=494450,2640081=736411} 2026-02-13T18:23:46.743 INFO:tasks.rados.rados.0.trial187.stdout:3935: writing trial18717860-24 from 581872 to 1084586 tid 1 2026-02-13T18:23:46.749 INFO:tasks.rados.rados.0.trial187.stdout:3935: writing trial18717860-24 from 1488781 to 1983231 tid 2 2026-02-13T18:23:46.759 INFO:tasks.rados.rados.0.trial187.stdout:3935: writing trial18717860-24 from 2640081 to 3376492 tid 3 2026-02-13T18:23:46.759 INFO:tasks.rados.rados.0.trial187.stdout:3936: snap_remove snap 423 2026-02-13T18:23:47.737 INFO:tasks.rados.rados.0.trial187.stdout:3936: done (1 left) 2026-02-13T18:23:47.737 INFO:tasks.rados.rados.0.trial187.stdout:3937: snap_remove snap 434 2026-02-13T18:23:48.739 INFO:tasks.rados.rados.0.trial187.stdout:3937: done (1 left) 2026-02-13T18:23:48.739 INFO:tasks.rados.rados.0.trial187.stdout:3938: read oid 2 snap 426 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3938: expect deleted 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3939: delete oid 41 current snap is 443 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: finishing write tid 1 to trial18717860-24 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: finishing write tid 2 to trial18717860-24 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: finishing write tid 3 to trial18717860-24 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: finishing write tid 4 to trial18717860-24 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: finishing write tid 5 to trial18717860-24 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: oid 24 updating version 0 to 2304 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: oid 24 version 2304 is already newer than 2302 2026-02-13T18:23:48.740 INFO:tasks.rados.rados.0.trial187.stdout:3935: oid 24 version 2304 is already newer than 2303 2026-02-13T18:23:48.741 INFO:tasks.rados.rados.0.trial187.stdout:3935: oid 24 updating version 2304 to 2305 2026-02-13T18:23:48.741 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 24 v 2305 (ObjNum 1296 snap 443 seq_num 1296) dirty exists 2026-02-13T18:23:48.741 INFO:tasks.rados.rados.0.trial187.stdout:3935: left oid 24 (ObjNum 1296 snap 443 seq_num 1296) 2026-02-13T18:23:48.743 INFO:tasks.rados.rados.0.trial187.stdout:3935: done (2 left) 2026-02-13T18:23:48.743 INFO:tasks.rados.rados.0.trial187.stdout:3938: done (1 left) 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3939: done (0 left) 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3940: read oid 19 snap -1 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3940: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3941: read oid 10 snap 441 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3941: expect (ObjNum 1282 snap 440 seq_num 1282) 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3942: write oid 27 current snap is 443 2026-02-13T18:23:48.744 INFO:tasks.rados.rados.0.trial187.stdout:3942: seq_num 1298 ranges {615486=653212,1889392=498119,2978574=475308} 2026-02-13T18:23:48.751 INFO:tasks.rados.rados.0.trial187.stdout:3942: writing trial18717860-27 from 615486 to 1268698 tid 1 2026-02-13T18:23:48.759 INFO:tasks.rados.rados.0.trial187.stdout:3942: writing trial18717860-27 from 1889392 to 2387511 tid 2 2026-02-13T18:23:48.767 INFO:tasks.rados.rados.0.trial187.stdout:3942: writing trial18717860-27 from 2978574 to 3453882 tid 3 2026-02-13T18:23:48.767 INFO:tasks.rados.rados.0.trial187.stdout:3943: copy_from oid 45 from oid 44 current snap is 443 2026-02-13T18:23:48.767 INFO:tasks.rados.rados.0.trial187.stdout:3940: expect (ObjNum 1167 snap 387 seq_num 1167) 2026-02-13T18:23:48.864 INFO:tasks.rados.rados.0.trial187.stdout:3941: expect (ObjNum 1282 snap 440 seq_num 1282) 2026-02-13T18:23:49.023 INFO:tasks.rados.rados.0.trial187.stdout:3942: finishing write tid 1 to trial18717860-27 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: finishing write tid 2 to trial18717860-27 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: finishing write tid 3 to trial18717860-27 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: finishing write tid 4 to trial18717860-27 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: finishing write tid 5 to trial18717860-27 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: oid 27 updating version 0 to 1683 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: oid 27 updating version 1683 to 1685 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: oid 27 version 1685 is already newer than 1684 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:3942: oid 27 updating version 1685 to 1686 2026-02-13T18:23:49.024 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 27 v 1686 (ObjNum 1298 snap 443 seq_num 1298) dirty exists 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3942: left oid 27 (ObjNum 1298 snap 443 seq_num 1298) 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3943: finishing copy_from racing read to trial18717860-45 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3943: finishing copy_from to trial18717860-45 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 45 v 2625 (ObjNum 1290 snap 441 seq_num 1290) dirty exists 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3940: done (3 left) 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3941: done (2 left) 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3942: done (1 left) 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3943: done (0 left) 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3944: write (excl) oid 46 current snap is 443 2026-02-13T18:23:49.025 INFO:tasks.rados.rados.0.trial187.stdout:3944: seq_num 1299 ranges {632293=728461,1947874=641777,3005997=686580} 2026-02-13T18:23:49.032 INFO:tasks.rados.rados.0.trial187.stdout:3944: writing trial18717860-46 from 632293 to 1360754 tid 1 2026-02-13T18:23:49.041 INFO:tasks.rados.rados.0.trial187.stdout:3944: writing trial18717860-46 from 1947874 to 2589651 tid 2 2026-02-13T18:23:49.049 INFO:tasks.rados.rados.0.trial187.stdout:3944: writing trial18717860-46 from 3005997 to 3692577 tid 3 2026-02-13T18:23:49.049 INFO:tasks.rados.rados.0.trial187.stdout:3945: read oid 17 snap -1 2026-02-13T18:23:49.049 INFO:tasks.rados.rados.0.trial187.stdout:3945: expect (ObjNum 1170 snap 389 seq_num 1170) 2026-02-13T18:23:49.049 INFO:tasks.rados.rados.0.trial187.stdout:3946: copy_from oid 4 from oid 36 current snap is 443 2026-02-13T18:23:49.050 INFO:tasks.rados.rados.0.trial187.stdout:3944: finishing write tid 1 to trial18717860-46 2026-02-13T18:23:49.050 INFO:tasks.rados.rados.0.trial187.stdout:3944: finishing write tid 2 to trial18717860-46 2026-02-13T18:23:49.050 INFO:tasks.rados.rados.0.trial187.stdout:3947: snap_create 2026-02-13T18:23:49.052 INFO:tasks.rados.rados.0.trial187.stdout:3944: finishing write tid 3 to trial18717860-46 2026-02-13T18:23:49.052 INFO:tasks.rados.rados.0.trial187.stdout:3944: finishing write tid 4 to trial18717860-46 2026-02-13T18:23:49.052 INFO:tasks.rados.rados.0.trial187.stdout:3944: finishing write tid 5 to trial18717860-46 2026-02-13T18:23:49.052 INFO:tasks.rados.rados.0.trial187.stdout:3944: oid 46 updating version 0 to 2439 2026-02-13T18:23:49.052 INFO:tasks.rados.rados.0.trial187.stdout:3944: oid 46 version 2439 is already newer than 2438 2026-02-13T18:23:49.052 INFO:tasks.rados.rados.0.trial187.stdout:3944: oid 46 version 2439 is already newer than 2437 2026-02-13T18:23:49.053 INFO:tasks.rados.rados.0.trial187.stdout:3944: oid 46 version 2439 is already newer than 2436 2026-02-13T18:23:49.053 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 2439 (ObjNum 1299 snap 443 seq_num 1299) dirty exists 2026-02-13T18:23:49.053 INFO:tasks.rados.rados.0.trial187.stdout:3944: left oid 46 (ObjNum 1299 snap 443 seq_num 1299) 2026-02-13T18:23:49.053 INFO:tasks.rados.rados.0.trial187.stdout:3945: expect (ObjNum 1170 snap 389 seq_num 1170) 2026-02-13T18:23:49.097 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 3506839 2026-02-13T18:23:49.108 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1603901 2026-02-13T18:23:49.147 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1759958 2026-02-13T18:23:49.167 INFO:tasks.rados.rados.0.trial187.stdout:3946: finishing copy_from racing read to trial18717860-4 2026-02-13T18:23:49.167 INFO:tasks.rados.rados.0.trial187.stdout:3946: finishing copy_from to trial18717860-4 2026-02-13T18:23:49.168 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1655 (ObjNum 1233 snap 423 seq_num 1233) dirty exists 2026-02-13T18:23:49.733 INFO:tasks.rados.rados.0.trial187.stdout:3944: done (3 left) 2026-02-13T18:23:49.733 INFO:tasks.rados.rados.0.trial187.stdout:3945: done (2 left) 2026-02-13T18:23:49.734 INFO:tasks.rados.rados.0.trial187.stdout:3946: done (1 left) 2026-02-13T18:23:49.734 INFO:tasks.rados.rados.0.trial187.stdout:3947: done (0 left) 2026-02-13T18:23:49.734 INFO:tasks.rados.rados.0.trial187.stdout:3948: copy_from oid 36 from oid 38 current snap is 444 2026-02-13T18:23:49.734 INFO:tasks.rados.rados.0.trial187.stdout:3949: write (excl) oid 15 current snap is 444 2026-02-13T18:23:49.734 INFO:tasks.rados.rados.0.trial187.stdout:3949: seq_num 1300 ranges {649100=403710,1606356=501788,2633420=497852,3636005=213095} 2026-02-13T18:23:49.740 INFO:tasks.rados.rados.0.trial187.stdout:3949: writing trial18717860-15 from 649100 to 1052810 tid 1 2026-02-13T18:23:49.747 INFO:tasks.rados.rados.0.trial187.stdout:3949: writing trial18717860-15 from 1606356 to 2108144 tid 2 2026-02-13T18:23:49.754 INFO:tasks.rados.rados.0.trial187.stdout:3949: writing trial18717860-15 from 2633420 to 3131272 tid 3 2026-02-13T18:23:49.759 INFO:tasks.rados.rados.0.trial187.stdout:3949: writing trial18717860-15 from 3636005 to 3849100 tid 4 2026-02-13T18:23:49.759 INFO:tasks.rados.rados.0.trial187.stdout:3950: write oid 47 current snap is 444 2026-02-13T18:23:49.759 INFO:tasks.rados.rados.0.trial187.stdout:3949: finishing write tid 1 to trial18717860-15 2026-02-13T18:23:49.759 INFO:tasks.rados.rados.0.trial187.stdout:3948: finishing copy_from racing read to trial18717860-36 2026-02-13T18:23:49.760 INFO:tasks.rados.rados.0.trial187.stdout:3948: finishing copy_from to trial18717860-36 2026-02-13T18:23:49.760 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 36 v 1856 (ObjNum 1275 snap 438 seq_num 1275) dirty exists 2026-02-13T18:23:49.760 INFO:tasks.rados.rados.0.trial187.stdout:3949: finishing write tid 2 to trial18717860-15 2026-02-13T18:23:49.760 INFO:tasks.rados.rados.0.trial187.stdout:3949: finishing write tid 3 to trial18717860-15 2026-02-13T18:23:49.760 INFO:tasks.rados.rados.0.trial187.stdout:3950: seq_num 1301 ranges {665907=595312,1781191=645446,3177196=688711} 2026-02-13T18:23:49.768 INFO:tasks.rados.rados.0.trial187.stdout:3950: writing trial18717860-47 from 665907 to 1261219 tid 1 2026-02-13T18:23:49.776 INFO:tasks.rados.rados.0.trial187.stdout:3950: writing trial18717860-47 from 1781191 to 2426637 tid 2 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3950: writing trial18717860-47 from 3177196 to 3865907 tid 3 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3948: done (2 left) 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3951: delete oid 30 current snap is 444 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3949: finishing write tid 4 to trial18717860-15 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3949: finishing write tid 5 to trial18717860-15 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3949: finishing write tid 6 to trial18717860-15 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3949: oid 15 updating version 0 to 1687 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3949: oid 15 updating version 1687 to 1688 2026-02-13T18:23:49.785 INFO:tasks.rados.rados.0.trial187.stdout:3949: oid 15 updating version 1688 to 1689 2026-02-13T18:23:49.786 INFO:tasks.rados.rados.0.trial187.stdout:3949: oid 15 version 1689 is already newer than 1686 2026-02-13T18:23:49.786 INFO:tasks.rados.rados.0.trial187.stdout:3949: oid 15 version 1689 is already newer than 1685 2026-02-13T18:23:49.786 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 15 v 1689 (ObjNum 1300 snap 444 seq_num 1300) dirty exists 2026-02-13T18:23:49.786 INFO:tasks.rados.rados.0.trial187.stdout:3949: left oid 15 (ObjNum 1300 snap 444 seq_num 1300) 2026-02-13T18:23:49.786 INFO:tasks.rados.rados.0.trial187.stdout:3950: finishing write tid 1 to trial18717860-47 2026-02-13T18:23:49.786 INFO:tasks.rados.rados.0.trial187.stdout:3950: finishing write tid 2 to trial18717860-47 2026-02-13T18:23:49.787 INFO:tasks.rados.rados.0.trial187.stdout:3949: done (2 left) 2026-02-13T18:23:49.787 INFO:tasks.rados.rados.0.trial187.stdout:3951: done (1 left) 2026-02-13T18:23:49.787 INFO:tasks.rados.rados.0.trial187.stdout:3952: copy_from oid 41 from oid 1 current snap is 444 2026-02-13T18:23:49.787 INFO:tasks.rados.rados.0.trial187.stdout:3953: snap_remove snap 436 2026-02-13T18:23:50.749 INFO:tasks.rados.rados.0.trial187.stdout:3953: done (2 left) 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3954: copy_from oid 50 from oid 46 current snap is 444 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: finishing write tid 3 to trial18717860-47 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: finishing write tid 4 to trial18717860-47 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: finishing write tid 5 to trial18717860-47 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: oid 47 updating version 0 to 1672 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: oid 47 version 1672 is already newer than 1671 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: oid 47 updating version 1672 to 1673 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: oid 47 updating version 1673 to 1674 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 47 v 1674 (ObjNum 1301 snap 444 seq_num 1301) dirty exists 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3950: left oid 47 (ObjNum 1301 snap 444 seq_num 1301) 2026-02-13T18:23:50.750 INFO:tasks.rados.rados.0.trial187.stdout:3952: finishing copy_from racing read to trial18717860-41 2026-02-13T18:23:50.751 INFO:tasks.rados.rados.0.trial187.stdout:3952: finishing copy_from to trial18717860-41 2026-02-13T18:23:50.751 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 41 v 1658 (ObjNum 1254 snap 431 seq_num 1254) dirty exists 2026-02-13T18:23:50.751 INFO:tasks.rados.rados.0.trial187.stdout:3950: done (2 left) 2026-02-13T18:23:50.751 INFO:tasks.rados.rados.0.trial187.stdout:3952: done (1 left) 2026-02-13T18:23:50.751 INFO:tasks.rados.rados.0.trial187.stdout:3955: delete oid 21 current snap is 444 2026-02-13T18:23:50.756 INFO:tasks.rados.rados.0.trial187.stdout:3955: done (1 left) 2026-02-13T18:23:50.756 INFO:tasks.rados.rados.0.trial187.stdout:3956: snap_remove snap 437 2026-02-13T18:23:51.974 INFO:tasks.rados.rados.0.trial187.stdout:3956: done (1 left) 2026-02-13T18:23:51.974 INFO:tasks.rados.rados.0.trial187.stdout:3957: write (excl) oid 1 current snap is 444 2026-02-13T18:23:51.974 INFO:tasks.rados.rados.0.trial187.stdout:3957: seq_num 1304 ranges {716328=421059,1840284=509126,3143112=659293} 2026-02-13T18:23:51.981 INFO:tasks.rados.rados.0.trial187.stdout:3957: writing trial18717860-1 from 716328 to 1137387 tid 1 2026-02-13T18:23:51.987 INFO:tasks.rados.rados.0.trial187.stdout:3957: writing trial18717860-1 from 1840284 to 2349410 tid 2 2026-02-13T18:23:51.993 INFO:tasks.rados.rados.0.trial187.stdout:3957: writing trial18717860-1 from 3143112 to 3802405 tid 3 2026-02-13T18:23:51.993 INFO:tasks.rados.rados.0.trial187.stdout:3958: delete oid 34 current snap is 444 2026-02-13T18:23:51.994 INFO:tasks.rados.rados.0.trial187.stdout:3954: finishing copy_from racing read to trial18717860-50 2026-02-13T18:23:51.994 INFO:tasks.rados.rados.0.trial187.stdout:3954: finishing copy_from to trial18717860-50 2026-02-13T18:23:51.994 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 2439 (ObjNum 1299 snap 443 seq_num 1299) dirty exists 2026-02-13T18:23:51.994 INFO:tasks.rados.rados.0.trial187.stdout:3957: finishing write tid 1 to trial18717860-1 2026-02-13T18:23:51.994 INFO:tasks.rados.rados.0.trial187.stdout:3957: finishing write tid 2 to trial18717860-1 2026-02-13T18:23:51.995 INFO:tasks.rados.rados.0.trial187.stdout:3954: done (2 left) 2026-02-13T18:23:51.995 INFO:tasks.rados.rados.0.trial187.stdout:3958: done (1 left) 2026-02-13T18:23:51.996 INFO:tasks.rados.rados.0.trial187.stdout:3959: snap_remove snap 441 2026-02-13T18:23:52.979 INFO:tasks.rados.rados.0.trial187.stdout:3959: done (1 left) 2026-02-13T18:23:52.979 INFO:tasks.rados.rados.0.trial187.stdout:3960: write oid 46 current snap is 444 2026-02-13T18:23:52.979 INFO:tasks.rados.rados.0.trial187.stdout:3960: seq_num 1306 ranges {749942=571557,1840895=796442,3365252=584690} 2026-02-13T18:23:52.987 INFO:tasks.rados.rados.0.trial187.stdout:3960: writing trial18717860-46 from 749942 to 1321499 tid 1 2026-02-13T18:23:52.997 INFO:tasks.rados.rados.0.trial187.stdout:3960: writing trial18717860-46 from 1840895 to 2637337 tid 2 2026-02-13T18:23:53.006 INFO:tasks.rados.rados.0.trial187.stdout:3960: writing trial18717860-46 from 3365252 to 3949942 tid 3 2026-02-13T18:23:53.006 INFO:tasks.rados.rados.0.trial187.stdout:3961: rollback oid 40 current snap is 444 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: finishing write tid 3 to trial18717860-1 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: finishing write tid 4 to trial18717860-1 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: finishing write tid 5 to trial18717860-1 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: oid 1 updating version 0 to 1691 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: oid 1 version 1691 is already newer than 1690 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: oid 1 updating version 1691 to 1693 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: oid 1 version 1693 is already newer than 1692 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 1693 (ObjNum 1304 snap 444 seq_num 1304) dirty exists 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3957: left oid 1 (ObjNum 1304 snap 444 seq_num 1304) 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3960: finishing write tid 1 to trial18717860-46 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:3960: finishing write tid 2 to trial18717860-46 2026-02-13T18:23:53.007 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 40 to 442 2026-02-13T18:23:53.008 INFO:tasks.rados.rados.0.trial187.stdout:3957: done (2 left) 2026-02-13T18:23:53.008 INFO:tasks.rados.rados.0.trial187.stdout:3962: copy_from oid 5 from oid 20 current snap is 444 2026-02-13T18:23:53.008 INFO:tasks.rados.rados.0.trial187.stdout:3963: snap_remove snap 433 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3963: done (3 left) 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3964: read oid 47 snap 395 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3964: expect (ObjNum 1176 snap 393 seq_num 1176) 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3965: snap_create 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3961: finishing rollback tid 0 to trial18717860-40 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3961: finishing rollback tid 1 to trial18717860-40 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:3961: finishing rollback tid 2 to trial18717860-40 2026-02-13T18:23:53.983 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 40 v 2628 (ObjNum 1232 snap 422 seq_num 1232) dirty exists 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3962: finishing copy_from to trial18717860-5 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3962: got expected ENOENT (src dne) 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3962: finishing copy_from racing read to trial18717860-5 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: finishing write tid 3 to trial18717860-46 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: finishing write tid 4 to trial18717860-46 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: finishing write tid 5 to trial18717860-46 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: oid 46 updating version 0 to 2444 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: oid 46 version 2444 is already newer than 2441 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: oid 46 version 2444 is already newer than 2443 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: oid 46 version 2444 is already newer than 2442 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 46 v 2444 (ObjNum 1306 snap 444 seq_num 1306) dirty exists 2026-02-13T18:23:53.984 INFO:tasks.rados.rados.0.trial187.stdout:3960: left oid 46 (ObjNum 1306 snap 444 seq_num 1306) 2026-02-13T18:23:53.991 INFO:tasks.rados.rados.0.trial187.stdout:3964: expect (ObjNum 1176 snap 393 seq_num 1176) 2026-02-13T18:23:54.102 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:54.735 INFO:tasks.rados.rados.0.trial187.stdout:3960: done (4 left) 2026-02-13T18:23:54.735 INFO:tasks.rados.rados.0.trial187.stdout:3961: done (3 left) 2026-02-13T18:23:54.735 INFO:tasks.rados.rados.0.trial187.stdout:3962: done (2 left) 2026-02-13T18:23:54.735 INFO:tasks.rados.rados.0.trial187.stdout:3964: done (1 left) 2026-02-13T18:23:54.736 INFO:tasks.rados.rados.0.trial187.stdout:3965: done (0 left) 2026-02-13T18:23:54.736 INFO:tasks.rados.rados.0.trial187.stdout:3966: snap_remove snap 444 2026-02-13T18:23:55.735 INFO:tasks.rados.rados.0.trial187.stdout:3966: done (0 left) 2026-02-13T18:23:55.735 INFO:tasks.rados.rados.0.trial187.stdout:3967: delete oid 34 current snap is 445 2026-02-13T18:23:55.738 INFO:tasks.rados.rados.0.trial187.stdout:3967: done (0 left) 2026-02-13T18:23:55.738 INFO:tasks.rados.rados.0.trial187.stdout:3968: delete oid 29 current snap is 445 2026-02-13T18:23:55.741 INFO:tasks.rados.rados.0.trial187.stdout:3968: done (0 left) 2026-02-13T18:23:55.741 INFO:tasks.rados.rados.0.trial187.stdout:3969: read oid 26 snap -1 2026-02-13T18:23:55.741 INFO:tasks.rados.rados.0.trial187.stdout:3969: expect deleted 2026-02-13T18:23:55.742 INFO:tasks.rados.rados.0.trial187.stdout:3970: snap_create 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3969: done (1 left) 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3970: done (0 left) 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3971: read oid 41 snap -1 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3971: expect (ObjNum 1254 snap 431 seq_num 1254) 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3972: read oid 16 snap 377 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3972: expect (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:23:56.739 INFO:tasks.rados.rados.0.trial187.stdout:3973: snap_remove snap 445 2026-02-13T18:23:58.379 INFO:tasks.rados.rados.0.trial187.stdout:3973: done (2 left) 2026-02-13T18:23:58.379 INFO:tasks.rados.rados.0.trial187.stdout:3974: copy_from oid 21 from oid 47 current snap is 446 2026-02-13T18:23:58.379 INFO:tasks.rados.rados.0.trial187.stdout:3972: expect (ObjNum 1038 snap 338 seq_num 1038) 2026-02-13T18:23:58.394 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2228811 2026-02-13T18:23:58.413 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 1686019 2026-02-13T18:23:58.446 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 2462335 2026-02-13T18:23:58.453 INFO:tasks.rados.rados.0.trial187.stdout:3971: expect (ObjNum 1254 snap 431 seq_num 1254) 2026-02-13T18:23:58.538 INFO:tasks.rados.rados.0.trial187.stdout:seeking to 0 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:3974: finishing copy_from racing read to trial18717860-21 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:3974: finishing copy_from to trial18717860-21 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 21 v 1674 (ObjNum 1301 snap 444 seq_num 1301) dirty exists 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:3971: done (2 left) 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:3972: done (1 left) 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:3974: done (0 left) 2026-02-13T18:23:58.589 INFO:tasks.rados.rados.0.trial187.stdout:3975: write oid 33 current snap is 446 2026-02-13T18:23:58.590 INFO:tasks.rados.rados.0.trial187.stdout:3975: seq_num 1309 ranges {400363=513657,1332694=660122} 2026-02-13T18:23:58.595 INFO:tasks.rados.rados.0.trial187.stdout:3975: writing trial18717860-33 from 400363 to 914020 tid 1 2026-02-13T18:23:58.603 INFO:tasks.rados.rados.0.trial187.stdout:3975: writing trial18717860-33 from 1332694 to 1992816 tid 2 2026-02-13T18:23:58.603 INFO:tasks.rados.rados.0.trial187.stdout:3976: rollback oid 4 current snap is 446 2026-02-13T18:23:58.603 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 4 to 442 2026-02-13T18:23:58.603 INFO:tasks.rados.rados.0.trial187.stdout:3975: finishing write tid 1 to trial18717860-33 2026-02-13T18:23:58.603 INFO:tasks.rados.rados.0.trial187.stdout:3977: delete oid 49 current snap is 446 2026-02-13T18:23:58.607 INFO:tasks.rados.rados.0.trial187.stdout:3975: finishing write tid 2 to trial18717860-33 2026-02-13T18:23:58.608 INFO:tasks.rados.rados.0.trial187.stdout:3977: done (2 left) 2026-02-13T18:23:58.608 INFO:tasks.rados.rados.0.trial187.stdout:3978: copy_from oid 45 from oid 35 current snap is 446 2026-02-13T18:23:58.608 INFO:tasks.rados.rados.0.trial187.stdout:3979: copy_from oid 1 from oid 9 current snap is 446 2026-02-13T18:23:58.608 INFO:tasks.rados.rados.0.trial187.stdout:3980: snap_create 2026-02-13T18:23:58.608 INFO:tasks.rados.rados.0.trial187.stdout:3976: finishing rollback tid 0 to trial18717860-4 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:3978: finishing copy_from to trial18717860-45 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:3978: got expected ENOENT (src dne) 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:3978: finishing copy_from racing read to trial18717860-45 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:3976: finishing rollback tid 1 to trial18717860-4 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:3976: finishing rollback tid 2 to trial18717860-4 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1658 (ObjNum 1283 snap 440 seq_num 1283) dirty exists 2026-02-13T18:23:58.609 INFO:tasks.rados.rados.0.trial187.stdout:3975: finishing write tid 3 to trial18717860-33 2026-02-13T18:23:58.610 INFO:tasks.rados.rados.0.trial187.stdout:3975: finishing write tid 4 to trial18717860-33 2026-02-13T18:23:58.610 INFO:tasks.rados.rados.0.trial187.stdout:3975: oid 33 updating version 0 to 2686 2026-02-13T18:23:58.610 INFO:tasks.rados.rados.0.trial187.stdout:3975: oid 33 version 2686 is already newer than 2685 2026-02-13T18:23:58.610 INFO:tasks.rados.rados.0.trial187.stdout:3975: oid 33 updating version 2686 to 2687 2026-02-13T18:23:58.610 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 33 v 2687 (ObjNum 1309 snap 446 seq_num 1309) dirty exists 2026-02-13T18:23:58.610 INFO:tasks.rados.rados.0.trial187.stdout:3975: left oid 33 (ObjNum 1309 snap 446 seq_num 1309) 2026-02-13T18:23:58.618 INFO:tasks.rados.rados.0.trial187.stdout:3979: finishing copy_from racing read to trial18717860-1 2026-02-13T18:23:58.618 INFO:tasks.rados.rados.0.trial187.stdout:3979: finishing copy_from to trial18717860-1 2026-02-13T18:23:58.618 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 1 v 2442 (ObjNum 1292 snap 441 seq_num 1292) dirty exists 2026-02-13T18:23:58.743 INFO:tasks.rados.rados.0.trial187.stdout:3975: done (4 left) 2026-02-13T18:23:58.743 INFO:tasks.rados.rados.0.trial187.stdout:3976: done (3 left) 2026-02-13T18:23:58.743 INFO:tasks.rados.rados.0.trial187.stdout:3978: done (2 left) 2026-02-13T18:23:58.743 INFO:tasks.rados.rados.0.trial187.stdout:3979: done (1 left) 2026-02-13T18:23:58.743 INFO:tasks.rados.rados.0.trial187.stdout:3980: done (0 left) 2026-02-13T18:23:58.744 INFO:tasks.rados.rados.0.trial187.stdout:3981: snap_create 2026-02-13T18:23:59.734 INFO:tasks.rados.rados.0.trial187.stdout:3981: done (0 left) 2026-02-13T18:23:59.734 INFO:tasks.rados.rados.0.trial187.stdout:3982: snap_create 2026-02-13T18:24:00.735 INFO:tasks.rados.rados.0.trial187.stdout:3982: done (0 left) 2026-02-13T18:24:00.736 INFO:tasks.rados.rados.0.trial187.stdout:3983: copy_from oid 17 from oid 18 current snap is 449 2026-02-13T18:24:00.736 INFO:tasks.rados.rados.0.trial187.stdout:3984: delete oid 46 current snap is 449 2026-02-13T18:24:00.741 INFO:tasks.rados.rados.0.trial187.stdout:3984: done (1 left) 2026-02-13T18:24:00.741 INFO:tasks.rados.rados.0.trial187.stdout:3985: read oid 46 snap 448 2026-02-13T18:24:00.741 INFO:tasks.rados.rados.0.trial187.stdout:3985: expect (ObjNum 1306 snap 444 seq_num 1306) 2026-02-13T18:24:00.742 INFO:tasks.rados.rados.0.trial187.stdout:3986: copy_from oid 5 from oid 4 current snap is 449 2026-02-13T18:24:00.742 INFO:tasks.rados.rados.0.trial187.stdout:3987: rollback oid 43 current snap is 449 2026-02-13T18:24:00.742 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 43 to 442 2026-02-13T18:24:00.742 INFO:tasks.rados.rados.0.trial187.stdout:3988: snap_remove snap 424 2026-02-13T18:24:01.737 INFO:tasks.rados.rados.0.trial187.stdout:3988: done (4 left) 2026-02-13T18:24:01.737 INFO:tasks.rados.rados.0.trial187.stdout:3989: read oid 48 snap -1 2026-02-13T18:24:01.738 INFO:tasks.rados.rados.0.trial187.stdout:3989: expect deleted 2026-02-13T18:24:01.738 INFO:tasks.rados.rados.0.trial187.stdout:3990: rollback oid 30 current snap is 449 2026-02-13T18:24:01.738 INFO:tasks.rados.rados.0.trial187.stdout:rollback oid 30 to 429 2026-02-13T18:24:01.738 INFO:tasks.rados.rados.0.trial187.stdout:3985: expect (ObjNum 1306 snap 444 seq_num 1306) 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3987: finishing rollback tid 1 to trial18717860-43 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 43 v 2573 (ObjNum 49 snap 0 seq_num 4) dirty dne 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3983: finishing copy_from racing read to trial18717860-17 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3983: finishing copy_from to trial18717860-17 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 17 v 1677 (ObjNum 1294 snap 441 seq_num 1294) dirty exists 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3986: finishing copy_from racing read to trial18717860-5 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3986: finishing copy_from to trial18717860-5 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 5 v 1658 (ObjNum 1283 snap 440 seq_num 1283) dirty exists 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3990: finishing rollback tid 1 to trial18717860-30 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:3990: finishing rollback tid 2 to trial18717860-30 2026-02-13T18:24:01.916 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 30 v 2442 (ObjNum 1241 snap 424 seq_num 1241) dirty exists 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3983: done (5 left) 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3985: done (4 left) 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3986: done (3 left) 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3987: done (2 left) 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3989: done (1 left) 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3990: done (0 left) 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3991: copy_from oid 28 from oid 16 current snap is 449 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3992: write (excl) oid 4 current snap is 449 2026-02-13T18:24:01.917 INFO:tasks.rados.rados.0.trial187.stdout:3992: seq_num 1312 ranges {450784=739404,1791787=258997} 2026-02-13T18:24:01.924 INFO:tasks.rados.rados.0.trial187.stdout:3992: writing trial18717860-4 from 450784 to 1190188 tid 1 2026-02-13T18:24:01.930 INFO:tasks.rados.rados.0.trial187.stdout:3992: writing trial18717860-4 from 1791787 to 2050784 tid 2 2026-02-13T18:24:01.930 INFO:tasks.rados.rados.0.trial187.stdout:3993: snap_create 2026-02-13T18:24:01.930 INFO:tasks.rados.rados.0.trial187.stdout:3991: finishing copy_from racing read to trial18717860-28 2026-02-13T18:24:01.930 INFO:tasks.rados.rados.0.trial187.stdout:3991: finishing copy_from to trial18717860-28 2026-02-13T18:24:01.930 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 28 v 1669 (ObjNum 1272 snap 435 seq_num 1272) dirty exists 2026-02-13T18:24:01.930 INFO:tasks.rados.rados.0.trial187.stdout:3992: finishing write tid 1 to trial18717860-4 2026-02-13T18:24:01.932 INFO:tasks.rados.rados.0.trial187.stdout:3992: finishing write tid 2 to trial18717860-4 2026-02-13T18:24:01.932 INFO:tasks.rados.rados.0.trial187.stdout:3992: finishing write tid 3 to trial18717860-4 2026-02-13T18:24:01.933 INFO:tasks.rados.rados.0.trial187.stdout:3992: finishing write tid 4 to trial18717860-4 2026-02-13T18:24:01.933 INFO:tasks.rados.rados.0.trial187.stdout:3992: oid 4 updating version 0 to 1659 2026-02-13T18:24:01.933 INFO:tasks.rados.rados.0.trial187.stdout:3992: oid 4 updating version 1659 to 1660 2026-02-13T18:24:01.933 INFO:tasks.rados.rados.0.trial187.stdout:3992: oid 4 updating version 1660 to 1661 2026-02-13T18:24:01.933 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 4 v 1661 (ObjNum 1312 snap 449 seq_num 1312) dirty exists 2026-02-13T18:24:01.933 INFO:tasks.rados.rados.0.trial187.stdout:3992: left oid 4 (ObjNum 1312 snap 449 seq_num 1312) 2026-02-13T18:24:02.742 INFO:tasks.rados.rados.0.trial187.stdout:3991: done (2 left) 2026-02-13T18:24:02.743 INFO:tasks.rados.rados.0.trial187.stdout:3992: done (1 left) 2026-02-13T18:24:02.743 INFO:tasks.rados.rados.0.trial187.stdout:3993: done (0 left) 2026-02-13T18:24:02.743 INFO:tasks.rados.rados.0.trial187.stdout:3994: snap_remove snap 443 2026-02-13T18:24:03.745 INFO:tasks.rados.rados.0.trial187.stdout:3994: done (0 left) 2026-02-13T18:24:03.746 INFO:tasks.rados.rados.0.trial187.stdout:3995: delete oid 47 current snap is 450 2026-02-13T18:24:03.750 INFO:tasks.rados.rados.0.trial187.stdout:3995: done (0 left) 2026-02-13T18:24:03.750 INFO:tasks.rados.rados.0.trial187.stdout:3996: delete oid 15 current snap is 450 2026-02-13T18:24:03.754 INFO:tasks.rados.rados.0.trial187.stdout:3996: done (0 left) 2026-02-13T18:24:03.754 INFO:tasks.rados.rados.0.trial187.stdout:3997: snap_create 2026-02-13T18:24:05.485 INFO:tasks.rados.rados.0.trial187.stdout:3997: done (0 left) 2026-02-13T18:24:05.485 INFO:tasks.rados.rados.0.trial187.stdout:3998: write (excl) oid 50 current snap is 451 2026-02-13T18:24:05.485 INFO:tasks.rados.rados.0.trial187.stdout:3998: seq_num 1315 ranges {501205=565151,1850880=250325} 2026-02-13T18:24:05.493 INFO:tasks.rados.rados.0.trial187.stdout:3998: writing trial18717860-50 from 501205 to 1066356 tid 1 2026-02-13T18:24:05.500 INFO:tasks.rados.rados.0.trial187.stdout:3998: writing trial18717860-50 from 1850880 to 2101205 tid 2 2026-02-13T18:24:05.500 INFO:tasks.rados.rados.0.trial187.stdout:3999: write (excl) oid 18 current snap is 451 2026-02-13T18:24:05.500 INFO:tasks.rados.rados.0.trial187.stdout:3998: finishing write tid 1 to trial18717860-50 2026-02-13T18:24:05.500 INFO:tasks.rados.rados.0.trial187.stdout:3999: seq_num 1316 ranges {518012=756753,2025715=92297} 2026-02-13T18:24:05.508 INFO:tasks.rados.rados.0.trial187.stdout:3999: writing trial18717860-18 from 518012 to 1274765 tid 1 2026-02-13T18:24:05.514 INFO:tasks.rados.rados.0.trial187.stdout:3999: writing trial18717860-18 from 2025715 to 2118012 tid 2 2026-02-13T18:24:05.514 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 2 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: finishing write tid 2 to trial18717860-50 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: finishing write tid 3 to trial18717860-50 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: finishing write tid 4 to trial18717860-50 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: oid 50 updating version 0 to 2440 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: oid 50 updating version 2440 to 2441 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: oid 50 updating version 2441 to 2442 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 50 v 2442 (ObjNum 1315 snap 451 seq_num 1315) dirty exists 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: left oid 50 (ObjNum 1315 snap 451 seq_num 1315) 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout:3998: done (1 left) 2026-02-13T18:24:05.515 INFO:tasks.rados.rados.0.trial187.stdout: waiting on 1 2026-02-13T18:24:05.516 INFO:tasks.rados.rados.0.trial187.stdout:3999: finishing write tid 1 to trial18717860-18 2026-02-13T18:24:05.517 INFO:tasks.rados.rados.0.trial187.stdout:3999: finishing write tid 2 to trial18717860-18 2026-02-13T18:24:05.517 INFO:tasks.rados.rados.0.trial187.stdout:3999: finishing write tid 3 to trial18717860-18 2026-02-13T18:24:05.517 INFO:tasks.rados.rados.0.trial187.stdout:3999: finishing write tid 4 to trial18717860-18 2026-02-13T18:24:05.517 INFO:tasks.rados.rados.0.trial187.stdout:3999: oid 18 updating version 0 to 1678 2026-02-13T18:24:05.517 INFO:tasks.rados.rados.0.trial187.stdout:3999: oid 18 updating version 1678 to 1679 2026-02-13T18:24:05.518 INFO:tasks.rados.rados.0.trial187.stdout:3999: oid 18 updating version 1679 to 1680 2026-02-13T18:24:05.518 INFO:tasks.rados.rados.0.trial187.stdout:update_object_version oid 18 v 1680 (ObjNum 1316 snap 451 seq_num 1316) dirty exists 2026-02-13T18:24:05.518 INFO:tasks.rados.rados.0.trial187.stdout:3999: left oid 18 (ObjNum 1316 snap 451 seq_num 1316) 2026-02-13T18:24:05.518 INFO:tasks.rados.rados.0.trial187.stdout:3999: done (0 left) 2026-02-13T18:24:05.520 INFO:tasks.rados.rados.0.trial187.stderr:0 errors. 2026-02-13T18:24:05.520 INFO:tasks.rados.rados.0.trial187.stderr: 2026-02-13T18:24:05.652 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T18:24:05.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.706+0000 7f084a117640 10 monclient: get_monmap_and_config 2026-02-13T18:24:05.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.706+0000 7f084a117640 10 monclient: build_initial_monmap 2026-02-13T18:24:05.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.706+0000 7f084a117640 10 monclient: monmap: 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:24:05.712969+0000 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:24:05.712969+0000 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:24:05.725 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.706+0000 7f084a117640 1 Processor -- start 2026-02-13T18:24:05.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.706+0000 7f084a117640 1 -- start start 2026-02-13T18:24:05.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.706+0000 7f084a117640 10 monclient: init 2026-02-13T18:24:05.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient: _reopen_session rank -1 2026-02-13T18:24:05.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient(hunting): picked mon.noname-a con 0x7f084413f7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient(hunting): picked mon.noname-b con 0x7f0844095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient(hunting): picked mon.noname-c con 0x7f08441851c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0844140290 con 0x7f084413f7b0 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0844094750 con 0x7f08441851c0 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0844093c80 con 0x7f0844095410 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient(hunting): _renew_subs 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient(hunting): authenticate will time out at 1676.768448s 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0848914640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f0844095410 legacy=0x7f0844183aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0849115640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f084413f7b0 0x7f084413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37926/0 (socket says 10.20.193.78:37926) 2026-02-13T18:24:05.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0849115640 1 -- 10.20.193.78:0/2312820203 learned_addr learned my addr 10.20.193.78:0/2312820203 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:24:05.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0849115640 1 -- 10.20.193.78:0/2312820203 >> v1:10.20.193.78:6789/0 conn(0x7f084413f7b0 legacy=0x7f084413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152371381 0 0) 0x7f0834002c60 con 0x7f084413f7b0 2026-02-13T18:24:05.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient(hunting): _negotiate 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient(hunting): my global_id is 124257 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f082c003620 con 0x7f084413f7b0 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0849916640 1 -- 10.20.193.78:0/2312820203 >> v1:10.20.193.187:6789/0 conn(0x7f08441851c0 legacy=0x7f08441a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 723421874 0 0) 0x7f082c003620 con 0x7f084413f7b0 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 >> v1:10.20.193.78:6790/0 conn(0x7f0844095410 legacy=0x7f0844183aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 >> v1:10.20.193.187:6789/0 conn(0x7f08441851c0 legacy=0x7f08441a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: _finish_hunting 0 2026-02-13T18:24:05.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 monclient: found mon.noname-a 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0844094190 con 0x7f084413f7b0 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: _finish_auth 0 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: _check_auth_tickets 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 5 monclient: authenticate success, global_id 124257 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f08340032e0 con 0x7f084413f7b0 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:05.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: dump: 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.738 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08340049a0 con 0x7f084413f7b0 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 1 -- 10.20.193.78:0/2312820203 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0834004d30 con 0x7f084413f7b0 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f0833fff640 10 monclient: dump: 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.739 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient: get_monmap_and_config success 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 4 set_mon_vals no callback set 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 10 monclient: shutdown 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- 10.20.193.78:0/2312820203 >> v1:10.20.193.78:6789/0 conn(0x7f084413f7b0 legacy=0x7f084413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- 10.20.193.78:0/2312820203 shutdown_connections 2026-02-13T18:24:05.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- 10.20.193.78:0/2312820203 >> 10.20.193.78:0/2312820203 conn(0x7f0844054400 msgr2=0x7f0844054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- 10.20.193.78:0/2312820203 shutdown_connections 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.710+0000 7f084a117640 1 -- 10.20.193.78:0/2312820203 wait complete. 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: build_initial_monmap 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: monmap: 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:24:05.741 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 1 Processor -- start 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 1 -- start start 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: init 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: _reopen_session rank -1 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient(hunting): picked mon.noname-b con 0x7f0844095410 addr v1:10.20.193.187:6789/0 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient(hunting): picked mon.noname-a con 0x7f084413f7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient(hunting): picked mon.noname-c con 0x7f08441851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:24:05.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0844111be0 con 0x7f084413f7b0 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0844110d70 con 0x7f0844095410 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084410f880 con 0x7f08441851c0 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient(hunting): _renew_subs 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient(hunting): authenticate will time out at 1676.773106s 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0849916640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7f08441851c0 legacy=0x7f08441814a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0848914640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f084413f7b0 0x7f084413ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37932/0 (socket says 10.20.193.78:37932) 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0848914640 1 -- 10.20.193.78:0/1256408297 learned_addr learned my addr 10.20.193.78:0/1256408297 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0848914640 1 -- 10.20.193.78:0/1256408297 >> v1:10.20.193.78:6789/0 conn(0x7f084413f7b0 legacy=0x7f084413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202822288 0 0) 0x7f0844111be0 con 0x7f084413f7b0 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:24:05.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): my global_id is 124260 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0814003620 con 0x7f084413f7b0 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0849115640 1 -- 10.20.193.78:0/1256408297 >> v1:10.20.193.187:6789/0 conn(0x7f0844095410 legacy=0x7f084413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3998661179 0 0) 0x7f0814003620 con 0x7f084413f7b0 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0844111be0 con 0x7f084413f7b0 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f08380045c0 con 0x7f084413f7b0 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): dump: 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.744 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124168799 0 0) 0x7f0844110d70 con 0x7f0844095410 2026-02-13T18:24:05.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient(hunting): my global_id is 134194 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0814003620 con 0x7f0844095410 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1037907005 0 0) 0x7f0844111be0 con 0x7f084413f7b0 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 >> v1:10.20.193.78:6790/0 conn(0x7f08441851c0 legacy=0x7f08441814a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 >> v1:10.20.193.187:6789/0 conn(0x7f0844095410 legacy=0x7f084413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 monclient: found mon.a 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0844111340 con 0x7f084413f7b0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient: _finish_auth 0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f0831ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 5 monclient: authenticate success, global_id 124260 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: _renew_subs 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.714+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f084410f230 con 0x7f084413f7b0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 10 monclient: _renew_subs 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f08441105b0 con 0x7f084413f7b0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0838004890 con 0x7f084413f7b0 2026-02-13T18:24:05.747 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0838004bf0 con 0x7f084413f7b0 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 10 monclient: dump: 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.748 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f08337fe640 4 set_mon_vals no callback set 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08440008e0 con 0x7f084413f7b0 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f0838004ec0 con 0x7f084413f7b0 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(912..912 src has 621..912) ==== 3943+0+0 (unknown 2141432028 0 0) 0x7f083804c7a0 con 0x7f084413f7b0 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0849115640 10 monclient: get_auth_request con 0x7f081403d4d0 auth_method 0 2026-02-13T18:24:05.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f0838017730 con 0x7f084413f7b0 2026-02-13T18:24:05.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:05.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.718+0000 7f0831ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:24:05.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.802+0000 7f084a117640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.802+0000 7f084a117640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.802+0000 7f084a117640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.802+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0844092cd0 con 0x7f084413f7b0 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f0831ffb640 1 -- 10.20.193.78:0/1256408297 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v912) ==== 74+0+12874 (unknown 1065954404 0 1278797721) 0x7f0838017010 con 0x7f084413f7b0 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f0831ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f0831ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:24:05.821 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":912,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:24:04.717079+0000","last_up_change":"2026-02-13T18:05:25.449453+0000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T18:05:25.773956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T18:05:28.499550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2026-02-13T18:05:53.665893+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"912","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":459,"snap_epoch":912,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":425425936}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":425425936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":425425936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":425425936}]},"public_addr":"10.20.193.78:6804/425425936","cluster_addr":"10.20.193.78:6805/425425936","heartbeat_back_addr":"10.20.193.78:6807/425425936","heartbeat_front_addr":"10.20.193.78:6806/425425936","state":["exists","up"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":444681404}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":444681404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":444681404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":444681404}]},"public_addr":"10.20.193.78:6800/444681404","cluster_addr":"10.20.193.78:6801/444681404","heartbeat_back_addr":"10.20.193.78:6803/444681404","heartbeat_front_addr":"10.20.193.78:6802/444681404","state":["exists","up"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2589033462}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":2589033462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":2589033462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":2589033462}]},"public_addr":"10.20.193.78:6808/2589033462","cluster_addr":"10.20.193.78:6809/2589033462","heartbeat_back_addr":"10.20.193.78:6811/2589033462","heartbeat_front_addr":"10.20.193.78:6810/2589033462","state":["exists","up"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6800","nonce":1622449099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6801","nonce":1622449099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6803","nonce":1622449099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6802","nonce":1622449099}]},"public_addr":"10.20.193.187:6800/1622449099","cluster_addr":"10.20.193.187:6801/1622449099","heartbeat_back_addr":"10.20.193.187:6803/1622449099","heartbeat_front_addr":"10.20.193.187:6802/1622449099","state":["exists","up"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6807","nonce":218078640}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6809","nonce":218078640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6811","nonce":218078640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6810","nonce":218078640}]},"public_addr":"10.20.193.187:6807/218078640","cluster_addr":"10.20.193.187:6809/218078640","heartbeat_back_addr":"10.20.193.187:6811/218078640","heartbeat_front_addr":"10.20.193.187:6810/218078640","state":["exists","up"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6804","nonce":1501659775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6805","nonce":1501659775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6808","nonce":1501659775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6806","nonce":1501659775}]},"public_addr":"10.20.193.187:6804/1501659775","cluster_addr":"10.20.193.187:6805/1501659775","heartbeat_back_addr":"10.20.193.187:6808/1501659775","heartbeat_front_addr":"10.20.193.187:6806/1501659775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:22.793056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:22.766917+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:22.768140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:23.042253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:23.105972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:23.109668+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":432,"length":1},{"begin":452,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":453,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 >> v1:10.20.193.187:6812/2668687789 conn(0x7f081403d4d0 legacy=0x7f081405d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 10 monclient: shutdown 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 >> v1:10.20.193.78:6789/0 conn(0x7f084413f7b0 legacy=0x7f084413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 shutdown_connections 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 >> 10.20.193.78:0/1256408297 conn(0x7f0844054400 msgr2=0x7f0844089730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 shutdown_connections 2026-02-13T18:24:05.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.806+0000 7f084a117640 1 -- 10.20.193.78:0/1256408297 wait complete. 2026-02-13T18:24:05.833 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:24:05.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.874+0000 7fe04828c640 10 monclient: get_monmap_and_config 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.874+0000 7fe04828c640 10 monclient: build_initial_monmap 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.874+0000 7fe04828c640 10 monclient: monmap: 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:24:05.881138+0000 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:24:05.881138+0000 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:24:05.893 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:24:05.894 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.874+0000 7fe04828c640 1 Processor -- start 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.874+0000 7fe04828c640 1 -- start start 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: init 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: _reopen_session rank -1 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient(hunting): picked mon.noname-a con 0x7fe04008eae0 addr v1:10.20.193.78:6789/0 2026-02-13T18:24:05.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient(hunting): picked mon.noname-b con 0x7fe04008cf30 addr v1:10.20.193.78:6790/0 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient(hunting): picked mon.noname-c con 0x7fe0401813e0 addr v1:10.20.193.187:6789/0 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008eeb0 con 0x7fe04008eae0 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008dce0 con 0x7fe0401813e0 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe040089b50 con 0x7fe04008cf30 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient(hunting): _renew_subs 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient(hunting): authenticate will time out at 1676.936307s 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe045800640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fe04008cf30 legacy=0x7fe04017fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe046001640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe04008eae0 0x7fe04008b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37940/0 (socket says 10.20.193.78:37940) 2026-02-13T18:24:05.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe046001640 1 -- 10.20.193.78:0/3111256492 learned_addr learned my addr 10.20.193.78:0/3111256492 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe046001640 1 -- 10.20.193.78:0/3111256492 >> v1:10.20.193.78:6789/0 conn(0x7fe04008eae0 legacy=0x7fe04008b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956857711 0 0) 0x7fe04008eeb0 con 0x7fe04008eae0 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient(hunting): _negotiate 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient(hunting): my global_id is 124263 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe028003620 con 0x7fe04008eae0 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe046802640 1 -- 10.20.193.78:0/3111256492 >> v1:10.20.193.187:6789/0 conn(0x7fe0401813e0 legacy=0x7fe0401a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1240966292 0 0) 0x7fe028003620 con 0x7fe04008eae0 2026-02-13T18:24:05.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 >> v1:10.20.193.78:6790/0 conn(0x7fe04008cf30 legacy=0x7fe04017fcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 >> v1:10.20.193.187:6789/0 conn(0x7fe0401813e0 legacy=0x7fe0401a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: _finish_hunting 0 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 monclient: found mon.noname-a 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040089870 con 0x7fe04008eae0 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: _finish_auth 0 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: _check_auth_tickets 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe030003110 con 0x7fe04008eae0 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:05.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: dump: 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 5 monclient: authenticate success, global_id 124263 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0300033e0 con 0x7fe04008eae0 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 1 -- 10.20.193.78:0/3111256492 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe030004b50 con 0x7fe04008eae0 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe044fff640 10 monclient: dump: 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.906 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: get_monmap_and_config success 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 4 set_mon_vals no callback set 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: shutdown 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- 10.20.193.78:0/3111256492 >> v1:10.20.193.78:6789/0 conn(0x7fe04008eae0 legacy=0x7fe04008b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- 10.20.193.78:0/3111256492 shutdown_connections 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- 10.20.193.78:0/3111256492 >> 10.20.193.78:0/3111256492 conn(0x7fe04008ff50 msgr2=0x7fe040090350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- 10.20.193.78:0/3111256492 shutdown_connections 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 1 -- 10.20.193.78:0/3111256492 wait complete. 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: build_initial_monmap 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.878+0000 7fe04828c640 10 monclient: monmap: 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:24:05.908 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 Processor -- start 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- start start 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: init 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _reopen_session rank -1 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient(hunting): picked mon.noname-b con 0x7fe04008cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient(hunting): picked mon.noname-a con 0x7fe04008eae0 addr v1:10.20.193.78:6789/0 2026-02-13T18:24:05.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient(hunting): picked mon.noname-c con 0x7fe0401813e0 addr v1:10.20.193.78:6790/0 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe040110510 con 0x7fe04008eae0 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0401107f0 con 0x7fe04008cf30 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe040124cf0 con 0x7fe0401813e0 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient(hunting): _renew_subs 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient(hunting): authenticate will time out at 1676.940406s 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe046802640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fe0401813e0 legacy=0x7fe040175570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe045800640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe04008eae0 0x7fe040153bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37954/0 (socket says 10.20.193.78:37954) 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe045800640 1 -- 10.20.193.78:0/1722781936 learned_addr learned my addr 10.20.193.78:0/1722781936 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe045800640 1 -- 10.20.193.78:0/1722781936 >> v1:10.20.193.78:6789/0 conn(0x7fe04008eae0 legacy=0x7fe040153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24496471 0 0) 0x7fe040110510 con 0x7fe04008eae0 2026-02-13T18:24:05.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): my global_id is 124266 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe010003620 con 0x7fe04008eae0 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe046001640 1 -- 10.20.193.78:0/1722781936 >> v1:10.20.193.187:6789/0 conn(0x7fe04008cf30 legacy=0x7fe0401534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3274493455 0 0) 0x7fe010003620 con 0x7fe04008eae0 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe040110510 con 0x7fe04008eae0 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe034004540 con 0x7fe04008eae0 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:24:05.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): dump: 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280154972 0 0) 0x7fe0401107f0 con 0x7fe04008cf30 2026-02-13T18:24:05.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient(hunting): my global_id is 134200 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe010003620 con 0x7fe04008cf30 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 376727690 0 0) 0x7fe040110510 con 0x7fe04008eae0 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 >> v1:10.20.193.78:6790/0 conn(0x7fe0401813e0 legacy=0x7fe040175570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 >> v1:10.20.193.187:6789/0 conn(0x7fe04008cf30 legacy=0x7fe0401534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 monclient: found mon.a 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04005db40 con 0x7fe04008eae0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 5 monclient: authenticate success, global_id 124266 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _renew_subs 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe040110230 con 0x7fe04008eae0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _renew_subs 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe04010dbb0 con 0x7fe04008eae0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe034004810 con 0x7fe04008eae0 2026-02-13T18:24:05.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe034004b70 con 0x7fe04008eae0 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02ffff640 4 set_mon_vals no callback set 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe02e7fc640 10 monclient: dump: 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:05.915 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.882+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04005e950 con 0x7fe04008eae0 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.886+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe034004e40 con 0x7fe04008eae0 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.886+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(912..912 src has 621..912) ==== 3943+0+0 (unknown 2141432028 0 0) 0x7fe03404c700 con 0x7fe04008eae0 2026-02-13T18:24:05.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.886+0000 7fe046001640 10 monclient: get_auth_request con 0x7fe01003d4d0 auth_method 0 2026-02-13T18:24:05.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.886+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fe0340176a0 con 0x7fe04008eae0 2026-02-13T18:24:05.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.886+0000 7fe02e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:05.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.886+0000 7fe02e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:24:05.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe040060260 con 0x7fe01003d4d0 2026-02-13T18:24:05.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe02e7fc640 1 -- 10.20.193.78:0/1722781936 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+77365 (unknown 2965378022 0 371321661) 0x7fe040060260 con 0x7fe01003d4d0 2026-02-13T18:24:05.992 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:24:05.993 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:24:05.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe01003d4d0 legacy=0x7fe01005d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 10 monclient: shutdown 2026-02-13T18:24:05.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:24:05.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 >> v1:10.20.193.78:6789/0 conn(0x7fe04008eae0 legacy=0x7fe040153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:05.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 shutdown_connections 2026-02-13T18:24:05.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 >> 10.20.193.78:0/1722781936 conn(0x7fe04008ff50 msgr2=0x7fe040127aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:24:05.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 shutdown_connections 2026-02-13T18:24:05.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:05.974+0000 7fe04828c640 1 -- 10.20.193.78:0/1722781936 wait complete. 2026-02-13T18:24:06.003 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":1466,"stamp":"2026-02-13T18:24:05.862366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":561663166,"num_objects":248,"num_object_clones":194,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":15,"num_read":7682,"num_read_kb":5707016,"num_write":5460,"num_write_kb":2127275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21393,"ondisk_log_size":21393,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":924144,"kb_used_data":672144,"kb_used_omap":10445,"kb_used_meta":241458,"kb_avail":565306896,"statfs":{"total":579820584960,"available":578874261504,"internally_reserved":0,"allocated":688275456,"data_stored":915109176,"data_compressed":21004051,"data_compressed_allocated":16248832,"data_compressed_original":52400564,"omap_allocated":10696489,"internal_metadata":247253207},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13547630,"num_objects":4,"num_object_clones":4,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":5,"num_write_kb":10441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.141780"},"pg_stats":[{"pgid":"3.f","version":"909'986","reported_seq":5329,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.736282+0000","last_change":"2026-02-13T18:24:03.736663+0000","last_active":"2026-02-13T18:24:03.736282+0000","last_peered":"2026-02-13T18:24:03.736282+0000","last_clean":"2026-02-13T18:24:03.736282+0000","last_became_active":"2026-02-13T18:05:54.723603+0000","last_became_peered":"2026-02-13T18:05:54.723603+0000","last_unstale":"2026-02-13T18:24:03.736282+0000","last_undegraded":"2026-02-13T18:24:03.736282+0000","last_fullsized":"2026-02-13T18:24:03.736282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:20:57.413710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054685300000000003,"stat_sum":{"num_bytes":15715516,"num_objects":8,"num_object_clones":6,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":310,"num_read_kb":234800,"num_write":241,"num_write_kb":103237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"3"}]},{"pgid":"3.e","version":"911'2017","reported_seq":6322,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.740693+0000","last_change":"2026-02-13T18:24:03.740807+0000","last_active":"2026-02-13T18:24:03.740693+0000","last_peered":"2026-02-13T18:24:03.740693+0000","last_clean":"2026-02-13T18:24:03.740693+0000","last_became_active":"2026-02-13T18:05:54.724254+0000","last_became_peered":"2026-02-13T18:05:54.724254+0000","last_unstale":"2026-02-13T18:24:03.740693+0000","last_undegraded":"2026-02-13T18:24:03.740693+0000","last_fullsized":"2026-02-13T18:24:03.740693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":2017,"log_dups_size":0,"ondisk_log_size":2017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:28:48.295953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043452889999999996,"stat_sum":{"num_bytes":46390889,"num_objects":17,"num_object_clones":12,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":643,"num_read_kb":442141,"num_write":524,"num_write_kb":223830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"3"}]},{"pgid":"3.d","version":"901'1121","reported_seq":5492,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.720495+0000","last_change":"2026-02-13T18:23:58.370320+0000","last_active":"2026-02-13T18:24:00.720495+0000","last_peered":"2026-02-13T18:24:00.720495+0000","last_clean":"2026-02-13T18:24:00.720495+0000","last_became_active":"2026-02-13T18:05:54.724087+0000","last_became_peered":"2026-02-13T18:05:54.724087+0000","last_unstale":"2026-02-13T18:24:00.720495+0000","last_undegraded":"2026-02-13T18:24:00.720495+0000","last_fullsized":"2026-02-13T18:24:00.720495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T20:30:06.614870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004802756,"stat_sum":{"num_bytes":29239431,"num_objects":14,"num_object_clones":11,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":438,"num_read_kb":368691,"num_write":258,"num_write_kb":123058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"3.c","version":"911'1496","reported_seq":5809,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.739510+0000","last_change":"2026-02-13T18:24:03.739690+0000","last_active":"2026-02-13T18:24:03.739510+0000","last_peered":"2026-02-13T18:24:03.739510+0000","last_clean":"2026-02-13T18:24:03.739510+0000","last_became_active":"2026-02-13T18:05:54.724076+0000","last_became_peered":"2026-02-13T18:05:54.724076+0000","last_unstale":"2026-02-13T18:24:03.739510+0000","last_undegraded":"2026-02-13T18:24:03.739510+0000","last_fullsized":"2026-02-13T18:24:03.739510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:00:41.207344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034837980000000002,"stat_sum":{"num_bytes":31307803,"num_objects":17,"num_object_clones":13,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":2,"num_read":495,"num_read_kb":302008,"num_write":341,"num_write_kb":132295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"3"}]},{"pgid":"3.b","version":"905'819","reported_seq":5199,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.724157+0000","last_change":"2026-02-13T18:23:58.049514+0000","last_active":"2026-02-13T18:24:00.724157+0000","last_peered":"2026-02-13T18:24:00.724157+0000","last_clean":"2026-02-13T18:24:00.724157+0000","last_became_active":"2026-02-13T18:05:54.721450+0000","last_became_peered":"2026-02-13T18:05:54.721450+0000","last_unstale":"2026-02-13T18:24:00.724157+0000","last_undegraded":"2026-02-13T18:24:00.724157+0000","last_fullsized":"2026-02-13T18:24:00.724157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:59:53.397430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046641299999999999,"stat_sum":{"num_bytes":27111836,"num_objects":9,"num_object_clones":7,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":343,"num_read_kb":261031,"num_write":202,"num_write_kb":89443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"3.a","version":"901'1364","reported_seq":5694,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.720228+0000","last_change":"2026-02-13T18:23:58.365638+0000","last_active":"2026-02-13T18:24:00.720228+0000","last_peered":"2026-02-13T18:24:00.720228+0000","last_clean":"2026-02-13T18:24:00.720228+0000","last_became_active":"2026-02-13T18:05:54.721856+0000","last_became_peered":"2026-02-13T18:05:54.721856+0000","last_unstale":"2026-02-13T18:24:00.720228+0000","last_undegraded":"2026-02-13T18:24:00.720228+0000","last_fullsized":"2026-02-13T18:24:00.720228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1364,"log_dups_size":0,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:01:03.226146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027395300000000001,"stat_sum":{"num_bytes":34713138,"num_objects":16,"num_object_clones":13,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":1,"num_read":514,"num_read_kb":421092,"num_write":335,"num_write_kb":133530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"3.9","version":"911'1151","reported_seq":5548,"reported_epoch":912,"state":"active+clean","last_fresh":"2026-02-13T18:24:05.479919+0000","last_change":"2026-02-13T18:24:03.734522+0000","last_active":"2026-02-13T18:24:05.479919+0000","last_peered":"2026-02-13T18:24:05.479919+0000","last_clean":"2026-02-13T18:24:05.479919+0000","last_became_active":"2026-02-13T18:05:54.723752+0000","last_became_peered":"2026-02-13T18:05:54.723752+0000","last_unstale":"2026-02-13T18:24:05.479919+0000","last_undegraded":"2026-02-13T18:24:05.479919+0000","last_fullsized":"2026-02-13T18:24:05.479919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:33:00.335301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027233240000000001,"stat_sum":{"num_bytes":31797075,"num_objects":15,"num_object_clones":12,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":444,"num_read_kb":346914,"num_write":269,"num_write_kb":104992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"1"}]},{"pgid":"3.8","version":"909'942","reported_seq":5308,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.738160+0000","last_change":"2026-02-13T18:24:03.738512+0000","last_active":"2026-02-13T18:24:03.738160+0000","last_peered":"2026-02-13T18:24:03.738160+0000","last_clean":"2026-02-13T18:24:03.738160+0000","last_became_active":"2026-02-13T18:05:54.722389+0000","last_became_peered":"2026-02-13T18:05:54.722389+0000","last_unstale":"2026-02-13T18:24:03.738160+0000","last_undegraded":"2026-02-13T18:24:03.738160+0000","last_fullsized":"2026-02-13T18:24:03.738160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:32:43.258383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050338200000000003,"stat_sum":{"num_bytes":34392405,"num_objects":16,"num_object_clones":14,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":315,"num_read_kb":249137,"num_write":223,"num_write_kb":86907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"3"}]},{"pgid":"1.0","version":"13'112","reported_seq":1919,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.720555+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:24:00.720555+0000","last_peered":"2026-02-13T18:24:00.720555+0000","last_clean":"2026-02-13T18:24:00.720555+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:24:00.720555+0000","last_undegraded":"2026-02-13T18:24:00.720555+0000","last_fullsized":"2026-02-13T18:24:00.720555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1792,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.736368+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:24:03.736368+0000","last_peered":"2026-02-13T18:24:03.736368+0000","last_clean":"2026-02-13T18:24:03.736368+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:24:03.736368+0000","last_undegraded":"2026-02-13T18:24:03.736368+0000","last_fullsized":"2026-02-13T18:24:03.736368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"901'1349","reported_seq":5670,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.724242+0000","last_change":"2026-02-13T18:23:58.049662+0000","last_active":"2026-02-13T18:24:00.724242+0000","last_peered":"2026-02-13T18:24:00.724242+0000","last_clean":"2026-02-13T18:24:00.724242+0000","last_became_active":"2026-02-13T18:05:54.721902+0000","last_became_peered":"2026-02-13T18:05:54.721902+0000","last_unstale":"2026-02-13T18:24:00.724242+0000","last_undegraded":"2026-02-13T18:24:00.724242+0000","last_fullsized":"2026-02-13T18:24:00.724242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:45:49.883710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045475099999999998,"stat_sum":{"num_bytes":31625803,"num_objects":15,"num_object_clones":12,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":474,"num_read_kb":345774,"num_write":331,"num_write_kb":103771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":1782,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.720438+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:24:00.720438+0000","last_peered":"2026-02-13T18:24:00.720438+0000","last_clean":"2026-02-13T18:24:00.720438+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:24:00.720438+0000","last_undegraded":"2026-02-13T18:24:00.720438+0000","last_fullsized":"2026-02-13T18:24:00.720438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"901'1206","reported_seq":5557,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.723974+0000","last_change":"2026-02-13T18:23:57.727920+0000","last_active":"2026-02-13T18:24:00.723974+0000","last_peered":"2026-02-13T18:24:00.723974+0000","last_clean":"2026-02-13T18:24:00.723974+0000","last_became_active":"2026-02-13T18:05:54.720815+0000","last_became_peered":"2026-02-13T18:05:54.720815+0000","last_unstale":"2026-02-13T18:24:00.723974+0000","last_undegraded":"2026-02-13T18:24:00.723974+0000","last_fullsized":"2026-02-13T18:24:00.723974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1206,"log_dups_size":0,"ondisk_log_size":1206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T00:30:56.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045023300000000002,"stat_sum":{"num_bytes":40748983,"num_objects":15,"num_object_clones":12,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":449,"num_read_kb":344497,"num_write":294,"num_write_kb":129417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":1785,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.738356+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:24:03.738356+0000","last_peered":"2026-02-13T18:24:03.738356+0000","last_clean":"2026-02-13T18:24:03.738356+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:24:03.738356+0000","last_undegraded":"2026-02-13T18:24:03.738356+0000","last_fullsized":"2026-02-13T18:24:03.738356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"908'1614","reported_seq":5914,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.733115+0000","last_change":"2026-02-13T18:23:58.049715+0000","last_active":"2026-02-13T18:24:00.733115+0000","last_peered":"2026-02-13T18:24:00.733115+0000","last_clean":"2026-02-13T18:24:00.733115+0000","last_became_active":"2026-02-13T18:05:54.722385+0000","last_became_peered":"2026-02-13T18:05:54.722385+0000","last_unstale":"2026-02-13T18:24:00.733115+0000","last_undegraded":"2026-02-13T18:24:00.733115+0000","last_fullsized":"2026-02-13T18:24:00.733115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:00:38.363123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043312199999999998,"stat_sum":{"num_bytes":46283712,"num_objects":20,"num_object_clones":17,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":545,"num_read_kb":424957,"num_write":389,"num_write_kb":144781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"2.2","version":"18'2","reported_seq":1793,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.736421+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:24:03.736421+0000","last_peered":"2026-02-13T18:24:03.736421+0000","last_clean":"2026-02-13T18:24:03.736421+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:24:03.736421+0000","last_undegraded":"2026-02-13T18:24:03.736421+0000","last_fullsized":"2026-02-13T18:24:03.736421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"911'1260","reported_seq":5627,"reported_epoch":912,"state":"active+clean","last_fresh":"2026-02-13T18:24:05.479965+0000","last_change":"2026-02-13T18:24:03.734518+0000","last_active":"2026-02-13T18:24:05.479965+0000","last_peered":"2026-02-13T18:24:05.479965+0000","last_clean":"2026-02-13T18:24:05.479965+0000","last_became_active":"2026-02-13T18:05:54.722844+0000","last_became_peered":"2026-02-13T18:05:54.722844+0000","last_unstale":"2026-02-13T18:24:05.479965+0000","last_undegraded":"2026-02-13T18:24:05.479965+0000","last_fullsized":"2026-02-13T18:24:05.479965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:57:26.436826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026995399999999998,"stat_sum":{"num_bytes":22756256,"num_objects":11,"num_object_clones":8,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":413,"num_read_kb":291509,"num_write":346,"num_write_kb":134600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"1"}]},{"pgid":"3.5","version":"911'1079","reported_seq":5463,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.739513+0000","last_change":"2026-02-13T18:24:03.739690+0000","last_active":"2026-02-13T18:24:03.739513+0000","last_peered":"2026-02-13T18:24:03.739513+0000","last_clean":"2026-02-13T18:24:03.739513+0000","last_became_active":"2026-02-13T18:05:54.724753+0000","last_became_peered":"2026-02-13T18:05:54.724753+0000","last_unstale":"2026-02-13T18:24:03.739513+0000","last_undegraded":"2026-02-13T18:24:03.739513+0000","last_fullsized":"2026-02-13T18:24:03.739513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:11:58.986449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003375875,"stat_sum":{"num_bytes":28551144,"num_objects":13,"num_object_clones":10,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":361,"num_read_kb":234316,"num_write":307,"num_write_kb":113483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":1781,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.724339+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:24:00.724339+0000","last_peered":"2026-02-13T18:24:00.724339+0000","last_clean":"2026-02-13T18:24:00.724339+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:24:00.724339+0000","last_undegraded":"2026-02-13T18:24:00.724339+0000","last_fullsized":"2026-02-13T18:24:00.724339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"901'881","reported_seq":5246,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.724111+0000","last_change":"2026-02-13T18:23:58.049511+0000","last_active":"2026-02-13T18:24:00.724111+0000","last_peered":"2026-02-13T18:24:00.724111+0000","last_clean":"2026-02-13T18:24:00.724111+0000","last_became_active":"2026-02-13T18:05:54.722765+0000","last_became_peered":"2026-02-13T18:05:54.722765+0000","last_unstale":"2026-02-13T18:24:00.724111+0000","last_undegraded":"2026-02-13T18:24:00.724111+0000","last_fullsized":"2026-02-13T18:24:00.724111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:54:44.938164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045680599999999998,"stat_sum":{"num_bytes":22366119,"num_objects":9,"num_object_clones":7,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":300,"num_read_kb":202829,"num_write":231,"num_write_kb":99048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":1781,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.720354+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:24:00.720354+0000","last_peered":"2026-02-13T18:24:00.720354+0000","last_clean":"2026-02-13T18:24:00.720354+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:24:00.720354+0000","last_undegraded":"2026-02-13T18:24:00.720354+0000","last_fullsized":"2026-02-13T18:24:00.720354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"911'1305","reported_seq":5656,"reported_epoch":911,"state":"active+clean","last_fresh":"2026-02-13T18:24:03.743382+0000","last_change":"2026-02-13T18:24:03.743471+0000","last_active":"2026-02-13T18:24:03.743382+0000","last_peered":"2026-02-13T18:24:03.743382+0000","last_clean":"2026-02-13T18:24:03.743382+0000","last_became_active":"2026-02-13T18:05:54.722150+0000","last_became_peered":"2026-02-13T18:05:54.722150+0000","last_unstale":"2026-02-13T18:24:03.743382+0000","last_undegraded":"2026-02-13T18:24:03.743382+0000","last_fullsized":"2026-02-13T18:24:03.743382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:16:23.284269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052914279999999999,"stat_sum":{"num_bytes":49748209,"num_objects":19,"num_object_clones":16,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":479,"num_read_kb":353027,"num_write":339,"num_write_kb":135256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1b0","length":"1"},{"start":"1c4","length":"3"}]},{"pgid":"2.6","version":"0'0","reported_seq":1781,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.724323+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:24:00.724323+0000","last_peered":"2026-02-13T18:24:00.724323+0000","last_clean":"2026-02-13T18:24:00.724323+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:24:00.724323+0000","last_undegraded":"2026-02-13T18:24:00.724323+0000","last_fullsized":"2026-02-13T18:24:00.724323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"908'2688","reported_seq":6996,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.724015+0000","last_change":"2026-02-13T18:23:57.727833+0000","last_active":"2026-02-13T18:24:00.724015+0000","last_peered":"2026-02-13T18:24:00.724015+0000","last_clean":"2026-02-13T18:24:00.724015+0000","last_became_active":"2026-02-13T18:05:54.721808+0000","last_became_peered":"2026-02-13T18:05:54.721808+0000","last_unstale":"2026-02-13T18:24:00.724015+0000","last_undegraded":"2026-02-13T18:24:00.724015+0000","last_fullsized":"2026-02-13T18:24:00.724015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:53.711388+0000","last_clean_scrub_stamp":"2026-02-13T18:05:53.711388+0000","objects_scrubbed":0,"log_size":2688,"log_dups_size":0,"ondisk_log_size":2688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:25:52.216455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043569600000000001,"stat_sum":{"num_bytes":68324460,"num_objects":30,"num_object_clones":24,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":4,"num_read":1073,"num_read_kb":884220,"num_write":683,"num_write_kb":266953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c5","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":1781,"reported_epoch":908,"state":"active+clean","last_fresh":"2026-02-13T18:24:00.720268+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:24:00.720268+0000","last_peered":"2026-02-13T18:24:00.720268+0000","last_clean":"2026-02-13T18:24:00.720268+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:24:00.720268+0000","last_undegraded":"2026-02-13T18:24:00.720268+0000","last_fullsized":"2026-02-13T18:24:00.720268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":561072779,"num_objects":244,"num_object_clones":194,"num_object_copies":488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":15,"num_read":7596,"num_read_kb":5706943,"num_write":5313,"num_write_kb":2124601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":674713600,"data_stored":907339186,"data_compressed":21040657,"data_compressed_allocated":16183296,"data_compressed_original":51442100,"omap_allocated":0,"internal_metadata":0},"log_size":21278,"ondisk_log_size":21278,"up":32,"acting":32,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640482,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135972,"kb_used_data":90964,"kb_used_omap":1763,"kb_used_meta":43228,"kb_avail":94235868,"statfs":{"total":96636764160,"available":96497528832,"internally_reserved":0,"allocated":93147136,"data_stored":131151652,"data_compressed":2166847,"data_compressed_allocated":1683456,"data_compressed_original":5480683,"omap_allocated":1806304,"internal_metadata":44265504},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640482,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154624,"kb_used_data":109616,"kb_used_omap":1796,"kb_used_meta":43195,"kb_avail":94217216,"statfs":{"total":96636764160,"available":96478429184,"internally_reserved":0,"allocated":112246784,"data_stored":149471457,"data_compressed":4054421,"data_compressed_allocated":3129344,"data_compressed_original":10772237,"omap_allocated":1839979,"internal_metadata":44231829},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640481,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84536,"kb_used_data":57576,"kb_used_omap":1212,"kb_used_meta":25731,"kb_avail":94287304,"statfs":{"total":96636764160,"available":96550199296,"internally_reserved":0,"allocated":58957824,"data_stored":73340731,"data_compressed":1133972,"data_compressed_allocated":978944,"data_compressed_original":3219560,"omap_allocated":1241528,"internal_metadata":26349128},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640485,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185836,"kb_used_data":140828,"kb_used_omap":1968,"kb_used_meta":43023,"kb_avail":94186004,"statfs":{"total":96636764160,"available":96446468096,"internally_reserved":0,"allocated":144207872,"data_stored":197741465,"data_compressed":4648478,"data_compressed_allocated":3489792,"data_compressed_original":11335914,"omap_allocated":2015725,"internal_metadata":44056083},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640482,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205764,"kb_used_data":160756,"kb_used_omap":1854,"kb_used_meta":43137,"kb_avail":94166076,"statfs":{"total":96636764160,"available":96426061824,"internally_reserved":0,"allocated":164614144,"data_stored":215061225,"data_compressed":4759175,"data_compressed_allocated":3567616,"data_compressed_original":10451170,"omap_allocated":1899404,"internal_metadata":44172404},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640481,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157412,"kb_used_data":112404,"kb_used_omap":1849,"kb_used_meta":43142,"kb_avail":94214428,"statfs":{"total":96636764160,"available":96475574272,"internally_reserved":0,"allocated":115101696,"data_stored":148342646,"data_compressed":4241158,"data_compressed_allocated":3399680,"data_compressed_original":11141000,"omap_allocated":1893549,"internal_metadata":44178259},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112680960,"data_stored":146510830,"data_compressed":4234292,"data_compressed_allocated":3366912,"data_compressed_original":10629000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":162242560,"data_stored":213758318,"data_compressed":4759175,"data_compressed_allocated":3567616,"data_compressed_original":10451170,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":141815808,"data_stored":196425091,"data_compressed":4648478,"data_compressed_allocated":3489792,"data_compressed_original":11335914,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":56545280,"data_stored":71513357,"data_compressed":1127106,"data_compressed_allocated":946176,"data_compressed_original":2707560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110678016,"data_stored":149296331,"data_compressed":4104759,"data_compressed_allocated":3129344,"data_compressed_original":10837773,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90750976,"data_stored":129835259,"data_compressed":2166847,"data_compressed_allocated":1683456,"data_compressed_original":5480683,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:24:06.006 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-13T18:24:06.007 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-13T18:24:06.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient: get_monmap_and_config 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient: build_initial_monmap 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient: monmap: 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:24:06.065952+0000 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:24:06.065952+0000 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:06.078 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:24:06.079 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:24:06.079 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:24:06.079 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:06.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 1 Processor -- start 2026-02-13T18:24:06.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 1 -- start start 2026-02-13T18:24:06.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient: init 2026-02-13T18:24:06.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient: _reopen_session rank -1 2026-02-13T18:24:06.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient(hunting): picked mon.noname-a con 0x7fa43808c200 addr v1:10.20.193.78:6789/0 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient(hunting): picked mon.noname-b con 0x7fa43808d1c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient(hunting): picked mon.noname-c con 0x7fa43808d5e0 addr v1:10.20.193.187:6789/0 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43808c5d0 con 0x7fa43808c200 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43808e100 con 0x7fa43808d5e0 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43808b910 con 0x7fa43808d1c0 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient(hunting): _renew_subs 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa4377fe640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fa43808d1c0 legacy=0x7fa438183fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 10 monclient(hunting): authenticate will time out at 1677.121290s 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa437fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa43808c200 0x7fa43808cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37960/0 (socket says 10.20.193.78:37960) 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa437fff640 1 -- 10.20.193.78:0/3764825693 learned_addr learned my addr 10.20.193.78:0/3764825693 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:24:06.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa437fff640 1 -- 10.20.193.78:0/3764825693 >> v1:10.20.193.78:6789/0 conn(0x7fa43808c200 legacy=0x7fa43808cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3003474134 0 0) 0x7fa43808c5d0 con 0x7fa43808c200 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient(hunting): my global_id is 124269 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa41c003620 con 0x7fa43808c200 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43ca5f640 1 -- 10.20.193.78:0/3764825693 >> v1:10.20.193.187:6789/0 conn(0x7fa43808d5e0 legacy=0x7fa4381a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2818835060 0 0) 0x7fa41c003620 con 0x7fa43808c200 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 >> v1:10.20.193.78:6790/0 conn(0x7fa43808d1c0 legacy=0x7fa438183fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 >> v1:10.20.193.187:6789/0 conn(0x7fa43808d5e0 legacy=0x7fa4381a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:24:06.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 monclient: found mon.noname-a 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43808a890 con 0x7fa43808c200 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: _finish_auth 0 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa424003110 con 0x7fa43808c200 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa436ffd640 10 monclient: dump: 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:06.086 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 5 monclient: authenticate success, global_id 124269 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.062+0000 7fa43e4e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4240033e0 con 0x7fa43808c200 2026-02-13T18:24:06.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa436ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa436ffd640 1 -- 10.20.193.78:0/3764825693 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa424004b50 con 0x7fa43808c200 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa436ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa436ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa436ffd640 10 monclient: dump: 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:06.088 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: get_monmap_and_config success 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 4 set_mon_vals no callback set 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: shutdown 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3764825693 >> v1:10.20.193.78:6789/0 conn(0x7fa43808c200 legacy=0x7fa43808cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3764825693 shutdown_connections 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3764825693 >> 10.20.193.78:0/3764825693 conn(0x7fa438091800 msgr2=0x7fa438091c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3764825693 shutdown_connections 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3764825693 wait complete. 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: build_initial_monmap 2026-02-13T18:24:06.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: monmap: 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 Processor -- start 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- start start 2026-02-13T18:24:06.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: init 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: _reopen_session rank -1 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient(hunting): picked mon.noname-a con 0x7fa43808c200 addr v1:10.20.193.78:6789/0 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient(hunting): picked mon.noname-c con 0x7fa43808d1c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient(hunting): picked mon.noname-b con 0x7fa43808d5e0 addr v1:10.20.193.187:6789/0 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa438088280 con 0x7fa43808c200 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa4377fe640 1 -- >> v1:10.20.193.78:6790/0 conn(0x7fa43808d1c0 legacy=0x7fa4381944e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.78:6790/0 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4380889f0 con 0x7fa43808d5e0 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa438080e30 con 0x7fa43808d1c0 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient(hunting): _renew_subs 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa43e4e9640 10 monclient(hunting): authenticate will time out at 1677.125680s 2026-02-13T18:24:06.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa437fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa43808c200 0x7fa4381532d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:37974/0 (socket says 10.20.193.78:37974) 2026-02-13T18:24:06.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa437fff640 1 -- 10.20.193.78:0/3126190103 learned_addr learned my addr 10.20.193.78:0/3126190103 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa437fff640 1 -- 10.20.193.78:0/3126190103 >> v1:10.20.193.78:6789/0 conn(0x7fa43808c200 legacy=0x7fa4381532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001372799 0 0) 0x7fa438088280 con 0x7fa43808c200 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa434ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa434ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa434ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa434ff9640 10 monclient(hunting): my global_id is 124272 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.066+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa408003620 con 0x7fa43808c200 2026-02-13T18:24:06.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43ca5f640 1 -- 10.20.193.78:0/3126190103 >> v1:10.20.193.187:6789/0 conn(0x7fa43808d5e0 legacy=0x7fa438195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2495198543 0 0) 0x7fa408003620 con 0x7fa43808c200 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa438088280 con 0x7fa43808c200 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa4240048e0 con 0x7fa43808c200 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): dump: 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:06.096 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976309419 0 0) 0x7fa4380889f0 con 0x7fa43808d5e0 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient(hunting): my global_id is 134206 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa408003620 con 0x7fa43808d5e0 2026-02-13T18:24:06.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2943783190 0 0) 0x7fa438088280 con 0x7fa43808c200 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 >> v1:10.20.193.78:6790/0 conn(0x7fa43808d1c0 legacy=0x7fa4381944e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 >> v1:10.20.193.187:6789/0 conn(0x7fa43808d5e0 legacy=0x7fa438195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 monclient: found mon.a 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa438083190 con 0x7fa43808c200 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: _finish_auth 0 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 5 monclient: authenticate success, global_id 124272 2026-02-13T18:24:06.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 monclient: _renew_subs 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa438081990 con 0x7fa43808c200 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 monclient: _renew_subs 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa438080380 con 0x7fa43808c200 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa424003380 con 0x7fa43808c200 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa424005190 con 0x7fa43808c200 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: dump: 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:24:06.099 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa4367fc640 4 set_mon_vals no callback set 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:06.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4380008e0 con 0x7fa43808c200 2026-02-13T18:24:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa424011820 con 0x7fa43808c200 2026-02-13T18:24:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(912..912 src has 621..912) ==== 3943+0+0 (unknown 2141432028 0 0) 0x7fa42404c6d0 con 0x7fa43808c200 2026-02-13T18:24:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa4377fe640 10 monclient: get_auth_request con 0x7fa40803d4d0 auth_method 0 2026-02-13T18:24:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fa4240176c0 con 0x7fa43808c200 2026-02-13T18:24:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:24:06.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.070+0000 7fa434ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:24:06.175 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.158+0000 7fa43e4e9640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-13T18:24:06.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.158+0000 7fa43e4e9640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-13T18:24:06.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.158+0000 7fa43e4e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:24:06.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.158+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa438082fb0 con 0x7fa43808c200 2026-02-13T18:24:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa434ff9640 1 -- 10.20.193.78:0/3126190103 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]=0 pool 'unique_pool_0' removed v913) ==== 175+0+0 (unknown 3283116152 0 0) 0x7fa438082fb0 con 0x7fa43808c200 2026-02-13T18:24:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa434ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-13T18:24:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa434ff9640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' removed 2026-02-13T18:24:06.493 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_0' removed 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa40803d4d0 legacy=0x7fa40805d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 10 monclient: shutdown 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 >> v1:10.20.193.78:6789/0 conn(0x7fa43808c200 legacy=0x7fa4381532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 shutdown_connections 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 >> 10.20.193.78:0/3126190103 conn(0x7fa438091800 msgr2=0x7fa43805e050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 shutdown_connections 2026-02-13T18:24:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:24:06.478+0000 7fa43e4e9640 1 -- 10.20.193.78:0/3126190103 wait complete. 2026-02-13T18:24:06.505 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-13T18:24:06.522 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-13T18:25:07.196 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T18:25:07.196 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T18:25:07.196 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T18:25:07.197 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T18:25:07.199 INFO:tasks.ceph.mon.c:Started 2026-02-13T18:25:07.199 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:25:07.199 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:25:07.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 10 monclient: get_monmap_and_config 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 10 monclient: build_initial_monmap 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 10 monclient: monmap: 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:07.248809+0000 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:07.248809+0000 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:07.262 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:07.263 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:07.263 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 1 Processor -- start 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 1 -- start start 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 10 monclient: init 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.245+0000 7fd1ed9e8640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient(hunting): picked mon.noname-c con 0x7fd1e813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient(hunting): picked mon.noname-b con 0x7fd1e805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient(hunting): picked mon.noname-a con 0x7fd1e81853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e8095530 con 0x7fd1e81853c0 2026-02-13T18:25:07.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e8140390 con 0x7fd1e813f8b0 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e805d230 con 0x7fd1e805e4b0 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient(hunting): authenticate will time out at 1738.304091s 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e67fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd1e805e4b0 0x7fd1e8183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38680/0 (socket says 10.20.193.78:38680) 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e67fc640 1 -- 10.20.193.78:0/1532798082 learned_addr learned my addr 10.20.193.78:0/1532798082 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e67fc640 1 -- 10.20.193.78:0/1532798082 >> v1:10.20.193.78:6790/0 conn(0x7fd1e805e4b0 legacy=0x7fd1e8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e77fe640 1 -- 10.20.193.78:0/1532798082 >> v1:10.20.193.78:6789/0 conn(0x7fd1e81853c0 legacy=0x7fd1e81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e6ffd640 1 -- 10.20.193.78:0/1532798082 >> v1:10.20.193.187:6789/0 conn(0x7fd1e813f8b0 legacy=0x7fd1e813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052503790 0 0) 0x7fd1d80041c0 con 0x7fd1e81853c0 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:07.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): my global_id is 124275 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d4003620 con 0x7fd1e81853c0 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188380048 0 0) 0x7fd1dc002cb0 con 0x7fd1e813f8b0 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient(hunting): my global_id is 134209 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d80041c0 con 0x7fd1e813f8b0 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4247651985 0 0) 0x7fd1d4003620 con 0x7fd1e81853c0 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 >> v1:10.20.193.78:6790/0 conn(0x7fd1e805e4b0 legacy=0x7fd1e8183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 >> v1:10.20.193.187:6789/0 conn(0x7fd1e813f8b0 legacy=0x7fd1e813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 monclient: found mon.noname-a 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e805d510 con 0x7fd1e81853c0 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1d8004840 con 0x7fd1e81853c0 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 5 monclient: authenticate success, global_id 124275 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:07.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: dump: 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:07.272 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1d8004c20 con 0x7fd1e81853c0 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 1 -- 10.20.193.78:0/1532798082 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1d8004fb0 con 0x7fd1e81853c0 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1e5ffb640 10 monclient: dump: 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.273 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 4 set_mon_vals no callback set 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient: shutdown 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/1532798082 >> v1:10.20.193.78:6789/0 conn(0x7fd1e81853c0 legacy=0x7fd1e81a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/1532798082 shutdown_connections 2026-02-13T18:25:07.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/1532798082 >> 10.20.193.78:0/1532798082 conn(0x7fd1e80545d0 msgr2=0x7fd1e80549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/1532798082 shutdown_connections 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/1532798082 wait complete. 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient: build_initial_monmap 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient: monmap: 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:07.275 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 Processor -- start 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 1 -- start start 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.249+0000 7fd1ed9e8640 10 monclient: init 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient(hunting): picked mon.noname-c con 0x7fd1e805e4b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient(hunting): picked mon.noname-b con 0x7fd1e813f8b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient(hunting): picked mon.noname-a con 0x7fd1e81853c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e8112260 con 0x7fd1e81853c0 2026-02-13T18:25:07.276 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e813f480 con 0x7fd1e813f8b0 2026-02-13T18:25:07.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e81113f0 con 0x7fd1e805e4b0 2026-02-13T18:25:07.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:07.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient(hunting): authenticate will time out at 1738.308160s 2026-02-13T18:25:07.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1e6ffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd1e805e4b0 0x7fd1e813ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:38682/0 (socket says 10.20.193.78:38682) 2026-02-13T18:25:07.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1e6ffd640 1 -- 10.20.193.78:0/3419389147 learned_addr learned my addr 10.20.193.78:0/3419389147 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1e6ffd640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.78:6790/0 conn(0x7fd1e805e4b0 legacy=0x7fd1e813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1e77fe640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.78:6789/0 conn(0x7fd1e81853c0 legacy=0x7fd1e8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215565251 0 0) 0x7fd1e8112260 con 0x7fd1e81853c0 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): my global_id is 124278 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003620 con 0x7fd1e81853c0 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1e67fc640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.187:6789/0 conn(0x7fd1e813f8b0 legacy=0x7fd1e8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:07.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3453155450 0 0) 0x7fd1b8003620 con 0x7fd1e81853c0 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1e8112260 con 0x7fd1e81853c0 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1d8004620 con 0x7fd1e81853c0 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): dump: 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:07.281 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360020652 0 0) 0x7fd1e813f480 con 0x7fd1e813f8b0 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient(hunting): my global_id is 134212 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003620 con 0x7fd1e813f8b0 2026-02-13T18:25:07.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3175659602 0 0) 0x7fd1e8112260 con 0x7fd1e81853c0 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.78:6790/0 conn(0x7fd1e805e4b0 legacy=0x7fd1e813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.187:6789/0 conn(0x7fd1e813f8b0 legacy=0x7fd1e8180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 monclient: found mon.a 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e810ff00 con 0x7fd1e81853c0 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: _finish_auth 0 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 5 monclient: authenticate success, global_id 124278 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _renew_subs 2026-02-13T18:25:07.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e81119c0 con 0x7fd1e81853c0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _renew_subs 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1e8110c30 con 0x7fd1e81853c0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1d8004c20 con 0x7fd1e81853c0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd1d80055d0 con 0x7fd1e81853c0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 10 monclient: dump: 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:07.284 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1e57fa640 4 set_mon_vals no callback set 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:07.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e80008e0 con 0x7fd1e81853c0 2026-02-13T18:25:07.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd1d80058a0 con 0x7fd1e81853c0 2026-02-13T18:25:07.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.253+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fd1d804dae0 con 0x7fd1e81853c0 2026-02-13T18:25:07.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.257+0000 7fd1e6ffd640 10 monclient: get_auth_request con 0x7fd1b803d590 auth_method 0 2026-02-13T18:25:07.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.257+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fd1e8095530 con 0x7fd1e81853c0 2026-02-13T18:25:07.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.257+0000 7fd1bffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:07.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.257+0000 7fd1bffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:07.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:25:07.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:25:07.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:07.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd1e8093020 con 0x7fd1e81853c0 2026-02-13T18:25:07.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1bffff640 1 -- 10.20.193.78:0/3419389147 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1599 (unknown 254746657 0 2027704316) 0x7fd1d8018c70 con 0x7fd1e81853c0 2026-02-13T18:25:07.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1bffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:25:07.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1bffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:07.393 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":90,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd1b803d590 legacy=0x7fd1b805da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 10 monclient: shutdown 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 >> v1:10.20.193.78:6789/0 conn(0x7fd1e81853c0 legacy=0x7fd1e8181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 shutdown_connections 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 >> 10.20.193.78:0/3419389147 conn(0x7fd1e80545d0 msgr2=0x7fd1e80965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 shutdown_connections 2026-02-13T18:25:07.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:07.377+0000 7fd1ed9e8640 1 -- 10.20.193.78:0/3419389147 wait complete. 2026-02-13T18:25:10.404 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:25:10.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient: get_monmap_and_config 2026-02-13T18:25:10.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient: monmap: 2026-02-13T18:25:10.465 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.465 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:10.452259+0000 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:10.452259+0000 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:10.466 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 1 Processor -- start 2026-02-13T18:25:10.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 1 -- start start 2026-02-13T18:25:10.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient: init 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient(hunting): picked mon.noname-a con 0x7fa69c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient(hunting): picked mon.noname-b con 0x7fa69c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient(hunting): picked mon.noname-c con 0x7fa69c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c089e80 con 0x7fa69c08c2f0 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c088c20 con 0x7fa69c08cdd0 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c089ba0 con 0x7fa69c08dc80 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a39fb640 10 monclient(hunting): authenticate will time out at 1741.507374s 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a0f6f640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 0x7fa69c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33244/0 (socket says 10.20.193.78:33244) 2026-02-13T18:25:10.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a0f6f640 1 -- 10.20.193.78:0/3067067843 learned_addr learned my addr 10.20.193.78:0/3067067843 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.449+0000 7fa6a1770640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fa69c08c2f0 0x7fa69c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59326/0 (socket says 10.20.193.78:59326) 2026-02-13T18:25:10.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a0f6f640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 legacy=0x7fa69c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a1770640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6789/0 conn(0x7fa69c08c2f0 legacy=0x7fa69c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a0f6f640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 legacy=0x7fa69c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T18:25:10.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a0f6f640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 legacy=0x7fa69c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a0f6f640 1 --1- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 0x7fa69c181ce0 :-1 s=OPENED pgs=702 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a0f6f640 1 --1- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 0x7fa69c181ce0 :-1 s=OPENED pgs=702 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6790/0 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638149984 0 0) 0x7fa69c089e80 con 0x7fa69c08c2f0 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient(hunting): my global_id is 124281 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa684003620 con 0x7fa69c08c2f0 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a1f71640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.187:6789/0 conn(0x7fa69c08cdd0 legacy=0x7fa69c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3479841200 0 0) 0x7fa684003620 con 0x7fa69c08c2f0 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08dc80 legacy=0x7fa69c181ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.187:6789/0 conn(0x7fa69c08cdd0 legacy=0x7fa69c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 monclient: found mon.noname-a 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c08d370 con 0x7fa69c08c2f0 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa68c003040 con 0x7fa69c08c2f0 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: dump: 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.478 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 5 monclient: authenticate success, global_id 124281 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa68c003310 con 0x7fa69c08c2f0 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 1 -- 10.20.193.78:0/3067067843 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa68c0048e0 con 0x7fa69c08c2f0 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa68bfff640 10 monclient: dump: 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.479 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 4 set_mon_vals no callback set 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: shutdown 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- 10.20.193.78:0/3067067843 >> v1:10.20.193.78:6789/0 conn(0x7fa69c08c2f0 legacy=0x7fa69c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- 10.20.193.78:0/3067067843 shutdown_connections 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- 10.20.193.78:0/3067067843 >> 10.20.193.78:0/3067067843 conn(0x7fa69c091720 msgr2=0x7fa69c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- 10.20.193.78:0/3067067843 shutdown_connections 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- 10.20.193.78:0/3067067843 wait complete. 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: monmap: 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.481 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 Processor -- start 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- start start 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: init 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient(hunting): picked mon.noname-c con 0x7fa69c08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient(hunting): picked mon.noname-b con 0x7fa69c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient(hunting): picked mon.noname-a con 0x7fa69c08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c07faa0 con 0x7fa69c08dc80 2026-02-13T18:25:10.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c05dd50 con 0x7fa69c08cdd0 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c088910 con 0x7fa69c08c2f0 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.453+0000 7fa6a39fb640 10 monclient(hunting): authenticate will time out at 1741.511968s 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a1770640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fa69c08c2f0 0x7fa69c083890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33258/0 (socket says 10.20.193.78:33258) 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a1770640 1 -- 10.20.193.78:0/317800456 learned_addr learned my addr 10.20.193.78:0/317800456 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a1770640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08c2f0 legacy=0x7fa69c083890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a1f71640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.78:6789/0 conn(0x7fa69c08dc80 legacy=0x7fa69c193a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165271760 0 0) 0x7fa69c088910 con 0x7fa69c08c2f0 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): my global_id is 144101 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66c003620 con 0x7fa69c08c2f0 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836862858 0 0) 0x7fa69c088c20 con 0x7fa69c08dc80 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): my global_id is 124284 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa69c088910 con 0x7fa69c08dc80 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a0f6f640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.187:6789/0 conn(0x7fa69c08cdd0 legacy=0x7fa69c192310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1174384669 0 0) 0x7fa69c088910 con 0x7fa69c08dc80 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa69c088c20 con 0x7fa69c08dc80 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa698004890 con 0x7fa69c08dc80 2026-02-13T18:25:10.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.485 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 864441385 0 0) 0x7fa66c003620 con 0x7fa69c08c2f0 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa69c088910 con 0x7fa69c08c2f0 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa68c0048e0 con 0x7fa69c08c2f0 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.486 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048809584 0 0) 0x7fa69c05dd50 con 0x7fa69c08cdd0 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient(hunting): my global_id is 134218 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66c003620 con 0x7fa69c08cdd0 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 647152287 0 0) 0x7fa69c088c20 con 0x7fa69c08dc80 2026-02-13T18:25:10.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.78:6790/0 conn(0x7fa69c08c2f0 legacy=0x7fa69c083890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.187:6789/0 conn(0x7fa69c08cdd0 legacy=0x7fa69c192310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 monclient: found mon.a 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c07dfe0 con 0x7fa69c08dc80 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 5 monclient: authenticate success, global_id 124284 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 monclient: _renew_subs 2026-02-13T18:25:10.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c080340 con 0x7fa69c08dc80 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 monclient: _renew_subs 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa69c083fa0 con 0x7fa69c08dc80 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa698004ed0 con 0x7fa69c08dc80 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fa698005260 con 0x7fa69c08dc80 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 10 monclient: dump: 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.489 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa68b7fe640 4 set_mon_vals no callback set 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c08f600 con 0x7fa69c08dc80 2026-02-13T18:25:10.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fa698005440 con 0x7fa69c08dc80 2026-02-13T18:25:10.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.457+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fa69804d870 con 0x7fa69c08dc80 2026-02-13T18:25:10.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.461+0000 7fa6a1770640 10 monclient: get_auth_request con 0x7fa66c03d890 auth_method 0 2026-02-13T18:25:10.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.461+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fa69c07faa0 con 0x7fa69c08dc80 2026-02-13T18:25:10.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.461+0000 7fa689ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.461+0000 7fa689ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:10.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa69c090810 con 0x7fa69c08dc80 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa689ffb640 1 -- 10.20.193.78:0/317800456 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1633662748) 0x7fa6980189f0 con 0x7fa69c08dc80 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa689ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa689ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:10.597 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:25:10.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.187:6812/2668687789 conn(0x7fa66c03d890 legacy=0x7fa66c05dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 10 monclient: shutdown 2026-02-13T18:25:10.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 >> v1:10.20.193.78:6789/0 conn(0x7fa69c08dc80 legacy=0x7fa69c193a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 shutdown_connections 2026-02-13T18:25:10.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 >> 10.20.193.78:0/317800456 conn(0x7fa69c091720 msgr2=0x7fa69c08ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 shutdown_connections 2026-02-13T18:25:10.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.581+0000 7fa6a39fb640 1 -- 10.20.193.78:0/317800456 wait complete. 2026-02-13T18:25:10.607 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:25:10.607 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T18:25:10.607 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T18:25:10.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient: get_monmap_and_config 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient: monmap: 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:10.664742+0000 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:10.664742+0000 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.678 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:10.679 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 1 Processor -- start 2026-02-13T18:25:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 1 -- start start 2026-02-13T18:25:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient: init 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient(hunting): picked mon.noname-c con 0x7f5a3808e920 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient(hunting): picked mon.noname-a con 0x7f5a3808d7b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient(hunting): picked mon.noname-b con 0x7f5a38184cb0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3805d030 con 0x7f5a3808d7b0 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3805d730 con 0x7f5a3808e920 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3805e0d0 con 0x7f5a38184cb0 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.661+0000 7f5a3d2ef640 10 monclient(hunting): authenticate will time out at 1741.719937s 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a367fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5a3808d7b0 0x7f5a3808f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59350/0 (socket says 10.20.193.78:59350) 2026-02-13T18:25:10.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a367fc640 1 -- 10.20.193.78:0/2903582149 learned_addr learned my addr 10.20.193.78:0/2903582149 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a367fc640 1 -- 10.20.193.78:0/2903582149 >> v1:10.20.193.78:6789/0 conn(0x7f5a3808d7b0 legacy=0x7f5a3808f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a377fe640 1 -- 10.20.193.78:0/2903582149 >> v1:10.20.193.78:6790/0 conn(0x7f5a38184cb0 legacy=0x7f5a381a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a36ffd640 1 -- 10.20.193.78:0/2903582149 >> v1:10.20.193.187:6789/0 conn(0x7f5a3808e920 legacy=0x7f5a3808ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041934215 0 0) 0x7f5a3805d030 con 0x7f5a3808d7b0 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): my global_id is 124287 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a24003620 con 0x7f5a3808d7b0 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308802012 0 0) 0x7f5a3805e0d0 con 0x7f5a38184cb0 2026-02-13T18:25:10.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): my global_id is 144104 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3805d030 con 0x7f5a38184cb0 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204799164 0 0) 0x7f5a3805d730 con 0x7f5a3808e920 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient(hunting): my global_id is 134221 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3805e0d0 con 0x7f5a3808e920 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1325127991 0 0) 0x7f5a24003620 con 0x7f5a3808d7b0 2026-02-13T18:25:10.686 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 >> v1:10.20.193.78:6790/0 conn(0x7f5a38184cb0 legacy=0x7f5a381a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 >> v1:10.20.193.187:6789/0 conn(0x7f5a3808e920 legacy=0x7f5a3808ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 monclient: found mon.noname-a 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3808cdd0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 5 monclient: authenticate success, global_id 124287 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:10.687 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a20003110 con 0x7f5a3808d7b0 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: dump: 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.688 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a200033e0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 1 -- 10.20.193.78:0/2903582149 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a20004b50 con 0x7f5a3808d7b0 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a35ffb640 10 monclient: dump: 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.689 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 4 set_mon_vals no callback set 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: shutdown 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2903582149 >> v1:10.20.193.78:6789/0 conn(0x7f5a3808d7b0 legacy=0x7f5a3808f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.690 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2903582149 shutdown_connections 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2903582149 >> 10.20.193.78:0/2903582149 conn(0x7f5a3808ff50 msgr2=0x7f5a38090350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2903582149 shutdown_connections 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2903582149 wait complete. 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: monmap: 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.691 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 Processor -- start 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- start start 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: init 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient(hunting): picked mon.noname-b con 0x7f5a3808d7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient(hunting): picked mon.noname-c con 0x7f5a3808e920 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient(hunting): picked mon.noname-a con 0x7f5a38184cb0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38189960 con 0x7f5a38184cb0 2026-02-13T18:25:10.692 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38184ac0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38189c40 con 0x7f5a3808e920 2026-02-13T18:25:10.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.665+0000 7f5a3d2ef640 10 monclient(hunting): authenticate will time out at 1741.723966s 2026-02-13T18:25:10.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 0x7f5a381843b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59358/0 (socket says 10.20.193.78:59358) 2026-02-13T18:25:10.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 -- 10.20.193.78:0/2035977727 learned_addr learned my addr 10.20.193.78:0/2035977727 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.693 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a367fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 0x7f5a38183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33288/0 (socket says 10.20.193.78:33288) 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 legacy=0x7f5a381843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a367fc640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 legacy=0x7f5a38183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a367fc640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 legacy=0x7f5a38183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a367fc640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 legacy=0x7f5a38183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a367fc640 1 --1- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 0x7f5a38183ca0 :-1 s=OPENED pgs=705 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a367fc640 1 --1- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 0x7f5a38183ca0 :-1 s=OPENED pgs=705 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6790/0 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732529203 0 0) 0x7f5a38189960 con 0x7f5a38184cb0 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): my global_id is 124290 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04003620 con 0x7f5a38184cb0 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a36ffd640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.187:6789/0 conn(0x7f5a3808d7b0 legacy=0x7f5a381319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 legacy=0x7f5a381843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 legacy=0x7f5a381843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 --1- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 0x7f5a381843b0 :-1 s=OPENED pgs=546 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a377fe640 1 --1- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 0x7f5a381843b0 :-1 s=OPENED pgs=546 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6789/0 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4102908388 0 0) 0x7f5a04003620 con 0x7f5a38184cb0 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a38189960 con 0x7f5a38184cb0 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028172220 0 0) 0x7f5a38184ac0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): my global_id is 134224 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04003620 con 0x7f5a3808d7b0 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1338590130 0 0) 0x7f5a04003620 con 0x7f5a3808d7b0 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a38184ac0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a2c0033c0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): dump: 2026-02-13T18:25:10.701 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2328966826 0 0) 0x7f5a38184ac0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6790/0 conn(0x7f5a3808e920 legacy=0x7f5a38183ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a38184cb0 legacy=0x7f5a381843b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 monclient: found mon.b 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a381a12d0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 5 monclient: authenticate success, global_id 134224 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 10 monclient: _renew_subs 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:25:10.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.187:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a38189680 con 0x7f5a3808d7b0 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 10 monclient: _renew_subs 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.187:6789/0 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.187:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a38187000 con 0x7f5a3808d7b0 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a2c0039c0 con 0x7f5a3808d7b0 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a2c003d50 con 0x7f5a3808d7b0 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a177fe640 10 monclient: dump: 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.704 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a357fa640 4 set_mon_vals no callback set 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.669+0000 7f5a3d2ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5a3805e950 con 0x7f5a381320b0 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5a2c003f30 con 0x7f5a3808d7b0 2026-02-13T18:25:10.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.1 v1:10.20.193.187:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f5a2c04c410 con 0x7f5a3808d7b0 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a377fe640 10 monclient: get_auth_request con 0x7f5a0403d640 auth_method 0 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a367fc640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a381320b0 legacy=0x7f5a381a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896181654 0 0) 0x7f5a3805e950 con 0x7f5a381320b0 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient(hunting): my global_id is 124293 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a38184ac0 con 0x7f5a381320b0 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 467676533 0 0) 0x7f5a38184ac0 con 0x7f5a381320b0 2026-02-13T18:25:10.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a3805e950 con 0x7f5a381320b0 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a20004a90 con 0x7f5a381320b0 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient: dump: 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.707 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1954027832 0 0) 0x7f5a3805e950 con 0x7f5a381320b0 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a380008e0 con 0x7f5a381320b0 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5a20002cc0 con 0x7f5a381320b0 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a381320b0 legacy=0x7f5a381a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.673+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a381320b0 legacy=0x7f5a381a1500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.677+0000 7f5a3d2ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.677+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5a38132480 con 0x7f5a381a1c10 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a367fc640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a381a1c10 legacy=0x7f5a381359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047369540 0 0) 0x7f5a38132480 con 0x7f5a381a1c10 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient(hunting): my global_id is 124296 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3805e950 con 0x7f5a381a1c10 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3665997166 0 0) 0x7f5a3805e950 con 0x7f5a381a1c10 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a38132480 con 0x7f5a381a1c10 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a200051b0 con 0x7f5a381a1c10 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient: dump: 2026-02-13T18:25:10.709 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1408873750 0 0) 0x7f5a38132480 con 0x7f5a381a1c10 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 --> v1:10.20.193.78:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5a380626c0 con 0x7f5a381a1c10 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 <== mon.0 v1:10.20.193.78:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4508 (unknown 0 0 3145463756) 0x7f5a200052e0 con 0x7f5a381a1c10 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:25:10.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a381a1c10 legacy=0x7f5a381359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a177fe640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.78:6789/0 conn(0x7f5a381a1c10 legacy=0x7f5a381359b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:25:10.711 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 68, 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 239219, 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 3, 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.712 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:25:10.713 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.714 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:25:10.715 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:25:10.716 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:25:10.717 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.718 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.719 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.720 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "num": 5 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:25:10.721 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.722 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.722 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.722 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:25:10.722 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.187:6812/2668687789 conn(0x7f5a0403d640 legacy=0x7f5a0405daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 10 monclient: shutdown 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 >> v1:10.20.193.187:6789/0 conn(0x7f5a3808d7b0 legacy=0x7f5a381319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a377fe640 1 -- 10.20.193.78:0/2035977727 reap_dead start 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a377fe640 1 -- 10.20.193.78:0/2035977727 reap_dead start 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 shutdown_connections 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 >> 10.20.193.78:0/2035977727 conn(0x7f5a3808ff50 msgr2=0x7f5a381a5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 shutdown_connections 2026-02-13T18:25:10.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.681+0000 7f5a3d2ef640 1 -- 10.20.193.78:0/2035977727 wait complete. 2026-02-13T18:25:10.724 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:25:10.724 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T18:25:10.724 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T18:25:10.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient: get_monmap_and_config 2026-02-13T18:25:10.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient: monmap: 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:10.780693+0000 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:10.780693+0000 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:10.794 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 1 Processor -- start 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 1 -- start start 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient: init 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient(hunting): picked mon.noname-a con 0x7f786808cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient(hunting): picked mon.noname-b con 0x7f786808d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient(hunting): picked mon.noname-c con 0x7f786808d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7868085ad0 con 0x7f786808cdc0 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7868085ee0 con 0x7f786808d5d0 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786808e000 con 0x7f786808d190 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786f98b640 10 monclient(hunting): authenticate will time out at 1741.835807s 2026-02-13T18:25:10.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786d700640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 0x7f786808c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59386/0 (socket says 10.20.193.78:59386) 2026-02-13T18:25:10.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.777+0000 7f786d700640 1 -- 10.20.193.78:0/347753739 learned_addr learned my addr 10.20.193.78:0/347753739 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786d700640 1 -- 10.20.193.78:0/347753739 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 legacy=0x7f786808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786ceff640 1 -- 10.20.193.78:0/347753739 >> v1:10.20.193.78:6790/0 conn(0x7f786808d190 legacy=0x7f7868183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786df01640 1 -- 10.20.193.78:0/347753739 >> v1:10.20.193.187:6789/0 conn(0x7f786808d5d0 legacy=0x7f78681a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985746704 0 0) 0x7f7868085ad0 con 0x7f786808cdc0 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient(hunting): my global_id is 124299 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7850003620 con 0x7f786808cdc0 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1480772483 0 0) 0x7f7850003620 con 0x7f786808cdc0 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 >> v1:10.20.193.78:6790/0 conn(0x7f786808d190 legacy=0x7f7868183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 >> v1:10.20.193.187:6789/0 conn(0x7f786808d5d0 legacy=0x7f78681a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 monclient: found mon.noname-a 2026-02-13T18:25:10.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7868086f80 con 0x7f786808cdc0 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7858003110 con 0x7f786808cdc0 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: dump: 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.801 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 5 monclient: authenticate success, global_id 124299 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78580033e0 con 0x7f786808cdc0 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 1 -- 10.20.193.78:0/347753739 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7858004b50 con 0x7f786808cdc0 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f7857fff640 10 monclient: dump: 2026-02-13T18:25:10.802 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 4 set_mon_vals no callback set 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 10 monclient: shutdown 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 -- 10.20.193.78:0/347753739 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 legacy=0x7f786808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 -- 10.20.193.78:0/347753739 shutdown_connections 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 -- 10.20.193.78:0/347753739 >> 10.20.193.78:0/347753739 conn(0x7f7868091720 msgr2=0x7f7868091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 -- 10.20.193.78:0/347753739 shutdown_connections 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 -- 10.20.193.78:0/347753739 wait complete. 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 10 monclient: monmap: 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.804 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 Processor -- start 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.781+0000 7f786f98b640 1 -- start start 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: init 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient(hunting): picked mon.noname-a con 0x7f786808cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient(hunting): picked mon.noname-b con 0x7f786808d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient(hunting): picked mon.noname-c con 0x7f786808d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786808b750 con 0x7f786808cdc0 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7868083190 con 0x7f786808d190 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7868081c70 con 0x7f786808d5d0 2026-02-13T18:25:10.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient(hunting): authenticate will time out at 1741.840303s 2026-02-13T18:25:10.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 0x7f7868152d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59402/0 (socket says 10.20.193.78:59402) 2026-02-13T18:25:10.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 -- 10.20.193.78:0/349924621 learned_addr learned my addr 10.20.193.78:0/349924621 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 legacy=0x7f7868152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786df01640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786808d5d0 legacy=0x7f78681950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 legacy=0x7f7868152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 legacy=0x7f7868152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 --1- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 0x7f7868152d50 :-1 s=OPENED pgs=550 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786d700640 1 --1- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 0x7f7868152d50 :-1 s=OPENED pgs=550 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.78:6789/0 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786ceff640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.187:6789/0 conn(0x7f786808d190 legacy=0x7f78680849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782791428 0 0) 0x7f7868081c70 con 0x7f786808d5d0 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): my global_id is 144110 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7838003620 con 0x7f786808d5d0 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134053458 0 0) 0x7f7868083190 con 0x7f786808d190 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): my global_id is 134230 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7868081c70 con 0x7f786808d190 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 845916015 0 0) 0x7f7838003620 con 0x7f786808d5d0 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7868083190 con 0x7f786808d5d0 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7864004860 con 0x7f786808d5d0 2026-02-13T18:25:10.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:10.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2286606555 0 0) 0x7f7868081c70 con 0x7f786808d190 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7838003620 con 0x7f786808d190 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f785c003380 con 0x7f786808d190 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.813 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3432593573 0 0) 0x7f7868083190 con 0x7f786808d5d0 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.187:6789/0 conn(0x7f786808d190 legacy=0x7f78680849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6789/0 conn(0x7f786808cdc0 legacy=0x7f7868152d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 monclient: found mon.c 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7868081110 con 0x7f786808d5d0 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 5 monclient: authenticate success, global_id 144110 2026-02-13T18:25:10.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: _renew_subs 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7868082bd0 con 0x7f786808d5d0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: _renew_subs 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7868085280 con 0x7f786808d5d0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7864004a40 con 0x7f786808d5d0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7864005080 con 0x7f786808d5d0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f7855ffb640 10 monclient: dump: 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.815 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f78577fe640 4 set_mon_vals no callback set 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.785+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f786808f620 con 0x7f786807b3e0 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f7864005260 con 0x7f786808d5d0 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f786404d870 con 0x7f786808d5d0 2026-02-13T18:25:10.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f786ceff640 10 monclient: get_auth_request con 0x7f783803d650 auth_method 0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f786d700640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786807b3e0 legacy=0x7f786807b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180973205 0 0) 0x7f7868086f80 con 0x7f786807b3e0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient(hunting): my global_id is 144113 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7868083190 con 0x7f786807b3e0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3231757515 0 0) 0x7f7868083190 con 0x7f786807b3e0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7868086f80 con 0x7f786807b3e0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f7858002d90 con 0x7f786807b3e0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient: dump: 2026-02-13T18:25:10.817 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2840902940 0 0) 0x7f7868086f80 con 0x7f786807b3e0 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7868088910 con 0x7f786807b3e0 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7858003030 con 0x7f786807b3e0 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:10.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786807b3e0 legacy=0x7f786807b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.789+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786807b3e0 legacy=0x7f786807b7b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.793+0000 7f786f98b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:25:10.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.793+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7868090810 con 0x7f786807bec0 2026-02-13T18:25:10.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786d700640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786807bec0 legacy=0x7f7868197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925347921 0 0) 0x7f7868090810 con 0x7f786807bec0 2026-02-13T18:25:10.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient(hunting): my global_id is 144116 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7868086f80 con 0x7f786807bec0 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 572705563 0 0) 0x7f7868086f80 con 0x7f786807bec0 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7868090810 con 0x7f786807bec0 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f78580051b0 con 0x7f786807bec0 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient: dump: 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.821 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3391556835 0 0) 0x7f7868090810 con 0x7f786807bec0 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 --> v1:10.20.193.78:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f78680510e0 con 0x7f786807bec0 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 <== mon.2 v1:10.20.193.78:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4341 (unknown 0 0 503514528) 0x7f78580073b0 con 0x7f786807bec0 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786807bec0 legacy=0x7f7868197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f7855ffb640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786807bec0 legacy=0x7f7868197810 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "state": "leader", 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 68, 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 3571, 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.823 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 3, 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.824 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.825 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:25:10.826 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.827 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.828 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.829 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.830 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:25:10.831 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: "num": 2 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:25:10.832 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:10.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.187:6812/2668687789 conn(0x7f783803d650 legacy=0x7f783805db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 10 monclient: shutdown 2026-02-13T18:25:10.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 >> v1:10.20.193.78:6790/0 conn(0x7f786808d5d0 legacy=0x7f78681950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786df01640 1 -- 10.20.193.78:0/349924621 reap_dead start 2026-02-13T18:25:10.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786df01640 1 -- 10.20.193.78:0/349924621 reap_dead start 2026-02-13T18:25:10.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 shutdown_connections 2026-02-13T18:25:10.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 >> 10.20.193.78:0/349924621 conn(0x7f7868091720 msgr2=0x7f7868089b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 shutdown_connections 2026-02-13T18:25:10.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.797+0000 7f786f98b640 1 -- 10.20.193.78:0/349924621 wait complete. 2026-02-13T18:25:10.834 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:25:10.834 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T18:25:10.834 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T18:25:10.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient: get_monmap_and_config 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient: monmap: 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:10.891947+0000 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:10.891947+0000 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:10.905 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 1 Processor -- start 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 1 -- start start 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient: init 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient(hunting): picked mon.noname-a con 0x7f273408cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient(hunting): picked mon.noname-c con 0x7f273408d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient(hunting): picked mon.noname-b con 0x7f273408d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2734085ad0 con 0x7f273408cdc0 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2734085ee0 con 0x7f273408d190 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f273408e000 con 0x7f273408d5d0 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2738e7d640 10 monclient(hunting): authenticate will time out at 1741.947070s 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2732575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f273408cdc0 0x7f273408c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59410/0 (socket says 10.20.193.78:59410) 2026-02-13T18:25:10.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.889+0000 7f2732575640 1 -- 10.20.193.78:0/2471901602 learned_addr learned my addr 10.20.193.78:0/2471901602 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2732d76640 1 -- 10.20.193.78:0/2471901602 >> v1:10.20.193.78:6790/0 conn(0x7f273408d5d0 legacy=0x7f27341a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2732575640 1 -- 10.20.193.78:0/2471901602 >> v1:10.20.193.78:6789/0 conn(0x7f273408cdc0 legacy=0x7f273408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731d74640 1 -- 10.20.193.78:0/2471901602 >> v1:10.20.193.187:6789/0 conn(0x7f273408d190 legacy=0x7f2734183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907935088 0 0) 0x7f2734085ad0 con 0x7f273408cdc0 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): my global_id is 124305 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2720003620 con 0x7f273408cdc0 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155118982 0 0) 0x7f273408e000 con 0x7f273408d5d0 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): my global_id is 144119 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2734085ad0 con 0x7f273408d5d0 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262427852 0 0) 0x7f271c002cb0 con 0x7f273408d190 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient(hunting): my global_id is 134233 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f273408e000 con 0x7f273408d190 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2855560118 0 0) 0x7f2720003620 con 0x7f273408cdc0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 >> v1:10.20.193.78:6790/0 conn(0x7f273408d5d0 legacy=0x7f27341a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 >> v1:10.20.193.187:6789/0 conn(0x7f273408d190 legacy=0x7f2734183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 monclient: found mon.noname-a 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2734086f80 con 0x7f273408cdc0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2728003110 con 0x7f273408cdc0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: dump: 2026-02-13T18:25:10.911 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 5 monclient: authenticate success, global_id 124305 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27280033e0 con 0x7f273408cdc0 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 1 -- 10.20.193.78:0/2471901602 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2728004b50 con 0x7f273408cdc0 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2731573640 10 monclient: dump: 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.912 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 4 set_mon_vals no callback set 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: shutdown 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- 10.20.193.78:0/2471901602 >> v1:10.20.193.78:6789/0 conn(0x7f273408cdc0 legacy=0x7f273408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- 10.20.193.78:0/2471901602 shutdown_connections 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- 10.20.193.78:0/2471901602 >> 10.20.193.78:0/2471901602 conn(0x7f2734091720 msgr2=0x7f2734091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- 10.20.193.78:0/2471901602 shutdown_connections 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- 10.20.193.78:0/2471901602 wait complete. 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: build_initial_monmap 2026-02-13T18:25:10.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: monmap: 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 Processor -- start 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- start start 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: init 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient(hunting): picked mon.noname-b con 0x7f273408cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient(hunting): picked mon.noname-c con 0x7f273408d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:10.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient(hunting): picked mon.noname-a con 0x7f273408d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2734082230 con 0x7f273408d5d0 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27340836f0 con 0x7f273408cdc0 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2734080e00 con 0x7f273408d190 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2738e7d640 10 monclient(hunting): authenticate will time out at 1741.951221s 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2732d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f273408d5d0 0x7f2734195af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59416/0 (socket says 10.20.193.78:59416) 2026-02-13T18:25:10.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.893+0000 7f2732d76640 1 -- 10.20.193.78:0/115864733 learned_addr learned my addr 10.20.193.78:0/115864733 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2732d76640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.78:6789/0 conn(0x7f273408d5d0 legacy=0x7f2734195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2731d74640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.78:6790/0 conn(0x7f273408d190 legacy=0x7f27341943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2732575640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f273408cdc0 legacy=0x7f2734084c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254844189 0 0) 0x7f2734082230 con 0x7f273408d5d0 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): my global_id is 124308 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2700003620 con 0x7f273408d5d0 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209873970 0 0) 0x7f2734080e00 con 0x7f273408d190 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): my global_id is 144122 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2734082230 con 0x7f273408d190 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699164420 0 0) 0x7f27340836f0 con 0x7f273408cdc0 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): my global_id is 134236 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2734080e00 con 0x7f273408cdc0 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2573955961 0 0) 0x7f2700003620 con 0x7f273408d5d0 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27340836f0 con 0x7f273408d5d0 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2724004930 con 0x7f273408d5d0 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): dump: 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.919 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4029145040 0 0) 0x7f2734082230 con 0x7f273408d190 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2700003620 con 0x7f273408d190 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f271c002cc0 con 0x7f273408d190 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient(hunting): dump: 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.920 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2504374427 0 0) 0x7f27340836f0 con 0x7f273408d5d0 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.78:6790/0 conn(0x7f273408d190 legacy=0x7f27341943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f273408cdc0 legacy=0x7f2734084c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 monclient: found mon.a 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273405de70 con 0x7f273408d5d0 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: _finish_auth 0 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:10.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 5 monclient: authenticate success, global_id 124308 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 10 monclient: _renew_subs 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2734088910 con 0x7f273408d5d0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 10 monclient: _renew_subs 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2734085330 con 0x7f273408d5d0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2724004ed0 con 0x7f273408d5d0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2724005260 con 0x7f273408d5d0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 10 monclient: dump: 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.922 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2730d72640 4 set_mon_vals no callback set 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2734153440 con 0x7f2734153070 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f27240054f0 con 0x7f273408d5d0 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f272404d950 con 0x7f273408d5d0 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.897+0000 7f2731d74640 10 monclient: get_auth_request con 0x7f270003d5c0 auth_method 0 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f2732575640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f2734153070 legacy=0x7f273407b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777412041 0 0) 0x7f2734153440 con 0x7f2734153070 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient(hunting): my global_id is 134239 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27340836f0 con 0x7f2734153070 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3986721884 0 0) 0x7f27340836f0 con 0x7f2734153070 2026-02-13T18:25:10.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2734153440 con 0x7f2734153070 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f2728003570 con 0x7f2734153070 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient: dump: 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1732519274 0 0) 0x7f2734153440 con 0x7f2734153070 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2734081350 con 0x7f2734153070 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2728004f10 con 0x7f2734153070 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:10.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:10.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f2734153070 legacy=0x7f273407b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.901+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f2734153070 legacy=0x7f273407b550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.905+0000 7f2738e7d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.905+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2734090810 con 0x7f273404d200 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2732575640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f273404d200 legacy=0x7f2734198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19996694 0 0) 0x7f2734090810 con 0x7f273404d200 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient(hunting): my global_id is 134242 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2734153440 con 0x7f273404d200 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3271459948 0 0) 0x7f2734153440 con 0x7f273404d200 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2734090810 con 0x7f273404d200 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f27280054a0 con 0x7f273404d200 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:10.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient: dump: 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3838831866 0 0) 0x7f2734090810 con 0x7f273404d200 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 --> v1:10.20.193.187:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27340510e0 con 0x7f273404d200 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 <== mon.1 v1:10.20.193.187:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 3640945097) 0x7f2728007890 con 0x7f273404d200 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f273404d200 legacy=0x7f2734198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f271affd640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6789/0 conn(0x7f273404d200 legacy=0x7f2734198220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "state": "peon", 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "election_epoch": 68, 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "uptime": 126201, 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "quorum": [ 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: 0, 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: 1, 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: 2 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_age": 3, 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:25:10.928 INFO:teuthology.orchestra.run.trial078.stdout: "required_con": "2453899407728394244", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "required_mon": [ 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_con": "4544132024016699391", 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "quorum_mon": [ 2026-02-13T18:25:10.929 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "outside_quorum": [], 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "extra_probe_peers": [], 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "sync_provider": [], 2026-02-13T18:25:10.930 INFO:teuthology.orchestra.run.trial078.stdout: "monmap": { 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "epoch": 1, 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "fsid": "54a6df06-e4af-4200-a7a8-eae08bdbf188", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "modified": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "created": "2026-02-13T18:05:06.319910Z", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release": 20, 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "min_mon_release_name": "tentacle", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "election_strategy": 3, 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "disallowed_leaders": "", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false, 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "tiebreaker_mon": "", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "removed_ranks": "", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "features": { 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "persistent": [ 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "kraken", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "luminous", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "mimic", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "osdmap-prune", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "nautilus", 2026-02-13T18:25:10.931 INFO:teuthology.orchestra.run.trial078.stdout: "octopus", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "pacific", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "elector-pinging", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "quincy", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "reef", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "squid", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "tentacle", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "nvmeof_beacon_diff" 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "optional": [] 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "mons": [ 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 0, 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "name": "a", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.932 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789", 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6789/0", 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6789/0", 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319957+0000", 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 1, 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "name": "b", 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.933 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789", 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.187:6789/0", 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.187:6789/0", 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "rank": 2, 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "name": "c", 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "public_addrs": { 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "addrvec": [ 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.934 INFO:teuthology.orchestra.run.trial078.stdout: "type": "v1", 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790", 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "nonce": 0 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "addr": "10.20.193.78:6790/0", 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "public_addr": "10.20.193.78:6790/0", 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "priority": 0, 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "weight": 0, 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "time_added": "2026-02-13T18:05:06:319962+0000", 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "crush_location": [] 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "feature_map": { 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "mon": [ 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.935 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "osd": [ 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "client": [ 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "num": 3 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: ], 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "mgr": [ 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T18:25:10.936 INFO:teuthology.orchestra.run.trial078.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout: "release": "squid", 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout: "num": 1 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout: }, 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout: "stretch_mode": false 2026-02-13T18:25:10.937 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.187:6812/2668687789 conn(0x7f270003d5c0 legacy=0x7f270005da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 10 monclient: shutdown 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 >> v1:10.20.193.78:6789/0 conn(0x7f273408d5d0 legacy=0x7f2734195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2732d76640 1 -- 10.20.193.78:0/115864733 reap_dead start 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2732d76640 1 -- 10.20.193.78:0/115864733 reap_dead start 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 shutdown_connections 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 >> 10.20.193.78:0/115864733 conn(0x7f2734091720 msgr2=0x7f273408add0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 shutdown_connections 2026-02-13T18:25:10.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.909+0000 7f2738e7d640 1 -- 10.20.193.78:0/115864733 wait complete. 2026-02-13T18:25:10.939 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T18:25:10.939 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T18:25:10.939 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient: get_monmap_and_config 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient: build_initial_monmap 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient: monmap: 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:10.995107+0000 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:10.995107+0000 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:11.008 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:11.009 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:11.009 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:11.009 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 1 Processor -- start 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 1 -- start start 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient: init 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient(hunting): picked mon.noname-c con 0x7f05d408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient(hunting): picked mon.noname-b con 0x7f05d408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient(hunting): picked mon.noname-a con 0x7f05d408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4089e80 con 0x7f05d408cdd0 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4088c20 con 0x7f05d408c2f0 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4089ba0 con 0x7f05d408dc80 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d9a15640 10 monclient(hunting): authenticate will time out at 1742.050240s 2026-02-13T18:25:11.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d27fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f05d408dc80 0x7f05d4181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33346/0 (socket says 10.20.193.78:33346) 2026-02-13T18:25:11.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d27fc640 1 -- 10.20.193.78:0/1314516849 learned_addr learned my addr 10.20.193.78:0/1314516849 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:11.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.993+0000 7f05d37fe640 1 --1- 10.20.193.78:0/1314516849 >> v1:10.20.193.78:6789/0 conn(0x7f05d408cdd0 0x7f05d41a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59422/0 (socket says 10.20.193.78:59422) 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d27fc640 1 -- 10.20.193.78:0/1314516849 >> v1:10.20.193.78:6790/0 conn(0x7f05d408dc80 legacy=0x7f05d4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d37fe640 1 -- 10.20.193.78:0/1314516849 >> v1:10.20.193.78:6789/0 conn(0x7f05d408cdd0 legacy=0x7f05d41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720718491 0 0) 0x7f05d4089e80 con 0x7f05d408cdd0 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): my global_id is 124311 2026-02-13T18:25:11.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c0003620 con 0x7f05d408cdd0 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802924876 0 0) 0x7f05d4089ba0 con 0x7f05d408dc80 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient(hunting): my global_id is 144125 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d4089e80 con 0x7f05d408dc80 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d2ffd640 1 -- 10.20.193.78:0/1314516849 >> v1:10.20.193.187:6789/0 conn(0x7f05d408c2f0 legacy=0x7f05d408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3865364552 0 0) 0x7f05c0003620 con 0x7f05d408cdd0 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 >> v1:10.20.193.78:6790/0 conn(0x7f05d408dc80 legacy=0x7f05d4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 >> v1:10.20.193.187:6789/0 conn(0x7f05d408c2f0 legacy=0x7f05d408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 monclient: found mon.noname-a 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d408d370 con 0x7f05d408cdd0 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:11.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f05c4004550 con 0x7f05d408cdd0 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: dump: 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 5 monclient: authenticate success, global_id 124311 2026-02-13T18:25:11.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05c4004820 con 0x7f05d408cdd0 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 1 -- 10.20.193.78:0/1314516849 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f05c4005df0 con 0x7f05d408cdd0 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d1ffb640 10 monclient: dump: 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:11.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 4 set_mon_vals no callback set 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: shutdown 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- 10.20.193.78:0/1314516849 >> v1:10.20.193.78:6789/0 conn(0x7f05d408cdd0 legacy=0x7f05d41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- 10.20.193.78:0/1314516849 shutdown_connections 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- 10.20.193.78:0/1314516849 >> 10.20.193.78:0/1314516849 conn(0x7f05d4091720 msgr2=0x7f05d4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- 10.20.193.78:0/1314516849 shutdown_connections 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- 10.20.193.78:0/1314516849 wait complete. 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: build_initial_monmap 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: monmap: 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:11.017 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 Processor -- start 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- start start 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: init 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient(hunting): picked mon.noname-b con 0x7f05d408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient(hunting): picked mon.noname-a con 0x7f05d408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient(hunting): picked mon.noname-c con 0x7f05d408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4082370 con 0x7f05d408cdd0 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4085b60 con 0x7f05d408c2f0 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05d4153f60 con 0x7f05d408dc80 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d9a15640 10 monclient(hunting): authenticate will time out at 1742.054363s 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d27fc640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f05d408cdd0 0x7f05d41943d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59436/0 (socket says 10.20.193.78:59436) 2026-02-13T18:25:11.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:10.997+0000 7f05d27fc640 1 -- 10.20.193.78:0/2538263480 learned_addr learned my addr 10.20.193.78:0/2538263480 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d27fc640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.78:6789/0 conn(0x7f05d408cdd0 legacy=0x7f05d41943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d37fe640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.78:6790/0 conn(0x7f05d408dc80 legacy=0x7f05d4195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226625210 0 0) 0x7f05d4082370 con 0x7f05d408cdd0 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): my global_id is 124314 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a4003620 con 0x7f05d408cdd0 2026-02-13T18:25:11.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d2ffd640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.187:6789/0 conn(0x7f05d408c2f0 legacy=0x7f05d40838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939882925 0 0) 0x7f05d4153f60 con 0x7f05d408dc80 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): my global_id is 144128 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d4082370 con 0x7f05d408dc80 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 98114566 0 0) 0x7f05a4003620 con 0x7f05d408cdd0 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05d4153f60 con 0x7f05d408cdd0 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f05bc003360 con 0x7f05d408cdd0 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): dump: 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.022 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 720988702 0 0) 0x7f05d4153f60 con 0x7f05d408cdd0 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.78:6790/0 conn(0x7f05d408dc80 legacy=0x7f05d4195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.187:6789/0 conn(0x7f05d408c2f0 legacy=0x7f05d40838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 monclient: found mon.a 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4080010 con 0x7f05d408cdd0 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:11.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 5 monclient: authenticate success, global_id 124314 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 monclient: _renew_subs 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05d4080b70 con 0x7f05d408cdd0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 monclient: _renew_subs 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05d4084180 con 0x7f05d408cdd0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05bc004b90 con 0x7f05d408cdd0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f05bc004ef0 con 0x7f05d408cdd0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d17fa640 4 set_mon_vals no callback set 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: dump: 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.024 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d408f5e0 con 0x7f05d408cdd0 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f05bc0051c0 con 0x7f05d408cdd0 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f05bc04c650 con 0x7f05d408cdd0 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05d2ffd640 10 monclient: get_auth_request con 0x7f05a403d540 auth_method 0 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f05bc017770 con 0x7f05d408cdd0 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:11.025 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.001+0000 7f05abfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:11.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.121+0000 7f05d9a15640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T18:25:11.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.121+0000 7f05d9a15640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T18:25:11.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.121+0000 7f05d9a15640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:11.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.121+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f05d4090810 con 0x7f05d408cdd0 2026-02-13T18:25:11.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05abfff640 1 -- 10.20.193.78:0/2538263480 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f05bc017050 con 0x7f05d408cdd0 2026-02-13T18:25:11.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05abfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T18:25:11.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05abfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:11.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.187:6812/2668687789 conn(0x7f05a403d540 legacy=0x7f05a405d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 10 monclient: shutdown 2026-02-13T18:25:11.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:11.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 >> v1:10.20.193.78:6789/0 conn(0x7f05d408cdd0 legacy=0x7f05d41943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:11.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 shutdown_connections 2026-02-13T18:25:11.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 >> 10.20.193.78:0/2538263480 conn(0x7f05d4091720 msgr2=0x7f05d405b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:11.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 shutdown_connections 2026-02-13T18:25:11.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:11.125+0000 7f05d9a15640 1 -- 10.20.193.78:0/2538263480 wait complete. 2026-02-13T18:25:11.148 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T18:25:11.461 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.445+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.461 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.445+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=13,kv=11,logm=50} crc {auth=2636273782,config=1618278320,health=1731762008,kv=4087868365,logm=3912615597}) 2026-02-13T18:25:11.462 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.445+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=12,kv=10,logm=54} crc {auth=2986499430,config=1618278320,health=3597419013,kv=2475567950,logm=1356827885}) 2026-02-13T18:25:11.462 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.445+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.462 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.445+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=13,kv=11,logm=50} crc {auth=2636273782,config=1618278320,health=1731762008,kv=4087868365,logm=3912615597}) 2026-02-13T18:25:11.462 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.445+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=22,config=2,health=13,kv=11,logm=52} crc {auth=736973098,config=1618278320,health=1731762008,kv=4087868365,logm=3889884267}) 2026-02-13T18:25:11.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.469+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.469+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2635488674}) 2026-02-13T18:25:11.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.469+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688796997}) 2026-02-13T18:25:11.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.469+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.469+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2635488674}) 2026-02-13T18:25:11.485 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.469+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3632704666}) 2026-02-13T18:25:11.543 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.529+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.543 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.529+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2843844891}) 2026-02-13T18:25:11.543 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.529+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2908097778}) 2026-02-13T18:25:11.544 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.529+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.544 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.529+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2843844891}) 2026-02-13T18:25:11.544 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.529+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=219068965}) 2026-02-13T18:25:11.547 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.533+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.547 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.533+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1489876588}) 2026-02-13T18:25:11.547 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.533+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2853655870}) 2026-02-13T18:25:11.547 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.533+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.547 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.533+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1489876588}) 2026-02-13T18:25:11.547 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.533+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2313841361}) 2026-02-13T18:25:11.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.573+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.573+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=839862095}) 2026-02-13T18:25:11.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.573+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1548848598}) 2026-02-13T18:25:11.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.573+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.573+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=839862095}) 2026-02-13T18:25:11.590 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.573+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1831571739}) 2026-02-13T18:25:11.767 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.767 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4184169578}) 2026-02-13T18:25:11.767 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773261720}) 2026-02-13T18:25:11.767 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.767 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4184169578}) 2026-02-13T18:25:11.768 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2331849534}) 2026-02-13T18:25:11.769 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.769 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1395351519}) 2026-02-13T18:25:11.769 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827828339}) 2026-02-13T18:25:11.769 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.769 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1395351519}) 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1457253440}) 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1124903929}) 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1712582345}) 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1124903929}) 2026-02-13T18:25:11.770 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3180721561}) 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2517874093}) 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2413685953}) 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2517874093}) 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.753+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=931014796}) 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.772 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4226763902}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=150989174}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4226763902}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2495695724}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=36894249}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1860944942}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=36894249}) 2026-02-13T18:25:11.773 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2451791476}) 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=224163604}) 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3568308903}) 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=224163604}) 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1596545772}) 2026-02-13T18:25:11.776 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2227350863}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=668474771}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2227350863}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1793561384}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3166738925}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3360057458}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3166738925}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.757+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3693960927}) 2026-02-13T18:25:11.777 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=623599577}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2128228647}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=623599577}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3588233007}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2274942922}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1436476845}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2274942922}) 2026-02-13T18:25:11.778 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1659929055}) 2026-02-13T18:25:11.782 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.782 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3164974092}) 2026-02-13T18:25:11.782 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1125796242}) 2026-02-13T18:25:11.782 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.782 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3164974092}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1893583273}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3489316940}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1934360140}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3489316940}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=900770183}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2202289684}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3700949272}) 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.783 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2202289684}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.761+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1803528818}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2862767749}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071218783}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2862767749}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=201830694}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2337698862}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419577149}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2337698862}) 2026-02-13T18:25:11.784 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2625860002}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1364673143}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254012593}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1364673143}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1011892187}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2341602031}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1499182829}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2341602031}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2273563676}) 2026-02-13T18:25:11.785 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.786 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2533271742}) 2026-02-13T18:25:11.786 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807665135}) 2026-02-13T18:25:11.786 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.786 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2533271742}) 2026-02-13T18:25:11.786 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.765+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3131816628}) 2026-02-13T18:25:11.788 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.788 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1043005153}) 2026-02-13T18:25:11.788 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=738731769}) 2026-02-13T18:25:11.788 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.788 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1043005153}) 2026-02-13T18:25:11.788 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3063643066}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2308581858}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=671198780}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2308581858}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1013820686}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2331380625}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003615354}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2331380625}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=965928470}) 2026-02-13T18:25:11.789 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.790 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2156294888}) 2026-02-13T18:25:11.790 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049218895}) 2026-02-13T18:25:11.790 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.790 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2156294888}) 2026-02-13T18:25:11.790 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.769+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=316885583}) 2026-02-13T18:25:11.797 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.797 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4244312289}) 2026-02-13T18:25:11.797 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466214898}) 2026-02-13T18:25:11.797 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.797 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4244312289}) 2026-02-13T18:25:11.797 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3601204798}) 2026-02-13T18:25:11.799 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.799 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2218677294}) 2026-02-13T18:25:11.799 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310015614}) 2026-02-13T18:25:11.799 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2218677294}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.781+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1550146011}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1410125435}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2053521403}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1410125435}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=805871043}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2571920851}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1435990861}) 2026-02-13T18:25:11.800 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.801 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2571920851}) 2026-02-13T18:25:11.801 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2201653025}) 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2686878387}) 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143961428}) 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2686878387}) 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3986617295}) 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.804 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1529474017}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3878468359}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1529474017}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1408868384}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1251894005}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1620677905}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1251894005}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2637966573}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2262281827}) 2026-02-13T18:25:11.805 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.785+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=815260922}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2262281827}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=298312234}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3178439891}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203261187}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3178439891}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1578649667}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=871438268}) 2026-02-13T18:25:11.806 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2247690221}) 2026-02-13T18:25:11.807 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.807 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=871438268}) 2026-02-13T18:25:11.807 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3488717759}) 2026-02-13T18:25:11.811 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=310868745}) 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500970480}) 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=310868745}) 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1402384689}) 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1425097199}) 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2314941312}) 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.812 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1425097199}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4252031795}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3312428254}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716892404}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3312428254}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.789+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2933308571}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4191169832}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2809410860}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4191169832}) 2026-02-13T18:25:11.813 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1199914449}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2175449223}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1655734567}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2175449223}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=80176243}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1232719705}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3176549723}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1232719705}) 2026-02-13T18:25:11.814 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=155837561}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=52,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6} crc {logm=4094180411,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=490578779,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=2,nvmeofgw=3,osd_metadata=6,osd_snap=5} crc {logm=3867662210,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=1126076800,mon_config_key=2284528010,monmap=3140514009,nvmeofgw=3360707892,osd_metadata=1252444728,osd_snap=1179533545}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=52,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6} crc {logm=4094180411,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=490578779,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.793+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=51,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3920185774,mdsmap=685858242,mgr=903296875,mgr_command_descs=2141687499,mgr_metadata=3546443502,mgrstat=1552301505,mon_config_key=2615342343,monmap=1180532494,nvmeofgw=3360707892,osd_metadata=1252444728,osd_pg_creating=2580398430}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_pg_creating=1,osd_snap=99} crc {osd_pg_creating=2580398430,osd_snap=4047716867}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=99} crc {osd_pg_creating=2580398430,osd_snap=1022898640}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_pg_creating=1,osd_snap=99} crc {osd_pg_creating=2580398430,osd_snap=4047716867}) 2026-02-13T18:25:11.815 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_pg_creating=1,osd_snap=99} crc {osd_pg_creating=2580398430,osd_snap=2731995599}) 2026-02-13T18:25:11.816 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.816 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=72,osdmap=28} crc {osd_snap=2022884688,osdmap=2890016233}) 2026-02-13T18:25:11.816 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=70,osdmap=30} crc {osd_snap=3624484092,osdmap=2909485360}) 2026-02-13T18:25:11.816 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.816 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=72,osdmap=28} crc {osd_snap=2022884688,osdmap=2890016233}) 2026-02-13T18:25:11.816 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=73,osdmap=27} crc {osd_snap=3837035631,osdmap=962753646}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=813202012}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2121224028}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=813202012}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=262785872}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=421546487}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3981972736}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=421546487}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=976533016}) 2026-02-13T18:25:11.819 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1618269512}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3065445886}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1618269512}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.797+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1774693990}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=620098762}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2212843343}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=620098762}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2068686488}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=9} crc {osdmap=2036562636}) 2026-02-13T18:25:11.820 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=8} crc {osdmap=644408895}) 2026-02-13T18:25:11.821 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T18:25:11.821 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=9} crc {osdmap=2036562636}) 2026-02-13T18:25:11.821 INFO:tasks.ceph.mon.c.trial078.stderr:2026-02-13T18:25:11.801+0000 7ff883106640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=8} crc {osdmap=1229155505}) 2026-02-13T18:25:12.149 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T18:25:12.150 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T18:25:12.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient: get_monmap_and_config 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient: monmap: 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:12.204727+0000 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:12.204727+0000 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.218 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:12.219 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:12.219 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 1 Processor -- start 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 1 -- start start 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient: init 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient(hunting): picked mon.noname-a con 0x7fc5c408c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient(hunting): picked mon.noname-b con 0x7fc5c408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient(hunting): picked mon.noname-c con 0x7fc5c408cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c4089e80 con 0x7fc5c408c2f0 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c4088c20 con 0x7fc5c408cdd0 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c4089ba0 con 0x7fc5c408dc80 2026-02-13T18:25:12.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c9f22640 10 monclient(hunting): authenticate will time out at 1743.259879s 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c37fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc5c408c2f0 0x7fc5c408c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59448/0 (socket says 10.20.193.78:59448) 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.201+0000 7fc5c37fe640 1 -- 10.20.193.78:0/3963664374 learned_addr learned my addr 10.20.193.78:0/3963664374 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c2ffd640 1 -- 10.20.193.78:0/3963664374 >> v1:10.20.193.78:6790/0 conn(0x7fc5c408dc80 legacy=0x7fc5c4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c37fe640 1 -- 10.20.193.78:0/3963664374 >> v1:10.20.193.78:6789/0 conn(0x7fc5c408c2f0 legacy=0x7fc5c408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c3fff640 1 -- 10.20.193.78:0/3963664374 >> v1:10.20.193.187:6789/0 conn(0x7fc5c408cdd0 legacy=0x7fc5c41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411113176 0 0) 0x7fc5c4089ba0 con 0x7fc5c408dc80 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): my global_id is 144131 2026-02-13T18:25:12.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a8003620 con 0x7fc5c408dc80 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063074559 0 0) 0x7fc5c4089e80 con 0x7fc5c408c2f0 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): my global_id is 124317 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5c4089ba0 con 0x7fc5c408c2f0 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579634484 0 0) 0x7fc5c4088c20 con 0x7fc5c408cdd0 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient(hunting): my global_id is 134251 2026-02-13T18:25:12.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5c4089e80 con 0x7fc5c408cdd0 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 260404244 0 0) 0x7fc5a8003620 con 0x7fc5c408dc80 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 >> v1:10.20.193.187:6789/0 conn(0x7fc5c408cdd0 legacy=0x7fc5c41a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 >> v1:10.20.193.78:6789/0 conn(0x7fc5c408c2f0 legacy=0x7fc5c408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 monclient: found mon.noname-b 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c408d370 con 0x7fc5c408dc80 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc5b4003160 con 0x7fc5c408dc80 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: dump: 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.228 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 5 monclient: authenticate success, global_id 144131 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5b4003430 con 0x7fc5c408dc80 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 1 -- 10.20.193.78:0/3963664374 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc5b40038c0 con 0x7fc5c408dc80 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c27fc640 10 monclient: dump: 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.229 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 4 set_mon_vals no callback set 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 10 monclient: shutdown 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.230 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 -- 10.20.193.78:0/3963664374 >> v1:10.20.193.78:6790/0 conn(0x7fc5c408dc80 legacy=0x7fc5c4181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 -- 10.20.193.78:0/3963664374 shutdown_connections 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 -- 10.20.193.78:0/3963664374 >> 10.20.193.78:0/3963664374 conn(0x7fc5c4091720 msgr2=0x7fc5c4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 -- 10.20.193.78:0/3963664374 shutdown_connections 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 -- 10.20.193.78:0/3963664374 wait complete. 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 10 monclient: monmap: 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:12.231 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 Processor -- start 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 1 -- start start 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.205+0000 7fc5c9f22640 10 monclient: init 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient(hunting): picked mon.noname-c con 0x7fc5c408c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient(hunting): picked mon.noname-a con 0x7fc5c408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient(hunting): picked mon.noname-b con 0x7fc5c408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c407f5e0 con 0x7fc5c408cdd0 2026-02-13T18:25:12.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c4085c90 con 0x7fc5c408dc80 2026-02-13T18:25:12.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c4088910 con 0x7fc5c408c2f0 2026-02-13T18:25:12.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient(hunting): authenticate will time out at 1743.264088s 2026-02-13T18:25:12.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c2ffd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fc5c408cdd0 0x7fc5c407eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59458/0 (socket says 10.20.193.78:59458) 2026-02-13T18:25:12.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c2ffd640 1 -- 10.20.193.78:0/1885563740 learned_addr learned my addr 10.20.193.78:0/1885563740 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c2ffd640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.78:6789/0 conn(0x7fc5c408cdd0 legacy=0x7fc5c407eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c37fe640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.78:6790/0 conn(0x7fc5c408c2f0 legacy=0x7fc5c407e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305270642 0 0) 0x7fc5c407f5e0 con 0x7fc5c408cdd0 2026-02-13T18:25:12.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): my global_id is 124320 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc594003620 con 0x7fc5c408cdd0 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107790687 0 0) 0x7fc5c4088910 con 0x7fc5c408c2f0 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): my global_id is 144134 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5c407f5e0 con 0x7fc5c408c2f0 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3055601240 0 0) 0x7fc594003620 con 0x7fc5c408cdd0 2026-02-13T18:25:12.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5c4088910 con 0x7fc5c408cdd0 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c3fff640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.187:6789/0 conn(0x7fc5c408dc80 legacy=0x7fc5c41954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc5b4003710 con 0x7fc5c408cdd0 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): dump: 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.238 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2382419544 0 0) 0x7fc5c407f5e0 con 0x7fc5c408c2f0 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc594003620 con 0x7fc5c408c2f0 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc5b0002e50 con 0x7fc5c408c2f0 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient(hunting): dump: 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.239 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3623613950 0 0) 0x7fc5c4088910 con 0x7fc5c408cdd0 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.78:6790/0 conn(0x7fc5c408c2f0 legacy=0x7fc5c407e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.187:6789/0 conn(0x7fc5c408dc80 legacy=0x7fc5c41954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 monclient: found mon.a 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c40801e0 con 0x7fc5c408cdd0 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 5 monclient: authenticate success, global_id 124320 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _renew_subs 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c4082260 con 0x7fc5c408cdd0 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _renew_subs 2026-02-13T18:25:12.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5c405de60 con 0x7fc5c408cdd0 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5b4003410 con 0x7fc5c408cdd0 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fc5b4004090 con 0x7fc5c408cdd0 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 10 monclient: dump: 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.242 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c1ffb640 4 set_mon_vals no callback set 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fc5b4004360 con 0x7fc5c408cdd0 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c408f620 con 0x7fc5c408cdd0 2026-02-13T18:25:12.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fc5b404c5a0 con 0x7fc5c408cdd0 2026-02-13T18:25:12.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.209+0000 7fc5c37fe640 10 monclient: get_auth_request con 0x7fc59403d650 auth_method 0 2026-02-13T18:25:12.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.213+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fc5c408f620 con 0x7fc5c408cdd0 2026-02-13T18:25:12.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.213+0000 7fc59ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.213+0000 7fc59ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T18:25:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T18:25:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc5c4090810 con 0x7fc5c408cdd0 2026-02-13T18:25:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc59ffff640 1 -- 10.20.193.78:0/1885563740 <== mon.0 v1:10.20.193.78:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1616717577) 0x7fc5b40176c0 con 0x7fc5c408cdd0 2026-02-13T18:25:12.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc59ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T18:25:12.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc59ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:12.349 INFO:teuthology.orchestra.run.trial078.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","modified":"2026-02-13T18:05:06.319910Z","created":"2026-02-13T18:05:06.319910Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319957+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6790","nonce":0}]},"addr":"10.20.193.78:6790/0","public_addr":"10.20.193.78:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T18:05:06:319962+0000","crush_location":[]}]}} 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.187:6812/2668687789 conn(0x7fc59403d650 legacy=0x7fc59405db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 10 monclient: shutdown 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 >> v1:10.20.193.78:6789/0 conn(0x7fc5c408cdd0 legacy=0x7fc5c407eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 shutdown_connections 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 >> 10.20.193.78:0/1885563740 conn(0x7fc5c4091720 msgr2=0x7fc5c405b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 shutdown_connections 2026-02-13T18:25:12.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.333+0000 7fc5c9f22640 1 -- 10.20.193.78:0/1885563740 wait complete. 2026-02-13T18:25:12.359 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T18:25:12.359 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-13T18:25:12.376 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-13T18:25:12.376 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:25:12.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient: get_monmap_and_config 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient: monmap: 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:12.431761+0000 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:12.431761+0000 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.445 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.446 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:12.446 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:12.446 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 1 Processor -- start 2026-02-13T18:25:12.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 1 -- start start 2026-02-13T18:25:12.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient: init 2026-02-13T18:25:12.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:12.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient(hunting): picked mon.noname-b con 0x7f9de808cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient(hunting): picked mon.noname-c con 0x7f9de808d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient(hunting): picked mon.noname-a con 0x7f9de808d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de8085ad0 con 0x7f9de808d5d0 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de8085ee0 con 0x7f9de808d190 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de808e000 con 0x7f9de808cdc0 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9decaa9640 10 monclient(hunting): authenticate will time out at 1743.486896s 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9de6575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9de808cdc0 0x7f9de808c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33400/0 (socket says 10.20.193.78:33400) 2026-02-13T18:25:12.448 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.429+0000 7f9de6575640 1 -- 10.20.193.78:0/1008870489 learned_addr learned my addr 10.20.193.78:0/1008870489 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de6575640 1 -- 10.20.193.78:0/1008870489 >> v1:10.20.193.78:6790/0 conn(0x7f9de808cdc0 legacy=0x7f9de808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de6d76640 1 -- 10.20.193.78:0/1008870489 >> v1:10.20.193.78:6789/0 conn(0x7f9de808d5d0 legacy=0x7f9de81a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033668527 0 0) 0x7f9de808e000 con 0x7f9de808cdc0 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): my global_id is 144137 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5d74640 1 -- 10.20.193.78:0/1008870489 >> v1:10.20.193.187:6789/0 conn(0x7f9de808d190 legacy=0x7f9de8183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd4003620 con 0x7f9de808cdc0 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645877415 0 0) 0x7f9de8085ad0 con 0x7f9de808d5d0 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient(hunting): my global_id is 124323 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de808e000 con 0x7f9de808d5d0 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1790649918 0 0) 0x7f9dd4003620 con 0x7f9de808cdc0 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 >> v1:10.20.193.187:6789/0 conn(0x7f9de808d190 legacy=0x7f9de8183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 >> v1:10.20.193.78:6789/0 conn(0x7f9de808d5d0 legacy=0x7f9de81a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 monclient: found mon.noname-b 2026-02-13T18:25:12.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de8086f80 con 0x7f9de808cdc0 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ddc003190 con 0x7f9de808cdc0 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: dump: 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.457 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 5 monclient: authenticate success, global_id 144137 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ddc003420 con 0x7f9de808cdc0 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 1 -- 10.20.193.78:0/1008870489 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ddc004b50 con 0x7f9de808cdc0 2026-02-13T18:25:12.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de5573640 10 monclient: dump: 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.459 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 4 set_mon_vals no callback set 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: shutdown 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- 10.20.193.78:0/1008870489 >> v1:10.20.193.78:6790/0 conn(0x7f9de808cdc0 legacy=0x7f9de808c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- 10.20.193.78:0/1008870489 shutdown_connections 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- 10.20.193.78:0/1008870489 >> 10.20.193.78:0/1008870489 conn(0x7f9de8091720 msgr2=0x7f9de8091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- 10.20.193.78:0/1008870489 shutdown_connections 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- 10.20.193.78:0/1008870489 wait complete. 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: monmap: 2026-02-13T18:25:12.460 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 Processor -- start 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- start start 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: init 2026-02-13T18:25:12.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient(hunting): picked mon.noname-a con 0x7f9de808cdc0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient(hunting): picked mon.noname-b con 0x7f9de808d190 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient(hunting): picked mon.noname-c con 0x7f9de808d5d0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de8083470 con 0x7f9de808cdc0 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de8083190 con 0x7f9de808d190 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de80822e0 con 0x7f9de808d5d0 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9decaa9640 10 monclient(hunting): authenticate will time out at 1743.491405s 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de6575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f9de808cdc0 0x7f9de80849a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59472/0 (socket says 10.20.193.78:59472) 2026-02-13T18:25:12.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de6d76640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f9de808d5d0 0x7f9de8195860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33404/0 (socket says 10.20.193.78:33404) 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.433+0000 7f9de6575640 1 -- 10.20.193.78:0/3445999300 learned_addr learned my addr 10.20.193.78:0/3445999300 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9de6d76640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.78:6790/0 conn(0x7f9de808d5d0 legacy=0x7f9de8195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9de6575640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.78:6789/0 conn(0x7f9de808cdc0 legacy=0x7f9de80849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905748108 0 0) 0x7f9de80822e0 con 0x7f9de808d5d0 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): my global_id is 144140 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db4003620 con 0x7f9de808d5d0 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349172760 0 0) 0x7f9de8083470 con 0x7f9de808cdc0 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): my global_id is 124326 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de80822e0 con 0x7f9de808cdc0 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 562961637 0 0) 0x7f9db4003620 con 0x7f9de808d5d0 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9de8083470 con 0x7f9de808d5d0 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9dd8004900 con 0x7f9de808d5d0 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): dump: 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.464 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1045806140 0 0) 0x7f9de80822e0 con 0x7f9de808cdc0 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9db4003620 con 0x7f9de808cdc0 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9ddc004a90 con 0x7f9de808cdc0 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient(hunting): dump: 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2810520373 0 0) 0x7f9de8083470 con 0x7f9de808d5d0 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9de5d74640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.187:6789/0 conn(0x7f9de808d190 legacy=0x7f9de8194140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.187:6789/0 conn(0x7f9de808d190 legacy=0x7f9de8194140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.78:6789/0 conn(0x7f9de808cdc0 legacy=0x7f9de80849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 monclient: found mon.c 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de8081110 con 0x7f9de808d5d0 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 5 monclient: authenticate success, global_id 144140 2026-02-13T18:25:12.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 monclient: _renew_subs 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9de8082bd0 con 0x7f9de808d5d0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 monclient: _renew_subs 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9de8153040 con 0x7f9de808d5d0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9dd8004ed0 con 0x7f9de808d5d0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f9dd80052a0 con 0x7f9de808d5d0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 10 monclient: dump: 2026-02-13T18:25:12.468 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9de4d72640 4 set_mon_vals no callback set 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de808f620 con 0x7f9de808d5d0 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f9dd8005570 con 0x7f9de808d5d0 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f9dd804d950 con 0x7f9de808d5d0 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.437+0000 7f9de6575640 10 monclient: get_auth_request con 0x7f9db403d650 auth_method 0 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.441+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f9de808f620 con 0x7f9de808d5d0 2026-02-13T18:25:12.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.441+0000 7f9dceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.441+0000 7f9dceffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:12.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9de8082e10 con 0x7f9db403d650 2026-02-13T18:25:12.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9dceffd640 1 -- 10.20.193.78:0/3445999300 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34071 (unknown 2965378022 0 1170435915) 0x7f9de8082e10 con 0x7f9db403d650 2026-02-13T18:25:12.542 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:25:12.543 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.187:6812/2668687789 conn(0x7f9db403d650 legacy=0x7f9db405db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 10 monclient: shutdown 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 >> v1:10.20.193.78:6790/0 conn(0x7f9de808d5d0 legacy=0x7f9de8195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 shutdown_connections 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 >> 10.20.193.78:0/3445999300 conn(0x7f9de8091720 msgr2=0x7f9de8089b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 shutdown_connections 2026-02-13T18:25:12.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.525+0000 7f9decaa9640 1 -- 10.20.193.78:0/3445999300 wait complete. 2026-02-13T18:25:12.551 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":1500,"stamp":"2026-02-13T18:25:11.868181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":266248,"kb_used_data":14248,"kb_used_omap":10614,"kb_used_meta":241289,"kb_avail":565964792,"statfs":{"total":579820584960,"available":579547947008,"internally_reserved":0,"allocated":14589952,"data_stored":9007960,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":10869217,"internal_metadata":247080479},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001024"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1929,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311997+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:24:07.311997+0000","last_peered":"2026-02-13T18:24:07.311997+0000","last_clean":"2026-02-13T18:24:07.311997+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:24:07.311997+0000","last_undegraded":"2026-02-13T18:24:07.311997+0000","last_fullsized":"2026-02-13T18:24:07.311997+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1797,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025579+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:24:08.025579+0000","last_peered":"2026-02-13T18:24:08.025579+0000","last_clean":"2026-02-13T18:24:08.025579+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:24:08.025579+0000","last_undegraded":"2026-02-13T18:24:08.025579+0000","last_fullsized":"2026-02-13T18:24:08.025579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311554+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:24:07.311554+0000","last_peered":"2026-02-13T18:24:07.311554+0000","last_clean":"2026-02-13T18:24:07.311554+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:24:07.311554+0000","last_undegraded":"2026-02-13T18:24:07.311554+0000","last_fullsized":"2026-02-13T18:24:07.311554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1790,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.029611+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:24:08.029611+0000","last_peered":"2026-02-13T18:24:08.029611+0000","last_clean":"2026-02-13T18:24:08.029611+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:24:08.029611+0000","last_undegraded":"2026-02-13T18:24:08.029611+0000","last_fullsized":"2026-02-13T18:24:08.029611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1798,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025826+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:24:08.025826+0000","last_peered":"2026-02-13T18:24:08.025826+0000","last_clean":"2026-02-13T18:24:08.025826+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:24:08.025826+0000","last_undegraded":"2026-02-13T18:24:08.025826+0000","last_fullsized":"2026-02-13T18:24:08.025826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483577+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:24:06.483577+0000","last_peered":"2026-02-13T18:24:06.483577+0000","last_clean":"2026-02-13T18:24:06.483577+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:24:06.483577+0000","last_undegraded":"2026-02-13T18:24:06.483577+0000","last_fullsized":"2026-02-13T18:24:06.483577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311517+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:24:07.311517+0000","last_peered":"2026-02-13T18:24:07.311517+0000","last_clean":"2026-02-13T18:24:07.311517+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:24:07.311517+0000","last_undegraded":"2026-02-13T18:24:07.311517+0000","last_fullsized":"2026-02-13T18:24:07.311517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483536+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:24:06.483536+0000","last_peered":"2026-02-13T18:24:06.483536+0000","last_clean":"2026-02-13T18:24:06.483536+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:24:06.483536+0000","last_undegraded":"2026-02-13T18:24:06.483536+0000","last_fullsized":"2026-02-13T18:24:06.483536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311428+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:24:07.311428+0000","last_peered":"2026-02-13T18:24:07.311428+0000","last_clean":"2026-02-13T18:24:07.311428+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:24:07.311428+0000","last_undegraded":"2026-02-13T18:24:07.311428+0000","last_fullsized":"2026-02-13T18:24:07.311428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1770,"kb_used_meta":43221,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1813168,"internal_metadata":44258640},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":1825,"kb_used_meta":43166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1869742,"internal_metadata":44202066},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640495,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":1233,"kb_used_meta":25710,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1262921,"internal_metadata":26327735},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":2004,"kb_used_meta":42987,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2052945,"internal_metadata":44018863},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640497,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1893,"kb_used_meta":43098,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1939244,"internal_metadata":44132564},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":2408,"kb_used_omap":1885,"kb_used_meta":43106,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1931197,"internal_metadata":44140611},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:25:12.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:25:12.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient: get_monmap_and_config 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient: monmap: 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:12.608363+0000 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:12.608363+0000 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.623 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 1 Processor -- start 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 1 -- start start 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient: init 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient(hunting): picked mon.noname-c con 0x7faf8013f820 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient(hunting): picked mon.noname-a con 0x7faf80088e40 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient(hunting): picked mon.noname-b con 0x7faf8013f3a0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf80089750 con 0x7faf80088e40 2026-02-13T18:25:12.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf80089a30 con 0x7faf8013f820 2026-02-13T18:25:12.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8005db10 con 0x7faf8013f3a0 2026-02-13T18:25:12.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf869f0640 10 monclient(hunting): authenticate will time out at 1743.663559s 2026-02-13T18:25:12.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf84f66640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7faf8013f3a0 0x7faf801a5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33418/0 (socket says 10.20.193.78:33418) 2026-02-13T18:25:12.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.605+0000 7faf84f66640 1 -- 10.20.193.78:0/699006715 learned_addr learned my addr 10.20.193.78:0/699006715 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf84f66640 1 -- 10.20.193.78:0/699006715 >> v1:10.20.193.78:6790/0 conn(0x7faf8013f3a0 legacy=0x7faf801a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7f7fe640 1 -- 10.20.193.78:0/699006715 >> v1:10.20.193.78:6789/0 conn(0x7faf80088e40 legacy=0x7faf80183c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672184963 0 0) 0x7faf8005db10 con 0x7faf8013f3a0 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): my global_id is 144143 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf64003620 con 0x7faf8013f3a0 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344876489 0 0) 0x7faf80089750 con 0x7faf80088e40 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient(hunting): my global_id is 124329 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8005db10 con 0x7faf80088e40 2026-02-13T18:25:12.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7ffff640 1 -- 10.20.193.78:0/699006715 >> v1:10.20.193.187:6789/0 conn(0x7faf8013f820 legacy=0x7faf8013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3851263228 0 0) 0x7faf64003620 con 0x7faf8013f3a0 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 >> v1:10.20.193.187:6789/0 conn(0x7faf8013f820 legacy=0x7faf8013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 >> v1:10.20.193.78:6789/0 conn(0x7faf80088e40 legacy=0x7faf80183c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 monclient: found mon.noname-b 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf801a9ae0 con 0x7faf8013f3a0 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 5 monclient: authenticate success, global_id 144143 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf74004620 con 0x7faf8013f3a0 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: dump: 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.632 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf740048f0 con 0x7faf8013f3a0 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 1 -- 10.20.193.78:0/699006715 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf74006060 con 0x7faf8013f3a0 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf7effd640 10 monclient: dump: 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.633 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 4 set_mon_vals no callback set 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: shutdown 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 -- 10.20.193.78:0/699006715 >> v1:10.20.193.78:6790/0 conn(0x7faf8013f3a0 legacy=0x7faf801a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 -- 10.20.193.78:0/699006715 shutdown_connections 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 -- 10.20.193.78:0/699006715 >> 10.20.193.78:0/699006715 conn(0x7faf80054e70 msgr2=0x7faf80093b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 -- 10.20.193.78:0/699006715 shutdown_connections 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 -- 10.20.193.78:0/699006715 wait complete. 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: monmap: 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:12.635 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 Processor -- start 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 1 -- start start 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: init 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.609+0000 7faf869f0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 10 monclient(hunting): picked mon.noname-a con 0x7faf8013f3a0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 10 monclient(hunting): picked mon.noname-c con 0x7faf8013f820 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 10 monclient(hunting): picked mon.noname-b con 0x7faf8010b9f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf801212b0 con 0x7faf8013f3a0 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8005e3d0 con 0x7faf8010b9f0 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8012fb40 con 0x7faf8013f820 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7ffff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7faf8013f3a0 0x7faf8012ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59488/0 (socket says 10.20.193.78:59488) 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7ffff640 1 -- 10.20.193.78:0/3372483124 learned_addr learned my addr 10.20.193.78:0/3372483124 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf869f0640 10 monclient(hunting): authenticate will time out at 1743.668092s 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7f7fe640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.78:6790/0 conn(0x7faf8013f820 legacy=0x7faf8012f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7ffff640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.78:6789/0 conn(0x7faf8013f3a0 legacy=0x7faf8012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935590016 0 0) 0x7faf8012fb40 con 0x7faf8013f820 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): my global_id is 144146 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf50003620 con 0x7faf8013f820 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591590455 0 0) 0x7faf80089a30 con 0x7faf8013f3a0 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 10 monclient(hunting): my global_id is 124332 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8012fb40 con 0x7faf8013f3a0 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf84f66640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.187:6789/0 conn(0x7faf8010b9f0 legacy=0x7faf801a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.613+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 DispatchQueue::entry inject delay of 0.002000 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 886400907 0 0) 0x7faf8012fb40 con 0x7faf8013f3a0 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf80089a30 con 0x7faf8013f3a0 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2835524207 0 0) 0x7faf50003620 con 0x7faf8013f820 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf8012fb40 con 0x7faf8013f820 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795959406 0 0) 0x7faf8005e3d0 con 0x7faf8010b9f0 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): my global_id is 134266 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf50003620 con 0x7faf8010b9f0 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf6c003420 con 0x7faf8013f3a0 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): dump: 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.643 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf70003350 con 0x7faf8013f820 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient(hunting): dump: 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.644 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2541967207 0 0) 0x7faf80089a30 con 0x7faf8013f3a0 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.78:6790/0 conn(0x7faf8013f820 legacy=0x7faf8012f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.187:6789/0 conn(0x7faf8010b9f0 legacy=0x7faf801a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 monclient: found mon.a 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8008f520 con 0x7faf8013f3a0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 5 monclient: authenticate success, global_id 124332 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 monclient: _renew_subs 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf8010d1f0 con 0x7faf8013f3a0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 monclient: _renew_subs 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faf8012c5e0 con 0x7faf8013f3a0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf6c0039c0 con 0x7faf8013f3a0 2026-02-13T18:25:12.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7faf6c003d50 con 0x7faf8013f3a0 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 10 monclient: dump: 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.647 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7e7fc640 4 set_mon_vals no callback set 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf40005130 con 0x7faf8013f3a0 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7faf6c003fe0 con 0x7faf8013f3a0 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7faf6c04c560 con 0x7faf8013f3a0 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.617+0000 7faf7f7fe640 10 monclient: get_auth_request con 0x7faf5003d800 auth_method 0 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.621+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7faf801212b0 con 0x7faf8013f3a0 2026-02-13T18:25:12.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.621+0000 7faf7cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.621+0000 7faf7cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:12.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf40002bf0 con 0x7faf5003d800 2026-02-13T18:25:12.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf7cff9640 1 -- 10.20.193.78:0/3372483124 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34071 (unknown 2965378022 0 1170435915) 0x7faf40002bf0 con 0x7faf5003d800 2026-02-13T18:25:12.720 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:25:12.721 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:25:12.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.187:6812/2668687789 conn(0x7faf5003d800 legacy=0x7faf5005dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 10 monclient: shutdown 2026-02-13T18:25:12.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 >> v1:10.20.193.78:6789/0 conn(0x7faf8013f3a0 legacy=0x7faf8012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 shutdown_connections 2026-02-13T18:25:12.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 >> 10.20.193.78:0/3372483124 conn(0x7faf80054e70 msgr2=0x7faf801a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 shutdown_connections 2026-02-13T18:25:12.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.705+0000 7faf869f0640 1 -- 10.20.193.78:0/3372483124 wait complete. 2026-02-13T18:25:12.729 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":1500,"stamp":"2026-02-13T18:25:11.868181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":266248,"kb_used_data":14248,"kb_used_omap":10614,"kb_used_meta":241289,"kb_avail":565964792,"statfs":{"total":579820584960,"available":579547947008,"internally_reserved":0,"allocated":14589952,"data_stored":9007960,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":10869217,"internal_metadata":247080479},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001024"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1929,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311997+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:24:07.311997+0000","last_peered":"2026-02-13T18:24:07.311997+0000","last_clean":"2026-02-13T18:24:07.311997+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:24:07.311997+0000","last_undegraded":"2026-02-13T18:24:07.311997+0000","last_fullsized":"2026-02-13T18:24:07.311997+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1797,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025579+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:24:08.025579+0000","last_peered":"2026-02-13T18:24:08.025579+0000","last_clean":"2026-02-13T18:24:08.025579+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:24:08.025579+0000","last_undegraded":"2026-02-13T18:24:08.025579+0000","last_fullsized":"2026-02-13T18:24:08.025579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311554+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:24:07.311554+0000","last_peered":"2026-02-13T18:24:07.311554+0000","last_clean":"2026-02-13T18:24:07.311554+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:24:07.311554+0000","last_undegraded":"2026-02-13T18:24:07.311554+0000","last_fullsized":"2026-02-13T18:24:07.311554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1790,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.029611+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:24:08.029611+0000","last_peered":"2026-02-13T18:24:08.029611+0000","last_clean":"2026-02-13T18:24:08.029611+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:24:08.029611+0000","last_undegraded":"2026-02-13T18:24:08.029611+0000","last_fullsized":"2026-02-13T18:24:08.029611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1798,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025826+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:24:08.025826+0000","last_peered":"2026-02-13T18:24:08.025826+0000","last_clean":"2026-02-13T18:24:08.025826+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:24:08.025826+0000","last_undegraded":"2026-02-13T18:24:08.025826+0000","last_fullsized":"2026-02-13T18:24:08.025826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483577+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:24:06.483577+0000","last_peered":"2026-02-13T18:24:06.483577+0000","last_clean":"2026-02-13T18:24:06.483577+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:24:06.483577+0000","last_undegraded":"2026-02-13T18:24:06.483577+0000","last_fullsized":"2026-02-13T18:24:06.483577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311517+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:24:07.311517+0000","last_peered":"2026-02-13T18:24:07.311517+0000","last_clean":"2026-02-13T18:24:07.311517+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:24:07.311517+0000","last_undegraded":"2026-02-13T18:24:07.311517+0000","last_fullsized":"2026-02-13T18:24:07.311517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483536+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:24:06.483536+0000","last_peered":"2026-02-13T18:24:06.483536+0000","last_clean":"2026-02-13T18:24:06.483536+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:24:06.483536+0000","last_undegraded":"2026-02-13T18:24:06.483536+0000","last_fullsized":"2026-02-13T18:24:06.483536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311428+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:24:07.311428+0000","last_peered":"2026-02-13T18:24:07.311428+0000","last_clean":"2026-02-13T18:24:07.311428+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:24:07.311428+0000","last_undegraded":"2026-02-13T18:24:07.311428+0000","last_fullsized":"2026-02-13T18:24:07.311428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1770,"kb_used_meta":43221,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1813168,"internal_metadata":44258640},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":1825,"kb_used_meta":43166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1869742,"internal_metadata":44202066},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640495,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":1233,"kb_used_meta":25710,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1262921,"internal_metadata":26327735},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":2004,"kb_used_meta":42987,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2052945,"internal_metadata":44018863},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640497,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1893,"kb_used_meta":43098,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1939244,"internal_metadata":44132564},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":2408,"kb_used_omap":1885,"kb_used_meta":43106,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1931197,"internal_metadata":44140611},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:25:12.731 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-13T18:25:12.731 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient: get_monmap_and_config 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient: monmap: 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:12.788161+0000 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:12.788161+0000 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 1 Processor -- start 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 1 -- start start 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient: init 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:25:12.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient(hunting): picked mon.noname-b con 0x7fd0dc08e400 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient(hunting): picked mon.noname-a con 0x7fd0dc08eee0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient(hunting): picked mon.noname-c con 0x7fd0dc057870 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc056e90 con 0x7fd0dc08eee0 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc0565f0 con 0x7fd0dc057870 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc0568d0 con 0x7fd0dc08e400 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e3612640 10 monclient(hunting): authenticate will time out at 1743.843533s 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e0b86640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd0dc08eee0 0x7fd0dc183fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59504/0 (socket says 10.20.193.78:59504) 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e0b86640 1 -- 10.20.193.78:0/2400375886 learned_addr learned my addr 10.20.193.78:0/2400375886 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.785+0000 7fd0e1387640 1 --1- 10.20.193.78:0/2400375886 >> v1:10.20.193.78:6790/0 conn(0x7fd0dc08e400 0x7fd0dc08e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33448/0 (socket says 10.20.193.78:33448) 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e0b86640 1 -- 10.20.193.78:0/2400375886 >> v1:10.20.193.78:6789/0 conn(0x7fd0dc08eee0 legacy=0x7fd0dc183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e1387640 1 -- 10.20.193.78:0/2400375886 >> v1:10.20.193.78:6790/0 conn(0x7fd0dc08e400 legacy=0x7fd0dc08e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855719380 0 0) 0x7fd0dc056e90 con 0x7fd0dc08eee0 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): my global_id is 124335 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c4003620 con 0x7fd0dc08eee0 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459503535 0 0) 0x7fd0dc0568d0 con 0x7fd0dc08e400 2026-02-13T18:25:12.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient(hunting): my global_id is 144149 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0dc056e90 con 0x7fd0dc08e400 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e1b88640 1 -- 10.20.193.78:0/2400375886 >> v1:10.20.193.187:6789/0 conn(0x7fd0dc057870 legacy=0x7fd0dc1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 134601944 0 0) 0x7fd0dc056e90 con 0x7fd0dc08e400 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 >> v1:10.20.193.187:6789/0 conn(0x7fd0dc057870 legacy=0x7fd0dc1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 >> v1:10.20.193.78:6789/0 conn(0x7fd0dc08eee0 legacy=0x7fd0dc183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 monclient: found mon.noname-b 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc08f530 con 0x7fd0dc08e400 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0cc003190 con 0x7fd0dc08e400 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 5 monclient: authenticate success, global_id 144149 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: dump: 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0cc003420 con 0x7fd0dc08e400 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 4 set_mon_vals no callback set 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 1 -- 10.20.193.78:0/2400375886 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0cc004a90 con 0x7fd0dc08e400 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0cbfff640 10 monclient: dump: 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.805 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 10 monclient: shutdown 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 -- 10.20.193.78:0/2400375886 >> v1:10.20.193.78:6790/0 conn(0x7fd0dc08e400 legacy=0x7fd0dc08e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 -- 10.20.193.78:0/2400375886 shutdown_connections 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 -- 10.20.193.78:0/2400375886 >> 10.20.193.78:0/2400375886 conn(0x7fd0dc054e30 msgr2=0x7fd0dc093a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 -- 10.20.193.78:0/2400375886 shutdown_connections 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 -- 10.20.193.78:0/2400375886 wait complete. 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 10 monclient: monmap: 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.806 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 Processor -- start 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 1 -- start start 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.789+0000 7fd0e3612640 10 monclient: init 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient(hunting): picked mon.noname-c con 0x7fd0dc057870 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient(hunting): picked mon.noname-b con 0x7fd0dc08e400 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient(hunting): picked mon.noname-a con 0x7fd0dc08eee0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc140020 con 0x7fd0dc08eee0 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc141540 con 0x7fd0dc08e400 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc143b80 con 0x7fd0dc057870 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient(hunting): authenticate will time out at 1743.848132s 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e1387640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd0dc057870 0x7fd0dc1532f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33460/0 (socket says 10.20.193.78:33460) 2026-02-13T18:25:12.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e1387640 1 -- 10.20.193.78:0/898850342 learned_addr learned my addr 10.20.193.78:0/898850342 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e1387640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.78:6790/0 conn(0x7fd0dc057870 legacy=0x7fd0dc1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e1b88640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.78:6789/0 conn(0x7fd0dc08eee0 legacy=0x7fd0dc195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847900231 0 0) 0x7fd0dc143b80 con 0x7fd0dc057870 2026-02-13T18:25:12.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): my global_id is 144152 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ac003620 con 0x7fd0dc057870 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e0b86640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.187:6789/0 conn(0x7fd0dc08e400 legacy=0x7fd0dc194500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222614232 0 0) 0x7fd0dc140020 con 0x7fd0dc08eee0 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): my global_id is 124338 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0dc143b80 con 0x7fd0dc08eee0 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826728577 0 0) 0x7fd0dc141540 con 0x7fd0dc08e400 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): my global_id is 134272 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0dc140020 con 0x7fd0dc08e400 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2737287969 0 0) 0x7fd0ac003620 con 0x7fd0dc057870 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0dc141540 con 0x7fd0dc057870 2026-02-13T18:25:12.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0cc003190 con 0x7fd0dc057870 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4075087593 0 0) 0x7fd0dc143b80 con 0x7fd0dc08eee0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0ac003620 con 0x7fd0dc08eee0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0d8004890 con 0x7fd0dc08eee0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1048503489 0 0) 0x7fd0dc141540 con 0x7fd0dc057870 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.187:6789/0 conn(0x7fd0dc08e400 legacy=0x7fd0dc194500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.78:6789/0 conn(0x7fd0dc08eee0 legacy=0x7fd0dc195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 monclient: found mon.c 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc089ff0 con 0x7fd0dc057870 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 5 monclient: authenticate success, global_id 144152 2026-02-13T18:25:12.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _renew_subs 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc140f80 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _renew_subs 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0dc13ea10 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0cc003370 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0cc0051e0 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 10 monclient: dump: 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0cb7fe640 4 set_mon_vals no callback set 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd0cc0053c0 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc0008e0 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fd0cc04c600 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.793+0000 7fd0e0b86640 10 monclient: get_auth_request con 0x7fd0ac03d800 auth_method 0 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.797+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fd0cc017780 con 0x7fd0dc057870 2026-02-13T18:25:12.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.797+0000 7fd0c9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.797+0000 7fd0c9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:12.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0dc05e1b0 con 0x7fd0ac03d800 2026-02-13T18:25:12.898 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0c9ffb640 1 -- 10.20.193.78:0/898850342 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34071 (unknown 2965378022 0 1170435915) 0x7fd0dc05e1b0 con 0x7fd0ac03d800 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd0ac03d800 legacy=0x7fd0ac05dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 10 monclient: shutdown 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 >> v1:10.20.193.78:6790/0 conn(0x7fd0dc057870 legacy=0x7fd0dc1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 shutdown_connections 2026-02-13T18:25:12.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 >> 10.20.193.78:0/898850342 conn(0x7fd0dc054e30 msgr2=0x7fd0dc089800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 shutdown_connections 2026-02-13T18:25:12.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.885+0000 7fd0e3612640 1 -- 10.20.193.78:0/898850342 wait complete. 2026-02-13T18:25:12.908 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":1500,"stamp":"2026-02-13T18:25:11.868181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":266248,"kb_used_data":14248,"kb_used_omap":10614,"kb_used_meta":241289,"kb_avail":565964792,"statfs":{"total":579820584960,"available":579547947008,"internally_reserved":0,"allocated":14589952,"data_stored":9007960,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":10869217,"internal_metadata":247080479},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001024"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1929,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311997+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:24:07.311997+0000","last_peered":"2026-02-13T18:24:07.311997+0000","last_clean":"2026-02-13T18:24:07.311997+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:24:07.311997+0000","last_undegraded":"2026-02-13T18:24:07.311997+0000","last_fullsized":"2026-02-13T18:24:07.311997+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1797,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025579+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:24:08.025579+0000","last_peered":"2026-02-13T18:24:08.025579+0000","last_clean":"2026-02-13T18:24:08.025579+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:24:08.025579+0000","last_undegraded":"2026-02-13T18:24:08.025579+0000","last_fullsized":"2026-02-13T18:24:08.025579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311554+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:24:07.311554+0000","last_peered":"2026-02-13T18:24:07.311554+0000","last_clean":"2026-02-13T18:24:07.311554+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:24:07.311554+0000","last_undegraded":"2026-02-13T18:24:07.311554+0000","last_fullsized":"2026-02-13T18:24:07.311554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1790,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.029611+0000","last_change":"2026-02-13T18:05:33.228633+0000","last_active":"2026-02-13T18:24:08.029611+0000","last_peered":"2026-02-13T18:24:08.029611+0000","last_clean":"2026-02-13T18:24:08.029611+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:24:08.029611+0000","last_undegraded":"2026-02-13T18:24:08.029611+0000","last_fullsized":"2026-02-13T18:24:08.029611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:36:34.565239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1798,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025826+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:24:08.025826+0000","last_peered":"2026-02-13T18:24:08.025826+0000","last_clean":"2026-02-13T18:24:08.025826+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:24:08.025826+0000","last_undegraded":"2026-02-13T18:24:08.025826+0000","last_fullsized":"2026-02-13T18:24:08.025826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483577+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:24:06.483577+0000","last_peered":"2026-02-13T18:24:06.483577+0000","last_clean":"2026-02-13T18:24:06.483577+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:24:06.483577+0000","last_undegraded":"2026-02-13T18:24:06.483577+0000","last_fullsized":"2026-02-13T18:24:06.483577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311517+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:24:07.311517+0000","last_peered":"2026-02-13T18:24:07.311517+0000","last_clean":"2026-02-13T18:24:07.311517+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:24:07.311517+0000","last_undegraded":"2026-02-13T18:24:07.311517+0000","last_fullsized":"2026-02-13T18:24:07.311517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483536+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:24:06.483536+0000","last_peered":"2026-02-13T18:24:06.483536+0000","last_clean":"2026-02-13T18:24:06.483536+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:24:06.483536+0000","last_undegraded":"2026-02-13T18:24:06.483536+0000","last_fullsized":"2026-02-13T18:24:06.483536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311428+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:24:07.311428+0000","last_peered":"2026-02-13T18:24:07.311428+0000","last_clean":"2026-02-13T18:24:07.311428+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:24:07.311428+0000","last_undegraded":"2026-02-13T18:24:07.311428+0000","last_fullsized":"2026-02-13T18:24:07.311428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1770,"kb_used_meta":43221,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1813168,"internal_metadata":44258640},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":1825,"kb_used_meta":43166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1869742,"internal_metadata":44202066},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640495,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":1233,"kb_used_meta":25710,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1262921,"internal_metadata":26327735},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":2004,"kb_used_meta":42987,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2052945,"internal_metadata":44018863},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640497,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1893,"kb_used_meta":43098,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1939244,"internal_metadata":44132564},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":2408,"kb_used_omap":1885,"kb_used_meta":43106,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1931197,"internal_metadata":44140611},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:25:12.909 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient: get_monmap_and_config 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient: monmap: 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:12.967212+0000 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:12.967212+0000 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 1 Processor -- start 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 1 -- start start 2026-02-13T18:25:12.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient: init 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient(hunting): picked mon.noname-a con 0x7f5a2c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient(hunting): picked mon.noname-b con 0x7f5a2c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient(hunting): picked mon.noname-c con 0x7f5a2c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c089e80 con 0x7f5a2c08c2f0 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c088c20 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c089ba0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a320c6640 10 monclient(hunting): authenticate will time out at 1744.022445s 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a2affd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f5a2c08dc80 0x7f5a2c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33466/0 (socket says 10.20.193.78:33466) 2026-02-13T18:25:12.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.965+0000 7f5a2affd640 1 -- 10.20.193.78:0/502128540 learned_addr learned my addr 10.20.193.78:0/502128540 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2affd640 1 -- 10.20.193.78:0/502128540 >> v1:10.20.193.78:6790/0 conn(0x7f5a2c08dc80 legacy=0x7f5a2c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2b7fe640 1 -- 10.20.193.78:0/502128540 >> v1:10.20.193.78:6789/0 conn(0x7f5a2c08c2f0 legacy=0x7f5a2c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727827304 0 0) 0x7f5a2c089ba0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): my global_id is 144155 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a10003620 con 0x7f5a2c08dc80 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463053131 0 0) 0x7f5a2c089e80 con 0x7f5a2c08c2f0 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient(hunting): my global_id is 124341 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a2c089ba0 con 0x7f5a2c08c2f0 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2bfff640 1 -- 10.20.193.78:0/502128540 >> v1:10.20.193.187:6789/0 conn(0x7f5a2c08cdd0 legacy=0x7f5a2c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4002434414 0 0) 0x7f5a10003620 con 0x7f5a2c08dc80 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 >> v1:10.20.193.187:6789/0 conn(0x7f5a2c08cdd0 legacy=0x7f5a2c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 >> v1:10.20.193.78:6789/0 conn(0x7f5a2c08c2f0 legacy=0x7f5a2c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 monclient: found mon.noname-b 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2c08d370 con 0x7f5a2c08dc80 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 5 monclient: authenticate success, global_id 144155 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a1c003110 con 0x7f5a2c08dc80 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: dump: 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a1c0033e0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 1 -- 10.20.193.78:0/502128540 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a1c004b50 con 0x7f5a2c08dc80 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2a7fc640 10 monclient: dump: 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 4 set_mon_vals no callback set 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: shutdown 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- 10.20.193.78:0/502128540 >> v1:10.20.193.78:6790/0 conn(0x7f5a2c08dc80 legacy=0x7f5a2c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- 10.20.193.78:0/502128540 shutdown_connections 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- 10.20.193.78:0/502128540 >> 10.20.193.78:0/502128540 conn(0x7f5a2c091720 msgr2=0x7f5a2c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- 10.20.193.78:0/502128540 shutdown_connections 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- 10.20.193.78:0/502128540 wait complete. 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: build_initial_monmap 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: monmap: 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 Processor -- start 2026-02-13T18:25:12.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- start start 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: init 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient(hunting): picked mon.noname-b con 0x7f5a2c08c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient(hunting): picked mon.noname-a con 0x7f5a2c08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient(hunting): picked mon.noname-c con 0x7f5a2c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c07e050 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c05dc00 con 0x7f5a2c08c2f0 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c0800d0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a320c6640 10 monclient(hunting): authenticate will time out at 1744.026954s 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2affd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f5a2c08cdd0 0x7f5a2c083900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59530/0 (socket says 10.20.193.78:59530) 2026-02-13T18:25:12.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.969+0000 7f5a2affd640 1 -- 10.20.193.78:0/875304963 learned_addr learned my addr 10.20.193.78:0/875304963 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:12.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a2affd640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.78:6789/0 conn(0x7f5a2c08cdd0 legacy=0x7f5a2c083900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a2bfff640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.78:6790/0 conn(0x7f5a2c08dc80 legacy=0x7f5a2c1933c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958870326 0 0) 0x7f5a2c0800d0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): my global_id is 144158 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59fc003620 con 0x7f5a2c08dc80 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597156421 0 0) 0x7f5a2c07e050 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): my global_id is 124344 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a2c0800d0 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a2b7fe640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.187:6789/0 conn(0x7f5a2c08c2f0 legacy=0x7f5a2c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3839912585 0 0) 0x7f59fc003620 con 0x7f5a2c08dc80 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a2c07e050 con 0x7f5a2c08dc80 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a20004890 con 0x7f5a2c08dc80 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): dump: 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3226977531 0 0) 0x7f5a2c0800d0 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59fc003620 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a1c002b70 con 0x7f5a2c08cdd0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): dump: 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26761238 0 0) 0x7f5a2c089ba0 con 0x7f5a2c08c2f0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient(hunting): my global_id is 134278 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a2c0800d0 con 0x7f5a2c08c2f0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1688374525 0 0) 0x7f5a2c07e050 con 0x7f5a2c08dc80 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.187:6789/0 conn(0x7f5a2c08c2f0 legacy=0x7f5a2c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.78:6789/0 conn(0x7f5a2c08cdd0 legacy=0x7f5a2c083900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 monclient: found mon.c 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2c0803b0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: _finish_auth 0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 5 monclient: authenticate success, global_id 144158 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 monclient: _renew_subs 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a2c088910 con 0x7f5a2c08dc80 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 monclient: _renew_subs 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a2c084010 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a20004ed0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f5a20005260 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 10 monclient: dump: 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a29ffb640 4 set_mon_vals no callback set 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2c08f600 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f5a20005440 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f5a2004d930 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.973+0000 7f5a2b7fe640 10 monclient: get_auth_request con 0x7f59fc03d880 auth_method 0 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.977+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f5a20018ab0 con 0x7f5a2c08dc80 2026-02-13T18:25:12.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.977+0000 7f5a07fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:12.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:12.977+0000 7f5a07fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:13.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:25:13.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:25:13.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:13.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a2c090810 con 0x7f5a2c08dc80 2026-02-13T18:25:13.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a07fff640 1 -- 10.20.193.78:0/875304963 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v913) ==== 74+0+10972 (unknown 3245231555 0 474231920) 0x7f5a20018390 con 0x7f5a2c08dc80 2026-02-13T18:25:13.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a07fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T18:25:13.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a07fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:13.076 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:25:13.076 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":913,"fsid":"54a6df06-e4af-4200-a7a8-eae08bdbf188","created":"2026-02-13T18:05:19.488219+0000","modified":"2026-02-13T18:24:06.471571+0000","last_up_change":"2026-02-13T18:05:25.449453+0000","last_in_change":"2026-02-13T18:05:20.703785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T18:05:25.773956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T18:05:28.499550+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0458b6dd-2248-4622-ad34-c5b862d03fbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":425425936}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":425425936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":425425936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":425425936}]},"public_addr":"10.20.193.78:6804/425425936","cluster_addr":"10.20.193.78:6805/425425936","heartbeat_back_addr":"10.20.193.78:6807/425425936","heartbeat_front_addr":"10.20.193.78:6806/425425936","state":["exists","up"]},{"osd":1,"uuid":"bb192088-5eba-48c0-82aa-550bd21e170d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":444681404}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":444681404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":444681404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":444681404}]},"public_addr":"10.20.193.78:6800/444681404","cluster_addr":"10.20.193.78:6801/444681404","heartbeat_back_addr":"10.20.193.78:6803/444681404","heartbeat_front_addr":"10.20.193.78:6802/444681404","state":["exists","up"]},{"osd":2,"uuid":"b90c999b-baf5-460a-acff-1e45f3214fc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":2589033462}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":2589033462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":2589033462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":2589033462}]},"public_addr":"10.20.193.78:6808/2589033462","cluster_addr":"10.20.193.78:6809/2589033462","heartbeat_back_addr":"10.20.193.78:6811/2589033462","heartbeat_front_addr":"10.20.193.78:6810/2589033462","state":["exists","up"]},{"osd":3,"uuid":"2fea0170-ac6c-43b4-ba22-661f1f1723b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6800","nonce":1622449099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6801","nonce":1622449099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6803","nonce":1622449099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6802","nonce":1622449099}]},"public_addr":"10.20.193.187:6800/1622449099","cluster_addr":"10.20.193.187:6801/1622449099","heartbeat_back_addr":"10.20.193.187:6803/1622449099","heartbeat_front_addr":"10.20.193.187:6802/1622449099","state":["exists","up"]},{"osd":4,"uuid":"b22c98c9-3704-459a-8d11-f1090966127b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6807","nonce":218078640}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6809","nonce":218078640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6811","nonce":218078640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6810","nonce":218078640}]},"public_addr":"10.20.193.187:6807/218078640","cluster_addr":"10.20.193.187:6809/218078640","heartbeat_back_addr":"10.20.193.187:6811/218078640","heartbeat_front_addr":"10.20.193.187:6810/218078640","state":["exists","up"]},{"osd":5,"uuid":"f6df89ae-d7d7-4616-9af9-d386764d842f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6804","nonce":1501659775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6805","nonce":1501659775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6808","nonce":1501659775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.187:6806","nonce":1501659775}]},"public_addr":"10.20.193.187:6804/1501659775","cluster_addr":"10.20.193.187:6805/1501659775","heartbeat_back_addr":"10.20.193.187:6808/1501659775","heartbeat_front_addr":"10.20.193.187:6806/1501659775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:22.793056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:22.766917+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:22.768140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:23.042253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:23.105972+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T18:05:23.109668+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":432,"length":1},{"begin":452,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.187:6812/2668687789 conn(0x7f59fc03d880 legacy=0x7f59fc05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 10 monclient: shutdown 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 >> v1:10.20.193.78:6790/0 conn(0x7f5a2c08dc80 legacy=0x7f5a2c1933c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 shutdown_connections 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 >> 10.20.193.78:0/875304963 conn(0x7f5a2c091720 msgr2=0x7f5a2c08a380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 shutdown_connections 2026-02-13T18:25:13.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:13.061+0000 7f5a320c6640 1 -- 10.20.193.78:0/875304963 wait complete. 2026-02-13T18:25:14.086 INFO:tasks.ceph:Scrubbing osd.0 2026-02-13T18:25:14.087 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: monmap: 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.145598+0000 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.145598+0000 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.158 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 1 Processor -- start 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 1 -- start start 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: init 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient(hunting): picked mon.noname-a con 0x7f454008ca90 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient(hunting): picked mon.noname-c con 0x7f454008d570 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient(hunting): picked mon.noname-b con 0x7f45401834e0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454008b040 con 0x7f454008ca90 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4540086710 con 0x7f454008d570 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4540088740 con 0x7f45401834e0 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient(hunting): authenticate will time out at 1745.200955s 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453f7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 0x7f454008ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59536/0 (socket says 10.20.193.78:59536) 2026-02-13T18:25:14.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453f7fe640 1 -- 10.20.193.78:0/3236427983 learned_addr learned my addr 10.20.193.78:0/3236427983 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453f7fe640 1 -- 10.20.193.78:0/3236427983 >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 legacy=0x7f454008ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453ffff640 1 -- 10.20.193.78:0/3236427983 >> v1:10.20.193.78:6790/0 conn(0x7f45401834e0 legacy=0x7f45401a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105807077 0 0) 0x7f454008b040 con 0x7f454008ca90 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): my global_id is 124347 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4524003620 con 0x7f454008ca90 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453effd640 1 -- 10.20.193.78:0/3236427983 >> v1:10.20.193.187:6789/0 conn(0x7f454008d570 legacy=0x7f4540181dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052570021 0 0) 0x7f4540088740 con 0x7f45401834e0 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient(hunting): my global_id is 144161 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f454008b040 con 0x7f45401834e0 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103481822 0 0) 0x7f4524003620 con 0x7f454008ca90 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 >> v1:10.20.193.78:6790/0 conn(0x7f45401834e0 legacy=0x7f45401a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 >> v1:10.20.193.187:6789/0 conn(0x7f454008d570 legacy=0x7f4540181dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 monclient: found mon.noname-a 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4540086430 con 0x7f454008ca90 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f452c003110 con 0x7f454008ca90 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 5 monclient: authenticate success, global_id 124347 2026-02-13T18:25:14.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: dump: 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f452c0033e0 con 0x7f454008ca90 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 1 -- 10.20.193.78:0/3236427983 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f452c004b50 con 0x7f454008ca90 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f453e7fc640 10 monclient: dump: 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.145+0000 7f4545fb3640 4 set_mon_vals no callback set 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient: shutdown 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- 10.20.193.78:0/3236427983 >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 legacy=0x7f454008ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- 10.20.193.78:0/3236427983 shutdown_connections 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- 10.20.193.78:0/3236427983 >> 10.20.193.78:0/3236427983 conn(0x7f4540091800 msgr2=0x7f4540091c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- 10.20.193.78:0/3236427983 shutdown_connections 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- 10.20.193.78:0/3236427983 wait complete. 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient: monmap: 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 Processor -- start 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- start start 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient: init 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient(hunting): picked mon.noname-a con 0x7f454008ca90 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient(hunting): picked mon.noname-b con 0x7f454008d570 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient(hunting): picked mon.noname-c con 0x7f45401834e0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454005de90 con 0x7f454008ca90 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45400831d0 con 0x7f454008d570 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45400834b0 con 0x7f45401834e0 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f4545fb3640 10 monclient(hunting): authenticate will time out at 1745.205614s 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f453f7fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 0x7f4540153250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59538/0 (socket says 10.20.193.78:59538) 2026-02-13T18:25:14.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f453f7fe640 1 -- 10.20.193.78:0/3937014486 learned_addr learned my addr 10.20.193.78:0/3937014486 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f453f7fe640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 legacy=0x7f4540153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f453ffff640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.78:6790/0 conn(0x7f45401834e0 legacy=0x7f45401755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f453effd640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.187:6789/0 conn(0x7f454008d570 legacy=0x7f45400849e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f453f7fe640 1 --1- 10.20.193.78:0/3937014486 >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 0x7f4540153250 :-1 s=OPENED pgs=568 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f4540086430 auth_reply(proto 2 0 (0) Success) 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.149+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300967410 0 0) 0x7f45400834b0 con 0x7f45401834e0 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): my global_id is 144164 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4510003620 con 0x7f45401834e0 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465708361 0 0) 0x7f45400831d0 con 0x7f454008d570 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): my global_id is 134284 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45400834b0 con 0x7f454008d570 2026-02-13T18:25:14.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3387253462 0 0) 0x7f4510003620 con 0x7f45401834e0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45400831d0 con 0x7f45401834e0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4534004900 con 0x7f45401834e0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): dump: 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1663895352 0 0) 0x7f45400831d0 con 0x7f45401834e0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.187:6789/0 conn(0x7f454008d570 legacy=0x7f45400849e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.78:6789/0 conn(0x7f454008ca90 legacy=0x7f4540153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 monclient: found mon.c 2026-02-13T18:25:14.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4540081cb0 con 0x7f45401834e0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745046321 0 0) 0x7f4540086430 con 0x7f454008ca90 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 5 monclient: authenticate success, global_id 144164 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 10 monclient: _renew_subs 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4540082c10 con 0x7f45401834e0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 10 monclient: _renew_subs 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f45400850f0 con 0x7f45401834e0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4534004ed0 con 0x7f45401834e0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4534005230 con 0x7f45401834e0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f453dffb640 4 set_mon_vals no callback set 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: dump: 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f454008c460 con 0x7f45401834e0 2026-02-13T18:25:14.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f4534005480 con 0x7f45401834e0 2026-02-13T18:25:14.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f453404d970 con 0x7f45401834e0 2026-02-13T18:25:14.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6804/425425936 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4534005080 con 0x7f4510061f10 2026-02-13T18:25:14.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=913) ==== 24+0+0 (unknown 2866522527 0 0) 0x7f453404dd60 con 0x7f45401834e0 2026-02-13T18:25:14.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f451bfff640 10 monclient: handle_get_version_reply finishing 1 version 913 2026-02-13T18:25:14.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f453effd640 10 monclient: get_auth_request con 0x7f4510061f10 auth_method 0 2026-02-13T18:25:14.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.153+0000 7f453f7fe640 10 monclient: get_auth_request con 0x7f451003d2b0 auth_method 0 2026-02-13T18:25:14.172 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.157+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== osd.0 v1:10.20.193.78:6804/425425936 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f4534005080 con 0x7f4510061f10 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 --> v1:10.20.193.78:6804/425425936 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f454004ca40 con 0x7f4510061f10 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f451bfff640 1 -- 10.20.193.78:0/3937014486 <== osd.0 v1:10.20.193.78:6804/425425936 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f454004ca40 con 0x7f4510061f10 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.78:6804/425425936 conn(0x7f4510061f10 legacy=0x7f4510082320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.187:6812/2668687789 conn(0x7f451003d2b0 legacy=0x7f451005d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 10 monclient: shutdown 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 >> v1:10.20.193.78:6790/0 conn(0x7f45401834e0 legacy=0x7f45401755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f453ffff640 1 -- 10.20.193.78:0/3937014486 reap_dead start 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 shutdown_connections 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 >> 10.20.193.78:0/3937014486 conn(0x7f4540091800 msgr2=0x7f4540089580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.181 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 shutdown_connections 2026-02-13T18:25:14.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.165+0000 7f4545fb3640 1 -- 10.20.193.78:0/3937014486 wait complete. 2026-02-13T18:25:14.189 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.233+0000 7fd5e1a21640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.233+0000 7fd5e1a21640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.233+0000 7fd5e1a21640 10 monclient: monmap: 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.237144+0000 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.237144+0000 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.233+0000 7fd5e1a21640 1 Processor -- start 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- start start 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient: init 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient(hunting): picked mon.noname-b con 0x7fd5dc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient(hunting): picked mon.noname-c con 0x7fd5dc08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient(hunting): picked mon.noname-a con 0x7fd5dc08cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc089e80 con 0x7fd5dc08cdd0 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc088c20 con 0x7fd5dc08dc80 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc089ba0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient(hunting): authenticate will time out at 1745.292293s 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5daffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd5dc08c2f0 0x7fd5dc08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33514/0 (socket says 10.20.193.78:33514) 2026-02-13T18:25:14.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5daffd640 1 -- 10.20.193.78:0/3386310475 learned_addr learned my addr 10.20.193.78:0/3386310475 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5daffd640 1 -- 10.20.193.78:0/3386310475 >> v1:10.20.193.78:6790/0 conn(0x7fd5dc08c2f0 legacy=0x7fd5dc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5db7fe640 1 -- 10.20.193.78:0/3386310475 >> v1:10.20.193.78:6789/0 conn(0x7fd5dc08cdd0 legacy=0x7fd5dc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4007163535 0 0) 0x7fd5dc089ba0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): my global_id is 144167 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c8003620 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5da7fc640 1 -- 10.20.193.78:0/3386310475 >> v1:10.20.193.187:6789/0 conn(0x7fd5dc08dc80 legacy=0x7fd5dc181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429166920 0 0) 0x7fd5dc089e80 con 0x7fd5dc08cdd0 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient(hunting): my global_id is 124353 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5dc089ba0 con 0x7fd5dc08cdd0 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3080581870 0 0) 0x7fd5c8003620 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 >> v1:10.20.193.187:6789/0 conn(0x7fd5dc08dc80 legacy=0x7fd5dc181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 >> v1:10.20.193.78:6789/0 conn(0x7fd5dc08cdd0 legacy=0x7fd5dc1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 monclient: found mon.noname-b 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc08d370 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd5d0003110 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 5 monclient: authenticate success, global_id 144167 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: dump: 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5d00033e0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 1 -- 10.20.193.78:0/3386310475 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd5d0004b50 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5d9ffb640 10 monclient: dump: 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 4 set_mon_vals no callback set 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 10 monclient: shutdown 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- 10.20.193.78:0/3386310475 >> v1:10.20.193.78:6790/0 conn(0x7fd5dc08c2f0 legacy=0x7fd5dc08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- 10.20.193.78:0/3386310475 shutdown_connections 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- 10.20.193.78:0/3386310475 >> 10.20.193.78:0/3386310475 conn(0x7fd5dc091720 msgr2=0x7fd5dc091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- 10.20.193.78:0/3386310475 shutdown_connections 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.237+0000 7fd5e1a21640 1 -- 10.20.193.78:0/3386310475 wait complete. 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: monmap: 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 Processor -- start 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 -- start start 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: init 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:14.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient(hunting): picked mon.noname-c con 0x7fd5dc08c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient(hunting): picked mon.noname-b con 0x7fd5dc08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient(hunting): picked mon.noname-a con 0x7fd5dc08dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0821f0 con 0x7fd5dc08dc80 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc081290 con 0x7fd5dc08cdd0 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0824d0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient(hunting): authenticate will time out at 1745.296805s 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5daffd640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd5dc08c2f0 0x7fd5dc153170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33530/0 (socket says 10.20.193.78:33530) 2026-02-13T18:25:14.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5daffd640 1 -- 10.20.193.78:0/7688782 learned_addr learned my addr 10.20.193.78:0/7688782 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5daffd640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.78:6790/0 conn(0x7fd5dc08c2f0 legacy=0x7fd5dc153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5db7fe640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.78:6789/0 conn(0x7fd5dc08dc80 legacy=0x7fd5dc1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226004481 0 0) 0x7fd5dc0824d0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): my global_id is 144170 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5ac003620 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109441967 0 0) 0x7fd5dc0821f0 con 0x7fd5dc08dc80 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): my global_id is 124356 2026-02-13T18:25:14.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5dc0824d0 con 0x7fd5dc08dc80 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2023565927 0 0) 0x7fd5ac003620 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5dc0821f0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd5d0002b70 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): dump: 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.258 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1140726851 0 0) 0x7fd5dc0824d0 con 0x7fd5dc08dc80 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5ac003620 con 0x7fd5dc08dc80 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd5cc004900 con 0x7fd5dc08dc80 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient(hunting): dump: 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5da7fc640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.187:6789/0 conn(0x7fd5dc08cdd0 legacy=0x7fd5dc083a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4195091471 0 0) 0x7fd5dc0821f0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.187:6789/0 conn(0x7fd5dc08cdd0 legacy=0x7fd5dc083a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.78:6789/0 conn(0x7fd5dc08dc80 legacy=0x7fd5dc1954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 monclient: found mon.c 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc05dce0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 5 monclient: authenticate success, global_id 144170 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: _renew_subs 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc088910 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: _renew_subs 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5dc0842e0 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5d0004b10 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd5d0005170 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5b3fff640 10 monclient: dump: 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.259 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.241+0000 7fd5d97fa640 4 set_mon_vals no callback set 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5e1a21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd5d0011800 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5e1a21640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5e1a21640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc08f600 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fd5d004c580 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5da7fc640 10 monclient: get_auth_request con 0x7fd5ac03d650 auth_method 0 2026-02-13T18:25:14.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fd5d0017700 con 0x7fd5dc08c2f0 2026-02-13T18:25:14.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.245+0000 7fd5b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:14.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd5dc090810 con 0x7fd5ac03d650 2026-02-13T18:25:14.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5b3fff640 1 -- 10.20.193.78:0/7688782 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fd5dc090810 con 0x7fd5ac03d650 2026-02-13T18:25:14.349 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 0 to deep-scrub 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd5ac03d650 legacy=0x7fd5ac05db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 10 monclient: shutdown 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 >> v1:10.20.193.78:6790/0 conn(0x7fd5dc08c2f0 legacy=0x7fd5dc153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 shutdown_connections 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 >> 10.20.193.78:0/7688782 conn(0x7fd5dc091720 msgr2=0x7fd5dc058cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 shutdown_connections 2026-02-13T18:25:14.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.333+0000 7fd5e1a21640 1 -- 10.20.193.78:0/7688782 wait complete. 2026-02-13T18:25:14.359 INFO:tasks.ceph:Scrubbing osd.1 2026-02-13T18:25:14.359 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.405+0000 7f38bd085640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.405+0000 7f38bd085640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.405+0000 7f38bd085640 10 monclient: monmap: 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.409077+0000 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.409077+0000 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.405+0000 7f38bd085640 1 Processor -- start 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.405+0000 7f38bd085640 1 -- start start 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.405+0000 7f38bd085640 10 monclient: init 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient(hunting): picked mon.noname-a con 0x7f38b808ca90 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient(hunting): picked mon.noname-c con 0x7f38b808d570 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.422 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient(hunting): picked mon.noname-b con 0x7f38b81834e0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b808b040 con 0x7f38b808ca90 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b8086710 con 0x7f38b808d570 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b8088740 con 0x7f38b81834e0 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient(hunting): authenticate will time out at 1745.464460s 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b6d76640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f38b808ca90 0x7f38b808ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59554/0 (socket says 10.20.193.78:59554) 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b6d76640 1 -- 10.20.193.78:0/1447387789 learned_addr learned my addr 10.20.193.78:0/1447387789 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.423 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b7577640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f38b81834e0 0x7f38b81a38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33532/0 (socket says 10.20.193.78:33532) 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b6d76640 1 -- 10.20.193.78:0/1447387789 >> v1:10.20.193.78:6789/0 conn(0x7f38b808ca90 legacy=0x7f38b808ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b7577640 1 -- 10.20.193.78:0/1447387789 >> v1:10.20.193.78:6790/0 conn(0x7f38b81834e0 legacy=0x7f38b81a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b6575640 1 -- 10.20.193.78:0/1447387789 >> v1:10.20.193.187:6789/0 conn(0x7f38b808d570 legacy=0x7f38b8181dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644701843 0 0) 0x7f38b808b040 con 0x7f38b808ca90 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): my global_id is 124359 2026-02-13T18:25:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a4003620 con 0x7f38b808ca90 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51980672 0 0) 0x7f38b8088740 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): my global_id is 144173 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b808b040 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819008964 0 0) 0x7f38b8086710 con 0x7f38b808d570 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient(hunting): my global_id is 134293 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b8088740 con 0x7f38b808d570 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2058323814 0 0) 0x7f38b808b040 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 >> v1:10.20.193.187:6789/0 conn(0x7f38b808d570 legacy=0x7f38b8181dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 >> v1:10.20.193.78:6789/0 conn(0x7f38b808ca90 legacy=0x7f38b808ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 monclient: found mon.noname-b 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b8086430 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 5 monclient: authenticate success, global_id 144173 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f38a80044d0 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: dump: 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f38a80047a0 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 1 -- 10.20.193.78:0/1447387789 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f38a8005df0 con 0x7f38b81834e0 2026-02-13T18:25:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 4 set_mon_vals no callback set 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38b5d74640 10 monclient: dump: 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 10 monclient: shutdown 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- 10.20.193.78:0/1447387789 >> v1:10.20.193.78:6790/0 conn(0x7f38b81834e0 legacy=0x7f38b81a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- 10.20.193.78:0/1447387789 shutdown_connections 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- 10.20.193.78:0/1447387789 >> 10.20.193.78:0/1447387789 conn(0x7f38b8091800 msgr2=0x7f38b8091c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- 10.20.193.78:0/1447387789 shutdown_connections 2026-02-13T18:25:14.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.409+0000 7f38bd085640 1 -- 10.20.193.78:0/1447387789 wait complete. 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: monmap: 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 Processor -- start 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- start start 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: init 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient(hunting): picked mon.noname-b con 0x7f38b808ca90 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient(hunting): picked mon.noname-c con 0x7f38b808d570 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient(hunting): picked mon.noname-a con 0x7f38b81834e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b807b8e0 con 0x7f38b81834e0 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b80587a0 con 0x7f38b808ca90 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b8140d40 con 0x7f38b808d570 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient(hunting): authenticate will time out at 1745.468562s 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b7577640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f38b81834e0 0x7f38b8179e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59570/0 (socket says 10.20.193.78:59570) 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b6575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f38b808d570 0x7f38b8178740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33544/0 (socket says 10.20.193.78:33544) 2026-02-13T18:25:14.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b7577640 1 -- 10.20.193.78:0/2394164753 learned_addr learned my addr 10.20.193.78:0/2394164753 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b7577640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.78:6789/0 conn(0x7f38b81834e0 legacy=0x7f38b8179e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b6575640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.78:6790/0 conn(0x7f38b808d570 legacy=0x7f38b8178740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503052332 0 0) 0x7f38b807b8e0 con 0x7f38b81834e0 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): my global_id is 124362 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3884003620 con 0x7f38b81834e0 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768849421 0 0) 0x7f38b8140d40 con 0x7f38b808d570 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): my global_id is 144176 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b807b8e0 con 0x7f38b808d570 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b6d76640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.187:6789/0 conn(0x7f38b808ca90 legacy=0x7f38b807de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3951042196 0 0) 0x7f3884003620 con 0x7f38b81834e0 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38b8140d40 con 0x7f38b81834e0 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f38a8005df0 con 0x7f38b81834e0 2026-02-13T18:25:14.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): dump: 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 886308659 0 0) 0x7f38b807b8e0 con 0x7f38b808d570 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3884003620 con 0x7f38b808d570 2026-02-13T18:25:14.430 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f38a00033c0 con 0x7f38b808d570 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): dump: 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845614857 0 0) 0x7f38b80587a0 con 0x7f38b808ca90 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient(hunting): my global_id is 134296 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b807b8e0 con 0x7f38b808ca90 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3101956891 0 0) 0x7f38b8140d40 con 0x7f38b81834e0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.78:6790/0 conn(0x7f38b808d570 legacy=0x7f38b8178740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.187:6789/0 conn(0x7f38b808ca90 legacy=0x7f38b807de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 monclient: found mon.a 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b807b600 con 0x7f38b81834e0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 5 monclient: authenticate success, global_id 124362 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _renew_subs 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f38b807e510 con 0x7f38b81834e0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _renew_subs 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f38b81575a0 con 0x7f38b81834e0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f38a8004740 con 0x7f38b81834e0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f38a80065c0 con 0x7f38b81834e0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38977fe640 10 monclient: dump: 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.431 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38b5573640 4 set_mon_vals no callback set 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.413+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f38b81419b0 con 0x7f38b81834e0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f38a8012c50 con 0x7f38b81834e0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f38a804d7f0 con 0x7f38b81834e0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6800/444681404 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38a8006410 con 0x7f38840624d0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=913) ==== 24+0+0 (unknown 2866522527 0 0) 0x7f38a804db30 con 0x7f38b81834e0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38977fe640 10 monclient: handle_get_version_reply finishing 1 version 913 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38b6d76640 10 monclient: get_auth_request con 0x7f388403d870 auth_method 0 2026-02-13T18:25:14.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.417+0000 7f38b6575640 10 monclient: get_auth_request con 0x7f38840624d0 auth_method 0 2026-02-13T18:25:14.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.421+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== osd.1 v1:10.20.193.78:6800/444681404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f38a8006410 con 0x7f38840624d0 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 --> v1:10.20.193.78:6800/444681404 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38b805d3d0 con 0x7f38840624d0 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38977fe640 1 -- 10.20.193.78:0/2394164753 <== osd.1 v1:10.20.193.78:6800/444681404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f38b805d3d0 con 0x7f38840624d0 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.78:6800/444681404 conn(0x7f38840624d0 legacy=0x7f38840828e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.187:6812/2668687789 conn(0x7f388403d870 legacy=0x7f388405dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 10 monclient: shutdown 2026-02-13T18:25:14.443 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 >> v1:10.20.193.78:6789/0 conn(0x7f38b81834e0 legacy=0x7f38b8179e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38b7577640 1 -- 10.20.193.78:0/2394164753 reap_dead start 2026-02-13T18:25:14.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 shutdown_connections 2026-02-13T18:25:14.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 >> 10.20.193.78:0/2394164753 conn(0x7f38b8091800 msgr2=0x7f38b8088d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 shutdown_connections 2026-02-13T18:25:14.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.429+0000 7f38bd085640 1 -- 10.20.193.78:0/2394164753 wait complete. 2026-02-13T18:25:14.451 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.501+0000 7f439e9cd640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.501+0000 7f439e9cd640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.501+0000 7f439e9cd640 10 monclient: monmap: 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.505129+0000 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.505129+0000 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.501+0000 7f439e9cd640 1 Processor -- start 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.501+0000 7f439e9cd640 1 -- start start 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.501+0000 7f439e9cd640 10 monclient: init 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient(hunting): picked mon.noname-a con 0x7f439808c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient(hunting): picked mon.noname-c con 0x7f439808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient(hunting): picked mon.noname-b con 0x7f439808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4398089e80 con 0x7f439808c2f0 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4398088c20 con 0x7f439808dc80 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4398089ba0 con 0x7f439808cdd0 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient(hunting): authenticate will time out at 1745.560348s 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4397fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f439808c2f0 0x7f439808c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59578/0 (socket says 10.20.193.78:59578) 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439cf43640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f439808cdd0 0x7f43981a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33552/0 (socket says 10.20.193.78:33552) 2026-02-13T18:25:14.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4397fff640 1 -- 10.20.193.78:0/920146920 learned_addr learned my addr 10.20.193.78:0/920146920 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439cf43640 1 -- 10.20.193.78:0/920146920 >> v1:10.20.193.78:6790/0 conn(0x7f439808cdd0 legacy=0x7f43981a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4397fff640 1 -- 10.20.193.78:0/920146920 >> v1:10.20.193.78:6789/0 conn(0x7f439808c2f0 legacy=0x7f439808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f43977fe640 1 -- 10.20.193.78:0/920146920 >> v1:10.20.193.187:6789/0 conn(0x7f439808dc80 legacy=0x7f4398181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048285245 0 0) 0x7f4398089ba0 con 0x7f439808cdd0 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): my global_id is 144179 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f437c003620 con 0x7f439808cdd0 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083491146 0 0) 0x7f4398089e80 con 0x7f439808c2f0 2026-02-13T18:25:14.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient(hunting): my global_id is 124365 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4398089ba0 con 0x7f439808c2f0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854762835 0 0) 0x7f437c003620 con 0x7f439808cdd0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 >> v1:10.20.193.187:6789/0 conn(0x7f439808dc80 legacy=0x7f4398181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 >> v1:10.20.193.78:6789/0 conn(0x7f439808c2f0 legacy=0x7f439808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 monclient: found mon.noname-b 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439808d370 con 0x7f439808cdd0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f438c004620 con 0x7f439808cdd0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 5 monclient: authenticate success, global_id 144179 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: dump: 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f438c0048f0 con 0x7f439808cdd0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 1 -- 10.20.193.78:0/920146920 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f438c005fa0 con 0x7f439808cdd0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f4396ffd640 10 monclient: dump: 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.522 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 4 set_mon_vals no callback set 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 10 monclient: shutdown 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- 10.20.193.78:0/920146920 >> v1:10.20.193.78:6790/0 conn(0x7f439808cdd0 legacy=0x7f43981a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- 10.20.193.78:0/920146920 shutdown_connections 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- 10.20.193.78:0/920146920 >> 10.20.193.78:0/920146920 conn(0x7f4398091720 msgr2=0x7f4398091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- 10.20.193.78:0/920146920 shutdown_connections 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.505+0000 7f439e9cd640 1 -- 10.20.193.78:0/920146920 wait complete. 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: monmap: 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.523 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 Processor -- start 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 -- start start 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: init 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient(hunting): picked mon.noname-b con 0x7f439808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient(hunting): picked mon.noname-c con 0x7f439808cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient(hunting): picked mon.noname-a con 0x7f439808dc80 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980579a0 con 0x7f439808dc80 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4398088910 con 0x7f439808c2f0 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439807dd10 con 0x7f439808cdd0 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient(hunting): authenticate will time out at 1745.564865s 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f43977fe640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f439808cdd0 0x7f4398192080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33564/0 (socket says 10.20.193.78:33564) 2026-02-13T18:25:14.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f43977fe640 1 -- 10.20.193.78:0/2252600916 learned_addr learned my addr 10.20.193.78:0/2252600916 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f43977fe640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.78:6790/0 conn(0x7f439808cdd0 legacy=0x7f4398192080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439cf43640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.78:6789/0 conn(0x7f439808dc80 legacy=0x7f43981937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942426771 0 0) 0x7f439807dd10 con 0x7f439808cdd0 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): my global_id is 144182 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4397fff640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.187:6789/0 conn(0x7f439808c2f0 legacy=0x7f4398151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4368003620 con 0x7f439808cdd0 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966129061 0 0) 0x7f439808d370 con 0x7f439808dc80 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): my global_id is 124368 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f439807dd10 con 0x7f439808dc80 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570710862 0 0) 0x7f4398088910 con 0x7f439808c2f0 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): my global_id is 134302 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f439808d370 con 0x7f439808c2f0 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1924806978 0 0) 0x7f439807dd10 con 0x7f439808dc80 2026-02-13T18:25:14.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4398088910 con 0x7f439808dc80 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f438c004080 con 0x7f439808dc80 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1221345886 0 0) 0x7f4368003620 con 0x7f439808cdd0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f439807dd10 con 0x7f439808cdd0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f4388003400 con 0x7f439808cdd0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2053054082 0 0) 0x7f4398088910 con 0x7f439808dc80 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.78:6790/0 conn(0x7f439808cdd0 legacy=0x7f4398192080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.187:6789/0 conn(0x7f439808c2f0 legacy=0x7f4398151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 monclient: found mon.a 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398080a50 con 0x7f439808dc80 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 5 monclient: authenticate success, global_id 124368 2026-02-13T18:25:14.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: _renew_subs 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4398080070 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: _renew_subs 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f439807e870 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f438c0048d0 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f438c006770 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f4394ff9640 10 monclient: dump: 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.509+0000 7f43967fc640 4 set_mon_vals no callback set 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f439e9cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f439e9cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f439e9cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439808f5e0 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f438c012e00 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f438c04d880 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f4397fff640 10 monclient: get_auth_request con 0x7f436803d760 auth_method 0 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f43980579a0 con 0x7f439808dc80 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f4394ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.513+0000 7f4394ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:14.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4398090810 con 0x7f436803d760 2026-02-13T18:25:14.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f4394ff9640 1 -- 10.20.193.78:0/2252600916 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f4398090810 con 0x7f436803d760 2026-02-13T18:25:14.615 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 1 to deep-scrub 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.187:6812/2668687789 conn(0x7f436803d760 legacy=0x7f436805dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 10 monclient: shutdown 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 >> v1:10.20.193.78:6789/0 conn(0x7f439808dc80 legacy=0x7f43981937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 shutdown_connections 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 >> 10.20.193.78:0/2252600916 conn(0x7f4398091720 msgr2=0x7f439805ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 shutdown_connections 2026-02-13T18:25:14.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.601+0000 7f439e9cd640 1 -- 10.20.193.78:0/2252600916 wait complete. 2026-02-13T18:25:14.626 INFO:tasks.ceph:Scrubbing osd.2 2026-02-13T18:25:14.626 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-13T18:25:14.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.695 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient: monmap: 2026-02-13T18:25:14.695 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.695 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.682946+0000 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.682946+0000 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 1 Processor -- start 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 1 -- start start 2026-02-13T18:25:14.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient: init 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient(hunting): picked mon.noname-a con 0x7ff444142a60 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient(hunting): picked mon.noname-b con 0x7ff444095530 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient(hunting): picked mon.noname-c con 0x7ff444143540 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff444092340 con 0x7ff444142a60 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4440908b0 con 0x7ff444143540 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff444091070 con 0x7ff444095530 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff449987640 10 monclient(hunting): authenticate will time out at 1745.738573s 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff4427fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff444095530 0x7ff444183f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33574/0 (socket says 10.20.193.78:33574) 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff4427fc640 1 -- 10.20.193.78:0/1339071743 learned_addr learned my addr 10.20.193.78:0/1339071743 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.681+0000 7ff442ffd640 1 --1- 10.20.193.78:0/1339071743 >> v1:10.20.193.78:6789/0 conn(0x7ff444142a60 0x7ff444142e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59598/0 (socket says 10.20.193.78:59598) 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff4427fc640 1 -- 10.20.193.78:0/1339071743 >> v1:10.20.193.78:6790/0 conn(0x7ff444095530 legacy=0x7ff444183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff442ffd640 1 -- 10.20.193.78:0/1339071743 >> v1:10.20.193.78:6789/0 conn(0x7ff444142a60 legacy=0x7ff444142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346046581 0 0) 0x7ff444091070 con 0x7ff444095530 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff4437fe640 1 -- 10.20.193.78:0/1339071743 >> v1:10.20.193.187:6789/0 conn(0x7ff444143540 legacy=0x7ff4441a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): my global_id is 144185 2026-02-13T18:25:14.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff430003620 con 0x7ff444095530 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434973525 0 0) 0x7ff444092340 con 0x7ff444142a60 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): my global_id is 124371 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff444091070 con 0x7ff444142a60 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694752001 0 0) 0x7ff4440908b0 con 0x7ff444143540 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient(hunting): my global_id is 134305 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff444092340 con 0x7ff444143540 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2107840209 0 0) 0x7ff430003620 con 0x7ff444095530 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 >> v1:10.20.193.187:6789/0 conn(0x7ff444143540 legacy=0x7ff4441a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 >> v1:10.20.193.78:6789/0 conn(0x7ff444142a60 legacy=0x7ff444142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 monclient: found mon.noname-b 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff444091350 con 0x7ff444095530 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 5 monclient: authenticate success, global_id 144185 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c003110 con 0x7ff444095530 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: dump: 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.700 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff42c003460 con 0x7ff444095530 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 4 set_mon_vals no callback set 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 1 -- 10.20.193.78:0/1339071743 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c004b50 con 0x7ff444095530 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff441ffb640 10 monclient: dump: 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: shutdown 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- 10.20.193.78:0/1339071743 >> v1:10.20.193.78:6790/0 conn(0x7ff444095530 legacy=0x7ff444183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- 10.20.193.78:0/1339071743 shutdown_connections 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- 10.20.193.78:0/1339071743 >> 10.20.193.78:0/1339071743 conn(0x7ff4440545d0 msgr2=0x7ff4440549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- 10.20.193.78:0/1339071743 shutdown_connections 2026-02-13T18:25:14.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- 10.20.193.78:0/1339071743 wait complete. 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: monmap: 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 Processor -- start 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- start start 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: init 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient(hunting): picked mon.noname-b con 0x7ff444095530 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient(hunting): picked mon.noname-c con 0x7ff444142a60 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient(hunting): picked mon.noname-a con 0x7ff444143540 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4441326b0 con 0x7ff444143540 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff444057f90 con 0x7ff444095530 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff444131490 con 0x7ff444142a60 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff449987640 10 monclient(hunting): authenticate will time out at 1745.742772s 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff4427fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7ff444142a60 0x7ff444140cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33580/0 (socket says 10.20.193.78:33580) 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff4437fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7ff444143540 0x7ff444195770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59606/0 (socket says 10.20.193.78:59606) 2026-02-13T18:25:14.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.685+0000 7ff4427fc640 1 -- 10.20.193.78:0/645467205 learned_addr learned my addr 10.20.193.78:0/645467205 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff4427fc640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.78:6790/0 conn(0x7ff444142a60 legacy=0x7ff444140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff4437fe640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.78:6789/0 conn(0x7ff444143540 legacy=0x7ff444195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059005135 0 0) 0x7ff444131490 con 0x7ff444142a60 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): my global_id is 144188 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff414003620 con 0x7ff444142a60 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028698432 0 0) 0x7ff4441326b0 con 0x7ff444143540 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): my global_id is 124374 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff444131490 con 0x7ff444143540 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff442ffd640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.187:6789/0 conn(0x7ff444095530 legacy=0x7ff444153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3787821451 0 0) 0x7ff444131490 con 0x7ff444143540 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4441326b0 con 0x7ff444143540 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 969694768 0 0) 0x7ff414003620 con 0x7ff444142a60 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff444131490 con 0x7ff444142a60 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff4340048d0 con 0x7ff444143540 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): dump: 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c0048e0 con 0x7ff444142a60 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient(hunting): dump: 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.704 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3836323462 0 0) 0x7ff444131490 con 0x7ff444142a60 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.187:6789/0 conn(0x7ff444095530 legacy=0x7ff444153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.78:6789/0 conn(0x7ff444143540 legacy=0x7ff444195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 monclient: found mon.c 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff444130350 con 0x7ff444142a60 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 5 monclient: authenticate success, global_id 144188 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 10 monclient: _renew_subs 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4441323d0 con 0x7ff444142a60 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 10 monclient: _renew_subs 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff444141590 con 0x7ff444142a60 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff42c002d20 con 0x7ff444142a60 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7ff42c0050c0 con 0x7ff444142a60 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: dump: 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff4417fa640 4 set_mon_vals no callback set 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff44405dc10 con 0x7ff444142a60 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7ff42c011750 con 0x7ff444142a60 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7ff42c04c420 con 0x7ff444142a60 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6808/2589033462 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff42c003460 con 0x7ff414062240 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=913) ==== 24+0+0 (unknown 2866522527 0 0) 0x7ff42c04c810 con 0x7ff444142a60 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff41bfff640 10 monclient: handle_get_version_reply finishing 1 version 913 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff442ffd640 10 monclient: get_auth_request con 0x7ff41403d560 auth_method 0 2026-02-13T18:25:14.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.689+0000 7ff4437fe640 10 monclient: get_auth_request con 0x7ff414062240 auth_method 0 2026-02-13T18:25:14.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.693+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== osd.2 v1:10.20.193.78:6808/2589033462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7ff42c003460 con 0x7ff414062240 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 --> v1:10.20.193.78:6808/2589033462 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff444131f20 con 0x7ff414062240 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff41bfff640 1 -- 10.20.193.78:0/645467205 <== osd.2 v1:10.20.193.78:6808/2589033462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff444131f20 con 0x7ff414062240 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.78:6808/2589033462 conn(0x7ff414062240 legacy=0x7ff414082650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.187:6812/2668687789 conn(0x7ff41403d560 legacy=0x7ff41405da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 10 monclient: shutdown 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 >> v1:10.20.193.78:6790/0 conn(0x7ff444142a60 legacy=0x7ff444140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff4437fe640 1 -- 10.20.193.78:0/645467205 reap_dead start 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 shutdown_connections 2026-02-13T18:25:14.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 >> 10.20.193.78:0/645467205 conn(0x7ff4440545d0 msgr2=0x7ff44408a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 shutdown_connections 2026-02-13T18:25:14.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.701+0000 7ff449987640 1 -- 10.20.193.78:0/645467205 wait complete. 2026-02-13T18:25:14.725 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient: monmap: 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.783781+0000 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.783781+0000 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.796 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 1 Processor -- start 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 1 -- start start 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient: init 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient(hunting): picked mon.noname-c con 0x7f089808c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient(hunting): picked mon.noname-b con 0x7f089808dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient(hunting): picked mon.noname-a con 0x7f089808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0898089e80 con 0x7f089808cdd0 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0898088c20 con 0x7f089808c2f0 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0898089ba0 con 0x7f089808dc80 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f089ce11640 10 monclient(hunting): authenticate will time out at 1745.839083s 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f0895d74640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f089808dc80 0x7f0898181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33594/0 (socket says 10.20.193.78:33594) 2026-02-13T18:25:14.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.781+0000 7f0895d74640 1 -- 10.20.193.78:0/423236120 learned_addr learned my addr 10.20.193.78:0/423236120 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895d74640 1 -- 10.20.193.78:0/423236120 >> v1:10.20.193.78:6790/0 conn(0x7f089808dc80 legacy=0x7f0898181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0896d76640 1 -- 10.20.193.78:0/423236120 >> v1:10.20.193.78:6789/0 conn(0x7f089808cdd0 legacy=0x7f08981a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0896575640 1 -- 10.20.193.78:0/423236120 >> v1:10.20.193.187:6789/0 conn(0x7f089808c2f0 legacy=0x7f089808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090395966 0 0) 0x7f0898089ba0 con 0x7f089808dc80 2026-02-13T18:25:14.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): my global_id is 144191 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0884003620 con 0x7f089808dc80 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552741634 0 0) 0x7f0898089e80 con 0x7f089808cdd0 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient(hunting): my global_id is 124377 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0898089ba0 con 0x7f089808cdd0 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 764595849 0 0) 0x7f0884003620 con 0x7f089808dc80 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 >> v1:10.20.193.187:6789/0 conn(0x7f089808c2f0 legacy=0x7f089808c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 >> v1:10.20.193.78:6789/0 conn(0x7f089808cdd0 legacy=0x7f08981a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 monclient: found mon.noname-b 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089808d370 con 0x7f089808dc80 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0880003110 con 0x7f089808dc80 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: dump: 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.800 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 5 monclient: authenticate success, global_id 144191 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08800033e0 con 0x7f089808dc80 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 1 -- 10.20.193.78:0/423236120 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0880004b50 con 0x7f089808dc80 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0895573640 10 monclient: dump: 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 4 set_mon_vals no callback set 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: shutdown 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- 10.20.193.78:0/423236120 >> v1:10.20.193.78:6790/0 conn(0x7f089808dc80 legacy=0x7f0898181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- 10.20.193.78:0/423236120 shutdown_connections 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- 10.20.193.78:0/423236120 >> 10.20.193.78:0/423236120 conn(0x7f0898091720 msgr2=0x7f0898091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- 10.20.193.78:0/423236120 shutdown_connections 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- 10.20.193.78:0/423236120 wait complete. 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: monmap: 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 Processor -- start 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- start start 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: init 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient(hunting): picked mon.noname-c con 0x7f089808c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient(hunting): picked mon.noname-a con 0x7f089808cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient(hunting): picked mon.noname-b con 0x7f089808dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089805d590 con 0x7f089808cdd0 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0898081ee0 con 0x7f089808dc80 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0898057930 con 0x7f089808c2f0 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f089ce11640 10 monclient(hunting): authenticate will time out at 1745.843635s 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0896575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f089808c2f0 0x7f0898153070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33598/0 (socket says 10.20.193.78:33598) 2026-02-13T18:25:14.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.785+0000 7f0896575640 1 -- 10.20.193.78:0/560756364 learned_addr learned my addr 10.20.193.78:0/560756364 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f0896575640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.78:6790/0 conn(0x7f089808c2f0 legacy=0x7f0898153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f0895d74640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.78:6789/0 conn(0x7f089808cdd0 legacy=0x7f08980838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f0896d76640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.187:6789/0 conn(0x7f089808dc80 legacy=0x7f0898195400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544889675 0 0) 0x7f0898057930 con 0x7f089808c2f0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): my global_id is 144194 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0864003620 con 0x7f089808c2f0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294677062 0 0) 0x7f089808d370 con 0x7f089808cdd0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): my global_id is 124380 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0898057930 con 0x7f089808cdd0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511279460 0 0) 0x7f0898081ee0 con 0x7f089808dc80 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): my global_id is 134314 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f089808d370 con 0x7f089808dc80 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 882115995 0 0) 0x7f0864003620 con 0x7f089808c2f0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0898081ee0 con 0x7f089808c2f0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f088c003340 con 0x7f089808c2f0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): dump: 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.805 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1260486854 0 0) 0x7f0898057930 con 0x7f089808cdd0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0864003620 con 0x7f089808cdd0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f0880002b70 con 0x7f089808cdd0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient(hunting): dump: 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1159458238 0 0) 0x7f0898081ee0 con 0x7f089808c2f0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.187:6789/0 conn(0x7f089808dc80 legacy=0x7f0898195400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.78:6789/0 conn(0x7f089808cdd0 legacy=0x7f08980838d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 monclient: found mon.c 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08980824a0 con 0x7f089808c2f0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 5 monclient: authenticate success, global_id 144194 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 monclient: _renew_subs 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0898083fe0 con 0x7f089808c2f0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 monclient: _renew_subs 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0898196b20 con 0x7f089808c2f0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f088c0039c0 con 0x7f089808c2f0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f088c003d50 con 0x7f089808c2f0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 10 monclient: dump: 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.806 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f0894d72640 4 set_mon_vals no callback set 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f088c003ff0 con 0x7f089808c2f0 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089808f600 con 0x7f089808c2f0 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f088c04c470 con 0x7f089808c2f0 2026-02-13T18:25:14.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.789+0000 7f0895d74640 10 monclient: get_auth_request con 0x7f086403d850 auth_method 0 2026-02-13T18:25:14.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.793+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f088c017590 con 0x7f089808c2f0 2026-02-13T18:25:14.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.793+0000 7f087effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:14.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.793+0000 7f087effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:14.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0898088910 con 0x7f086403d850 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f087effd640 1 -- 10.20.193.78:0/560756364 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f0898088910 con 0x7f086403d850 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 2 to deep-scrub 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.187:6812/2668687789 conn(0x7f086403d850 legacy=0x7f086405dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 10 monclient: shutdown 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 >> v1:10.20.193.78:6790/0 conn(0x7f089808c2f0 legacy=0x7f0898153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 shutdown_connections 2026-02-13T18:25:14.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 >> 10.20.193.78:0/560756364 conn(0x7f0898091720 msgr2=0x7f0898058b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 shutdown_connections 2026-02-13T18:25:14.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.881+0000 7f089ce11640 1 -- 10.20.193.78:0/560756364 wait complete. 2026-02-13T18:25:14.906 INFO:tasks.ceph:Scrubbing osd.3 2026-02-13T18:25:14.906 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient: get_monmap_and_config 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient: monmap: 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:14.955159+0000 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:14.955159+0000 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 1 Processor -- start 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 1 -- start start 2026-02-13T18:25:14.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient: init 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient(hunting): picked mon.noname-a con 0x7f82c8142a60 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient(hunting): picked mon.noname-c con 0x7f82c8095530 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient(hunting): picked mon.noname-b con 0x7f82c8143540 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c8092340 con 0x7f82c8142a60 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80908b0 con 0x7f82c8095530 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c8091070 con 0x7f82c8143540 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82ce3aa640 10 monclient(hunting): authenticate will time out at 1746.010766s 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82cc920640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f82c8143540 0x7f82c81a56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33604/0 (socket says 10.20.193.78:33604) 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82c7fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f82c8142a60 0x7f82c8142e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59628/0 (socket says 10.20.193.78:59628) 2026-02-13T18:25:14.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.953+0000 7f82cc920640 1 -- 10.20.193.78:0/3953895448 learned_addr learned my addr 10.20.193.78:0/3953895448 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c7fff640 1 -- 10.20.193.78:0/3953895448 >> v1:10.20.193.78:6789/0 conn(0x7f82c8142a60 legacy=0x7f82c8142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82cc920640 1 -- 10.20.193.78:0/3953895448 >> v1:10.20.193.78:6790/0 conn(0x7f82c8143540 legacy=0x7f82c81a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238209827 0 0) 0x7f82c8092340 con 0x7f82c8142a60 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): my global_id is 124383 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82ac003620 con 0x7f82c8142a60 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782009232 0 0) 0x7f82c8091070 con 0x7f82c8143540 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient(hunting): my global_id is 144197 2026-02-13T18:25:14.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c8092340 con 0x7f82c8143540 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c77fe640 1 -- 10.20.193.78:0/3953895448 >> v1:10.20.193.187:6789/0 conn(0x7f82c8095530 legacy=0x7f82c8183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3024467129 0 0) 0x7f82ac003620 con 0x7f82c8142a60 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 >> v1:10.20.193.78:6790/0 conn(0x7f82c8143540 legacy=0x7f82c81a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 >> v1:10.20.193.187:6789/0 conn(0x7f82c8095530 legacy=0x7f82c8183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 monclient: found mon.noname-a 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8091350 con 0x7f82c8142a60 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82b4003110 con 0x7f82c8142a60 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: dump: 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.972 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 5 monclient: authenticate success, global_id 124383 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c7fff640 1 --1- 10.20.193.78:0/3953895448 >> v1:10.20.193.78:6789/0 conn(0x7f82c8142a60 0x7f82c8142e30 :-1 s=OPENED pgs=579 gs=1 cs=1 l=1).queue_received will delay after 1.77101e+09 on 0x7f82b4004a90 mon_map magic: 0 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82b40033e0 con 0x7f82c8142a60 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 4 set_mon_vals no callback set 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: shutdown 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- 10.20.193.78:0/3953895448 >> v1:10.20.193.78:6789/0 conn(0x7f82c8142a60 legacy=0x7f82c8142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 1 -- 10.20.193.78:0/3953895448 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82b4004a90 con 0x7f82c8142a60 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c6ffd640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- 10.20.193.78:0/3953895448 shutdown_connections 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- 10.20.193.78:0/3953895448 >> 10.20.193.78:0/3953895448 conn(0x7f82c80545d0 msgr2=0x7f82c80549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- 10.20.193.78:0/3953895448 shutdown_connections 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- 10.20.193.78:0/3953895448 wait complete. 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: build_initial_monmap 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: monmap: 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:14.973 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 Processor -- start 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- start start 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: init 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient(hunting): picked mon.noname-c con 0x7f82c8095530 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient(hunting): picked mon.noname-b con 0x7f82c8142a60 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient(hunting): picked mon.noname-a con 0x7f82c8143540 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c8131fa0 con 0x7f82c8143540 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c8057f90 con 0x7f82c8142a60 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c81304e0 con 0x7f82c8095530 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82ce3aa640 10 monclient(hunting): authenticate will time out at 1746.015295s 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c7fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f82c8095530 0x7f82c8140e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33606/0 (socket says 10.20.193.78:33606) 2026-02-13T18:25:14.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.957+0000 7f82c7fff640 1 -- 10.20.193.78:0/1336331809 learned_addr learned my addr 10.20.193.78:0/1336331809 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:14.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c7fff640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.78:6790/0 conn(0x7f82c8095530 legacy=0x7f82c8140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82cc920640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.78:6789/0 conn(0x7f82c8143540 legacy=0x7f82c8195cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178492261 0 0) 0x7f82c81304e0 con 0x7f82c8095530 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): my global_id is 144200 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8298003620 con 0x7f82c8095530 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c77fe640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.187:6789/0 conn(0x7f82c8142a60 legacy=0x7f82c81945a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058991863 0 0) 0x7f82bc004320 con 0x7f82c8143540 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): my global_id is 124386 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c81304e0 con 0x7f82c8143540 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1363045335 0 0) 0x7f8298003620 con 0x7f82c8095530 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82bc004320 con 0x7f82c8095530 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82b40048e0 con 0x7f82c8095530 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.976 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626495339 0 0) 0x7f82c8057f90 con 0x7f82c8142a60 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): my global_id is 134320 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8298003620 con 0x7f82c8142a60 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1997837063 0 0) 0x7f82c81304e0 con 0x7f82c8143540 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82c8057f90 con 0x7f82c8143540 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82bc004150 con 0x7f82c8143540 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2061893193 0 0) 0x7f82c8057f90 con 0x7f82c8143540 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.78:6790/0 conn(0x7f82c8095530 legacy=0x7f82c8140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.187:6789/0 conn(0x7f82c8142a60 legacy=0x7f82c81945a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 monclient: found mon.a 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8132840 con 0x7f82c8143540 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: _finish_auth 0 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 5 monclient: authenticate success, global_id 124386 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 10 monclient: _renew_subs 2026-02-13T18:25:14.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82c8131040 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 10 monclient: _renew_subs 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f82c8141720 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82bc006250 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f82bc0065b0 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: dump: 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c67fc640 4 set_mon_vals no callback set 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f82c805dc10 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f82bc012c40 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f82bc04d8f0 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.187:6800/1622449099 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82bc006400 con 0x7f82980624b0 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=913) ==== 24+0+0 (unknown 2866522527 0 0) 0x7f82bc04dc30 con 0x7f82c8143540 2026-02-13T18:25:14.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c4ff9640 10 monclient: handle_get_version_reply finishing 1 version 913 2026-02-13T18:25:14.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c7fff640 10 monclient: get_auth_request con 0x7f829803d820 auth_method 0 2026-02-13T18:25:14.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.961+0000 7f82c77fe640 10 monclient: get_auth_request con 0x7f82980624b0 auth_method 0 2026-02-13T18:25:14.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.969+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== osd.3 v1:10.20.193.187:6800/1622449099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f82bc006400 con 0x7f82980624b0 2026-02-13T18:25:14.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.973+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 --> v1:10.20.193.187:6800/1622449099 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f82c8093060 con 0x7f82980624b0 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.973+0000 7f82c4ff9640 1 -- 10.20.193.78:0/1336331809 <== osd.3 v1:10.20.193.187:6800/1622449099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f82c8093060 con 0x7f82980624b0 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.973+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.187:6800/1622449099 conn(0x7f82980624b0 legacy=0x7f82980828c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.973+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.187:6812/2668687789 conn(0x7f829803d820 legacy=0x7f829805dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.973+0000 7f82ce3aa640 10 monclient: shutdown 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.973+0000 7f82ce3aa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.977+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 >> v1:10.20.193.78:6789/0 conn(0x7f82c8143540 legacy=0x7f82c8195cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.977+0000 7f82cc920640 1 -- 10.20.193.78:0/1336331809 reap_dead start 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.977+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 shutdown_connections 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.977+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 >> 10.20.193.78:0/1336331809 conn(0x7f82c80545d0 msgr2=0x7f82c80897c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.977+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 shutdown_connections 2026-02-13T18:25:14.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:14.977+0000 7f82ce3aa640 1 -- 10.20.193.78:0/1336331809 wait complete. 2026-02-13T18:25:14.998 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient: get_monmap_and_config 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient: monmap: 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:15.048711+0000 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:15.048711+0000 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:15.061 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 1 Processor -- start 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 1 -- start start 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient: init 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient(hunting): picked mon.noname-b con 0x7f187c08cdc0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient(hunting): picked mon.noname-a con 0x7f187c08d190 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient(hunting): picked mon.noname-c con 0x7f187c08d5d0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c085ad0 con 0x7f187c08d190 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c085ee0 con 0x7f187c08d5d0 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c08e000 con 0x7f187c08cdc0 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1883052640 10 monclient(hunting): authenticate will time out at 1746.103847s 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1873fff640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f187c08d190 0x7f187c183cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59648/0 (socket says 10.20.193.78:59648) 2026-02-13T18:25:15.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.045+0000 7f1873fff640 1 -- 10.20.193.78:0/199892347 learned_addr learned my addr 10.20.193.78:0/199892347 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1873fff640 1 -- 10.20.193.78:0/199892347 >> v1:10.20.193.78:6789/0 conn(0x7f187c08d190 legacy=0x7f187c183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1880dc7640 1 -- 10.20.193.78:0/199892347 >> v1:10.20.193.78:6790/0 conn(0x7f187c08cdc0 legacy=0x7f187c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18815c8640 1 -- 10.20.193.78:0/199892347 >> v1:10.20.193.187:6789/0 conn(0x7f187c08d5d0 legacy=0x7f187c1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084109204 0 0) 0x7f187c085ad0 con 0x7f187c08d190 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): my global_id is 124389 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1868003620 con 0x7f187c08d190 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039682364 0 0) 0x7f187c08e000 con 0x7f187c08cdc0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): my global_id is 144203 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c085ad0 con 0x7f187c08cdc0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97413114 0 0) 0x7f18780041c0 con 0x7f187c08d5d0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient(hunting): my global_id is 134323 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c08e000 con 0x7f187c08d5d0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3690807775 0 0) 0x7f1868003620 con 0x7f187c08d190 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 >> v1:10.20.193.78:6790/0 conn(0x7f187c08cdc0 legacy=0x7f187c08c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 >> v1:10.20.193.187:6789/0 conn(0x7f187c08d5d0 legacy=0x7f187c1a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 monclient: found mon.noname-a 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c086f80 con 0x7f187c08d190 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1864003110 con 0x7f187c08d190 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: dump: 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 5 monclient: authenticate success, global_id 124389 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18640033e0 con 0x7f187c08d190 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 1 -- 10.20.193.78:0/199892347 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f1864004b50 con 0x7f187c08d190 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f18737fe640 10 monclient: dump: 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:15.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 4 set_mon_vals no callback set 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: shutdown 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- 10.20.193.78:0/199892347 >> v1:10.20.193.78:6789/0 conn(0x7f187c08d190 legacy=0x7f187c183cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- 10.20.193.78:0/199892347 shutdown_connections 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- 10.20.193.78:0/199892347 >> 10.20.193.78:0/199892347 conn(0x7f187c091720 msgr2=0x7f187c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- 10.20.193.78:0/199892347 shutdown_connections 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- 10.20.193.78:0/199892347 wait complete. 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: monmap: 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 Processor -- start 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- start start 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: init 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient(hunting): picked mon.noname-b con 0x7f187c08cdc0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient(hunting): picked mon.noname-c con 0x7f187c08d190 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient(hunting): picked mon.noname-a con 0x7f187c08d5d0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c0829a0 con 0x7f187c08d5d0 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c086990 con 0x7f187c08cdc0 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c0814b0 con 0x7f187c08d190 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.049+0000 7f1883052640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient(hunting): authenticate will time out at 1746.108005s 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1873fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f187c08d190 0x7f187c080100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33624/0 (socket says 10.20.193.78:33624) 2026-02-13T18:25:15.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1873fff640 1 -- 10.20.193.78:0/3084618028 learned_addr learned my addr 10.20.193.78:0/3084618028 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1873fff640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.78:6790/0 conn(0x7f187c08d190 legacy=0x7f187c080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18815c8640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.78:6789/0 conn(0x7f187c08d5d0 legacy=0x7f187c080810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1880dc7640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.187:6789/0 conn(0x7f187c08cdc0 legacy=0x7f187c07f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145872839 0 0) 0x7f187c0814b0 con 0x7f187c08d190 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): my global_id is 144206 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f184c003620 con 0x7f187c08d190 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388489862 0 0) 0x7f187c0829a0 con 0x7f187c08d5d0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): my global_id is 124392 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c0814b0 con 0x7f187c08d5d0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865474687 0 0) 0x7f187c086990 con 0x7f187c08cdc0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): my global_id is 134326 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c0829a0 con 0x7f187c08cdc0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1926086220 0 0) 0x7f187c0814b0 con 0x7f187c08d5d0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f187c086990 con 0x7f187c08d5d0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f18780041a0 con 0x7f187c08d5d0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): dump: 2026-02-13T18:25:15.069 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3245312403 0 0) 0x7f184c003620 con 0x7f187c08d190 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f187c0814b0 con 0x7f187c08d190 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f18640048e0 con 0x7f187c08d190 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient(hunting): dump: 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1846511197 0 0) 0x7f187c086990 con 0x7f187c08d5d0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.78:6790/0 conn(0x7f187c08d190 legacy=0x7f187c080100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.187:6789/0 conn(0x7f187c08cdc0 legacy=0x7f187c07f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 monclient: found mon.a 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c083810 con 0x7f187c08d5d0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 5 monclient: authenticate success, global_id 124392 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient: _renew_subs 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f187c082f70 con 0x7f187c08d5d0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient: _renew_subs 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f187c082290 con 0x7f187c08d5d0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1878004f10 con 0x7f187c08d5d0 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f18780052a0 con 0x7f187c08d5d0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 10 monclient: dump: 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1872ffd640 4 set_mon_vals no callback set 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c005130 con 0x7f187c08d5d0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f1878005530 con 0x7f187c08d5d0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f187804d920 con 0x7f187c08d5d0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.053+0000 7f1880dc7640 10 monclient: get_auth_request con 0x7f184c03d5b0 auth_method 0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.057+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f187c085ee0 con 0x7f187c08d5d0 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.057+0000 7f18717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.057+0000 7f18717fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:15.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f183c002bf0 con 0x7f184c03d5b0 2026-02-13T18:25:15.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f18717fa640 1 -- 10.20.193.78:0/3084618028 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f183c002bf0 con 0x7f184c03d5b0 2026-02-13T18:25:15.160 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 3 to deep-scrub 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.187:6812/2668687789 conn(0x7f184c03d5b0 legacy=0x7f184c05da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 10 monclient: shutdown 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 >> v1:10.20.193.78:6789/0 conn(0x7f187c08d5d0 legacy=0x7f187c080810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 shutdown_connections 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 >> 10.20.193.78:0/3084618028 conn(0x7f187c091720 msgr2=0x7f187c08ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 shutdown_connections 2026-02-13T18:25:15.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.145+0000 7f1883052640 1 -- 10.20.193.78:0/3084618028 wait complete. 2026-02-13T18:25:15.170 INFO:tasks.ceph:Scrubbing osd.4 2026-02-13T18:25:15.170 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-13T18:25:15.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient: get_monmap_and_config 2026-02-13T18:25:15.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient: monmap: 2026-02-13T18:25:15.231 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.231 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:15.218936+0000 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:15.218936+0000 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 1 Processor -- start 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 1 -- start start 2026-02-13T18:25:15.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient: init 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient(hunting): picked mon.noname-c con 0x7fb8ec142a60 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient(hunting): picked mon.noname-b con 0x7fb8ec095530 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient(hunting): picked mon.noname-a con 0x7fb8ec143540 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec092340 con 0x7fb8ec143540 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec0908b0 con 0x7fb8ec142a60 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec091070 con 0x7fb8ec095530 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f32c2640 10 monclient(hunting): authenticate will time out at 1746.274522s 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f0836640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb8ec095530 0x7fb8ec183f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33628/0 (socket says 10.20.193.78:33628) 2026-02-13T18:25:15.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.217+0000 7fb8f0836640 1 -- 10.20.193.78:0/1661093991 learned_addr learned my addr 10.20.193.78:0/1661093991 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f0836640 1 -- 10.20.193.78:0/1661093991 >> v1:10.20.193.78:6790/0 conn(0x7fb8ec095530 legacy=0x7fb8ec183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f1838640 1 -- 10.20.193.78:0/1661093991 >> v1:10.20.193.78:6789/0 conn(0x7fb8ec143540 legacy=0x7fb8ec1a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178093408 0 0) 0x7fb8ec091070 con 0x7fb8ec095530 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): my global_id is 144209 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8d4003620 con 0x7fb8ec095530 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170958395 0 0) 0x7fb8ec092340 con 0x7fb8ec143540 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient(hunting): my global_id is 124395 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8ec091070 con 0x7fb8ec143540 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f1037640 1 -- 10.20.193.78:0/1661093991 >> v1:10.20.193.187:6789/0 conn(0x7fb8ec142a60 legacy=0x7fb8ec142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039316107 0 0) 0x7fb8d4003620 con 0x7fb8ec095530 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 >> v1:10.20.193.187:6789/0 conn(0x7fb8ec142a60 legacy=0x7fb8ec142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 >> v1:10.20.193.78:6789/0 conn(0x7fb8ec143540 legacy=0x7fb8ec1a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 monclient: found mon.noname-b 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec091350 con 0x7fb8ec095530 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb8e0003110 con 0x7fb8ec095530 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 5 monclient: authenticate success, global_id 144209 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: dump: 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8e00033e0 con 0x7fb8ec095530 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 1 -- 10.20.193.78:0/1661093991 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb8e0004b50 con 0x7fb8ec095530 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8dbfff640 10 monclient: dump: 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.236 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 4 set_mon_vals no callback set 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: shutdown 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1661093991 >> v1:10.20.193.78:6790/0 conn(0x7fb8ec095530 legacy=0x7fb8ec183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1661093991 shutdown_connections 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1661093991 >> 10.20.193.78:0/1661093991 conn(0x7fb8ec0545d0 msgr2=0x7fb8ec0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1661093991 shutdown_connections 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1661093991 wait complete. 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: monmap: 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:15.237 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 Processor -- start 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- start start 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: init 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient(hunting): picked mon.noname-a con 0x7fb8ec095530 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient(hunting): picked mon.noname-c con 0x7fb8ec142a60 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient(hunting): picked mon.noname-b con 0x7fb8ec143540 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec132880 con 0x7fb8ec095530 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec132b60 con 0x7fb8ec143540 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec131cf0 con 0x7fb8ec142a60 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f32c2640 10 monclient(hunting): authenticate will time out at 1746.279123s 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f0836640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fb8ec142a60 0x7fb8ec12f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33640/0 (socket says 10.20.193.78:33640) 2026-02-13T18:25:15.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.221+0000 7fb8f0836640 1 -- 10.20.193.78:0/1620443886 learned_addr learned my addr 10.20.193.78:0/1620443886 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f0836640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.78:6790/0 conn(0x7fb8ec142a60 legacy=0x7fb8ec12f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f1037640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.78:6789/0 conn(0x7fb8ec095530 legacy=0x7fb8ec12ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770392944 0 0) 0x7fb8ec131cf0 con 0x7fb8ec142a60 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): my global_id is 144212 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8bc003620 con 0x7fb8ec142a60 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942339722 0 0) 0x7fb8ec132880 con 0x7fb8ec095530 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): my global_id is 124398 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8ec131cf0 con 0x7fb8ec095530 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f1838640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.187:6789/0 conn(0x7fb8ec143540 legacy=0x7fb8ec1960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2774976489 0 0) 0x7fb8bc003620 con 0x7fb8ec142a60 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8ec132880 con 0x7fb8ec142a60 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb8e0002b70 con 0x7fb8ec142a60 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:15.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4285227189 0 0) 0x7fb8ec131cf0 con 0x7fb8ec095530 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8bc003620 con 0x7fb8ec095530 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb8dc003380 con 0x7fb8ec095530 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 737091543 0 0) 0x7fb8ec132880 con 0x7fb8ec142a60 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.187:6789/0 conn(0x7fb8ec143540 legacy=0x7fb8ec1960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.78:6789/0 conn(0x7fb8ec095530 legacy=0x7fb8ec12ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 monclient: found mon.c 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec130800 con 0x7fb8ec142a60 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 5 monclient: authenticate success, global_id 144212 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 10 monclient: _renew_subs 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec131360 con 0x7fb8ec142a60 2026-02-13T18:25:15.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 10 monclient: _renew_subs 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8ec12fb60 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8e00033e0 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fb8e0005320 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8db7fe640 4 set_mon_vals no callback set 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: dump: 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.78:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb8ec057f90 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fb8e00119b0 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fb8e004c4e0 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.187:6807/218078640 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8e0005170 con 0x7fb8bc0622b0 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_get_version_reply(handle=1 version=913) ==== 24+0+0 (unknown 2866522527 0 0) 0x7fb8e004c8d0 con 0x7fb8ec142a60 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8d9ffb640 10 monclient: handle_get_version_reply finishing 1 version 913 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f1037640 10 monclient: get_auth_request con 0x7fb8bc03d650 auth_method 0 2026-02-13T18:25:15.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.225+0000 7fb8f1838640 10 monclient: get_auth_request con 0x7fb8bc0622b0 auth_method 0 2026-02-13T18:25:15.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.233+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== osd.4 v1:10.20.193.187:6807/218078640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fb8e0005170 con 0x7fb8bc0622b0 2026-02-13T18:25:15.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 --> v1:10.20.193.187:6807/218078640 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8ec05dc10 con 0x7fb8bc0622b0 2026-02-13T18:25:15.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8d9ffb640 1 -- 10.20.193.78:0/1620443886 <== osd.4 v1:10.20.193.187:6807/218078640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb8e8004760 con 0x7fb8bc0622b0 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.187:6807/218078640 conn(0x7fb8bc0622b0 legacy=0x7fb8bc0826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.187:6812/2668687789 conn(0x7fb8bc03d650 legacy=0x7fb8bc05db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 10 monclient: shutdown 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 >> v1:10.20.193.78:6790/0 conn(0x7fb8ec142a60 legacy=0x7fb8ec12f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f1838640 1 -- 10.20.193.78:0/1620443886 reap_dead start 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 shutdown_connections 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 >> 10.20.193.78:0/1620443886 conn(0x7fb8ec0545d0 msgr2=0x7fb8ec08a110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 shutdown_connections 2026-02-13T18:25:15.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.237+0000 7fb8f32c2640 1 -- 10.20.193.78:0/1620443886 wait complete. 2026-02-13T18:25:15.262 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 10 monclient: get_monmap_and_config 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 10 monclient: monmap: 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:15.312570+0000 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:15.312570+0000 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:15.325 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 1 Processor -- start 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 1 -- start start 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 10 monclient: init 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.309+0000 7f8aed20b640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient(hunting): picked mon.noname-c con 0x7f8ae813f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient(hunting): picked mon.noname-a con 0x7f8ae8095410 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient(hunting): picked mon.noname-b con 0x7f8ae81851c0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae8140290 con 0x7f8ae8095410 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae8094750 con 0x7f8ae813f7b0 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae8093c80 con 0x7f8ae81851c0 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient(hunting): authenticate will time out at 1746.368097s 2026-02-13T18:25:15.326 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aeca0a640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f8ae81851c0 0x7f8ae81a55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33646/0 (socket says 10.20.193.78:33646) 2026-02-13T18:25:15.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae77fe640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7f8ae8095410 0x7f8ae8183aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59684/0 (socket says 10.20.193.78:59684) 2026-02-13T18:25:15.327 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aeca0a640 1 -- 10.20.193.78:0/995926985 learned_addr learned my addr 10.20.193.78:0/995926985 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aeca0a640 1 -- 10.20.193.78:0/995926985 >> v1:10.20.193.78:6790/0 conn(0x7f8ae81851c0 legacy=0x7f8ae81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.328 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae77fe640 1 -- 10.20.193.78:0/995926985 >> v1:10.20.193.78:6789/0 conn(0x7f8ae8095410 legacy=0x7f8ae8183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae7fff640 1 -- 10.20.193.78:0/995926985 >> v1:10.20.193.187:6789/0 conn(0x7f8ae813f7b0 legacy=0x7f8ae813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744377979 0 0) 0x7f8ae8093c80 con 0x7f8ae81851c0 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): my global_id is 144215 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8acc003620 con 0x7f8ae81851c0 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005801874 0 0) 0x7f8ad8002c60 con 0x7f8ae8095410 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): my global_id is 124401 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae8093c80 con 0x7f8ae8095410 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132825385 0 0) 0x7f8ae8094750 con 0x7f8ae813f7b0 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.329 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient(hunting): my global_id is 134332 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad8002c60 con 0x7f8ae813f7b0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2975980339 0 0) 0x7f8acc003620 con 0x7f8ae81851c0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 >> v1:10.20.193.187:6789/0 conn(0x7f8ae813f7b0 legacy=0x7f8ae813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 >> v1:10.20.193.78:6789/0 conn(0x7f8ae8095410 legacy=0x7f8ae8183aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 monclient: found mon.noname-b 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae8094190 con 0x7f8ae81851c0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 5 monclient: authenticate success, global_id 144215 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8adc004620 con 0x7f8ae81851c0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: dump: 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.2 v1:10.20.193.78:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8adc0048f0 con 0x7f8ae81851c0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 1 -- 10.20.193.78:0/995926985 <== mon.2 v1:10.20.193.78:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8adc006060 con 0x7f8ae81851c0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8ae6ffd640 10 monclient: dump: 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.330 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 4 set_mon_vals no callback set 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient: shutdown 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- 10.20.193.78:0/995926985 >> v1:10.20.193.78:6790/0 conn(0x7f8ae81851c0 legacy=0x7f8ae81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- 10.20.193.78:0/995926985 shutdown_connections 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- 10.20.193.78:0/995926985 >> 10.20.193.78:0/995926985 conn(0x7f8ae8054400 msgr2=0x7f8ae8054800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- 10.20.193.78:0/995926985 shutdown_connections 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 1 -- 10.20.193.78:0/995926985 wait complete. 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.313+0000 7f8aed20b640 10 monclient: monmap: 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 Processor -- start 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 -- start start 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: init 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:15.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient(hunting): picked mon.noname-c con 0x7f8ae8095410 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient(hunting): picked mon.noname-b con 0x7f8ae813f7b0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient(hunting): picked mon.noname-a con 0x7f8ae81851c0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae8111be0 con 0x7f8ae81851c0 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae8110d70 con 0x7f8ae813f7b0 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae810f880 con 0x7f8ae8095410 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient(hunting): authenticate will time out at 1746.372792s 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae7fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f8ae8095410 0x7f8ae813e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33662/0 (socket says 10.20.193.78:33662) 2026-02-13T18:25:15.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae7fff640 1 -- 10.20.193.78:0/3972890042 learned_addr learned my addr 10.20.193.78:0/3972890042 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae7fff640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.78:6790/0 conn(0x7f8ae8095410 legacy=0x7f8ae813e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aeca0a640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.78:6789/0 conn(0x7f8ae81851c0 legacy=0x7f8ae81814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012436196 0 0) 0x7f8ae8111be0 con 0x7f8ae81851c0 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): my global_id is 124404 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab8003620 con 0x7f8ae81851c0 2026-02-13T18:25:15.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632674207 0 0) 0x7f8ae810f880 con 0x7f8ae8095410 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): my global_id is 144218 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae8111be0 con 0x7f8ae8095410 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae77fe640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.187:6789/0 conn(0x7f8ae813f7b0 legacy=0x7f8ae813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1536148241 0 0) 0x7f8ae8111be0 con 0x7f8ae8095410 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ae810f880 con 0x7f8ae8095410 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8ad4003490 con 0x7f8ae8095410 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 901192711 0 0) 0x7f8ab8003620 con 0x7f8ae81851c0 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ae8111be0 con 0x7f8ae81851c0 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8adc004080 con 0x7f8ae81851c0 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.340 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 483573920 0 0) 0x7f8ae810f880 con 0x7f8ae8095410 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.187:6789/0 conn(0x7f8ae813f7b0 legacy=0x7f8ae813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.78:6789/0 conn(0x7f8ae81851c0 legacy=0x7f8ae81814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 monclient: found mon.c 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae8111340 con 0x7f8ae8095410 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 5 monclient: authenticate success, global_id 144218 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: _renew_subs 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae810f1a0 con 0x7f8ae8095410 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: _renew_subs 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ae81105b0 con 0x7f8ae8095410 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ad4003790 con 0x7f8ae8095410 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f8ad4003e60 con 0x7f8ae8095410 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae67fc640 4 set_mon_vals no callback set 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.317+0000 7f8ae4ff9640 10 monclient: dump: 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.343 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8aed20b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8aed20b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8aed20b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae80008e0 con 0x7f8ae8095410 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f8ad40040b0 con 0x7f8ae8095410 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f8ad404c690 con 0x7f8ae8095410 2026-02-13T18:25:15.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8ae77fe640 10 monclient: get_auth_request con 0x7f8ab803d5e0 auth_method 0 2026-02-13T18:25:15.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7f8ad40177b0 con 0x7f8ae8095410 2026-02-13T18:25:15.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8ae4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.321+0000 7f8ae4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:15.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8ae8092cd0 con 0x7f8ab803d5e0 2026-02-13T18:25:15.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8ae4ff9640 1 -- 10.20.193.78:0/3972890042 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f8ae8092cd0 con 0x7f8ab803d5e0 2026-02-13T18:25:15.425 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 4 to deep-scrub 2026-02-13T18:25:15.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.187:6812/2668687789 conn(0x7f8ab803d5e0 legacy=0x7f8ab805da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 10 monclient: shutdown 2026-02-13T18:25:15.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 >> v1:10.20.193.78:6790/0 conn(0x7f8ae8095410 legacy=0x7f8ae813e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 shutdown_connections 2026-02-13T18:25:15.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 >> 10.20.193.78:0/3972890042 conn(0x7f8ae8054400 msgr2=0x7f8ae8089710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 shutdown_connections 2026-02-13T18:25:15.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.409+0000 7f8aed20b640 1 -- 10.20.193.78:0/3972890042 wait complete. 2026-02-13T18:25:15.436 INFO:tasks.ceph:Scrubbing osd.5 2026-02-13T18:25:15.436 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-13T18:25:15.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.489+0000 7f14043a4640 10 monclient: get_monmap_and_config 2026-02-13T18:25:15.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.489+0000 7f14043a4640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.489+0000 7f14043a4640 10 monclient: monmap: 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:15.493466+0000 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:15.493466+0000 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:15.507 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 1 Processor -- start 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 1 -- start start 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient: init 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient(hunting): picked mon.noname-a con 0x7f13fc08ca90 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient(hunting): picked mon.noname-b con 0x7f13fc08d570 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient(hunting): picked mon.noname-c con 0x7f13fc1834e0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc08b040 con 0x7f13fc08ca90 2026-02-13T18:25:15.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc086710 con 0x7f13fc1834e0 2026-02-13T18:25:15.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc088740 con 0x7f13fc08d570 2026-02-13T18:25:15.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient(hunting): authenticate will time out at 1746.548982s 2026-02-13T18:25:15.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401918640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f13fc08d570 0x7f13fc181dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33678/0 (socket says 10.20.193.78:33678) 2026-02-13T18:25:15.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401918640 1 -- 10.20.193.78:0/1341416397 learned_addr learned my addr 10.20.193.78:0/1341416397 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401918640 1 -- 10.20.193.78:0/1341416397 >> v1:10.20.193.78:6790/0 conn(0x7f13fc08d570 legacy=0x7f13fc181dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1402119640 1 -- 10.20.193.78:0/1341416397 >> v1:10.20.193.78:6789/0 conn(0x7f13fc08ca90 legacy=0x7f13fc08ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f140291a640 1 -- 10.20.193.78:0/1341416397 >> v1:10.20.193.187:6789/0 conn(0x7f13fc1834e0 legacy=0x7f13fc1a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476067948 0 0) 0x7f13fc08b040 con 0x7f13fc08ca90 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): my global_id is 124407 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e4003620 con 0x7f13fc08ca90 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366056212 0 0) 0x7f13fc088740 con 0x7f13fc08d570 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): my global_id is 144221 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13fc08b040 con 0x7f13fc08d570 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782538255 0 0) 0x7f13fc086710 con 0x7f13fc1834e0 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient(hunting): my global_id is 134338 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13fc088740 con 0x7f13fc1834e0 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1628117845 0 0) 0x7f13e4003620 con 0x7f13fc08ca90 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 >> v1:10.20.193.78:6790/0 conn(0x7f13fc08d570 legacy=0x7f13fc181dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 >> v1:10.20.193.187:6789/0 conn(0x7f13fc1834e0 legacy=0x7f13fc1a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 monclient: found mon.noname-a 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc086430 con 0x7f13fc08ca90 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f13ec003160 con 0x7f13fc08ca90 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 5 monclient: authenticate success, global_id 124407 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: dump: 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.522 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13ec003430 con 0x7f13fc08ca90 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 1 -- 10.20.193.78:0/1341416397 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f13ec0038c0 con 0x7f13fc08ca90 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f1401117640 10 monclient: dump: 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.523 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.493+0000 7f14043a4640 4 set_mon_vals no callback set 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient: shutdown 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- 10.20.193.78:0/1341416397 >> v1:10.20.193.78:6789/0 conn(0x7f13fc08ca90 legacy=0x7f13fc08ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- 10.20.193.78:0/1341416397 shutdown_connections 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- 10.20.193.78:0/1341416397 >> 10.20.193.78:0/1341416397 conn(0x7f13fc091800 msgr2=0x7f13fc091c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- 10.20.193.78:0/1341416397 shutdown_connections 2026-02-13T18:25:15.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- 10.20.193.78:0/1341416397 wait complete. 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient: monmap: 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:15.525 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 Processor -- start 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- start start 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient: init 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient(hunting): picked mon.noname-b con 0x7f13fc08ca90 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient(hunting): picked mon.noname-c con 0x7f13fc08d570 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient(hunting): picked mon.noname-a con 0x7f13fc1834e0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc080f50 con 0x7f13fc1834e0 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc05d590 con 0x7f13fc08ca90 2026-02-13T18:25:15.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc058900 con 0x7f13fc08d570 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f14043a4640 10 monclient(hunting): authenticate will time out at 1746.553688s 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f1401918640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7f13fc08d570 0x7f13fc1722f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33694/0 (socket says 10.20.193.78:33694) 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f1401918640 1 -- 10.20.193.78:0/637442697 learned_addr learned my addr 10.20.193.78:0/637442697 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f140291a640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.78:6789/0 conn(0x7f13fc1834e0 legacy=0x7f13fc173a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f1401918640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.78:6790/0 conn(0x7f13fc08d570 legacy=0x7f13fc1722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f1402119640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.187:6789/0 conn(0x7f13fc08ca90 legacy=0x7f13fc1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.497+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163793427 0 0) 0x7f13fc080f50 con 0x7f13fc1834e0 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): my global_id is 124410 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003620 con 0x7f13fc1834e0 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886375659 0 0) 0x7f13fc058900 con 0x7f13fc08d570 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): my global_id is 144224 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13fc080f50 con 0x7f13fc08d570 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393499559 0 0) 0x7f13fc05d590 con 0x7f13fc08ca90 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): my global_id is 134341 2026-02-13T18:25:15.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13fc058900 con 0x7f13fc08ca90 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4147340504 0 0) 0x7f13cc003620 con 0x7f13fc1834e0 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13fc05d590 con 0x7f13fc1834e0 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f13f80048d0 con 0x7f13fc1834e0 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): dump: 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.529 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3389463532 0 0) 0x7f13fc080f50 con 0x7f13fc08d570 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13cc003620 con 0x7f13fc08d570 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f13f00048e0 con 0x7f13fc08d570 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient(hunting): dump: 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.530 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.1 v1:10.20.193.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1584066854 0 0) 0x7f13fc058900 con 0x7f13fc08ca90 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.187:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13fc080f50 con 0x7f13fc08ca90 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3580022113 0 0) 0x7f13fc05d590 con 0x7f13fc1834e0 2026-02-13T18:25:15.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.78:6790/0 conn(0x7f13fc08d570 legacy=0x7f13fc1722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.187:6789/0 conn(0x7f13fc08ca90 legacy=0x7f13fc1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 monclient: found mon.a 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc080c70 con 0x7f13fc1834e0 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 5 monclient: authenticate success, global_id 124410 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 10 monclient: _renew_subs 2026-02-13T18:25:15.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc07f750 con 0x7f13fc1834e0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 10 monclient: _renew_subs 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f13fc07e140 con 0x7f13fc1834e0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13f8004ed0 con 0x7f13fc1834e0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7f13f8005260 con 0x7f13fc1834e0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: dump: 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.533 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f1400916640 4 set_mon_vals no callback set 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.78:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f13fc0889f0 con 0x7f13fc1834e0 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7f13f8005400 con 0x7f13fc1834e0 2026-02-13T18:25:15.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7f13f804d8e0 con 0x7f13fc1834e0 2026-02-13T18:25:15.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.187:6804/1501659775 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13f80050b0 con 0x7f13cc062520 2026-02-13T18:25:15.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_get_version_reply(handle=1 version=913) ==== 24+0+0 (unknown 2866522527 0 0) 0x7f13f804dcd0 con 0x7f13fc1834e0 2026-02-13T18:25:15.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f13e2ffd640 10 monclient: handle_get_version_reply finishing 1 version 913 2026-02-13T18:25:15.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f1402119640 10 monclient: get_auth_request con 0x7f13cc03d910 auth_method 0 2026-02-13T18:25:15.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.501+0000 7f1401918640 10 monclient: get_auth_request con 0x7f13cc062520 auth_method 0 2026-02-13T18:25:15.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.505+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== osd.5 v1:10.20.193.187:6804/1501659775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f13f80050b0 con 0x7f13cc062520 2026-02-13T18:25:15.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 --> v1:10.20.193.187:6804/1501659775 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f13fc080840 con 0x7f13cc062520 2026-02-13T18:25:15.536 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f13e2ffd640 1 -- 10.20.193.78:0/637442697 <== osd.5 v1:10.20.193.187:6804/1501659775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f13fc080840 con 0x7f13cc062520 2026-02-13T18:25:15.536 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T18:25:15.536 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T18:25:15.537 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T18:25:15.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.187:6804/1501659775 conn(0x7f13cc062520 legacy=0x7f13cc082930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.187:6812/2668687789 conn(0x7f13cc03d910 legacy=0x7f13cc05ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 10 monclient: shutdown 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 >> v1:10.20.193.78:6789/0 conn(0x7f13fc1834e0 legacy=0x7f13fc173a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f140291a640 1 -- 10.20.193.78:0/637442697 reap_dead start 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 shutdown_connections 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 >> 10.20.193.78:0/637442697 conn(0x7f13fc091800 msgr2=0x7f13fc0578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 shutdown_connections 2026-02-13T18:25:15.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.513+0000 7f14043a4640 1 -- 10.20.193.78:0/637442697 wait complete. 2026-02-13T18:25:15.540 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-13T18:25:15.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient: get_monmap_and_config 2026-02-13T18:25:15.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient: monmap: 2026-02-13T18:25:15.610 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.610 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:15.596058+0000 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:15.596058+0000 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 1 Processor -- start 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 1 -- start start 2026-02-13T18:25:15.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient: init 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient(hunting): picked mon.noname-b con 0x7fd0d405e570 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient(hunting): picked mon.noname-c con 0x7fd0d408cad0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient(hunting): picked mon.noname-a con 0x7fd0d408cf30 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d405e940 con 0x7fd0d408cf30 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d408e000 con 0x7fd0d408cad0 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d4084e70 con 0x7fd0d405e570 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d8804640 10 monclient(hunting): authenticate will time out at 1746.651180s 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d2575640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd0d405e570 0x7fd0d408c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33698/0 (socket says 10.20.193.78:33698) 2026-02-13T18:25:15.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.593+0000 7fd0d2575640 1 -- 10.20.193.78:0/810701701 learned_addr learned my addr 10.20.193.78:0/810701701 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d2575640 1 -- 10.20.193.78:0/810701701 >> v1:10.20.193.78:6790/0 conn(0x7fd0d405e570 legacy=0x7fd0d408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d2d76640 1 -- 10.20.193.78:0/810701701 >> v1:10.20.193.78:6789/0 conn(0x7fd0d408cf30 legacy=0x7fd0d41aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1d74640 1 -- 10.20.193.78:0/810701701 >> v1:10.20.193.187:6789/0 conn(0x7fd0d408cad0 legacy=0x7fd0d4188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184440764 0 0) 0x7fd0d405e940 con 0x7fd0d408cf30 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): my global_id is 124413 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c0003620 con 0x7fd0d408cf30 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452639465 0 0) 0x7fd0d4084e70 con 0x7fd0d405e570 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient(hunting): my global_id is 144227 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d405e940 con 0x7fd0d405e570 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489980827 0 0) 0x7fd0c0003620 con 0x7fd0d408cf30 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 >> v1:10.20.193.78:6790/0 conn(0x7fd0d405e570 legacy=0x7fd0d408c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 >> v1:10.20.193.187:6789/0 conn(0x7fd0d408cad0 legacy=0x7fd0d4188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 monclient: found mon.noname-a 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d40845d0 con 0x7fd0d408cf30 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 5 monclient: authenticate success, global_id 124413 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0c4004670 con 0x7fd0d408cf30 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: dump: 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.622 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0c4004940 con 0x7fd0d408cf30 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 1 -- 10.20.193.78:0/810701701 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0c4004dd0 con 0x7fd0d408cf30 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d1573640 10 monclient: dump: 2026-02-13T18:25:15.623 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 4 set_mon_vals no callback set 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: shutdown 2026-02-13T18:25:15.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- 10.20.193.78:0/810701701 >> v1:10.20.193.78:6789/0 conn(0x7fd0d408cf30 legacy=0x7fd0d41aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- 10.20.193.78:0/810701701 shutdown_connections 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- 10.20.193.78:0/810701701 >> 10.20.193.78:0/810701701 conn(0x7fd0d4091720 msgr2=0x7fd0d4091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- 10.20.193.78:0/810701701 shutdown_connections 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- 10.20.193.78:0/810701701 wait complete. 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: monmap: 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.625 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 Processor -- start 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- start start 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: init 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient(hunting): picked mon.noname-a con 0x7fd0d405e570 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient(hunting): picked mon.noname-c con 0x7fd0d408cad0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient(hunting): picked mon.noname-b con 0x7fd0d408cf30 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d405d4f0 con 0x7fd0d405e570 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d405a4f0 con 0x7fd0d408cf30 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d4088910 con 0x7fd0d408cad0 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d8804640 10 monclient(hunting): authenticate will time out at 1746.655832s 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d2575640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd0d405e570 0x7fd0d40596d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59740/0 (socket says 10.20.193.78:59740) 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.597+0000 7fd0d2575640 1 -- 10.20.193.78:0/2598755615 learned_addr learned my addr 10.20.193.78:0/2598755615 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d2575640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.78:6789/0 conn(0x7fd0d405e570 legacy=0x7fd0d40596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d1d74640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.78:6790/0 conn(0x7fd0d408cad0 legacy=0x7fd0d4059de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313134601 0 0) 0x7fd0d405d4f0 con 0x7fd0d405e570 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): my global_id is 124416 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a0003620 con 0x7fd0d405e570 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694244817 0 0) 0x7fd0d4088910 con 0x7fd0d408cad0 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): my global_id is 144230 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d405d4f0 con 0x7fd0d408cad0 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2024241972 0 0) 0x7fd0a0003620 con 0x7fd0d405e570 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0d4088910 con 0x7fd0d405e570 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0c80033a0 con 0x7fd0d405e570 2026-02-13T18:25:15.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): dump: 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.629 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d2d76640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.187:6789/0 conn(0x7fd0d408cf30 legacy=0x7fd0d4240ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3348669107 0 0) 0x7fd0d405d4f0 con 0x7fd0d408cad0 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0a0003620 con 0x7fd0d408cad0 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0bc003380 con 0x7fd0d408cad0 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient(hunting): dump: 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.630 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 280614978 0 0) 0x7fd0d4088910 con 0x7fd0d405e570 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.78:6790/0 conn(0x7fd0d408cad0 legacy=0x7fd0d4059de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.187:6789/0 conn(0x7fd0d408cf30 legacy=0x7fd0d4240ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 monclient: found mon.a 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d405c680 con 0x7fd0d405e570 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 5 monclient: authenticate success, global_id 124416 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 monclient: _renew_subs 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d405b190 con 0x7fd0d405e570 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 monclient: _renew_subs 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0d405bf50 con 0x7fd0d405e570 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0c8004b90 con 0x7fd0d405e570 2026-02-13T18:25:15.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd0c8004ef0 con 0x7fd0d405e570 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 10 monclient: dump: 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.633 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d0d72640 4 set_mon_vals no callback set 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd0c80050d0 con 0x7fd0d405e570 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d408f620 con 0x7fd0d405e570 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fd0c804c5e0 con 0x7fd0d405e570 2026-02-13T18:25:15.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.601+0000 7fd0d1d74640 10 monclient: get_auth_request con 0x7fd0a003d690 auth_method 0 2026-02-13T18:25:15.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.605+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fd0d408f620 con 0x7fd0d405e570 2026-02-13T18:25:15.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.605+0000 7fd0baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.605+0000 7fd0baffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:15.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.689+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd0d408b440 con 0x7fd0a003d690 2026-02-13T18:25:15.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.689+0000 7fd0baffd640 1 -- 10.20.193.78:0/2598755615 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fd0d408b440 con 0x7fd0a003d690 2026-02-13T18:25:15.707 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 5 to deep-scrub 2026-02-13T18:25:15.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd0a003d690 legacy=0x7fd0a005db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 10 monclient: shutdown 2026-02-13T18:25:15.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 >> v1:10.20.193.78:6789/0 conn(0x7fd0d405e570 legacy=0x7fd0d40596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 shutdown_connections 2026-02-13T18:25:15.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 >> 10.20.193.78:0/2598755615 conn(0x7fd0d4091720 msgr2=0x7fd0d408e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 shutdown_connections 2026-02-13T18:25:15.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.693+0000 7fd0d8804640 1 -- 10.20.193.78:0/2598755615 wait complete. 2026-02-13T18:25:15.717 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:25:15.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient: get_monmap_and_config 2026-02-13T18:25:15.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient: monmap: 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:15.775473+0000 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:15.775473+0000 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:15.789 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 1 Processor -- start 2026-02-13T18:25:15.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 1 -- start start 2026-02-13T18:25:15.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient: init 2026-02-13T18:25:15.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient(hunting): picked mon.noname-a con 0x7fe47c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient(hunting): picked mon.noname-b con 0x7fe47c08dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient(hunting): picked mon.noname-c con 0x7fe47c08cdd0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c089e80 con 0x7fe47c08c2f0 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c088c20 con 0x7fe47c08cdd0 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c089ba0 con 0x7fe47c08dc80 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe48169c640 10 monclient(hunting): authenticate will time out at 1746.830638s 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe47a7fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe47c08dc80 0x7fe47c181ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33714/0 (socket says 10.20.193.78:33714) 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe47a7fc640 1 -- 10.20.193.78:0/449295610 learned_addr learned my addr 10.20.193.78:0/449295610 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.773+0000 7fe47affd640 1 --1- 10.20.193.78:0/449295610 >> v1:10.20.193.78:6789/0 conn(0x7fe47c08c2f0 0x7fe47c08c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59756/0 (socket says 10.20.193.78:59756) 2026-02-13T18:25:15.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe47a7fc640 1 -- 10.20.193.78:0/449295610 >> v1:10.20.193.78:6790/0 conn(0x7fe47c08dc80 legacy=0x7fe47c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe47affd640 1 -- 10.20.193.78:0/449295610 >> v1:10.20.193.78:6789/0 conn(0x7fe47c08c2f0 legacy=0x7fe47c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe47b7fe640 1 -- 10.20.193.78:0/449295610 >> v1:10.20.193.187:6789/0 conn(0x7fe47c08cdd0 legacy=0x7fe47c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134666512 0 0) 0x7fe47c089e80 con 0x7fe47c08c2f0 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): my global_id is 124419 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe468003620 con 0x7fe47c08c2f0 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534994986 0 0) 0x7fe47c089ba0 con 0x7fe47c08dc80 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.796 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): my global_id is 144233 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe47c089e80 con 0x7fe47c08dc80 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47378559 0 0) 0x7fe47c088c20 con 0x7fe47c08cdd0 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient(hunting): my global_id is 134350 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe47c089ba0 con 0x7fe47c08cdd0 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1650195799 0 0) 0x7fe468003620 con 0x7fe47c08c2f0 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 >> v1:10.20.193.78:6790/0 conn(0x7fe47c08dc80 legacy=0x7fe47c181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 >> v1:10.20.193.187:6789/0 conn(0x7fe47c08cdd0 legacy=0x7fe47c1a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.797 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 monclient: found mon.noname-a 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c08d370 con 0x7fe47c08c2f0 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe470003110 con 0x7fe47c08c2f0 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: dump: 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.798 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 5 monclient: authenticate success, global_id 124419 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4700033e0 con 0x7fe47c08c2f0 2026-02-13T18:25:15.799 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 1 -- 10.20.193.78:0/449295610 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe470004a90 con 0x7fe47c08c2f0 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe479ffb640 10 monclient: dump: 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.800 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 4 set_mon_vals no callback set 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: shutdown 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- 10.20.193.78:0/449295610 >> v1:10.20.193.78:6789/0 conn(0x7fe47c08c2f0 legacy=0x7fe47c08c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- 10.20.193.78:0/449295610 shutdown_connections 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- 10.20.193.78:0/449295610 >> 10.20.193.78:0/449295610 conn(0x7fe47c091720 msgr2=0x7fe47c091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- 10.20.193.78:0/449295610 shutdown_connections 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- 10.20.193.78:0/449295610 wait complete. 2026-02-13T18:25:15.801 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: build_initial_monmap 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: monmap: 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 Processor -- start 2026-02-13T18:25:15.802 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- start start 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: init 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient(hunting): picked mon.noname-a con 0x7fe47c08c2f0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient(hunting): picked mon.noname-c con 0x7fe47c08cdd0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient(hunting): picked mon.noname-b con 0x7fe47c08dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c081160 con 0x7fe47c08c2f0 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c0823b0 con 0x7fe47c08dc80 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c130b10 con 0x7fe47c08cdd0 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe48169c640 10 monclient(hunting): authenticate will time out at 1746.835269s 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe47affd640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fe47c08c2f0 0x7fe47c12fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:59758/0 (socket says 10.20.193.78:59758) 2026-02-13T18:25:15.803 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe47a7fc640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fe47c08cdd0 0x7fe47c130400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:33724/0 (socket says 10.20.193.78:33724) 2026-02-13T18:25:15.804 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.777+0000 7fe47affd640 1 -- 10.20.193.78:0/1285936348 learned_addr learned my addr 10.20.193.78:0/1285936348 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe47affd640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.78:6789/0 conn(0x7fe47c08c2f0 legacy=0x7fe47c12fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe47a7fc640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.78:6790/0 conn(0x7fe47c08cdd0 legacy=0x7fe47c130400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509521126 0 0) 0x7fe47c081160 con 0x7fe47c08c2f0 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): my global_id is 124422 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe448003620 con 0x7fe47c08c2f0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952136739 0 0) 0x7fe47c130b10 con 0x7fe47c08cdd0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _negotiate 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): my global_id is 144236 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe47c081160 con 0x7fe47c08cdd0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe47b7fe640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.187:6789/0 conn(0x7fe47c08dc80 legacy=0x7fe47c1a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1283611401 0 0) 0x7fe448003620 con 0x7fe47c08c2f0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe47c130b10 con 0x7fe47c08c2f0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe4700048e0 con 0x7fe47c08c2f0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): dump: 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.809 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3846089383 0 0) 0x7fe47c081160 con 0x7fe47c08cdd0 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe448003620 con 0x7fe47c08cdd0 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe464003320 con 0x7fe47c08cdd0 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient(hunting): dump: 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.810 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1404620593 0 0) 0x7fe47c130b10 con 0x7fe47c08c2f0 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.78:6790/0 conn(0x7fe47c08cdd0 legacy=0x7fe47c130400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.187:6789/0 conn(0x7fe47c08dc80 legacy=0x7fe47c1a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: _finish_hunting 0 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 monclient: found mon.a 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c080e90 con 0x7fe47c08c2f0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: _finish_auth 0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: _check_auth_tickets 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 5 monclient: authenticate success, global_id 124422 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 monclient: _renew_subs 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe47c057680 con 0x7fe47c08c2f0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 monclient: _renew_subs 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe47c088910 con 0x7fe47c08c2f0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4700033e0 con 0x7fe47c08c2f0 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:15.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fe470004fe0 con 0x7fe47c08c2f0 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 10 monclient: dump: 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:15.813 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe4797fa640 4 set_mon_vals no callback set 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47c08f620 con 0x7fe47c08c2f0 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fe4700052b0 con 0x7fe47c08c2f0 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fe47004c580 con 0x7fe47c08c2f0 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.781+0000 7fe47a7fc640 10 monclient: get_auth_request con 0x7fe44803d6a0 auth_method 0 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.785+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fe47c08f620 con 0x7fe47c08c2f0 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.785+0000 7fe45b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:15.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.785+0000 7fe45b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:15.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe47c0821f0 con 0x7fe44803d6a0 2026-02-13T18:25:15.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe45b7fe640 1 -- 10.20.193.78:0/1285936348 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34071 (unknown 2965378022 0 1838238276) 0x7fe464007a20 con 0x7fe44803d6a0 2026-02-13T18:25:15.885 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.187:6812/2668687789 conn(0x7fe44803d6a0 legacy=0x7fe44805db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 10 monclient: shutdown 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 >> v1:10.20.193.78:6789/0 conn(0x7fe47c08c2f0 legacy=0x7fe47c12fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 shutdown_connections 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 >> 10.20.193.78:0/1285936348 conn(0x7fe47c091720 msgr2=0x7fe47c057bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:15.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 shutdown_connections 2026-02-13T18:25:15.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:15.869+0000 7fe48169c640 1 -- 10.20.193.78:0/1285936348 wait complete. 2026-02-13T18:25:15.895 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":1502,"stamp":"2026-02-13T18:25:15.868511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":266248,"kb_used_data":14248,"kb_used_omap":10614,"kb_used_meta":241289,"kb_avail":565964792,"statfs":{"total":579820584960,"available":579547947008,"internally_reserved":0,"allocated":14589952,"data_stored":9007960,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":10869217,"internal_metadata":247080479},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001001"},"pg_stats":[{"pgid":"1.0","version":"13'112","reported_seq":1929,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311997+0000","last_change":"2026-02-13T18:05:27.473237+0000","last_active":"2026-02-13T18:24:07.311997+0000","last_peered":"2026-02-13T18:24:07.311997+0000","last_clean":"2026-02-13T18:24:07.311997+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:24:07.311997+0000","last_undegraded":"2026-02-13T18:24:07.311997+0000","last_fullsized":"2026-02-13T18:24:07.311997+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:26.464567+0000","last_clean_scrub_stamp":"2026-02-13T18:05:26.464567+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:54:33.794369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1797,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025579+0000","last_change":"2026-02-13T18:05:33.232513+0000","last_active":"2026-02-13T18:24:08.025579+0000","last_peered":"2026-02-13T18:24:08.025579+0000","last_clean":"2026-02-13T18:24:08.025579+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:24:08.025579+0000","last_undegraded":"2026-02-13T18:24:08.025579+0000","last_fullsized":"2026-02-13T18:24:08.025579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:19:19.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311554+0000","last_change":"2026-02-13T18:05:33.230916+0000","last_active":"2026-02-13T18:24:07.311554+0000","last_peered":"2026-02-13T18:24:07.311554+0000","last_clean":"2026-02-13T18:24:07.311554+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:24:07.311554+0000","last_undegraded":"2026-02-13T18:24:07.311554+0000","last_fullsized":"2026-02-13T18:24:07.311554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:58:53.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1798,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:15.410717+0000","last_change":"2026-02-13T18:25:15.410717+0000","last_active":"2026-02-13T18:25:15.410717+0000","last_peered":"2026-02-13T18:25:15.410717+0000","last_clean":"2026-02-13T18:25:15.410717+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:25:15.410717+0000","last_undegraded":"2026-02-13T18:25:15.410717+0000","last_fullsized":"2026-02-13T18:25:15.410717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:15.410655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:15.410655+0000","last_clean_scrub_stamp":"2026-02-13T18:25:15.410655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:07:21.030642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1798,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:08.025826+0000","last_change":"2026-02-13T18:05:33.232853+0000","last_active":"2026-02-13T18:24:08.025826+0000","last_peered":"2026-02-13T18:24:08.025826+0000","last_clean":"2026-02-13T18:24:08.025826+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:24:08.025826+0000","last_undegraded":"2026-02-13T18:24:08.025826+0000","last_fullsized":"2026-02-13T18:24:08.025826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:24:25.248456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483577+0000","last_change":"2026-02-13T18:05:33.228859+0000","last_active":"2026-02-13T18:24:06.483577+0000","last_peered":"2026-02-13T18:24:06.483577+0000","last_clean":"2026-02-13T18:24:06.483577+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:24:06.483577+0000","last_undegraded":"2026-02-13T18:24:06.483577+0000","last_fullsized":"2026-02-13T18:24:06.483577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:48:55.234222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311517+0000","last_change":"2026-02-13T18:05:33.230715+0000","last_active":"2026-02-13T18:24:07.311517+0000","last_peered":"2026-02-13T18:24:07.311517+0000","last_clean":"2026-02-13T18:24:07.311517+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:24:07.311517+0000","last_undegraded":"2026-02-13T18:24:07.311517+0000","last_fullsized":"2026-02-13T18:24:07.311517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:38:29.059854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:06.483536+0000","last_change":"2026-02-13T18:05:33.228821+0000","last_active":"2026-02-13T18:24:06.483536+0000","last_peered":"2026-02-13T18:24:06.483536+0000","last_clean":"2026-02-13T18:24:06.483536+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:24:06.483536+0000","last_undegraded":"2026-02-13T18:24:06.483536+0000","last_fullsized":"2026-02-13T18:24:06.483536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:11:05.338022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1792,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:24:07.311428+0000","last_change":"2026-02-13T18:05:33.230679+0000","last_active":"2026-02-13T18:24:07.311428+0000","last_peered":"2026-02-13T18:24:07.311428+0000","last_clean":"2026-02-13T18:24:07.311428+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:24:07.311428+0000","last_undegraded":"2026-02-13T18:24:07.311428+0000","last_fullsized":"2026-02-13T18:24:07.311428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:05:29.475673+0000","last_clean_scrub_stamp":"2026-02-13T18:05:29.475673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:38:13.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640496,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1770,"kb_used_meta":43221,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1813168,"internal_metadata":44258640},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":1825,"kb_used_meta":43166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1869742,"internal_metadata":44202066},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640495,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":1233,"kb_used_meta":25710,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1262921,"internal_metadata":26327735},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640499,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":2004,"kb_used_meta":42987,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2052945,"internal_metadata":44018863},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640497,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1893,"kb_used_meta":43098,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1939244,"internal_metadata":44132564},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":2408,"kb_used_omap":1885,"kb_used_meta":43106,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1931197,"internal_metadata":44140611},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:25:15.902 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-13T18:05:26.464567+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.902 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.902 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.902 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.903 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.903 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.903 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.903 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-13T18:05:29.475673+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=29, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=18, tm_min=25, tm_sec=13, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T18:25:15.903 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-13T18:25:35.904 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient: get_monmap_and_config 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient: build_initial_monmap 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient: monmap: 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:35.952309+0000 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:35.952309+0000 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:35.966 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:35.967 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:35.967 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:35.967 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:35.967 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 1 Processor -- start 2026-02-13T18:25:35.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 1 -- start start 2026-02-13T18:25:35.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient: init 2026-02-13T18:25:35.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:35.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T18:25:35.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient(hunting): picked mon.noname-b con 0x7fd58408c2f0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient(hunting): picked mon.noname-c con 0x7fd58408dc80 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient(hunting): picked mon.noname-a con 0x7fd58408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd584089e80 con 0x7fd58408cdd0 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd584088c20 con 0x7fd58408dc80 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd584089ba0 con 0x7fd58408c2f0 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd58a3cd640 10 monclient(hunting): authenticate will time out at 1767.007437s 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd588943640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fd58408cdd0 0x7fd5841a3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:60056/0 (socket says 10.20.193.78:60056) 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd583fff640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd58408c2f0 0x7fd58408c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48310/0 (socket says 10.20.193.78:48310) 2026-02-13T18:25:35.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.948+0000 7fd588943640 1 -- 10.20.193.78:0/3348463662 learned_addr learned my addr 10.20.193.78:0/3348463662 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:35.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd588943640 1 -- 10.20.193.78:0/3348463662 >> v1:10.20.193.78:6789/0 conn(0x7fd58408cdd0 legacy=0x7fd5841a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:35.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd583fff640 1 -- 10.20.193.78:0/3348463662 >> v1:10.20.193.78:6790/0 conn(0x7fd58408c2f0 legacy=0x7fd58408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:35.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209037896 0 0) 0x7fd584089e80 con 0x7fd58408cdd0 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): my global_id is 124425 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd568003620 con 0x7fd58408cdd0 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345977720 0 0) 0x7fd584089ba0 con 0x7fd58408c2f0 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): _negotiate 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient(hunting): my global_id is 144239 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584089e80 con 0x7fd58408c2f0 2026-02-13T18:25:35.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd5837fe640 1 -- 10.20.193.78:0/3348463662 >> v1:10.20.193.187:6789/0 conn(0x7fd58408dc80 legacy=0x7fd584181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3394219306 0 0) 0x7fd568003620 con 0x7fd58408cdd0 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 >> v1:10.20.193.78:6790/0 conn(0x7fd58408c2f0 legacy=0x7fd58408c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 >> v1:10.20.193.187:6789/0 conn(0x7fd58408dc80 legacy=0x7fd584181ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: _finish_hunting 0 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 monclient: found mon.noname-a 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58408d370 con 0x7fd58408cdd0 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: _finish_auth 0 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: _check_auth_tickets 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:35.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd578004620 con 0x7fd58408cdd0 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: dump: 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:35.979 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 5 monclient: authenticate success, global_id 124425 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5780048f0 con 0x7fd58408cdd0 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 1 -- 10.20.193.78:0/3348463662 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd578006060 con 0x7fd58408cdd0 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd582ffd640 10 monclient: dump: 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:35.980 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 4 set_mon_vals no callback set 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 10 monclient: shutdown 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:35.981 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3348463662 >> v1:10.20.193.78:6789/0 conn(0x7fd58408cdd0 legacy=0x7fd5841a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3348463662 shutdown_connections 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3348463662 >> 10.20.193.78:0/3348463662 conn(0x7fd584091720 msgr2=0x7fd584091b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3348463662 shutdown_connections 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3348463662 wait complete. 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 10 monclient: build_initial_monmap 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 10 monclient: monmap: 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:35.982 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 Processor -- start 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 1 -- start start 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.952+0000 7fd58a3cd640 10 monclient: init 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T18:25:35.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient(hunting): picked mon.noname-b con 0x7fd58408c2f0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient(hunting): picked mon.noname-a con 0x7fd58408cdd0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient(hunting): picked mon.noname-c con 0x7fd58408dc80 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd584088910 con 0x7fd58408cdd0 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd584082380 con 0x7fd58408c2f0 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd584082660 con 0x7fd58408dc80 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient(hunting): authenticate will time out at 1767.012149s 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd588943640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fd58408dc80 0x7fd584195cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48320/0 (socket says 10.20.193.78:48320) 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd588943640 1 -- 10.20.193.78:0/3041903350 learned_addr learned my addr 10.20.193.78:0/3041903350 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd588943640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.78:6790/0 conn(0x7fd58408dc80 legacy=0x7fd584195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:35.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd5837fe640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.78:6789/0 conn(0x7fd58408cdd0 legacy=0x7fd5841945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd583fff640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.187:6789/0 conn(0x7fd58408c2f0 legacy=0x7fd584083a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782825265 0 0) 0x7fd584088c20 con 0x7fd58408cdd0 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): my global_id is 124428 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd554003620 con 0x7fd58408cdd0 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179015445 0 0) 0x7fd584082660 con 0x7fd58408dc80 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): my global_id is 144242 2026-02-13T18:25:35.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584088c20 con 0x7fd58408dc80 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600268216 0 0) 0x7fd584082380 con 0x7fd58408c2f0 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _negotiate 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): my global_id is 134359 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584082660 con 0x7fd58408c2f0 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 718592375 0 0) 0x7fd554003620 con 0x7fd58408cdd0 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd584082380 con 0x7fd58408cdd0 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd574003380 con 0x7fd58408cdd0 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:35.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3924653856 0 0) 0x7fd584088c20 con 0x7fd58408dc80 2026-02-13T18:25:35.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd554003620 con 0x7fd58408dc80 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd578004080 con 0x7fd58408dc80 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient(hunting): dump: 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:35.988 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1227342566 0 0) 0x7fd584082380 con 0x7fd58408cdd0 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.78:6790/0 conn(0x7fd58408dc80 legacy=0x7fd584195cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.187:6789/0 conn(0x7fd58408c2f0 legacy=0x7fd584083a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: _finish_hunting 0 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 monclient: found mon.a 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd584080b40 con 0x7fd58408cdd0 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: _finish_auth 0 2026-02-13T18:25:35.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: _check_auth_tickets 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 5 monclient: authenticate success, global_id 124428 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _renew_subs 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5840841a0 con 0x7fd58408cdd0 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _renew_subs 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd584153440 con 0x7fd58408cdd0 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5740039c0 con 0x7fd58408cdd0 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fd574003d50 con 0x7fd58408cdd0 2026-02-13T18:25:35.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 10 monclient: dump: 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:35.991 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd5827fc640 4 set_mon_vals no callback set 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.78:6789/0 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.78:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58408f5e0 con 0x7fd58408cdd0 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fd574003f30 con 0x7fd58408cdd0 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.956+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fd57404c520 con 0x7fd58408cdd0 2026-02-13T18:25:35.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.960+0000 7fd583fff640 10 monclient: get_auth_request con 0x7fd55403d800 auth_method 0 2026-02-13T18:25:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.960+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mon.0 v1:10.20.193.78:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fd584088910 con 0x7fd58408cdd0 2026-02-13T18:25:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.960+0000 7fd580ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:35.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:35.960+0000 7fd580ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:36.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 --> v1:10.20.193.187:6812/2668687789 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5840871e0 con 0x7fd55403d800 2026-02-13T18:25:36.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd580ff9640 1 -- 10.20.193.78:0/3041903350 <== mgr.4104 v1:10.20.193.187:6812/2668687789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 2989755213) 0x7fd5840871e0 con 0x7fd55403d800 2026-02-13T18:25:36.064 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T18:25:36.065 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T18:25:36.065 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.187:6812/2668687789 conn(0x7fd55403d800 legacy=0x7fd55405dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 10 monclient: shutdown 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 >> v1:10.20.193.78:6789/0 conn(0x7fd58408cdd0 legacy=0x7fd5841945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 shutdown_connections 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 >> 10.20.193.78:0/3041903350 conn(0x7fd584091720 msgr2=0x7fd58408a380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 shutdown_connections 2026-02-13T18:25:36.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.048+0000 7fd58a3cd640 1 -- 10.20.193.78:0/3041903350 wait complete. 2026-02-13T18:25:36.074 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":1512,"stamp":"2026-02-13T18:25:35.870143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":266248,"kb_used_data":14248,"kb_used_omap":10614,"kb_used_meta":241289,"kb_avail":565964792,"statfs":{"total":579820584960,"available":579547947008,"internally_reserved":0,"allocated":14589952,"data_stored":9007960,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":10869217,"internal_metadata":247080479},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001001"},"pg_stats":[{"pgid":"1.0","version":"913'114","reported_seq":1939,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:15.403967+0000","last_change":"2026-02-13T18:25:15.403967+0000","last_active":"2026-02-13T18:25:15.403967+0000","last_peered":"2026-02-13T18:25:15.403967+0000","last_clean":"2026-02-13T18:25:15.403967+0000","last_became_active":"2026-02-13T18:05:27.473035+0000","last_became_peered":"2026-02-13T18:05:27.473035+0000","last_unstale":"2026-02-13T18:25:15.403967+0000","last_undegraded":"2026-02-13T18:25:15.403967+0000","last_fullsized":"2026-02-13T18:25:15.403967+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"913'114","last_scrub_stamp":"2026-02-13T18:25:15.403918+0000","last_deep_scrub":"913'114","last_deep_scrub_stamp":"2026-02-13T18:25:15.403918+0000","last_clean_scrub_stamp":"2026-02-13T18:25:15.403918+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:42:27.547508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"913'2","reported_seq":1806,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:17.557909+0000","last_change":"2026-02-13T18:25:17.557909+0000","last_active":"2026-02-13T18:25:17.557909+0000","last_peered":"2026-02-13T18:25:17.557909+0000","last_clean":"2026-02-13T18:25:17.557909+0000","last_became_active":"2026-02-13T18:05:30.487768+0000","last_became_peered":"2026-02-13T18:05:30.487768+0000","last_unstale":"2026-02-13T18:25:17.557909+0000","last_undegraded":"2026-02-13T18:25:17.557909+0000","last_fullsized":"2026-02-13T18:25:17.557909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"913'2","last_scrub_stamp":"2026-02-13T18:25:17.557858+0000","last_deep_scrub":"913'2","last_deep_scrub_stamp":"2026-02-13T18:25:17.557858+0000","last_clean_scrub_stamp":"2026-02-13T18:25:17.557858+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T06:22:34.969703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029840800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1800,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:16.378766+0000","last_change":"2026-02-13T18:25:16.378766+0000","last_active":"2026-02-13T18:25:16.378766+0000","last_peered":"2026-02-13T18:25:16.378766+0000","last_clean":"2026-02-13T18:25:16.378766+0000","last_became_active":"2026-02-13T18:05:30.488137+0000","last_became_peered":"2026-02-13T18:05:30.488137+0000","last_unstale":"2026-02-13T18:25:16.378766+0000","last_undegraded":"2026-02-13T18:25:16.378766+0000","last_fullsized":"2026-02-13T18:25:16.378766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:16.378693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:16.378693+0000","last_clean_scrub_stamp":"2026-02-13T18:25:16.378693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:01:40.156992+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00055888599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1798,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:15.410717+0000","last_change":"2026-02-13T18:25:15.410717+0000","last_active":"2026-02-13T18:25:15.410717+0000","last_peered":"2026-02-13T18:25:15.410717+0000","last_clean":"2026-02-13T18:25:15.410717+0000","last_became_active":"2026-02-13T18:05:30.486494+0000","last_became_peered":"2026-02-13T18:05:30.486494+0000","last_unstale":"2026-02-13T18:25:15.410717+0000","last_undegraded":"2026-02-13T18:25:15.410717+0000","last_fullsized":"2026-02-13T18:25:15.410717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:15.410655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:15.410655+0000","last_clean_scrub_stamp":"2026-02-13T18:25:15.410655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:07:21.030642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036141400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"913'3","reported_seq":1807,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:16.533474+0000","last_change":"2026-02-13T18:25:16.533474+0000","last_active":"2026-02-13T18:25:16.533474+0000","last_peered":"2026-02-13T18:25:16.533474+0000","last_clean":"2026-02-13T18:25:16.533474+0000","last_became_active":"2026-02-13T18:05:30.488223+0000","last_became_peered":"2026-02-13T18:05:30.488223+0000","last_unstale":"2026-02-13T18:25:16.533474+0000","last_undegraded":"2026-02-13T18:25:16.533474+0000","last_fullsized":"2026-02-13T18:25:16.533474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"913'3","last_scrub_stamp":"2026-02-13T18:25:16.533415+0000","last_deep_scrub":"913'3","last_deep_scrub_stamp":"2026-02-13T18:25:16.533415+0000","last_clean_scrub_stamp":"2026-02-13T18:25:16.533415+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T20:33:32.801652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063343399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1800,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:15.125248+0000","last_change":"2026-02-13T18:25:15.125248+0000","last_active":"2026-02-13T18:25:15.125248+0000","last_peered":"2026-02-13T18:25:15.125248+0000","last_clean":"2026-02-13T18:25:15.125248+0000","last_became_active":"2026-02-13T18:05:30.878818+0000","last_became_peered":"2026-02-13T18:05:30.878818+0000","last_unstale":"2026-02-13T18:25:15.125248+0000","last_undegraded":"2026-02-13T18:25:15.125248+0000","last_fullsized":"2026-02-13T18:25:15.125248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:15.125216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:15.125216+0000","last_clean_scrub_stamp":"2026-02-13T18:25:15.125216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:35:59.031700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000343321,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1800,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:17.368481+0000","last_change":"2026-02-13T18:25:17.368481+0000","last_active":"2026-02-13T18:25:17.368481+0000","last_peered":"2026-02-13T18:25:17.368481+0000","last_clean":"2026-02-13T18:25:17.368481+0000","last_became_active":"2026-02-13T18:05:30.880593+0000","last_became_peered":"2026-02-13T18:05:30.880593+0000","last_unstale":"2026-02-13T18:25:17.368481+0000","last_undegraded":"2026-02-13T18:25:17.368481+0000","last_fullsized":"2026-02-13T18:25:17.368481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:17.368395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:17.368395+0000","last_clean_scrub_stamp":"2026-02-13T18:25:17.368395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:58:46.207208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052078699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1800,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:16.118408+0000","last_change":"2026-02-13T18:25:16.118408+0000","last_active":"2026-02-13T18:25:16.118408+0000","last_peered":"2026-02-13T18:25:16.118408+0000","last_clean":"2026-02-13T18:25:16.118408+0000","last_became_active":"2026-02-13T18:05:30.485818+0000","last_became_peered":"2026-02-13T18:05:30.485818+0000","last_unstale":"2026-02-13T18:25:16.118408+0000","last_undegraded":"2026-02-13T18:25:16.118408+0000","last_fullsized":"2026-02-13T18:25:16.118408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:16.118308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:16.118308+0000","last_clean_scrub_stamp":"2026-02-13T18:25:16.118308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:01:00.235557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00031389599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1800,"reported_epoch":913,"state":"active+clean","last_fresh":"2026-02-13T18:25:18.352045+0000","last_change":"2026-02-13T18:25:18.352045+0000","last_active":"2026-02-13T18:25:18.352045+0000","last_peered":"2026-02-13T18:25:18.352045+0000","last_clean":"2026-02-13T18:25:18.352045+0000","last_became_active":"2026-02-13T18:05:31.173713+0000","last_became_peered":"2026-02-13T18:05:31.173713+0000","last_unstale":"2026-02-13T18:25:18.352045+0000","last_undegraded":"2026-02-13T18:25:18.352045+0000","last_fullsized":"2026-02-13T18:25:18.352045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T18:25:18.351974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T18:25:18.351974+0000","last_clean_scrub_stamp":"2026-02-13T18:25:18.351974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:37:19.353105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052671800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":13732,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640500,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1770,"kb_used_meta":43221,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1813168,"internal_metadata":44258640},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":1825,"kb_used_meta":43166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1869742,"internal_metadata":44202066},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640499,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29368,"kb_used_data":2408,"kb_used_omap":1233,"kb_used_meta":25710,"kb_avail":94342472,"statfs":{"total":96636764160,"available":96606691328,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1262921,"internal_metadata":26327735},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640503,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":2356,"kb_used_omap":2004,"kb_used_meta":42987,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":2412544,"data_stored":1325011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2052945,"internal_metadata":44018863},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640501,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47368,"kb_used_data":2360,"kb_used_omap":1893,"kb_used_meta":43098,"kb_avail":94324472,"statfs":{"total":96636764160,"available":96588259328,"internally_reserved":0,"allocated":2416640,"data_stored":1325030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1939244,"internal_metadata":44132564},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640499,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47416,"kb_used_data":2408,"kb_used_omap":1885,"kb_used_meta":43106,"kb_avail":94324424,"statfs":{"total":96636764160,"available":96588210176,"internally_reserved":0,"allocated":2465792,"data_stored":1853939,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1931197,"internal_metadata":44140611},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6866,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T18:25:36.076 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-13T18:25:36.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient: get_monmap_and_config 2026-02-13T18:25:36.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient: build_initial_monmap 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient: monmap: 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:25:36.125977+0000 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:25:36.125977+0000 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-c 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-b 2026-02-13T18:25:36.140 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 1 Processor -- start 2026-02-13T18:25:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 1 -- start start 2026-02-13T18:25:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient: init 2026-02-13T18:25:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T18:25:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient(hunting): picked mon.noname-b con 0x7fddfc13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient(hunting): picked mon.noname-a con 0x7fddfc05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient(hunting): picked mon.noname-c con 0x7fddfc1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc095530 con 0x7fddfc05e4b0 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc140390 con 0x7fddfc1853c0 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc05d230 con 0x7fddfc13f8b0 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde0388f640 10 monclient(hunting): authenticate will time out at 1767.181520s 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde00e03640 1 --1- >> v1:10.20.193.78:6789/0 conn(0x7fddfc05e4b0 0x7fddfc183ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.78:6789/0 says I am v1:10.20.193.78:60070/0 (socket says 10.20.193.78:60070) 2026-02-13T18:25:36.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde00e03640 1 -- 10.20.193.78:0/730675714 learned_addr learned my addr 10.20.193.78:0/730675714 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:36.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde00e03640 1 -- 10.20.193.78:0/730675714 >> v1:10.20.193.78:6789/0 conn(0x7fddfc05e4b0 legacy=0x7fddfc183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde01604640 1 -- 10.20.193.78:0/730675714 >> v1:10.20.193.78:6790/0 conn(0x7fddfc13f8b0 legacy=0x7fddfc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440756383 0 0) 0x7fddf0002c60 con 0x7fddfc05e4b0 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): my global_id is 124431 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdde4003620 con 0x7fddfc05e4b0 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98645748 0 0) 0x7fddfc05d230 con 0x7fddfc13f8b0 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): _negotiate 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:36.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 10 monclient(hunting): my global_id is 144245 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fde01e05640 1 -- 10.20.193.78:0/730675714 >> v1:10.20.193.187:6789/0 conn(0x7fddfc1853c0 legacy=0x7fddfc1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.124+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf0002c60 con 0x7fddfc13f8b0 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 113742005 0 0) 0x7fdde4003620 con 0x7fddfc05e4b0 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 >> v1:10.20.193.78:6790/0 conn(0x7fddfc13f8b0 legacy=0x7fddfc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 >> v1:10.20.193.187:6789/0 conn(0x7fddfc1853c0 legacy=0x7fddfc1a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: _finish_hunting 0 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 monclient: found mon.noname-a 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.78:6789/0 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 --> v1:10.20.193.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc05d510 con 0x7fddfc05e4b0 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: _finish_auth 0 2026-02-13T18:25:36.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: _check_auth_tickets 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 5 monclient: authenticate success, global_id 124431 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fddf00032e0 con 0x7fddfc05e4b0 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: dump: 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.149 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fddec003160 con 0x7fddfc13f8b0 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.0 v1:10.20.193.78:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fddf00049a0 con 0x7fddfc05e4b0 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 1 -- 10.20.193.78:0/730675714 <== mon.0 v1:10.20.193.78:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fddf0004d30 con 0x7fddfc05e4b0 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:36.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fddebfff640 10 monclient: dump: 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: get_monmap_and_config success 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 4 set_mon_vals no callback set 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: shutdown 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- 10.20.193.78:0/730675714 >> v1:10.20.193.78:6789/0 conn(0x7fddfc05e4b0 legacy=0x7fddfc183ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- 10.20.193.78:0/730675714 shutdown_connections 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- 10.20.193.78:0/730675714 >> 10.20.193.78:0/730675714 conn(0x7fddfc0545d0 msgr2=0x7fddfc0549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- 10.20.193.78:0/730675714 shutdown_connections 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- 10.20.193.78:0/730675714 wait complete. 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: build_initial_monmap 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: monmap: 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:epoch 0 2026-02-13T18:25:36.152 INFO:teuthology.orchestra.run.trial078.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 0.000000 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:created 0.000000 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 0 (unknown) 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 1 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.noname-a 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.noname-b 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.noname-c 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 Processor -- start 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- start start 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: init 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: _reopen_session rank -1 2026-02-13T18:25:36.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient(hunting): picked mon.noname-a con 0x7fddfc05e4b0 addr v1:10.20.193.78:6789/0 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient(hunting): picked mon.noname-c con 0x7fddfc13f8b0 addr v1:10.20.193.78:6790/0 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient(hunting): picked mon.noname-b con 0x7fddfc1853c0 addr v1:10.20.193.187:6789/0 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- --> v1:10.20.193.78:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc112160 con 0x7fddfc05e4b0 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- --> v1:10.20.193.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc1112f0 con 0x7fddfc1853c0 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 1 -- --> v1:10.20.193.78:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc10fe00 con 0x7fddfc13f8b0 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient(hunting): _renew_subs 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde0388f640 10 monclient(hunting): authenticate will time out at 1767.185751s 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde00e03640 1 --1- >> v1:10.20.193.78:6790/0 conn(0x7fddfc13f8b0 0x7fddfc180590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.78:6790/0 says I am v1:10.20.193.78:48336/0 (socket says 10.20.193.78:48336) 2026-02-13T18:25:36.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde00e03640 1 -- 10.20.193.78:0/1591291248 learned_addr learned my addr 10.20.193.78:0/1591291248 (peer_addr_for_me v1:10.20.193.78:0/0) 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde00e03640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.78:6790/0 conn(0x7fddfc13f8b0 legacy=0x7fddfc180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.128+0000 7fde01604640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.78:6789/0 conn(0x7fddfc05e4b0 legacy=0x7fddfc13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555864407 0 0) 0x7fddfc10fe00 con 0x7fddfc13f8b0 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): my global_id is 144248 2026-02-13T18:25:36.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddcc003620 con 0x7fddfc13f8b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.0 v1:10.20.193.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117072687 0 0) 0x7fddfc112160 con 0x7fddfc05e4b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): my global_id is 124434 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddfc10fe00 con 0x7fddfc05e4b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde01e05640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.187:6789/0 conn(0x7fddfc1853c0 legacy=0x7fddfc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1131681637 0 0) 0x7fddcc003620 con 0x7fddfc13f8b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddfc112160 con 0x7fddfc13f8b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.0 v1:10.20.193.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4071460847 0 0) 0x7fddfc10fe00 con 0x7fddfc05e4b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddcc003620 con 0x7fddfc05e4b0 2026-02-13T18:25:36.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.0 v1:10.20.193.78:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fddec003710 con 0x7fddfc05e4b0 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:36.160 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fddf0002d00 con 0x7fddfc13f8b0 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): dump: 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:36.161 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.1 v1:10.20.193.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276559136 0 0) 0x7fddfc1112f0 con 0x7fddfc1853c0 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _negotiate 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient(hunting): my global_id is 134365 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddfc10fe00 con 0x7fddfc1853c0 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 680063481 0 0) 0x7fddfc112160 con 0x7fddfc13f8b0 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.187:6789/0 conn(0x7fddfc1853c0 legacy=0x7fddfc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.78:6789/0 conn(0x7fddfc05e4b0 legacy=0x7fddfc13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: _finish_hunting 0 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 monclient: found mon.c 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc1118c0 con 0x7fddfc13f8b0 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: _finish_auth 0 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: _check_auth_tickets 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 5 monclient: authenticate success, global_id 144248 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 monclient: _renew_subs 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:36.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc10f7b0 con 0x7fddfc13f8b0 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 monclient: _renew_subs 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fddfc110960 con 0x7fddfc13f8b0 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fddf00049a0 con 0x7fddfc13f8b0 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 3597996020 0 0) 0x7fddf0005210 con 0x7fddfc13f8b0 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: dump: 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:epoch 1 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:fsid 54a6df06-e4af-4200-a7a8-eae08bdbf188 2026-02-13T18:25:36.164 INFO:teuthology.orchestra.run.trial078.stderr:last_changed 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:created 2026-02-13T18:05:06.319910+0000 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:min_mon_release 20 (tentacle) 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:election_strategy: 3 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:0: v1:10.20.193.78:6789/0 mon.a 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:1: v1:10.20.193.187:6789/0 mon.b 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:2: v1:10.20.193.78:6790/0 mon.c 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fddeb7fe640 4 set_mon_vals no callback set 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:36.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc1a6e40 con 0x7fddfc13f8b0 2026-02-13T18:25:36.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 7 ==== mgrmap(e 5) ==== 50408+0+0 (unknown 529943070 0 0) 0x7fddf00118a0 con 0x7fddfc13f8b0 2026-02-13T18:25:36.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 8 ==== osd_map(913..913 src has 621..913) ==== 3547+0+0 (unknown 163143860 0 0) 0x7fddf004c4b0 con 0x7fddfc13f8b0 2026-02-13T18:25:36.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fde01604640 10 monclient: get_auth_request con 0x7fddcc03d880 auth_method 0 2026-02-13T18:25:36.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+204907 (unknown 1092875540 0 3942553110) 0x7fddfc095530 con 0x7fddfc13f8b0 2026-02-13T18:25:36.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T18:25:36.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.132+0000 7fdde9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T18:25:36.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.216+0000 7fde0388f640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T18:25:36.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.216+0000 7fde0388f640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T18:25:36.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.216+0000 7fde0388f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.78:6790/0 2026-02-13T18:25:36.235 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.216+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 --> v1:10.20.193.78:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fddfc051150 con 0x7fddfc13f8b0 2026-02-13T18:25:36.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) ==== 123+0+0 (unknown 3022875181 0 0) 0x7fddf0017630 con 0x7fddfc13f8b0 2026-02-13T18:25:36.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fdde9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T18:25:36.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fdde9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T18:25:36.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fdde9ffb640 1 -- 10.20.193.78:0/1591291248 <== mon.2 v1:10.20.193.78:6790/0 11 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fddf0016f10 con 0x7fddfc13f8b0 2026-02-13T18:25:36.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fdde9ffb640 10 monclient: handle_config config(1 keys) 2026-02-13T18:25:36.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fddeaffd640 4 set_mon_vals no callback set 2026-02-13T18:25:36.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fddeaffd640 10 set_mon_vals mon_health_to_clog = false 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.187:6812/2668687789 conn(0x7fddcc03d880 legacy=0x7fddcc05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 10 monclient: shutdown 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 >> v1:10.20.193.78:6790/0 conn(0x7fddfc13f8b0 legacy=0x7fddfc180590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 shutdown_connections 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 >> 10.20.193.78:0/1591291248 conn(0x7fddfc0545d0 msgr2=0x7fddfc1a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T18:25:36.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 shutdown_connections 2026-02-13T18:25:36.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T18:25:36.220+0000 7fde0388f640 1 -- 10.20.193.78:0/1591291248 wait complete. 2026-02-13T18:25:36.249 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-13T18:25:36.249 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-13T18:25:36.249 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-13T18:25:36.249 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:36.320 INFO:tasks.ceph.osd.0:Stopped 2026-02-13T18:25:36.320 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-13T18:25:36.321 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:36.394 INFO:tasks.ceph.osd.1:Stopped 2026-02-13T18:25:36.394 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-13T18:25:36.394 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:41.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-13T18:25:42.496 INFO:tasks.ceph.osd.2:Stopped 2026-02-13T18:25:42.496 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-13T18:25:42.496 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:42.561 INFO:tasks.ceph.osd.3:Stopped 2026-02-13T18:25:42.561 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-13T18:25:42.562 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:46.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-13T18:25:46.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-13T18:25:48.663 INFO:tasks.ceph.osd.4:Stopped 2026-02-13T18:25:48.664 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-13T18:25:48.664 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:48.735 INFO:tasks.ceph.osd.5:Stopped 2026-02-13T18:25:48.735 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-13T18:25:48.735 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-13T18:25:48.735 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:48.762 INFO:tasks.ceph.mgr.x:Stopped 2026-02-13T18:25:48.762 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-13T18:25:48.762 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T18:25:48.762 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:48.779 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T18:25:48.780 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T18:25:48.780 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:48.834 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T18:25:48.834 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T18:25:48.834 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T18:25:48.847 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T18:25:48.848 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-13T18:25:48.848 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v ScrubResult | grep -E -v 'scrub mismatch' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MGR_DOWN\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v '\(MON_NETSPLIT)' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-13T18:25:48.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:25:48.886 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-13T18:25:48.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:25:48.946 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-13T18:25:49.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:25:49.006 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-13T18:25:49.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:25:49.059 DEBUG:teuthology.orchestra.run.trial187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-13T18:25:49.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:25:49.076 DEBUG:teuthology.orchestra.run.trial187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-13T18:25:49.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:25:49.136 DEBUG:teuthology.orchestra.run.trial187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-13T18:25:49.196 INFO:tasks.ceph:Archiving mon data... 2026-02-13T18:25:49.199 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/data/mon.a.tgz 2026-02-13T18:25:49.199 DEBUG:teuthology.orchestra.run.trial078:> mktemp 2026-02-13T18:25:49.204 INFO:teuthology.orchestra.run.trial078.stdout:/tmp/tmp.rhTh8v077j 2026-02-13T18:25:49.205 DEBUG:teuthology.orchestra.run.trial078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rhTh8v077j 2026-02-13T18:25:49.284 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0666 /tmp/tmp.rhTh8v077j 2026-02-13T18:25:49.389 DEBUG:teuthology.orchestra.remote:trial078:/tmp/tmp.rhTh8v077j is 300KB 2026-02-13T18:25:49.444 DEBUG:teuthology.orchestra.run.trial078:> rm -fr /tmp/tmp.rhTh8v077j 2026-02-13T18:25:49.449 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/data/mon.c.tgz 2026-02-13T18:25:49.449 DEBUG:teuthology.orchestra.run.trial078:> mktemp 2026-02-13T18:25:49.494 INFO:teuthology.orchestra.run.trial078.stdout:/tmp/tmp.2FD1cjMnpj 2026-02-13T18:25:49.495 DEBUG:teuthology.orchestra.run.trial078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2FD1cjMnpj 2026-02-13T18:25:49.571 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0666 /tmp/tmp.2FD1cjMnpj 2026-02-13T18:25:49.668 DEBUG:teuthology.orchestra.remote:trial078:/tmp/tmp.2FD1cjMnpj is 295KB 2026-02-13T18:25:49.724 DEBUG:teuthology.orchestra.run.trial078:> rm -fr /tmp/tmp.2FD1cjMnpj 2026-02-13T18:25:49.729 DEBUG:teuthology.misc:Transferring archived files from trial187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/data/mon.b.tgz 2026-02-13T18:25:49.729 DEBUG:teuthology.orchestra.run.trial187:> mktemp 2026-02-13T18:25:49.734 INFO:teuthology.orchestra.run.trial187.stdout:/tmp/tmp.jkBhsEOuog 2026-02-13T18:25:49.734 DEBUG:teuthology.orchestra.run.trial187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jkBhsEOuog 2026-02-13T18:25:49.821 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod 0666 /tmp/tmp.jkBhsEOuog 2026-02-13T18:25:49.885 DEBUG:teuthology.orchestra.remote:trial187:/tmp/tmp.jkBhsEOuog is 298KB 2026-02-13T18:25:49.941 DEBUG:teuthology.orchestra.run.trial187:> rm -fr /tmp/tmp.jkBhsEOuog 2026-02-13T18:25:49.945 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-13T18:25:49.945 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T18:25:49.947 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T18:25:50.002 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T18:25:50.039 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T18:25:50.039 INFO:tasks.ceph:Archiving crash dumps... 2026-02-13T18:25:50.042 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/remote/trial078/crash 2026-02-13T18:25:50.043 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T18:25:50.052 DEBUG:teuthology.misc:Transferring archived files from trial187:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/remote/trial187/crash 2026-02-13T18:25:50.054 DEBUG:teuthology.orchestra.run.trial187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T18:25:50.091 INFO:tasks.ceph:Compressing logs... 2026-02-13T18:25:50.091 DEBUG:teuthology.orchestra.run.trial078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T18:25:50.096 DEBUG:teuthology.orchestra.run.trial187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T18:25:50.103 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17825.log 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21264.log 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17965.log 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.17825.log.gz 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19429.log 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21264.log: /var/log/ceph/ceph-client.admin.17965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23418.log 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.17965.log.gz 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19429.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21264.log.gz 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19726.log 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.19429.log.gz 2026-02-13T18:25:50.105 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19246.log 2026-02-13T18:25:50.111 INFO:teuthology.orchestra.run.trial078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23418.log.gz 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23652.log 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19726.log: /var/log/ceph/ceph-client.admin.19246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18281.log 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.19726.log.gz 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19246.log.gz 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19016.log 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20428.log 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23652.log.gz 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18281.log: /var/log/ceph/ceph-client.admin.19016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23183.log 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.19016.log.gz 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.18281.log.gz 2026-02-13T18:25:50.112 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22436.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.20428.log.gz 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21846.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23183.log.gz 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21186.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.22436.log.gz 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22546.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17963.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21846.log.gz 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.21186.log.gz 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15194.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23210.log 2026-02-13T18:25:50.113 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17963.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22546.log.gz 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.15194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20975.log 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.17963.log.gz 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.15194.log.gz 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19831.log 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23210.log.gz 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17897.log 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19831.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.20975.log.gz --verbose 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr: -- /var/log/ceph/ceph-client.admin.22136.log 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23496.log 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.19831.log.gz 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21794.log 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.17897.log.gz 2026-02-13T18:25:50.114 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23496.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.22136.log.gz 2026-02-13T18:25:50.115 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21976.log 2026-02-13T18:25:50.115 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23496.log.gz 2026-02-13T18:25:50.129 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21212.log 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21976.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21794.log.gz 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22279.log 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20947.log 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.21976.log.gz 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22279.log: gzip 87.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.21212.log.gz -- 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr: /var/log/ceph/ceph-client.admin.21027.log 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22279.log.gz 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18123.log 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21027.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.20947.log.gz 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19936.log 2026-02-13T18:25:50.130 INFO:teuthology.orchestra.run.trial078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.21027.log.gz 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22754.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17800.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.18123.log.gz 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22754.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19936.log.gz 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21638.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.22754.log.gz 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19910.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17800.log: /var/log/ceph/ceph-client.admin.21638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21716.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.17800.log.gz 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.21638.log.gz 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22227.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19910.log: /var/log/ceph/ceph-client.admin.21716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20506.log 2026-02-13T18:25:50.131 INFO:teuthology.orchestra.run.trial078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.21716.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19910.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18677.log 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20506.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.22227.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21238.log 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20506.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23522.log 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17923.log 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21238.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.18677.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22080.log 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.21238.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17923.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23522.log.gz 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19752.log 2026-02-13T18:25:50.132 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.17923.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18729.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20086.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.22080.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.19752.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19622.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18729.log: /var/log/ceph/ceph-client.admin.20086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18938.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.18729.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19622.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.20086.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18279.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18703.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18938.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.19622.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19299.log 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.18279.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.18938.log.gz 2026-02-13T18:25:50.133 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19507.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19299.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.18703.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18457.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.19299.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18278.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21108.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18457.log: /var/log/ceph/ceph-client.admin.18278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.19507.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22598.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.18278.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.18457.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20740.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.21108.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19557.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20740.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.22598.log.gz 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22930.log 2026-02-13T18:25:50.134 INFO:teuthology.orchestra.run.trial078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20740.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21872.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22930.log: gzip -5 87.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.19557.log.gz /var/log/ceph/ceph-client.admin.23236.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.22930.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18455.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20584.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.21872.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18455.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23236.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23131.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20584.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18455.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20376.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23131.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.20584.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22306.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18429.log 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.23131.log.gz 2026-02-13T18:25:50.135 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22306.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.20376.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22332.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20636.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18429.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.22306.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22832.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22332.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.18429.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21924.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20636.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22572.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.22832.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22106.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18122.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22572.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.21924.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22106.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18122.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.22106.log.gz 2026-02-13T18:25:50.136 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.22572.log.gz 2026-02-13T18:25:50.137 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21316.log 2026-02-13T18:25:50.137 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.18122.log.gz 2026-02-13T18:25:50.137 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23444.log 2026-02-13T18:25:50.152 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15179.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-client.admin.15179.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.15179.log.gz 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15107.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15131.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-client.admin.15107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15204.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-client.admin.15131.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.15107.log.gz 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-client.admin.15204.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.15131.log.gz 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15155.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph.audit.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15204.log.gz 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-client.admin.15155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.17860.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.15155.log.gz 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15228.log 2026-02-13T18:25:50.153 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/ceph-client.0.17860.log: /var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.15228.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.15228.log.gz 2026-02-13T18:25:50.156 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21742.log 2026-02-13T18:25:50.156 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.21316.log.gz 2026-02-13T18:25:50.156 INFO:teuthology.orchestra.run.trial078.stderr:gzip/var/log/ceph/ceph-client.admin.23444.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23574.log 2026-02-13T18:25:50.156 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23340.log 2026-02-13T18:25:50.156 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23574.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23444.log.gz 2026-02-13T18:25:50.156 INFO:teuthology.orchestra.run.trial078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.21742.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23574.log.gz --verbose 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: -- /var/log/ceph/ceph-client.admin.21612.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19968.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23340.log: /var/log/ceph/ceph-client.admin.21612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19403.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21612.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23340.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18573.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.19968.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19804.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21586.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.19403.log.gz 88.0% 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.18573.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22520.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21690.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19804.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.21586.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23288.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.22520.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21690.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11442.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17845.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.21690.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.tmp-client.admin.11442.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.23288.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22253.log 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11442.log.gz 2026-02-13T18:25:50.157 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18755.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.17845.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18125.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18755.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22253.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20324.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.18755.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22904.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18125.log: /var/log/ceph/ceph-client.admin.20324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15235.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.20324.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.18125.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22858.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.15235.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.22904.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19674.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.15235.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21768.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23079.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.22858.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21768.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.19674.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21820.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23079.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.21768.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23676.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21820.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.23079.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20402.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.21820.log.gz 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20919.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23676.log: /var/log/ceph/ceph-client.admin.20402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19272.log 2026-02-13T18:25:50.158 INFO:teuthology.orchestra.run.trial078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23676.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.20402.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18886.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20919.log: /var/log/ceph/ceph-client.admin.19272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19069.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.20919.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.19272.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18781.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18428.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18781.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19069.log.gz 88.9% 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.18886.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19220.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18781.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20216.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.18428.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19325.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17775.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19220.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19884.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.19325.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20216.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20164.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.17775.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20893.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18427.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19884.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20164.log.gz 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20297.log 2026-02-13T18:25:50.159 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.20893.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17968.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23053.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20297.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.18427.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15973.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20297.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.17968.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18280.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23053.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.15973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20480.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19778.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.15973.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18280.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22702.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19778.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20480.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23626.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.19778.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20610.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23262.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22702.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23626.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22462.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20610.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19377.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18990.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23262.log.gz 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20841.log 2026-02-13T18:25:50.160 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.22462.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.19377.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21053.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23548.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.18990.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.20841.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22650.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21053.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:gzip/var/log/ceph/ceph-client.admin.23548.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23314.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22650.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23548.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.22650.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23314.log: /var/log/ceph/ceph-client.admin.17967.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23314.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19351.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.17967.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19648.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20688.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 93.4% 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.19351.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19648.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.19648.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15155.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-mon.c.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.20688.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.15155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18811.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.15155.log.gz 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21001.log 2026-02-13T18:25:50.161 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.18811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23366.log 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.18811.log.gz 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18417.log 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18121.log 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.21001.log.gz 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18964.log 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.23366.log.gz 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18121.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.18417.log.gz 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 87.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.18121.log.gz 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr: -- /var/log/ceph/ceph-client.admin.17871.log 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23105.log 2026-02-13T18:25:50.162 INFO:teuthology.orchestra.run.trial187.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17871.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.18964.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18276.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23392.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23105.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.17871.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22358.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.18276.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.23105.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23470.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23392.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20867.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21481.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.22358.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20867.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23470.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18120.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.20867.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21455.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21481.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22676.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.18120.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21290.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21455.log: /var/log/ceph/ceph-client.admin.22676.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.22676.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22624.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.21455.log.gz 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22028.log 2026-02-13T18:25:50.166 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22624.log: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.21290.log.gz -5 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21079.log 87.8% 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22624.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22988.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22028.log: /var/log/ceph/ceph-client.admin.21079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19042.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.22028.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22988.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.21079.log.gzgzip 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.18599.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19042.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22988.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21664.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18599.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19042.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20350.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.18599.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22780.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20271.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20350.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.21664.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.20350.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21560.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20271.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18124.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.20271.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22054.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22956.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18124.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.21560.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22054.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.18124.log.gz -5 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.20558.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.22054.log.gz 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20662.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21134.log 2026-02-13T18:25:50.167 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22956.log.gz/var/log/ceph/ceph-client.admin.20662.log: 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.20558.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20662.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22728.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22201.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21134.log: /var/log/ceph/ceph-client.admin.22728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20714.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21134.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21364.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.22728.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19194.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20714.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22201.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21507.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.21364.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20112.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20532.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21507.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.19194.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23157.log 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.20112.log.gz 2026-02-13T18:25:50.169 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.21507.log.gz 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21534.log 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20532.log.gz 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22806.log 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr:gzip/var/log/ceph/ceph-client.admin.21534.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.19481.log 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23157.log.gz 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22806.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.21534.log.gz 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr:gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.22806.log.gz 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-13T18:25:50.170 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21160.log 2026-02-13T18:25:50.171 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19481.log.gz 2026-02-13T18:25:50.171 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19700.log 2026-02-13T18:25:50.171 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21429.log 2026-02-13T18:25:50.171 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21160.log: /var/log/ceph/ceph-client.admin.19700.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.21160.log.gz 2026-02-13T18:25:50.172 INFO:teuthology.orchestra.run.trial078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.19700.log.gz 2026-02-13T18:25:50.172 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18860.log 2026-02-13T18:25:50.172 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20454.log 2026-02-13T18:25:50.172 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21429.log: /var/log/ceph/ceph-client.admin.18860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21950.log 2026-02-13T18:25:50.172 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20454.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21429.log.gz 2026-02-13T18:25:50.172 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19455.log 2026-02-13T18:25:50.173 INFO:teuthology.orchestra.run.trial078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.18860.log.gz 2026-02-13T18:25:50.173 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21950.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.20454.log.gz 2026-02-13T18:25:50.173 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18651.log 2026-02-13T18:25:50.173 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.21950.log.gz 2026-02-13T18:25:50.173 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18912.log 2026-02-13T18:25:50.173 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19455.log: /var/log/ceph/ceph-client.admin.18651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21898.log 2026-02-13T18:25:50.174 INFO:teuthology.orchestra.run.trial078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.19455.log.gz 2026-02-13T18:25:50.174 INFO:teuthology.orchestra.run.trial078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.18651.log.gz 2026-02-13T18:25:50.174 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20190.log 2026-02-13T18:25:50.174 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.21898.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.18912.log.gz 2026-02-13T18:25:50.174 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17969.log 2026-02-13T18:25:50.174 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20190.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.21898.log.gz 2026-02-13T18:25:50.175 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18810.log 2026-02-13T18:25:50.175 INFO:teuthology.orchestra.run.trial078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.20190.log.gz 2026-02-13T18:25:50.175 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17969.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-13T18:25:50.175 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.18810.log: /var/log/ceph/ceph-client.admin.20060.log 2026-02-13T18:25:50.175 INFO:teuthology.orchestra.run.trial078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.17969.log.gz 2026-02-13T18:25:50.175 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.1.log: -- /var/log/ceph/ceph-client.admin.22384.log 2026-02-13T18:25:50.176 INFO:teuthology.orchestra.run.trial078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.18810.log.gz 2026-02-13T18:25:50.176 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22002.log 2026-02-13T18:25:50.176 INFO:teuthology.orchestra.run.trial078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.20060.log.gz 2026-02-13T18:25:50.176 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19129.log 2026-02-13T18:25:50.177 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18261.log 2026-02-13T18:25:50.177 INFO:teuthology.orchestra.run.trial078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.22384.log.gz 2026-02-13T18:25:50.177 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.19129.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22002.log.gz 2026-02-13T18:25:50.177 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18625.log 2026-02-13T18:25:50.177 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18261.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.19129.log.gz 2026-02-13T18:25:50.178 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17966.log 2026-02-13T18:25:50.178 INFO:teuthology.orchestra.run.trial078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.18261.log.gz 2026-02-13T18:25:50.178 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.18625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20242.log 2026-02-13T18:25:50.178 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20138.log 2026-02-13T18:25:50.178 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.17966.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.18625.log.gz 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20242.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20242.log.gz --verbose 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr: -- /var/log/ceph/ceph-client.admin.19857.log 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.17966.log.gz 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22410.log 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.20138.log: /var/log/ceph/ceph-client.admin.19857.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.19857.log.gz 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20138.log.gz 2026-02-13T18:25:50.179 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23600.log 2026-02-13T18:25:50.180 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.22410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20033.log 2026-02-13T18:25:50.180 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.23600.log: /var/log/ceph/ceph-client.admin.20033.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.22410.log.gz 2026-02-13T18:25:50.180 INFO:teuthology.orchestra.run.trial078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20033.log.gz 2026-02-13T18:25:50.180 INFO:teuthology.orchestra.run.trial078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23600.log.gz 2026-02-13T18:25:50.198 INFO:teuthology.orchestra.run.trial187.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.17860.log.gz 2026-02-13T18:25:50.254 INFO:teuthology.orchestra.run.trial187.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-13T18:25:50.975 INFO:teuthology.orchestra.run.trial078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-13T18:25:51.216 INFO:teuthology.orchestra.run.trial187.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-13T18:25:51.382 INFO:teuthology.orchestra.run.trial078.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-13T18:25:51.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-13T18:25:51.787 INFO:teuthology.orchestra.run.trial187.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-13T18:25:52.360 INFO:teuthology.orchestra.run.trial187.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-13T18:25:52.582 INFO:teuthology.orchestra.run.trial078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-13T18:25:52.697 INFO:teuthology.orchestra.run.trial078.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-13T18:25:52.770 INFO:teuthology.orchestra.run.trial187.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-13T18:25:52.771 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T18:25:52.771 INFO:teuthology.orchestra.run.trial187.stderr:real 0m2.632s 2026-02-13T18:25:52.772 INFO:teuthology.orchestra.run.trial187.stderr:user 0m7.437s 2026-02-13T18:25:52.772 INFO:teuthology.orchestra.run.trial187.stderr:sys 0m0.289s 2026-02-13T18:25:53.407 INFO:teuthology.orchestra.run.trial078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-13T18:25:53.408 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T18:25:53.408 INFO:teuthology.orchestra.run.trial078.stderr:real 0m3.311s 2026-02-13T18:25:53.408 INFO:teuthology.orchestra.run.trial078.stderr:user 0m10.037s 2026-02-13T18:25:53.408 INFO:teuthology.orchestra.run.trial078.stderr:sys 0m0.488s 2026-02-13T18:25:53.410 INFO:tasks.ceph:Archiving logs... 2026-02-13T18:25:53.410 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/remote/trial078/log 2026-02-13T18:25:53.411 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T18:25:54.430 DEBUG:teuthology.misc:Transferring archived files from trial187:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/remote/trial187/log 2026-02-13T18:25:54.431 DEBUG:teuthology.orchestra.run.trial187:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T18:25:55.077 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T18:25:55.088 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T18:25:55.088 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T18:25:55.089 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T18:25:55.230 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T18:25:55.245 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T18:25:55.245 DEBUG:teuthology.orchestra.run.trial078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T18:25:55.247 DEBUG:teuthology.orchestra.run.trial187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T18:25:55.337 INFO:teuthology.orchestra.run.trial187.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T18:25:55.337 INFO:teuthology.orchestra.run.trial187.stdout:============================================================================== 2026-02-13T18:25:55.337 INFO:teuthology.orchestra.run.trial187.stdout:*38.45.64.130 129.134.25.123 2 u 40 64 377 20.059 +14.454 3.408 2026-02-13T18:25:55.337 INFO:teuthology.orchestra.run.trial187.stdout:+172-235-154-118 40.119.6.228 4 u 58 64 377 36.844 +17.212 3.092 2026-02-13T18:25:55.337 INFO:teuthology.orchestra.run.trial187.stdout:+s2-a.time.mci1. 135.45.28.167 2 u 54 64 377 29.780 +11.086 2.223 2026-02-13T18:25:55.337 INFO:teuthology.orchestra.run.trial187.stdout:-172-232-15-202. 82.43.52.28 2 u 44 64 377 27.307 +21.469 2.291 2026-02-13T18:25:55.470 INFO:teuthology.orchestra.run.trial078.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T18:25:55.471 INFO:teuthology.orchestra.run.trial078.stdout:============================================================================== 2026-02-13T18:25:55.471 INFO:teuthology.orchestra.run.trial078.stdout:-ip216-250-115-1 13.161.101.224 2 u 40 64 377 37.560 +10.778 3.926 2026-02-13T18:25:55.471 INFO:teuthology.orchestra.run.trial078.stdout:*sushi.ruselabs. 2.148.140.233 2 u 55 64 377 66.981 +9.244 1.754 2026-02-13T18:25:55.471 INFO:teuthology.orchestra.run.trial078.stdout:+108.61.215.221 168.235.69.132 3 u 45 64 377 18.766 +8.067 4.237 2026-02-13T18:25:55.471 INFO:teuthology.orchestra.run.trial078.stdout:+clock01.cymru.c 128.252.19.1 2 u 58 64 377 25.715 +17.074 3.463 2026-02-13T18:25:55.472 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T18:25:55.487 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T18:25:55.487 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T18:25:55.503 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T18:25:55.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T18:25:55.535 INFO:teuthology.task.internal:Duration was 1453.305469 seconds 2026-02-13T18:25:55.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T18:25:55.552 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T18:25:55.552 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T18:25:55.554 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T18:25:55.580 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T18:25:55.581 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial078.front.sepia.ceph.com 2026-02-13T18:25:55.581 DEBUG:teuthology.orchestra.run.trial078:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T18:25:55.625 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial187.front.sepia.ceph.com 2026-02-13T18:25:55.625 DEBUG:teuthology.orchestra.run.trial187:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T18:25:55.632 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T18:25:55.632 DEBUG:teuthology.orchestra.run.trial078:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T18:25:55.668 DEBUG:teuthology.orchestra.run.trial187:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T18:25:55.833 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T18:25:55.833 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T18:25:55.835 DEBUG:teuthology.orchestra.run.trial187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T18:25:55.842 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T18:25:55.843 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T18:25:55.844 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T18:25:55.844 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T18:25:55.844 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T18:25:55.844 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T18:25:55.845 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T18:25:55.846 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T18:25:55.846 INFO:teuthology.orchestra.run.trial187.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T18:25:55.846 INFO:teuthology.orchestra.run.trial187.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T18:25:55.890 INFO:teuthology.orchestra.run.trial078.stderr: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T18:25:55.892 INFO:teuthology.orchestra.run.trial187.stderr: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T18:25:55.893 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T18:25:55.910 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T18:25:55.910 DEBUG:teuthology.orchestra.run.trial078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T18:25:55.943 DEBUG:teuthology.orchestra.run.trial187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T18:25:55.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T18:25:55.969 DEBUG:teuthology.orchestra.run.trial078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T18:25:55.993 DEBUG:teuthology.orchestra.run.trial187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T18:25:55.998 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = core 2026-02-13T18:25:56.003 INFO:teuthology.orchestra.run.trial187.stdout:kernel.core_pattern = core 2026-02-13T18:25:56.012 DEBUG:teuthology.orchestra.run.trial078:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T18:25:56.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:25:56.058 DEBUG:teuthology.orchestra.run.trial187:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T18:25:56.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T18:25:56.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T18:25:56.080 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T18:25:56.081 DEBUG:teuthology.misc:Transferring archived files from trial078:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/remote/trial078 2026-02-13T18:25:56.081 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T18:25:56.131 DEBUG:teuthology.misc:Transferring archived files from trial187:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49683/remote/trial187 2026-02-13T18:25:56.131 DEBUG:teuthology.orchestra.run.trial187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T18:25:56.159 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T18:25:56.160 DEBUG:teuthology.orchestra.run.trial078:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T18:25:56.164 DEBUG:teuthology.orchestra.run.trial187:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T18:25:56.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T18:25:56.211 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T18:25:56.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T18:25:56.226 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T18:25:56.226 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T18:25:56.228 DEBUG:teuthology.orchestra.run.trial187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T18:25:56.231 INFO:teuthology.orchestra.run.trial078.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 18:25 /home/ubuntu/cephtest 2026-02-13T18:25:56.243 INFO:teuthology.orchestra.run.trial187.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 18:25 /home/ubuntu/cephtest 2026-02-13T18:25:56.244 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T18:25:56.257 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T18:25:56.296 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{low} onode-segment$/{none} write$/{v1/{compr$/{yes$/{zstd}} v1}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} duration: 1453.3054690361023 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-13T18:25:56.296 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T18:25:56.407 INFO:teuthology.run:pass